Next Article in Journal
Machine Learning-Based Dimension Optimization for Two-Stage Precoder in Massive MIMO Systems with Limited Feedback
Next Article in Special Issue
The Motivation of Technological Scenarios in Augmented Reality (AR): Results of Different Experiments
Previous Article in Journal
Vertical-Type Ni/GaN UV Photodetectors Fabricated on Free-Standing GaN Substrates
Previous Article in Special Issue
A Novel Real-Time Match-Moving Method with HoloLens
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Wrist Rehabilitation System Using Augmented Reality for Hemiplegic Stroke Patient Rehabilitation: A Feasibility Study

1
Department of Biomedical Engineering, University of Ulsan, Ulsan 44610, Korea
2
Mobile Healthcare Laboratory, Samsung Advanced Institute Technology, Suwon 16678, Korea
3
Department of Electronics and Control Engineering, Hanbat National University, Daejeon 34158, Korea
4
Department of Physical Medicine and Rehabilitation, Ulsan University Hospital, University of Ulsan College of Medicine, Ulsan 44610, Korea
*
Authors to whom correspondence should be addressed.
Appl. Sci. 2019, 9(14), 2892; https://doi.org/10.3390/app9142892
Submission received: 30 June 2019 / Revised: 12 July 2019 / Accepted: 16 July 2019 / Published: 19 July 2019
(This article belongs to the Special Issue Augmented Reality: Current Trends, Challenges and Prospects)

Abstract

:
Objective: Our objective was to investigate the effect of the rehabilitation system using augmented reality (AR) on upper extremity motor performance of patients with stroke. Methods: The system using AR applying mirror therapy mechanism provides the intervention protocol for the patient with hemiplegia after stroke. The system consists of a patient positioning tool (a chair), a white surface table, an image acquisition unit, an image processing unit, an image displaying unit, an arm holder, a Velcro-strap, and two blue circle stickers. To assess the feasibility of our system in motor function recovery, a stroke patient was recruited to receive the AR intervention. The treatment was performed two times a day for ten minutes over two weeks (ten days of treating weeks), except for the time of installation, calibration, and three minute breaks. Jebsen Taylor hand function test and Arm Motor Fugl-Meyer assessment were used as primary and secondary outcome measures, respectively, to evaluate the effect of motor function recovery. Additionally, stroke impact scale, Korean version-Modified Barthel Index (K-MBI), active range of motion of wrist joint (ROM), and the grasp force in Newtons were measured. Participants’ feedback and adverse effects were recorded as well. Results: Motor function improvements were exhibited in wrist and hand subtest of Arm Motor Fugl-Meyer (baseline: 19; post-intervention: 23), proximal arm subtest of Fugl-Meyer (baseline: 31; post-intervention: 34), ROM (extending ROM: 10° and 3° for flexion and extension, repeatedly), stroke impact scale (baseline: 46; post-intervention: 54), K-MBI (baseline: 92; post-intervention: 95), nine-hole pegboard (baseline: 30 s; post-intervention: 25 s), and grasp force in Newtons (baseline: 12.7; post-intervention: 17.7). However, the adverse effects were reported after the intervention. Conclusion: The system using AR applying mirror therapy mechanism demonstrated the feasibility in motor function recovery for the stroke patient.

1. Introduction

Stroke is one of the main causes of long-term disability in adults [1]. The most general stroke symptom is the limitation of upper limb function which significantly impacts on a person’s level of independence and daily living activities [2]. Some rehabilitation interventions which may involve different exercises, type of equipment or techniques have developed to improve the upper limb function and reduce the disability [3,4,5,6]. Particularly, traditional rehabilitation techniques are effective approaches in motor function recovery. However, these methods are time-consuming, expensive, and intensive resources as well as specialized facilities are needed [7,8]. Therefore, post-stroke rehabilitation needs new approaches that allow individuals to enhance motor function.
Recently, mirror therapy has been considered as an effective adjunct to improve upper extremity motor function for stroke patients [9,10]. The principle of the mirror therapy techniques is the reflective superimposition of healthy extremity movements on the affected upper limb through a mirror [11]. This induces a visual illusion of increased movement ability of the unhealthy extremity for the patient [12]. Due to the simplicity of mirror therapy systems, they become difficult to provide a perfectly synchronized mirrored movement for the patient [13].
To address limitations of the mirror therapy, avatar images or virtual objects have been constructed by image processing techniques in virtual reality (VR) systems. These systems create a challenging and motivating environment to provide enhanced feedback of movement characteristics and improved motor learning tasks for the patients [14,15]. However, the VR therapy systems have been widely used for the upper limb rehabilitation and have been adapted for individual patients after stroke [16]. Furthermore, some clinical trial reports figured out the effectiveness of VR in upper limb function improvement [17,18,19]. However, the systems could not provide a high sense of presence and embodiment to the patients due to using the rendered avatar images instead of real photos. Hence, the patients only obtain short-term effects from these systems. Meanwhile, augmented reality (AR) has emerged as one of the effective methods in rehabilitation. The AR combines real and virtual objects to run interactively in a common real-time environment [20]. Despite exhibiting advantages similar to the VR in the upper limb function recovery, the AR could provide a higher degree of presence and embodiment than the VR [21].
In order to overcome drawbacks of the VR technology, an AR system applying the mirror therapy principle has been reported to provide a higher quality of presence and embodiment for the patients [13,22,23]. Moreover, the system could be feasible for long-term neuromodulation. In this study, we proposed an AR system applying mirror therapy mechanism for hemiplegic patients and evaluated its effectiveness in eliciting upper-limb motor recovery.

2. Methods

2.1. Subjects

Participants were recruited from an inpatient rehabilitation unit in Korea according to the selection criteria. The inclusion criteria for the participants was (1) above 18 years old; (2) wrist/hand subscales of Fugl-Meyer Assessment for the upper extremity [24] score of above 2–20; (3) nine-hole pegboard [25] test above 25% of contra-lateral hand. Patients were excluded if they had (1) Alexander apraxia scale score of below 2 [26]; (2) National Institutes of Health (NIH) stroke scale question score of above 1 [27]; (3) Nottingham sensory scale less than 75% of contra-lateral hand [28]; (4) presented with spasticity score of more than 3 in the affected limb quantified by the Ashworth scale; (5) NIH stroke scale question IX higher than 2; (6) Beck depression inventory score of above 21 [29]; (7) significant upper extremity disease-causing hand or below elbow dysfunction; (8) visual disturbance; (9) refusal of participation. This study was a randomized, controlled trial. The present study was approved by the Ulsan university hospital institutional review board. The participants were given an explanation of the objective of the study and its requirements.

2.2. Augmented Reality System

2.2.1. Hardware

The AR System consists of a patient positioning tool (a chair), a white surface table, an image acquisition unit, an image processing unit, an image displaying unit, an arm holder, a Velcro-strap, and two blue circle stickers as shown in Figure 1a,b. The image displaying unit is a 20-inch screen (Samsung S23C340 1920 × 1080 @ 60 Hz) placed on the table and in front of a user with a monitor arm, which allowed the user to put their hands underneath so that the user only saw their wrists through the monitor. In addition, their hands were placed on the arm holder and immobilized by the Velcro-strap. The image acquisition unit equipped a Webcam C920 of Logitech (Max resolution: 1080 at 30 fps, 78° Field of view) which was mounted behind the screen. The computer (Intel® Core i5-7500 CPU 3.4 GHz with 8 Gb RAM) was utilized as the image processing unit to provide an image processing program. The two blue circle stickers were attached on the Velcro-strap and the user’s hands to recognize the wrist position.

2.2.2. Image Processing Program

Our image processing program was developed based on Microsoft Foundation Classes (MFC, C++) with OpenCV libraries in Windows operating system. Our program was composed of a color detecting function, a counting function, angle and velocity data managing functions, an image flipping function, and an image merging function. The program created a flexible and extensible exercise for the user.
The user was seated on a chair opposite the monitor. Then, his/her hands were placed on the arm holder of the table and his/her wrists were immobilized by the Velcro-strap. The two blue circle stickers were attached to the Velcro-strap and the user’s hands (Figure 1b). In order to complete the exercise, the user had to undergo three sections. In the first section, the user performed the flexible and extensible task with his/her unhealthy wrist 5 times. The number of time was automatically counted down by the counting function. Figure 2a shows the preparation of the user’s unhealthy wrist prior to the task’s beginning. The user had to put the blue circle sticker on the hands into the red circle and keep this position for 5 s. After 5 s, the user carried out the flexible and extensible movement 5 times as far as possible (Figure 2b,c). The moving images of the unhealthy wrist were stored as angles and velocities data by recognizing the flexible and extensible positions of the two blue circle stickers. The image processing unit provided movements of the unhealthy wrist to the image displaying unit without any image processing which allows the users to watch their real wrist movement in real-time for embodiment augment of the displayed images. In the second section, the user implemented a task similar to the first section with their healthy wrist as described in Figure 2d–f. After this section, the moving images of the healthy wrist were mirrored by the flipping image function. In the final section, the user repeated the task one more time. During this section, our system presented the speed-up movement of the unhealthy wrist, which showed the mirrored movements of the stored healthy wrist movements by the real-time image merging function. It meant that the flipping images of healthy wrist movements were processed and transferred to the displaying unit by processing the unit. Processing time was short enough that the user could not feel any movement delay in the flipping movement images. The processing unit replaced the unhealthy wrist movement images by the flipping healthy wrist movement images. For instance, if the unhealthy wrist is at a 20° position related to the extensible task, the image processing program processed and transferred an unhealthy wrist image at 30° position of the extensible task to the displaying unit. More specifically, when the real-unhealthy wrist moves to the maximal flexible or extensible position as the position of the white sticker on the screen, the program shows the movement of the unhealthy wrist that moves two red-flag positions as shown in Figure 2g,h. The two red-flag points indicate the maximal range of motion of the normal wrist.

2.3. Intervention and Procedure

The intervention was based on the flexible and extensible task which was provided by our AR system. The intervention consisted of three sequences. The first and second were the acquisition of a real-time hand and the third was of virtual hand presence. After each exercise, the validation of virtual reality and augmented reality was checked to assess the ability of the system to provide the degree of presence and embodiment for the patients (Appendix A) [30]. The patients carried out the task two times a day for ten minutes over two weeks (ten days of treatment weeks), except for the time of installation, calibration, and 3-min breaks. Assessments were performed before the first and last intervention.

2.4. Outcome Measures

Outcome measures were evaluated before the first and after the last intervention for all patients. The primary outcome was Jebsen Taylor test which was used to evaluate unilateral hand skill and provide an objective test of hand functions involved in daily living activities [31]. This test comprised of a series of seven items that consisted of the following: (1) Writing a 24-letter sentence; (2) simulated page turning; (3) picking up small, common objects such as a coin or a bottle cap; (4) simulated feeding; (5) stacking checkers; (6) lifting large, light objects such as an empty tin can; (7) picking up and moving large weighted cans. The results were measured objectively by a stopwatch after completing each task. The secondary outcome was designed to assess motor functioning, sensation, and joint range of motion in the upper extremity of patients with post-stroke hemiplegia, namely Fugl-Meyer scale [24] (wrist and hand upper extremity Fugl-Meyer includes 12-items [32]) and proximal arm subscale (score on a 0–34 point scale). Furthermore, Ashworth and modified Ashworth Scales, score of nine-hole pegboard [33], stroke impact scale [34], Korean version-Modified Barthel Index (K-MBI) [35], active range of motion (ROM) of wrist joint, grasp force in Newtons, motor evoke potential, and adverse effects (dizziness, psychological anxiety, boredom, gloomy feeling, muscle twist, motion sickness) were recorded after completion of each session.

3. Results

A hemiplegic patient who satisfied our criteria was recruited to assess the feasibility of our AR system in a clinical trial. Table 1 shows the detailed information of the patient.

3.1. Motor Function Improvement

To the primary outcome measure, there were small improvements in the writing (2 s of improvement) and stacking checkers (1 s of improvement) subtest of Jebsen Taylor test between pre- and post-intervention. However, no difference was found in the time total of Jebsen Taylor test in both evaluations (baseline: 65 s; post-treatment: 65 s). Noticeably, there was 4 points and 3 points improvement related to the wrist/hand and proximal arm subscale of Arm Motor Fugl-Meyer scale in the second outcome measure, respectively, after 10 days of intervention (Table 2).
Furthermore, apparent enhancements were exhibited in the stroke impact, hand function scale, grasp force in Newtons scale, active ROM of wrist joint scale (flexion and extension), in nine-hole pegboard, and Korean version-Modified Barthel Index scale from (improvement from pre- to post-: intervention) 9 points, 5 (kg), 10° for flexion, 3° for extension, 5 s, and 3 points, respectively. Nevertheless, there were negligible decreases in both the wrist and elbow subscale of the Ashworth scale (pre-intervention: 1; post-intervention: 0) and the peak to peak Motor Evoked Potential was not evaluated after intervention due to the poor patient condition.

3.2. Validation of Virtual Reality and Agmented Reality

The authors used questionnaires consisting of six items with a scale rating of −5 (not at all) to 5 (perfect) for the validation of VR and AR (more details in Appendix A). Table 3 shows the validation results after 10 days of intervention. From the patient’s feedback, he did not feel the moving hand on the screen similar to his hand.

3.3. Adverse Effects

The authors utilized questionnaires including six items (dizziness, psychological anxiety, boredom, gloomy feeling, muscle twist, and motion sickness) (more detail in Appendix B) with a scale rating of 0 (not at all), 2 (nervous), 4 (little uncomfortable), 6 (very uncomfortable), 8 (disturbed), and 10 (extremely disturbed) to assess the adverse effects after the intervention. The items dizziness, muscle twist, and motion sickness were reported after the intervention as shown in Table 4. Therefore, the patient felt a little uncomfortable with our system after the intervention.

4. Discussion

The purpose of this study was to investigate the effects of AR system for the upper limbs of patients who experienced a stroke. Positive effects after the intervention were detected in the participant.
A few studies have chosen the Jebsen-Taylor hand function test (JTHFT) to evaluate the effect of motor function recovery because of (1) the standardized tasks relative to norms; (2) everyday activities tasks; (3) using readily available materials [36]. In our results, there was no change in the total scores of JTHFT, but the results show the small improvements in writing and stacking checkers test of JTHFT after 10 days of intervention. Merians et al. used JTHFT to assess the fine motor dexterity of patients with brain damage. The clinical results showed the improvements in the speed and precision of fine movement in two of three patients. However, there was one patient who did not transfer the improvement to the functional activities after the intervention [37]. These improvements of writing, stacking checker, and speed movement were consistent with the need for fine, sequential, and bimanual coordination skills of the finger and thumb.
In addition, the Arm Motor Fugl-Meyer Test is most commonly used to assess the upper limb function in the stroke patient [38]. In this study, we used the wrist/hand and proximal arm Fugl-Meyer to assess the effect of functional recovery for the mildly impaired stroke survivor. After 10 days of intervention, the results showed the improvement in the scores of wrist/hand and proximal arm Fugl-Meyer. Particularly, the patient was able to reach the highest score of the proximal arm (34/34) and wrist/hand (23/24). Compared to the other methods, Faria et al. reported that both VR and control group showed significant improvements at the end of treatment in wrist/hand Fugl-Meyer (p = 0.034 and p = 0.04) [39]. However, these improvements were significant with respect to baseline, but they were modest for both groups at end of treatment (0.8 ± 1.4 in VR versus 1.3 ± 2.3 in control). This indicated that the improvement of our system in wrist/hand Fugl-Meyer is superior to the improvement in VR. The prominence could be explained by using patients with better functions in wrist/hand Fugl-Meyer in the current study.
Furthermore, the specific task of the flexion and extension of the wrist joint promoted by our system could also explain the improvement detected in the active ROM and the nine-hole pegboard test, stroke impact scale, and grasp force in Newtons. This is also consistent with the previous report of robotic rehabilitation [40]. Hence, our system showed to be as effective as other methods since it can promote hand dexterity, as measured by the nine-hole pegboard test and active ROM while being simpler than the robotic systems.
There were several limitations to our study. Firstly, although the results showed the improvement of the functional motor, they are not powered to detect significant changes due to the small sample size. Secondly, our system could not induce a high sense of the presence and embodiment for the patient. In order to assess the validity of presence of the system, most of VR or AR applying mirror therapy trials used a questionnaire. For instance, Koo et al. used a questionnaire including six items to check for real-time embodiment and virtual limb presence in which the mean scores were 4.0 and 4.0 (−5 to 5 rating), respectively [13]. These scores indicated that their system could provide a high degree of presence and might induce a long-term effect. Compared to our study, the results exhibited lower scores of validation of virtual reality and augmented reality (mean 0.8 and −4.16, respectively) which is not enough to provide a high presence, indicating that our system could not induce a long-term effect for the patient in motor function recovery. Finally, some adverse events were noticed after the intervention following dizziness, muscle twist, and motion sickness. This is similar to the VR [41,42] and mirror therapy [43,44].
A future study involving a larger sample size and long-term for follow-up should be performed to enhance significant improvements in outcome measures. Besides, more exercises should be added into the system to establish a standardized program for post-stroke rehabilitation. Furthermore, we should design the system in three-dimension (3D) to provide a higher sense of presence and embodiment of the upper limb for the patient which might reduce the adverse effects and induce long-term effects for the patient.
In conclusion, we developed the AR system applying mirror therapy mechanism to supply the wrist rehabilitation exercise for hemiplegic stroke patients using real-time image processing techniques. Our findings demonstrated that the AR system was feasible in the improvement of motor function rehabilitation for a patient with hemiplegia.

Author Contributions

All authors have read and approved the paper. H.L.P.: 1. Data curation, 2. Methodology, 3. Visualization, 4. Software, 5. Writing—original draft, 6. Writing—review & editing; J.P.K.: 1. Conceptualization, 2. Methodology, 3. Writing—original draft, 4. Writing—review & editing; K.K.: 1. Conceptualization, 2. Methodology, 3. Writing—original draft, 4. Writing—review & editing; C.H.H.: 1. Conceptualization, 2. Methodology, 3. Investigation, 4. Validation, 5. Writing—original draft, 6. Writing—review & editing; K.-i.K.: 1. Conceptualization, 2. Funding acquisition, 3. Investigation, 4. Methodology, 5. Project administration, 6. Software, 7. Supervision, 8. Visualization, 9. Writing—original draft, 10. Writing—review & editing.

Funding

This research was supported by the 2019 Research Fund of the University of Ulsan.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Validation of the AR System

Validation of virtual reality
1. Do you see the hand on the screen like yours?
−5 (Not at all.)−4−3−2−1012345 (Perfect)
2. Do you see the moving hand on the screen as your hand?
−5 (Not at all.)−4−3−2−1012345 (Perfect)
3. Do you feel your hands are getting warm?
−5 (Not at all.)−4−3−2−1012345 (Perfect)
Validation of augmented reality
1. Do you see the hand on the screen like yours?
−5 (Not at all.)−4−3−2−1012345 (Perfect)
2. Do you see the moving hand on the screen as your hand?
−5 (Not at all.)−4−3−2−1012345 (Perfect)
3. Do you feel your hands are getting warm?
−5 (Not at all.)−4−3−2−1012345 (Perfect)

Appendix B. Adverse Effects Assessment

0 [Not at all]2 [nervous]4 [a little uncomfortable]6 [very uncomfortable]8 [disturbed]10 [extremely disturbed]
DizzinessPsychological AnxietyBoredomGloomy FeelingMuscle TwistMotion Sickness
1 day800048
2 day400044
3 day400004
4 day400004
5 day400000
6 day200002
7 day200002
8 day200000
9 day200002
10 day400020

References

  1. Murray, C.J.; Vos, T.; Lozano, R.; Naghavi, M.; Flaxman, A.D.; Michaud, C.; Ezzati, M.; Shibuya, K.; Salomon, J.A.; Abdalla, S.; et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990–2010: A systematic analysis for the global burden of disease study 2010. Lancet 2013, 380, 2197–2223. [Google Scholar] [CrossRef]
  2. Hochstenbach, J.; Prigatano, G.; Mulder, T. Patients’ and relatives’ reports of disturbances 9 months after stroke: Subjective changes in physical functioning, cognition, emotion, and behavior. Arch. Phys. Med. Rehab. 2005, 86, 1587–1593. [Google Scholar] [CrossRef] [PubMed]
  3. Levin, M.F.; Musampa, N.K.; Henderson, A.K.; Knaut, L.A. New Approaches to enhance motor function of the upper limb in patients with hemiparesis. Hong Kong Physiother. J. 2005, 23, 2–5. [Google Scholar] [CrossRef]
  4. Vaughan, N.; Dubey, V.N. Monitoring rehabilitation parameters in stroke patients. In Proceedings of the International Design Engineering Technical Conferences & Computer and Information in Engineering Conference, Cleveland, OH, USA, 6–9 August 2017; pp. 6–9. [Google Scholar]
  5. Gandolfi, M.; Valè, N.; Dimitrova, E.; Mazzoleni, S.; Battini, E.; Benedetti, M.; Gajofatto, A.; Ferraro, F.; Castelli, M.; Camin, M.; et al. Effects of high-intensity robot-assisted hand training on upper limb recovery and muscle activity in individuals with multiple sclerosis: A randomized, controlled, single-blinded trial. Front. Neurol. 2018, 9, 905. [Google Scholar] [CrossRef] [PubMed]
  6. Viglialoro, R.; Condino, S.; Turini, G.; Carbone, M.; Ferrari, V.; Gesi, M. Review of the augmented reality systems for shoulder rehabilitation. Information 2019, 10, 154. [Google Scholar] [CrossRef]
  7. Teasell, R.; Meyer, M.J.; McClure, A.; Pan, C.; Murie-Fernandez, M.; Foley, N.; Salter, K. Stroke rehabilitation: An international perspective. Top. Stroke Rehabilit. 2009, 16, 44–56. [Google Scholar] [CrossRef] [PubMed]
  8. Saposnik, G.; Cohen, L.G.; Mamdani, M.; Pooyania, S.; Ploughman, M.; Cheung, D.; Shaw, J.; Hall, J.; Nord, P.; Dukelow, S.; et al. Efficacy and safety of non-immersive virtual reality exercising in stroke rehabilitation (EVREST): A randomised, multicentre, single-blind, controlled trial. Lancet Neurol. 2016, 15, 1019–1027. [Google Scholar] [CrossRef]
  9. Yavuzer, G.; Selles, R.; Sezer, N.; Sütbeyaz, S.; Bussmann, J.B.; Köseoğlu, F.; Atay, M.B.; Stam, H.J. Mirror therapy improves hand function in subacute stroke: A randomized controlled trial. Arch. Phys. Med. Rehab. 2008, 89, 393–398. [Google Scholar] [CrossRef]
  10. Yeldan, I.; Huseyınsınoglu, B.; Akıncı, B.; Tarakcı, E.; Baybas, S.; Ozdıncler, A. The effects of very early mirror therapy on functional improvement of the upper extremity in acute stroke patients. J. Phys. Ther. Sci. 2015, 27, 3519–3524. [Google Scholar] [CrossRef] [Green Version]
  11. Toh, S.; Fong, K. Systematic review on the effectiveness of mirror therapy in training upper limb hemiparesis after stroke. Hong Kong J. Occup. Ther. 2012, 22, 84–95. [Google Scholar] [CrossRef]
  12. Stevens, J.; Stoykov, M. Using motor imagery in the rehabilitation of hemiparesis. Arch. Phys. Med. Rehab. 2003, 84, 1090–1092. [Google Scholar] [CrossRef]
  13. Koo, K.; Park, D.; Youm, Y.; Cho, S.; Hwang, C. Enhanced reality showing long-lasting analgesia after total knee arthroplasty: Prospective, randomized clinical trial. Sci. Rep. 2018, 8, 2343. [Google Scholar] [CrossRef] [PubMed]
  14. Choi, H.S.; Shin, W.S.; Bang, D.H. Mirror therapy using gesture recognition for upper limb function, neck discomfort, and quality of life after chronic stroke: A single-blind randomized controlled trial. Med. Sci. Monit. Int. Med. J. Exp. Clin. Res. 2019, 25, 3271–3278. [Google Scholar] [CrossRef] [PubMed]
  15. Kiper, P.; Szczudlik, A.; Agostini, M.; Opara, J.; Nowobilski, R.; Ventura, L.; Tonin, P.; Turolla, A. Virtual reality for upper limb rehabilitation in sub-acute and chronic stroke: A randomized controlled trial. Arch. Phys. Med. Rehab. 2018, 99, 834–842. [Google Scholar] [CrossRef] [PubMed]
  16. Vaughan, N.; Gabrys, B.; Dubey, V.N. An overview of self-adaptive technologies within virtual reality training. Comput. Sci. Rev. 2016, 22, 65–87. [Google Scholar] [CrossRef] [Green Version]
  17. Turolla, A.; Dam, M.; Ventura, L.; Tonin, P.; Agostini, M.; Zucconi, C.; Kiper, P.; Cagnin, A.; Piron, L. Virtual reality for the rehabilitation of the upper limb motor function after stroke: A prospective controlled trial. J. Neuroeng. Rehabil. 2013, 10, 85. [Google Scholar] [CrossRef] [PubMed]
  18. Lee, S.; Kim, Y.; Lee, B. Effect of virtual reality-based bilateral upper extremity training on upper extremity function after stroke: A randomized controlled clinical trial. Occup. Ther. Int. 2016, 23, 357–368. [Google Scholar] [CrossRef]
  19. Soufi, A.H.; Hassani, M.A.; Amini, M.; Sheikhi, M. The effects of virtual reality on upper limb function in chronic stroke patients: A clinical trial. Iranian Rehabilit. J. 2019, 17, 81–89. [Google Scholar] [CrossRef]
  20. Azuma, R.; Baillot, Y.; Behringer, R.; Feiner, S.; Julier, S.; MacIntyre, B. Recent advances in augmented reality. IEEE Comput. Graph. 2001, 21, 34–47. [Google Scholar] [CrossRef]
  21. Tang, A.; Biocca, F.; Lim, L. Comparing differences in presence during social interaction in augmented reality versus virtual reality environments: An exploratory study. Proc. Presence 2004, 204–208. [Google Scholar]
  22. Hoermann, S.; Santos, F.L.; Morkisch, N.; Jettkowski, K.; Sillis, M.; Cutfield, N.J.; Schmidt, H.; Hale, L.; Kruger, J.; Regenbrecht, H.; et al. Computerized mirror therapy with augmented reflection technology for stroke rehabilitation. In Proceedings of the International Conference on Virtual Rehabilitation, Valencia, Spain, 9–12 June 2015; pp. 2331–9569. [Google Scholar]
  23. Mouraux, D.; Brassinne, E.; Sobczak, S.; Nonclercq, A.; Warzée, N.; Sizer, P.S.; Tuna, T.; Penelle, B. 3D augmented reality mirror visual feedback therapy applied to the treatment of persistent, unilateral upper extremity neuropathic pain: A preliminary study. J. Man. Manip. Ther. 2016, 25, 137–143. [Google Scholar] [CrossRef] [PubMed]
  24. Fugl-Meyer, A.R.; Jaasko, L.; Leyman, I.; Olsson, S.; Steglind, S. The post-stroke hemiplegic patient a method for evaluation of physical performance. Scand. J. Rehab. Med. 1975, 7, 13–31. [Google Scholar]
  25. Mathiowetz, V.; Weber, K.; Kashman, N.; Volland, G. Adult norms for the nine hold peg test of finger dexterity. Occup. Ther. J. Res. 1985, 5, 24–38. [Google Scholar] [CrossRef]
  26. Alexander, M.P.; Baker, E.; Naeser, M.; Kaplan, E.; Palumbo, C. Neuropsychological and neuroanatomical dimensions of ideomotor apraxia. Brain 1992, 115, 87–107. [Google Scholar] [CrossRef] [PubMed]
  27. Brott, T.; Adams, H.P., Jr.; Olinger, C.; Marler, J.; Barsan, W.; Biller, J.; Spilker, J.; Holleran, R.; Eberle, R.; Hertzberg, V. Measurements of acute cerebral infarction: A clinical examination scale. Stroke 1989, 20, 864–870. [Google Scholar] [CrossRef] [PubMed]
  28. Lincoln, N.; Jackson, J.; Adams, S. Reliability and revision of the nottingham sensory assessment for stroke patients. Physiotherapy 1998, 84, 358–365. [Google Scholar] [CrossRef]
  29. Beck, A.T.; Steer, R.A.; Ball, R.; Ranieri, W.F. Comparison of beck depression inventories-IA and-II in psychiatric outpatients. J. Personal. Assess. 1996, 67, 588–597. [Google Scholar] [CrossRef]
  30. Romano, D.; Bottini, G.; Maravita, A. Perceptual effects of the mirror box training in normal subjects. Restor. Neurol. Neurosci. 2013, 31, 373–386. [Google Scholar]
  31. Jebsen, R.; Taylor, N.; Trieschmann, R.; Trotter, M.; Howard, L. An objective and standardized test of hand function. Arch. Phys. Med. Rehab. 1969, 50, 311–319. [Google Scholar]
  32. Page, S.J.; Levine, P.; Hade, E. Psychometric properties and administration of the wrist/hand subscales of the fugl-meyer assessment in minimally impaired upper extremity hemiparesis in stroke. Arch. Phys. Med. Rehab. 2012, 93, 2373–2376.e5. [Google Scholar] [CrossRef]
  33. Kellor, M.; Frost, J.; Silberberg, N.; Iversen, I.; Cummings, R. Hand strength and dexterity. Am. J. Occup. Ther. 1971, 25, 77–83. [Google Scholar] [PubMed]
  34. Duncan, P.W.; Wallace, D.; Lai, S.; Johnson, D.; Embretson, S.; Laster, L. The stroke impact scale version 2.0. Stroke 1999, 30, 2131–2140. [Google Scholar] [CrossRef] [PubMed]
  35. Hong, I.; Lim, Y.; Han, H.; Hay, C.; Woo, H.S. Application of the Korean version of the modified barthel index: Development of a keyform for use in clinical practice. Hong Kong J. Occup. Ther. 2017, 29, 39–46. [Google Scholar] [CrossRef] [PubMed]
  36. Culicchia, G.; Nobilia, M.; Asturi, M.; Santilli, V.; Paoloni, M.; Santis, R.; Galeoto, G. Cross-cultural adaptation and validation of the Jebsen-Taylor hand function test in an Italian population. Rehabilit. Res. Pract. 2016, 2016, 8970917. [Google Scholar] [CrossRef] [PubMed]
  37. Merians, A.S.; Jack, D.; Boian, R.; Tremaine, M.; Burdea, G.C.; Adamovich, S.V.; Recce, M.; Poizner, H. Virtual reality–augmented rehabilitation for patients following stroke. Phys. Ther. 2002, 82, 898–915. [Google Scholar] [PubMed]
  38. Santisteban, L.; Térémetz, M.; Bleton, J.P.; Baron, J.C.; Maier, M.A.; Lindberg, P.G. Upper limb outcome measures used in stroke rehabilitation studies: A systematic literature review. PloS ONE 2016, 11, e0154792. [Google Scholar] [CrossRef]
  39. Faria, A.L.; Cameirão, M.S.; Couras, J.F.; Aguiar, J.R.; Costa, G.M.; i Badia, S.B. Combined cognitive-motor rehabilitation in virtual reality improves motor outcomes in chronic stroke—A pilot study. Front. Psychol. 2018, 9, 854. [Google Scholar] [CrossRef]
  40. Hwang, C.; Seong, J.; Son, D.S. Individual finger synchronized robot-assisted hand rehabilitation in subacute to chronic stroke: A prospective randomized clinical trial of efficacy. Clin. Rehabil. 2011, 26, 696–704. [Google Scholar] [CrossRef]
  41. Hoffman, H.G.; Patterson, D.R.; Carrougher, G.J.; Sharar, S.R. Effectiveness of virtual reality–based pain control with multiple treatments. Clin. J. Pain 2001, 17, 229–235. [Google Scholar] [CrossRef]
  42. Sharar, S.R.; Carrougher, G.J.; Nakamura, D.; Hoffman, H.G.; Blough, D.K.; Patterson, D.R. Factors influencing the efficacy of virtual reality distraction analgesia during postburn physical therapy: Preliminary results from 3 ongoing studies. Arch. Phys. Med. Rehab. 2007, 88, S43–S49. [Google Scholar] [CrossRef]
  43. Casale, R.; Damiani, C.; Rosati, V. Mirror therapy in the rehabilitation of lower-limb amputation. Am. J. Phys. Med. Rehab. 2009, 88, 837–842. [Google Scholar] [CrossRef] [PubMed]
  44. Darnall, B.; Li, H. Home-based self-delivered mirror therapy for phantom pain: A pilot study. J. Rehabil. Med. 2012, 44, 254–260. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. (a) A schematic view of the augmented reality (AR) system; (b) the users’ hands were placed on the arm holder of the table and their wrists were secured by the Velcro-strap; the two blue circle stickers were attached on the Velcro-strap and the users’ hands.
Figure 1. (a) A schematic view of the augmented reality (AR) system; (b) the users’ hands were placed on the arm holder of the table and their wrists were secured by the Velcro-strap; the two blue circle stickers were attached on the Velcro-strap and the users’ hands.
Applsci 09 02892 g001
Figure 2. The first section: (a) Preparation of the unhealthy wrist, (b,c) the extensible and flexible movement of the unhealthy wrist, respectively; the second section: (d) Preparation of the healthy wrist, (e,f) the extensible and flexible movement of the healthy wrist, respectively; the third section: (g,h) The speed-up movement of the unhealthy wrist.
Figure 2. The first section: (a) Preparation of the unhealthy wrist, (b,c) the extensible and flexible movement of the unhealthy wrist, respectively; the second section: (d) Preparation of the healthy wrist, (e,f) the extensible and flexible movement of the healthy wrist, respectively; the third section: (g,h) The speed-up movement of the unhealthy wrist.
Applsci 09 02892 g002aApplsci 09 02892 g002b
Table 1. Demographics of the patient.
Table 1. Demographics of the patient.
Patient Characteristics
Age (years old)56
SexMale
Weight (kg)77
Height (cm)174
ParalysisYes (۷)/No ( )
Lesion locationCerebrum (۷) Brainstem ( ) Cerebellum ( )
Treatment duration after paralysis17 days
Table 2. Upper extremity motor function measures before and after the intervention.
Table 2. Upper extremity motor function measures before and after the intervention.
Patient CharacteristicsPre-InterventionPost-Intervention
(10 Days)
Jebsen Taylor test (s)19; 8; 10; 11; 6; 5; 6 17; 10; 11; 11; 5; 5; 6
Arm Motor Fugl-Meyer scale; wrist/hand1923
Arm Motor Fugl-Meyer scale; proximal arm3134
Ashworth scale; wrist10
Ashworth scale; elbow10
Nine-hole pegboard (s)3025
Stroke impact scale, hand function4654
Grasp force in Newtons (kg)12.717.7
Active range of motion (ROM) of wrist jointFlexion: 60°; extension: 30°Flexion: 70°; extension: 33°
Korean version-Modified Barthel Index (K-MBI)9295
Peak to peak Motor Evoked PotentialMean amplitudeMaximal amplitude (mV)Amplitude (M-wave−1)Mean amplitudeMaximal amplitude (mV)Amplitude (M-wave−1)
-3.5/4.90.3043/0.7903---
Table 3. Validation of virtual reality and augmented reality.
Table 3. Validation of virtual reality and augmented reality.
Post-Intervention (10 Days)
Validation of virtual reality (−5 to 5)0.8 ± 1.79
Validation of augmented reality (−5 to 5)−4.16 ± 1.89
Values are presented as mean ± standard deviation.
Table 4. Adverse effects evaluation after the intervention.
Table 4. Adverse effects evaluation after the intervention.
Side Effect AssessmentPost-Intervention (10 Days)
Dizziness3.6 ± 1.83
Psychological anxiety0
Boredom0
Gloomy feeling0
Muscle twist1 ± 1.69
Motion sickness2.6 ± 2.5
Values are presented as mean ± standard deviation.

Share and Cite

MDPI and ACS Style

Phan, H.L.; Kim, J.P.; Kim, K.; Hwang, C.H.; Koo, K.-i. Wrist Rehabilitation System Using Augmented Reality for Hemiplegic Stroke Patient Rehabilitation: A Feasibility Study. Appl. Sci. 2019, 9, 2892. https://doi.org/10.3390/app9142892

AMA Style

Phan HL, Kim JP, Kim K, Hwang CH, Koo K-i. Wrist Rehabilitation System Using Augmented Reality for Hemiplegic Stroke Patient Rehabilitation: A Feasibility Study. Applied Sciences. 2019; 9(14):2892. https://doi.org/10.3390/app9142892

Chicago/Turabian Style

Phan, Huu Lam, Jong Pal Kim, Kwangsoo Kim, Chang Ho Hwang, and Kyo-in Koo. 2019. "Wrist Rehabilitation System Using Augmented Reality for Hemiplegic Stroke Patient Rehabilitation: A Feasibility Study" Applied Sciences 9, no. 14: 2892. https://doi.org/10.3390/app9142892

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop