Next Article in Journal
Enhanced Tensile Plasticity in Ultrafine Lamellar Eutectic Al-CuBased Composites with α-Al Dendrites Prepared by Progressive Solidification
Previous Article in Journal
Spore Viability and Cell Wall Integrity of Cordyceps pruinosa Treated with an Electric Shock-Free, Atmospheric-Pressure Air Plasma Jet
Previous Article in Special Issue
Perspectives and Challenges in Robotic Neurorehabilitation
Open AccessArticle

Upper Limb Robotics in Rehabilitation: An Approach to Select the Devices, Based on Rehabilitation Aims, and Their Evaluation in a Feasibility Study

IRCCS Fondazione Don Carlo Gnocchi, 20121 Milan, Italy
IRCCS Fondazione Don Carlo Gnocchi, 50143 Florence, Italy
Department of Geriatrics, Neurosciences and Orthopaedics Università Cattolica del Sacro Cuore, 00168 Rome, Italy
Fondazione Policlinico Universitario A. Gemelli IRCCS, 00168 Rome, Italy
Author to whom correspondence should be addressed.
Appl. Sci. 2019, 9(18), 3920;
Received: 6 August 2019 / Revised: 11 September 2019 / Accepted: 15 September 2019 / Published: 18 September 2019


Robot-mediated therapy is a viable approach for upper limb rehabilitation. The upper limb is a highly complex segment and the identification of the appropriate devices capable of rehabilitating it globally (from the shoulder to the hand) in clinical practice is crucial. In this work, we aimed: (i) to describe an approach used in identifying a set of technological and robotic devices to globally treat the upper limb, and (ii) to evaluate the feasibility of the identified set in clinical practice. Using an ad-hoc form, a multidisciplinary team identified a set of four robotic and sensor-based devices to treat globally the upper limb. Then, 30 stroke patients were enrolled and assigned to two groups: the robotic group (RG), where patients were treated with the robotic set, or the conventional group (CG). All patients were evaluated before and after the treatment. In the RG the patients used all the devices (one in each rehabilitation session); the treatment was well accepted, without drop-outs or adverse events. Using a multidisciplinary approach, we identified a set of technological and robotic devices to treat the upper limb globally, and then we experimented to ascertain its feasibility, in a pilot study. Robotics offers a considerable number of devices for rehabilitation that should be selected according to rehabilitation aims and feasibility in clinical practice.
Keywords: robotics; neurorehabilitation and brain computer Interfaces; assessment; usability robotics; neurorehabilitation and brain computer Interfaces; assessment; usability

1. Introduction

Stroke is the leading cause of disability in the world, with a very high social impact. Recovery is partial in 85% of stroke survivors [1], 35% of which have a persisting serious disability. Rehabilitation programs are mainly focused on walking recovery, with insufficient attention being paid to upper limb recovery. Thirty percent to 60% of patients treated with conventional therapy still exhibit functional deficits of the paretic arm, resulting in a reduction of autonomy for daily-life activities, productivity and the ability to socially reintegrate [2,3]. Robot-mediated therapy for the recovery of the upper limb is gaining an increasing attention from clinicians and researchers, providing promising results [4,5,6]. Recent studies suggest that robotics can facilitate recovery after stroke, promoting the mechanisms of brain plasticity and connectivity re-modulation [7], according to the baseline cortical excitability [8]. Several types of robotic and electromechanical systems, such as the exoskeleton or the end-effector [9,10], have been developed. Almost all scientific papers in the literature have focused on the effects of the use of one or, at most two, robotic devices. The anatomy, the kinematics and the motor function of the upper limb, especially the hand, are extremely complex; however, almost all commercial devices act on a limited number of joints and limit the workspace on a plane. Moreover, these commercial devices are often used in the research field rather than in clinical practice. For this reason, it is crucial to identify a set of robots and electromechanical systems, each one acting on a different joint and/or on a different plane, for a comprehensive upper limb rehabilitation (in all segments, including the hand), and verify the feasibility of their use in clinical practice.
In the light of the above, the aims of the study were: (1) to describe an approach to be used by a multidisciplinary team with the purpose of identifying a set of technological and robotic devices to treat the upper limb globally, and (2) to evaluate the feasibility of the identified set in clinical practice, with a pilot study on stroke patients.

2. Materials and Methods

The study has been conducted in two steps (Figure 1): (1) the robotic device set’s identification and (2) the feasibility pilot study.

2.1. The Robotic Device Set’s Identification

In the first step of the study, a multidisciplinary team worked to identify a set of technological and robotic devices to treat the upper limb globally. The team was created in April 2015, at our institution (Fondazione Don Carlo Gnocchi, FDG) consisting of the medical director of FDG, 3 physiatrists, 2 neurologists, 3 physiotherapists, and 4 bioengineers, coordinated by the head of the Innovation and Health Technology Assessment department. The team, created with the intent of developing a strategy for the implementation of robotic rehabilitation within the FDG centers, performed an analysis of robotic solutions commercially available, to generate a prioritized list of solutions of potential interest for acquisition by the FDG. The team also had the objective of following the deployment of the robotic solutions in the various centers of our institution and promoting the use of such solutions. The group, involving five different centers of the FDG throughout Italy, assessed different devices. A consensus building process was used to create a specific form aimed at standardizing the description of the devices and allowing for an easier comparison between them (see the supporting document: FDG Robotic System Characteristics Form). The analyzed features included general information (commercial name, manufacturer, distributor, name of the compiler, and confidence level of the compiler), system characteristics (type of system, treated body segment, stage of development, type of movement, portability, type of assistance provided by the system, main control inputs, configurability, normative values, and outcome measures), the possibility for patients to use it with a wheelchair, safety issues, literature data, costs of purchase and maintenance, an indication of the purchasing priority (by motivations), and efficiency parameters (autonomous use by the patient, preparation time, possibility of using the solution in group therapies, and number of clinicians involved during treatment). These features were selected according to the clinical and rehabilitative needs; organizational aspects as well.
The team evaluated 10 different devices by filling out 40 forms (the same solution was evaluated by several people in the team). The evaluated solutions included two exoskeletons, four end-effector systems, two unweighting systems for the upper limb (one electromechanical and one spring based) and two sensorized technological systems (Table 1). All the data were collected and the “qualitative” texting scales of the forms were transformed into “quantitative” ones (Table 2). Then, the last three parameters were combined to evaluate the efficiency level (Equation (1)):
E f f i c i e n c y   l e v e l = A u t o n o m o u s   u s e × G r o u p   t h e r a p y N u m b e r   o f   c l i n i c i a n s   i n v o l v e d
The efficiency level is an index representing the potential resource optimization, in terms of cost reduction, that could be obtained by using the robotic solution. In Equation (1) the efficiency level increases when the robotic solution can be used by the patient autonomously and if it is suitable for group therapies, while it becomes lower if it requires constant control by a physiotherapist. Similarly, the number of clinicians involved in the treatment also influence the efficiency level: if more than 1 clinician is needed to let the patient use robotic solution, the efficiency level decreases.
To rank the robotic solutions in terms of purchasing priority, the team defined an algorithm based on the weighted sum of the scores of the items in the evaluation form (Equation (2)):
S c o r e = p r o d u c t   m a t u r i t y × i P a r a m e t e r i × W e i g h t i
where the parameters and corresponding weights are depicted in Table 3. The score given to a robotic solution through Equation (2) takes into account the main characteristics of the device with a special focus on usability and sustainability in the framework of the FDG rehabilitation processes. According to the formula in Equation (1), the ideal robotic solution is a device at a high technology readiness level (TRL) that (i) is able to provide outcome measures that can be compared with reference normative values; (ii) has no safety issues and few contraindications; (iii) has strong scientific evidence supporting the efficacy; (iv) can be used even with patients with a high level of impairment; (v) gives the possibility of customizing the exercises; and (vi) can improve the efficiency of rehabilitation processes by optimizing the use of resources. The overall score given to a robotic solution is obtained by a weighted sum of the items listed above.
The choice of the parameters and weights was based on the priorities given by the case mix of FDG patients, sustainability of the robotic rehabilitation process and the need for innovative, technology-enabled solutions that could measure the outcome of the rehabilitation objectively. To take into account the knowledge of the evaluators, the average of the scores obtained by the same solution from different compilers was weighted according to their confidence level. Finally, the ranked device list obtained from this algorithm was integrated with the information of the cost of each device. The set of devices that was eventually defined was the one that had the highest average score among all the combinations giving the possibility of treating the upper limb globally (as defined by the physicians of the multidisciplinary team) and not exceeding a fixed budget. Such a budget was calculated considering the long-term sustainability of the rehabilitation services to be provided with the robots. It must be noted that the purpose of the method herein described was not to evaluate the quality of the robotic solutions per se, but rather to define a set of devices capable of responding to the clinical, organizational, and sustainability needs, as well as to the strategic objectives of our Institution. The set identified includes the following devices: Diego, Amadeo and Pablo (Tyromotion GmBH, Graz, Austria), and Motore (Humanware srl, Pisa, Italy). After the results of the set identification step, the identified robotic devices were installed in one center to run the feasibility pilot study.

2.2. Feasibility Pilot Study

In the second step of the study, 30 stroke patients were enrolled to compare the conventional therapeutic approach with a robotic approach, using the set of four devices identified, in the rehabilitation of upper limb.

2.2.1. Sample

We enrolled 30 consecutive patients after ischemic or hemorrhagic stroke, aged between 47 and 82 years (mean time since onset: 120 ± 46 days). Patients were recruited at the two centers of Don Gnocchi Foundation Onlus of Rome: (i) Santa Maria della Provvidenza, where the robotic/technological devices were installed (Robotic Center), and (ii) Santa Maria della Pace (Conventional Center). Inclusion criteria were: sub-acute patients (time latency since stroke ranging from two weeks to six months) after only one ischemic or hemorrhagic stroke, verified by MRI or CT; between 40 and 85 years old; time latency since the stroke between two weeks to six months; and the ability to understand simple instructions. Exclusion criteria included: fixed contraction deformity in the affected limb that would interfere with active therapy (ankylosis, Modified Ashworth Scale = 4) and severe deficits in visual acuity. Patients from the Robotic Center were treated by means of robotic devices for the upper limb (robotic group, RG, n = 16), while patients from the Conventional Center were treated according to conventional rehabilitation protocols for the upper limb (conventional group, CG, n = 14).

2.2.2. Clinical Evaluation and Instrumental Assessment

Patients in both the RG and CG were evaluated twice, at baseline (T0) and at the end of the rehabilitation program (T1). The clinical evaluations included scales for the upper limb function (the Fugl–Meyer [11] and the Motricity Index [12]), spasticity (the Modified Ashworth Scale for shoulder, elbow and wrist [13]), lower limb performance (the Deambulation Index [14]), and activities of daily living (the modified Barthel Index [15]). The instrumental evaluations included the evaluation of the muscle strength (handgrip dynamometer) and the finger pinch (pinch gauge). In addition, the Visual Analogue Scale (VAS) for Satisfaction (a self-assessment scale from a 10-cm horizontal axis where 0 means “no satisfaction” and 10 “extreme satisfaction”) was used by patients to rate their satisfaction by making a vertical mark on the 10-cm line [16]. The measurement in centimeters was converted to a number ranging from 0 to 10. The exact question was, “Are you satisfied with the robotic rehabilitation?”

2.2.3. Usability of the Set

To assess the subjective experiences of physiotherapists about the usability of the set, we used the System Usability Scale (SUS) [17]. The SUS is based on 10 questions and has a 5-point scale (1 = strongly disagree and 5 = strongly agree), with a total score of the SUS ranging from 0 to 100. A score below 50 indicates usability difficulties and is, therefore, not acceptable; a score between 50 and 70 indicates marginal acceptability; a score above 70 indicates a good probability of acceptance; a score above 85 indicates excellent usability; and finally, a score above 90 indicates the best imaginable usability [18].

2.2.4. Rehabilitation Treatments

Rehabilitation treatment, whether conventional or robotic, was performed daily for 45 min, for 5 days per week. A total of 30 sessions were performed. In the RG, during the rehabilitation session, both the distal and the proximal parts of the patient’s upper arm were treated by means of robotic and technological devices. A ratio of one therapist to three or four patients were used, depending on the patient’s severity, according to physician’s and physiotherapists’ opinions. During each session, the physiotherapist was able to use one or two systems for each patient, to minimize the time required to move the patients from one system to another. The rehabilitation program started with the robotic device for the shoulder and elbow joints, followed by the robotic device for the hand, the sensor-based device for the shoulder, elbow, and wrist, and finally, the electro-mechanical system for the shoulder. Therefore, during the 30-session treatment, the patient used all the identified devices. The adopted protocol followed general indications, in order to ensure the homogeneity of treatment; however, the physiotherapist selected and adapted the exercise to the patient’s residual ability. In the CG, a traditional approach was used. More detail on the rehabilitation treatments (both conventional and robotics) are reported elsewhere [19]. All patients underwent a conventional treatment focused on balance, walking, and lower limb recovery with a ratio of one therapist to one patient.

2.3. Statistical Analysis

Data related to the pilot study are expressed as medians (range). Considering the ordinal nature of the variables and the small sample size, non-parametric tests were used. Specifically, to test for baseline difference, the two groups were compared by means of the Mann–Whitney U test. To assess the effects of the rehabilitation approaches separately (within-group analysis), data obtained at T0 and T1 in the two groups were compared by means of Wilcoxon signed rank tests. Finally, to compare the effects obtained in the two groups (between-group analysis), for each variable we computed the change score (T1–T0); then, we compared the change score obtained in the two groups by means of the Mann–Whitney U tests. For all the statistical analysis, a p-value of 0.05 was deemed significant. Statistical analysis was performed with SPSS (IBM, version 25).

3. Results

3.1. Characteristics of the Set of Robotic Devices

According to the procedure described above, the team eventually came up with a proposal of a set of four solutions for the upper limb to be acquired. The set of four technological and robotic devices included:
  • A robotic device that allows passive, active, and active-assistive planar movements of the shoulder and elbow joints;
  • A robotic device that allows passive, active, and active-assistive finger flexion and extension movements;
  • A sensorized technological system that allows unassisted three-dimensional movements of the shoulder, elbow, and wrist joints, both unimanual and bimanual;
  • An electro-mechanical system that allows three-dimensional, unimanual, and bimanual, movements of the shoulder joint with gravity compensation.
The identified set allows one to treat the upper limb globally (from the shoulder to the hand), and to arrange the rehabilitation area so that one physiotherapist can treat more than one patient at once.

3.2. Feasibility Pilot Study

Baseline comparison showed that the two groups were similar but the Ashworth scores were higher in the CG than in the RG (p = 0.004, p = 0.025, and p = 0.017 for shoulder, elbow, and wrist, respectively) and the hand sub-score of the Motricity Index (p = 0.038). Within-group analysis showed that CG patients improved in the Ashworth scores (p = 0.046 for all the investigated segments). RG patients improved their score in Barthel Index (p = 0.001), Deambulation Index (p = 0.009), dynamometer (affected side: p = 0.021), pinch test (affected side: p = 0.034; not affected side: 0.034), Fugl–Meyer (total score: p = 0.006; volitional movement mixing synergies: 0.034), and in a subscore of the Motricity Index (elbow: p = 0.034). Between-group analysis showed that higher changes (meaning higher improvement) were detected in the Barthel Index (p = 0.002), Deambulation Index (p = 0.019), and in the Fugl–Meyer (total score: p = 0.046; hand: p = 0.046) in the RG (Table 4). No dropouts and no adverse events were recorded. With respect to patient satisfaction, the robotic treatment was accepted by all patients, as showed by a score of 8 ± 1 in the VAS scale. Finally, according to the physiotherapists (n = 14) involved in the robotic rehabilitation with the set, its usability was rated with a mean score of 78.9 (range 57.5–95) on the SUS scale, indicating a high degree of acceptance (between “good” and “excellent” on the overall scale).

4. Discussion

In recent years, there has been a significant increase in the number of available robotic systems for rehabilitation of the upper limb. Until 2014, 120 upper limb robotic systems were identified in a review [20]. However, while numerous studies on the efficacy of these systems are available [6], there is a lack of scientific data on the usability [21], efficiency, and applicability in clinical practice [22,23]. Indeed, even when an intervention has good evidence of benefits, the application of evidence-based practice for stroke can still raise challenges [24].
This problem is of particular importance when dealing with rehabilitation treatments based on technology and robotics. Therefore, clinicians specialized in the rehabilitation field should have tools to identify the appropriate type of technological system, according to the specific rehabilitation aims.
To the best of our knowledge, a standardized and detailed model to evaluate and compare these technological devices is not described in the scientific literature. Therefore, moving from the above-mentioned considerations, in this paper we suggest a methodological approach to choose a set of devices, both electromechanical and robotic, based on the rehabilitation aims, followed by a pilot study to evaluate the feasibility of the identified set of devices in clinical practice.
A multidisciplinary team from our institution discussed the clinical needs of upper limb rehabilitation; namely, the need to perform an intensive and a comprehensive treatment of the arm (including shoulder, elbow, wrist, and hand). Then, it analyzed some robotic solutions available commercially, in order to generate a prioritized list of devices of potential interest to be acquired by our institution (considering the rehabilitation aims discussed herein). A specific form was created to standardize the description of the robotic devices, and therefore, to allow an easier comparison between them. The analyzed features included general information, the system characteristics, the accessibility for wheelchair users, safety issues, literature data, costs of purchase and maintenance, an indication of purchasing priority by physicians and/or physiotherapists, and efficiency parameters. Ultimately, four devices were selected for intensive and comprehensive upper limb rehabilitation.
Our main goal was to implement, in a sustainable way, the robotic rehabilitation in our rehabilitation department, and therefore, we gave priority to the efficiency level (weight = 4). In this way, we were able to select a set of robots that: had a reduced set-up time, were accessible for wheelchair users, were easy to be autonomously used by the patient, were suitable for group therapy, and required a low number of physiotherapists to be involved in the treatment (i.e., more than one patient can be treated with the supervision of one physical therapist). Moreover, we had privileged robots able to provide outcome measures, in order to easily quantify the rehabilitation path of the patient and to modify it, accordingly. Finally, we selected a set of devices able to treat patients with different levels of upper limb impairment, from severe to mild. In the second phase, to support our institution in planning the most convenient investment strategy aimed to improve the clinical quality and management efficiency in seven of the 29 centers of our institution, a feasibility pilot study was performed. The purpose of this pilot clinical study was to verify the usability and applicability of these systems, according to organizational model of our institution, and to investigate the effects of the robotic rehabilitation (using, precisely, a set of different devices), before extending the set in other centers of our Institution.
The pilot study compared patients recruited in two FDG centers (one equipped with the set of devices and the other not equipped with it) and showed interesting results. Specifically, after rehabilitation, only the robotic group showed significant improvements in clinical functions of the upper limb (mainly in the elbow and wrist–hand, measured by the Fugl–Meyer and the Motricity Index) and instrumental outcome of the hand (obtained by dynamometer for the strength of the handgrip and with a pinch gauge for the fingered pinch). These results are consistent with those available in literature (see, for example, the recent meta-analysis by Mehrholz et al. [6] or the review by Bertani et al. [25]). We observed a significant reduction of the upper limb spasticity after treatment only in the control group. These data can be explained because of the different distribution of spasticity between the two groups (higher in the CG) at baseline. The pilot study allowed us to test the effects of the rehabilitation using a set of robotic systems, and therefore, the ability of our methodology to identify an effective set from a clinical perspective and rehabilitation aims. Note that the comparison between robotic and conventional treatment in this pilot study aimed to obtain preliminary clinical information before the introduction of the set in other centers of the Foundation. In addition, the pilot study showed that the treatment was well accepted by the patients; moreover, according to the practitioners (i.e., the physiotherapists involved in the robotic rehabilitation), the use of the identified set did not demonstrate major usability issues, and therefore, its degree of acceptance was high.
The choice to identify a set, rather than a single device, allowed us to treat patients with a high level of technology and with a global approach (with different devices acting on different joints), optimizing the available resources (one therapist treating three patients at the same time) [26,27,28]. Due to the high cost of devices, it is important to select devices that are economically viable, to be used in clinical practice in a sustainable way. It is also worth noting that the selected devices are not noisy, and they did not require specific room features to be installed, although these characteristics were not explicitly evaluated by the form. We will consider both aspects in a future updated version of the form, together with the overall dimensions of the device. In fact, these features can be crucial, especially when the aim is to select a set of devices to be installed in a single room, with one physiotherapist supervising more than one patient.
The feasibility study, more than to evaluate the (expected) clinical effects of robotics, was aimed to investigate the possibility of using the set in clinical practice, an indispensable prerequisite for the implementation of robotics in routine care (applicability) [24]. In that regard, a limitation is the lack of a longitudinal analysis of the cost-effectiveness of the implemented solution [29]. A further limitation of this study is that it was carried out in only one center of our Institution (the coordination center of the robotic rehabilitation group); another is the low statistical power of the pilot study. However, it is worth noting that this pilot study has been followed by the introduction of the set in seven other centers of our Institution; and by a multicenter RCT, aimed to evaluate the efficacy of the upper limb robotic rehabilitation, compared to conventional treatment [19], which confirms the feasibility and the usability of the selected set. Today, the robotic set is routinely used in these centers in clinical practice.
In our opinion, the methodology described above can be used as a model to select robotic devices suitable for different rehabilitation settings and aims (according to physician’s priority), using the same form but modifying the weight of each parameter. Moreover, the proposed approach, with very limited changes to the form, could be used to evaluate and identify devices; e.g., for walking or balance rehabilitation. Future studies should be performed to confirm these hypotheses.

5. Conclusions

With this work, we propose a methodological model to choose the best robotic or technological devices for rehabilitation, based on needs and aims in the clinical practice.

Supplementary Materials

The following are available online at

Author Contributions

Conceptualization, I.A., D.C., and F.G.; data curation, M.G., V.G., and F.V.; formal analysis, M.G., V.G., and F.V.; investigation, A.C. and C.P.; supervision, I.A., L.P., and F.G.; writing—original draft, I.A., A.C., and M.G.; writing—review and editing, V.G., C.P., D.C., F.V., L.P., and F.G.


This research received no external funding.


We would like to thank Mauro Ricca, Silvia Galeri, Angelo Montesano, Manuela Diverio, Ilaria Carpinella, Maurizio Ferrarin, Johanna Jonsdottir, and Guido Pasquini for their precious help in the identification of the set.

Conflicts of Interest

The authors declare no conflict of interest.


  1. Truelsen, T.; Piechowski-Jóźwiak, B.; Bonita, R.; Mathers, C.; Bogousslavsky, J.; Boysen, G. Stroke incidence and prevalence in Europe: A review of available data. Eur. J. Neurol. 2006, 13, 581–598. [Google Scholar] [CrossRef] [PubMed]
  2. Gowland, C. Recovery of motor function following stroke: Profile and predictors. Physiother. Can. 1982, 34, 77–84. [Google Scholar] [CrossRef]
  3. Kwakkel, G.; Wagenaar, R.C.; Kollen, B.J.; Lankhorst, G.J. Predicting disability in stroke—A critical review of the literature. Age Ageing 1996, 25, 479–489. [Google Scholar] [CrossRef] [PubMed]
  4. Norouzi-Gheidari, N.; Archambault, P.S.; Fung, J. Effects of robot-assisted therapy on stroke rehabilitation in upper limbs: Systematic review and meta-analysis of the literature. J. Rehabil. Res. Dev. 2012, 49, 479–496. [Google Scholar] [CrossRef] [PubMed]
  5. Pollock, A.; Farmer, S.E.; Brady, M.C.; Langhorne, P.; Mead, G.E.; Mehrholz, J.; van Wijck, F. Interventions for improving upper limb function after stroke. Cochrane Database Syst. Rev. 2014, 11, CD010820. [Google Scholar] [CrossRef] [PubMed]
  6. Mehrholz, J.; Pohl, M.; Platz, T.; Kugler, J.; Elsner, B. Electromechanical and robot-assisted arm training for improving activities of daily living, arm function, and arm muscle strength after stroke. Cochrane Database Syst. Rev. 2018, 9, CD006876. [Google Scholar] [CrossRef] [PubMed]
  7. Calabrò, R.S.; Naro, A.; Russo, M.; Bramanti, P.; Carioti, L.; Balletta, T.; Buda, A.; Manuli, A.; Filoni, S.; Bramanti, A. Shaping neuroplasticity by using powered exoskeletons in patients with stroke: A randomized clinical trial. J. Neuroeng. Rehabil. 2018, 15, 35. [Google Scholar] [CrossRef]
  8. Calabrò, R.S.; Russo, M.; Naro, A.; Milardi, D.; Balletta, T.; Leo, A.; Filoni, S.; Bramanti, P. Who May Benefit From Armeo Power Treatment? A Neurophysiological Approach to Predict Neurorehabilitation Outcomes. PM&R 2016, 8, 971–978. [Google Scholar]
  9. Calabrò, R.S.; Cacciola, A.; Bertè, F.; Manuli, A.; Leo, A.; Bramanti, A.; Naro, A.; Milardi, D.; Bramanti, P. Robotic gait rehabilitation and substitution devices in neurological disorders: Where are we now? Neurol. Sci. 2016, 37, 503–514. [Google Scholar] [CrossRef]
  10. Molteni, F.; Gasperini, G.; Cannaviello, G.; Guanziroli, E. Exoskeleton and End-Effector Robots for Upper and Lower Limbs Rehabilitation: Narrative Review. PM&R 2018, 10, S174–S188. [Google Scholar]
  11. Fugl-Meyer, A.R.; Jääskö, L.; Leyman, I.; Olsson, S.; Steglind, S. The post-stroke hemiplegic patient. 1. A method for evaluation of physical performance. Scand. J. Rehabil. Med. 1975, 7, 13–31. [Google Scholar] [PubMed]
  12. Demeurisse, G.; Demol, O.; Robaye, E. Motor evaluation in vascular hemiplegia. Eur. Neurol. 1980, 19, 382–389. [Google Scholar] [CrossRef] [PubMed]
  13. Bohannon, R.W.; Smith, M.B. Interrater reliability of a modified Ashworth scale of muscle spasticity. Phys. Ther. 1987, 67, 206–207. [Google Scholar] [CrossRef] [PubMed]
  14. Aprile, I.; Tonali, P.; Caliandro, P.; Pazzaglia, C.; Foschini, M.; Di Stasio, E.; Mondelli, M.; Padua, L.; Italian CTS and other entrapments Study Group. Italian multicentre study of peroneal mononeuropathy: Multiperspective follow-up. Neurol. Sci. 2009, 30, 37–44. [Google Scholar] [CrossRef] [PubMed]
  15. Shah, S.; Vanclay, F.; Cooper, B. Improving the sensitivity of the Barthel Index for stroke rehabilitation. J. Clin. Epidemiol. 1989, 42, 703–709. [Google Scholar] [CrossRef]
  16. Dixon, J.S.; Bird, H.A. Reproducibility along a 10 cm vertical visual analogue scale. Annu. Rheum. Dis. 1981, 40, 87–89. [Google Scholar] [CrossRef] [PubMed]
  17. Brooke, J. SUS-A quick and dirty usability scale. Usability Eval. Ind. 1996, 189, 4–7. [Google Scholar]
  18. Radder, B.; Prange-Lasonder, G.B.; Kottink, A.I.R.; Holmberg, J.; Sletta, K.; van Dijk, M.; Meyer, T.; Melendez-Calderon, A.; Buurke, J.H.; Rietman, J.S. Home rehabilitation supported by a wearable soft-robotic device for improving hand function in older adults: A pilot randomized controlled trial. PLoS ONE 2019, 14, e0220544. [Google Scholar] [CrossRef]
  19. Aprile, I.; Germanotta, M.; Cruciani, A.; Loreti, S.; Pecchioli, C.; Cecchi, F.; Montesano, A.; Galeri, S.; Diverio, M.; Falsini, C.; et al. Upper Limb Robotic Rehabilitation after Stroke: A Multicenter, Randomized Clinical Trial. J. Neurol. Phys. Ther. (in press).
  20. Maciejasz, P.; Eschweiler, J.; Gerlach-Hahn, K.; Jansen-Troy, A.; Leonhardt, S. A survey on robotic devices for upper limb rehabilitation. J. Neuroeng. Rehabil. 2014, 11, 3. [Google Scholar] [CrossRef]
  21. Jakob, I.; Kollreider, A.; Germanotta, M.; Benetti, F.; Cruciani, A.; Luca, P.; Aprile, I. Robotic and Sensor Technology for Upper Limb Rehabilitation. PM&R 2018, 10, S189–S197. [Google Scholar]
  22. Langhorne, P.; Coupar, F.; Pollock, A. Motor recovery after stroke: A systematic review. Lancet Neurol. 2009, 8, 741–754. [Google Scholar] [CrossRef]
  23. Kaleshtari, M.H.; Ciobanu, I.; Seiciu, P.L.; Marin, A.G.; Berteanu, M. Towards a Model of Rehabilitation Technology Acceptance and Usability. Int. J. Soc. Sci. Humanit. 2016, 6, 612. [Google Scholar] [CrossRef]
  24. Langhorne, P.; Sandercock, P.; Prasad, K. Evidence-based practice for stroke. Lancet Neurol. 2009, 8, 308–309. [Google Scholar] [CrossRef]
  25. Bertani, R.; Melegari, C.; De Cola, M.C.; Bramanti, A.; Bramanti, P.; Calabrò, R.S. Effects of robot-assisted upper limb rehabilitation in stroke patients: A systematic review with meta-analysis. Neurol. Sci. 2017, 38, 1561–1569. [Google Scholar] [CrossRef]
  26. Buschfort, R.; Brocke, J.; Heß, A.; Werner, C.; Waldner, A.; Hesse, S. The arm studio to intensify the upper limb rehabilitation after stroke: Concept, acceptance, utilization and preliminary clinical results. J. Rehabil. Med. 2010, 42, 310–314. [Google Scholar] [CrossRef] [PubMed]
  27. Hesse, S.; Heß, A.; Werner, C.C.; Kabbert, N.; Buschfort, R. Effect on arm function and cost of robot-assisted group therapy in subacute patients with stroke and a moderately to severely affected arm: A randomized controlled trial. Clin. Rehabil. 2014, 28, 637–647. [Google Scholar] [CrossRef] [PubMed]
  28. Bustamante Valles, K.; Montes, S.; de Jesus Madrigal, M.; Burciaga, A.; Martínez, M.E.; Johnson, M.J. Technology-assisted stroke rehabilitation in Mexico: A pilot randomized trial comparing traditional therapy to circuit training in a Robot/technology-assisted therapy gym. J. Neuroeng. Rehabil. 2016, 13, 83. [Google Scholar] [CrossRef] [PubMed]
  29. Wagner, T.H.; Lo, A.C.; Peduzzi, P.; Bravata, D.M.; Huang, G.D.; Krebs, H.I.; Ringer, R.J.; Federman, D.G.; Richards, L.G.; Haselkorn, J.K.; et al. An economic analysis of robot-assisted therapy for long-term upper-limb impairment after stroke. Stroke 2011, 42, 2630–2632. [Google Scholar] [CrossRef]
Figure 1. Steps of the study. First step: a multidisciplinary team identified a set of technological and robotic devices to treat the upper limb. Second step: 30 stroke patients were enrolled and treated either with the identified set of four devices (16 patients), or with a conventional treatment (14 patients).
Figure 1. Steps of the study. First step: a multidisciplinary team identified a set of technological and robotic devices to treat the upper limb. Second step: 30 stroke patients were enrolled and treated either with the identified set of four devices (16 patients), or with a conventional treatment (14 patients).
Applsci 09 03920 g001
Table 1. Technological systems evaluated. Price ranges: low < 40.000 €; medium, between 40.000 € and 100.000 €; high > 100.000 €.
Table 1. Technological systems evaluated. Price ranges: low < 40.000 €; medium, between 40.000 € and 100.000 €; high > 100.000 €.
Commercial NameType of SystemTreated Segment(s)Type of MovementDescription and Assisted MovementsCertificationEvaluation PeriodPrice Range
Gloreha—Idrogenet srl., Lumezzane (BS), ItalyExoskeletonHandSpatialActuated glove for fingers flexion-extensionMedical Device June–July 2015Low
Armeo Power—Hocoma AG, Volketswil, SwitzerlandExoskeletonUpper limb and Hand (grip only)SpatialActuated exoskeleton with 6 degrees of freedom for:
- shoulder flex/ext, horizontal abduction/adduction, and internal/external rotation;
- elbow flex/ext
- forearm prono/supination;
- wrist flex/ext
Medical Device June 2015High
Amadeo—Tyromotion GmbH, Graz, AustriaEnd-effectorHandLinearDevice with 5 degrees of freedom. Sliders to be attached to fingertips for fingers flexion-extensionMedical Device June 2015Medium
Motore—Humanware srl, Pisa, ItalyEnd-effectorUpper limbPlanar2 Degrees of freedom robot with a handgrip moving on wheels on top of a desk for shoulder horizontal abduction/adduction, and elbow flex/extMedical Device January–June 2015Medium
Physioassistant “braccio di ferro”—Celin srl, Follo (SP), ItalyEnd-effectorUpper limbPlanar2 Degrees of freedom robotic arm with handgrip for shoulder horizontal abduction/adduction, and elbow flex/extPrototype (not yet certified as Medical Device)June 2015Price not available (prototype)
ReoGo—Motorika Inc., Mount Laurel (NJ), USAEnd-effectorUpper limbSpatialRobotic arm with 6 degrees of freedom, with forearm-hand support allowing movements of elbow and shoulder.Medical DeviceJune 2015Medium
Diego—Tyromotion GmbH, Graz, AustriaElectro-mechanical unweighting systemUpper limbSpatialMotorized slings to be applied at elbow and wrist level for upper limb unweighting. Allows movements of shoulder, elbow and wristMedical Device June 2015Medium
Armeo Spring—Hocoma AG, Volketswil, SwitzerlandSpring based unweighting systemUpper limbSpatialSpring based exoskeleton with six degrees of freedomfor upper limb unweighting. Allows movements of shoulder and elbowMedical DeviceJune 2015Medium
Pablo—Tyromotion GmbH, Graz, AustriaSensorized technological systemUpper limbSpatialSensorized handgip (inertial measurement unit) able to record the hand movements in the space. No assistance to movement provided.Medical Device June 2015Low
Ultra—Humanware srl, Pisa, ItalySensorized technological systemUpper limbSpatialArticulated arm with seven degrees of freedom able to track position and speed of the hand during movements in 3D spaceMedical Device June 2015Low
Table 2. Conversion of text-based values into quantitative values.
Table 2. Conversion of text-based values into quantitative values.
Item in the Evaluation FormTransformation of Text Based Values into Quantitative Values
Product maturityPrototype0
Commercial product1
Provides outcome measuresYes1
Provides normative valuesYes1
Possible safety issuesYes0
Literature supporting efficacyNot-published data0
Conference proceedings/not peer reviewed journals1
Scientific paper on peer reviewed journals2
Purchase priority according to compilerLow1
Confidence level of evaluatorLow0.5
Maximum level of impairmentLow1
Customizable exercisesYes1.5
Autonomous use by the patientThe patient can use the device in autonomy1
The patient can use the device under physiotherapist supervision1
The physiotherapist must control continuously the patient’s robot training0
Possibility of using the solution in group therapiesYes1
Number of clinicians involved in the treatment11
Table 3. Weights used in the formula for calculating the score of a robotic solution.
Table 3. Weights used in the formula for calculating the score of a robotic solution.
ParameterWeight in the Ranking Formula
Provides outcome measures3
Provides normative values1
Safety issues1
Literature supporting efficacy3
Purchase priority3
Level of impairment2
Customizable exercises2
Efficiency level4
Table 4. Clinical scales values (medians and ranges) obtained at T0 and T1, for both the robotic and the conventional group, together with the results of the statistical analysis. Bold values denote statistical significance at the p < 0.05 level.
Table 4. Clinical scales values (medians and ranges) obtained at T0 and T1, for both the robotic and the conventional group, together with the results of the statistical analysis. Bold values denote statistical significance at the p < 0.05 level.
Conventional Group (n = 14)Robotic Group (n = 16)p
(between Groups)
(within Group)
(within Group)
Barthel Index51(8–84)51(12–81)0.07444(8–90)54.5(21–94)0.0010.002
Deambulation Index2(0–5)2(0–5)11(0–5)2(0–7)0.0090.019
Dynamometer (affected side)3(0–12)8(0–10)0.1130(0–16)2(0–20)0.0210.667
Dynamometer (not affected side)14(2–38)12(2–38)0.6624(4–46)25(4–50)0.9180.918
Pinch Test (affected side)2(0–3)2(0–3)0.1570(0–6)0.5(0–7)0.0340.423
Pinch Test (not affected side)3(2–7)3(3–7)0.1074.5(2–10)5(3–12)0.0340.854
 Flexor synergy2(0–12)4(0–12)0.0633(0–12)5.5(0–12)0.0700.400
 Extensor synergy2(0–6)2(0–6)0.1571.5(0–6)2.5(0–6)0.4570.697
 Volitional movement mixing synergies1(0–6)3(0–6)0.1570.5(0–6)1.5(0–6)0.0340.355
 Volitional movement with little or no synergy1(0–5)2(0–5)0.1571(0–5)1.5(0–6)0.1490.473
Back to TopTop