Next Article in Journal
Comprehensive Review of Open-Source Fundus Image Databases for Diabetic Retinopathy Diagnosis
Previous Article in Journal
Every Step Counts—How Can We Accurately Count Steps with Wearable Sensors During Activities of Daily Living in Individuals with Neurological Conditions?
Previous Article in Special Issue
A Survey on Design and Control Methodologies of High- Torque-Density Joints for Compliant Lower-Limb Exoskeleton
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Robot-Assisted Mirror Rehabilitation for Post-Stroke Upper Limbs: A Personalized Control Strategy

1
Sino-German College of Intelligent Manufacturing, Shenzhen Technology University, Shenzhen 518118, China
2
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
*
Author to whom correspondence should be addressed.
Sensors 2025, 25(18), 5659; https://doi.org/10.3390/s25185659
Submission received: 11 July 2025 / Revised: 31 August 2025 / Accepted: 2 September 2025 / Published: 11 September 2025

Abstract

To address the limitations of traditional mirror therapy in stroke rehabilitation, such as rigid movement mapping and insufficient personalization, this study proposes a robot-assisted mirror rehabilitation framework integrating multimodal biofeedback. By synchronously capturing kinematic features of the unaffected upper limb and surface electromyography (sEMG) signals from the affected limb, a dual-modal feature fusion network based on a cross-attention mechanism is developed. This network dynamically generates a time-varying mirror ratio coefficient λ , which is incorporated into the exoskeleton’s admittance control loop. Combining a trajectory generation algorithm based on dynamic movement primitives (DMPs) with a compliant control strategy incorporating dynamic constraints, the system achieves personalized rehabilitation trajectory planning and safe interaction. Experimental results demonstrate that, compared to traditional mirror therapy, the proposed system exhibits superior performance in bilateral trajectory covariance metrics, the mirror symmetry index, and muscle activation levels.

1. Introduction

Stroke is a debilitating neurological disorder that often leads to hemiplegia—paralysis or severe weakness on one side of the body—resulting in significant motor impairments. Compared to healthy individuals, stroke patients typically exhibit reduced grip strength, slower walking speed, and decreased knee joint strength [1]. Annually, approximately 2.41 billion people could benefit from rehabilitation during illness or injury [2]. Upper-limb rehabilitation is a critical domain in stroke recovery due to its profound impact on functional restoration and quality of life for individuals with neurological damage. Effective upper-limb rehabilitation significantly enhances motor function, muscle strength, and the capacity to perform activities of daily living (ADLs) [3].
While traditional unilateral ADL training provides therapeutic benefits for stroke patients, the motor skills acquired through unilateral training often fail to generalize effectively to bilateral limb function [4]. Bilateral training, however, activates the undamaged hemisphere to increase activation in the damaged hemisphere when both arms share a common movement intention, promoting neuroplasticity and motor control in the affected limb [5]. Therefore, bilateral training is essential for stroke rehabilitation.
Mirror therapy (MT) is a relatively novel stroke intervention focusing on movement of the unaffected limb while receiving mirrored visual feedback of that movement [6]. It primarily leverages motor imagery, where the brain’s motor cortex activates to some extent when imagining limb movement [7]. However, traditional MT relies predominantly on movement of the healthy limb and often neglects the residual motor capacity of the affected arm. This results in several limitations: it depends on symmetric movement reflexes and is largely ineffective for patients with severe impairments who are unable to move the affected limb [8,9]. Furthermore, since the affected limb does not actually move, the effectiveness in restoring real motor function may be reduced [10].
Robot-assisted mirror therapy represents an advanced modality of rehabilitation, particularly suitable for hemiplegic patients [11,12,13]. Bilateral robotic systems in this category facilitate training through customized trajectories involving coordinated movements of both the affected and unaffected limbs. For instance, the robot-assisted BFIAMT (Bilateral Force-Induced Arm Movement Trainer) [14] enables users to manipulate two conical handles symmetrically and smoothly via push–pull forces applied by both hands. This bilateral approach is compatible with mirror therapy, potentially enhancing recovery. The Mirror Movement Enabler (MIME) [15] employs a “leader–follower” mode, continuously guiding the paretic limb to mirror the position of the contralateral limb, with the movement speed and range controlled by the patient. Similarly, the EXO-UL7 [16] adopts a leader–follower strategy but provides only partial assistance, meaning that the affected limb is not forced into an exact mirror position. With robotic assistance, patients engaged in therapeutic games in a virtual environment and demonstrated significant post-treatment improvement [17,18]. These findings suggest that bilateral robots with leader–follower modes enable more effective training movements.
While existing robotic training paradigms help patients utilize residual motor capacity, they often lack contextually relevant, task-based assistance mimicking real-life ADLs, such as picking up a cup or opening a drawer. Engagement in ADL-related tasks has been shown to improve functional outcomes, foster independence, and boost rehabilitation confidence in stroke patients [19,20]. Wang et al. proposed a trajectory capture and tracking scheme leveraging Kinect sensors for upper-limb robot-assisted rehabilitation [21]. Liu et al. employed a combined approach integrating Virtual Reality Mirror Therapy (VRMT) with robot-assisted therapy for upper-limb rehabilitation [22]. Wang et al. developed a method that automatically generates posture trajectories for the affected limb by measuring limb orientations via IMUs, based on the concept of mirror therapy [23]. Therefore, enabling semi-autonomous, ADL task-guided rehabilitation training with robotic assistance is considered highly beneficial. Upper-limb exoskeletons can facilitate the movement of the affected limb, allowing daily ADLs to be transformed into coordinated bilateral training tasks aimed at restoring basic motor functions and establishing a solid foundation for recovery.
This paper proposes a task-guided bilateral exoskeleton mirror rehabilitation framework based on a cross-attention mechanism [24], which establishes an attention mechanism between sources of data, aiming to deliver precise and personalized interventions for early-stage stroke rehabilitation through multimodal biofeedback. Figure 1 shows the schematic diagram of the protocol for the upper limb’s exoskeleton. The proposed framework establishes a “healthy-side guidance–affected-side adaptation” bidirectional synergy mechanism:
  • The unaffected limb’s exoskeleton captures kinematic features in real time.
  • These kinematic features are fused with the temporal activation patterns of sEMG signals from the affected limb using a cross-attention network.
  • The network dynamically generates synergistic control parameters for mirror rehabilitation tasks.
  • The DMP algorithm decouples the spatiotemporal features of the healthy limb’s trajectory to generate an adaptable rehabilitation trajectory for the affected limb.
  • A compliant control strategy under dynamic constraints is designed to accommodate individual differences in motor dysfunction, enabling dynamic compensation for abnormal postures while ensuring that joint torques remain within safe limits.
Figure 1. Schematic diagram of protocol for upper limb’s exoskeleton.
Figure 1. Schematic diagram of protocol for upper limb’s exoskeleton.
Sensors 25 05659 g001

2. Materials and Methods

A mirror plane is defined as the sagittal plane P : x = 0 (the y-z plane). The mapping from the unaffected side motion y h ( t ) to the affected side is given by the following equation:
y p mirror ( t ) = 1 0 0 0 1 0 0 0 1 y h ( t )

2.1. DMPs

DMPs are a representative method for simulating robot motion trajectories through imitation learning [25,26]. For robotic mirror therapy, the imitation characteristics of DMPs precisely meet the requirement for the robot to imitate the healthy limb (HL) behavior. Furthermore, DMPs have been widely used in human–robot coupling systems. Therefore, a combined scheme based on DMP-based trajectory generation is expected to improve therapeutic efficacy.
An adaptive DMP-based controller was developed to facilitate assisted motion of the exoskeleton, enabling accurate prediction and smooth synchronization of the robot’s motion trajectory. This achieves imitation of the master arm’s motion patterns by the follower arm, aligning with the requirements of mirror therapy. Although these methods achieve satisfactory performance in assisting human motion to complete prescribed tasks, they cannot accommodate patients’ abnormal postures or personalized needs.
Simple motion trajectories can be modeled using DMPs. Robots can learn manipulation skills from human demonstrations and extend human-like skills. In this way, human demonstrations can naturally and intuitively convey desired trajectory curves to the robot. Similar to trajectory planning, directly replicating the HL’s stiffness to the robot for Impaired Limb (IL) rehabilitation is not beneficial [27]. Ideally, both the robot’s trajectory and stiffness could be simultaneously optimized in this scheme. However, current research efforts are limited to demonstrating its feasibility in robotic mirror therapy [28].

2.2. Dynamic Mirror Ratio Controller

Traditional mirror therapy suffers from the limitations of a static coupling mechanism during movement mapping, primarily characterized by fixed mapping intensity and an inability to adaptively adjust based on the patient’s real-time motor capacity. To overcome this technical bottleneck, this paper innovatively proposes a dynamic mirror ratio control method. This method leverages a cross-attention network to compute a time-varying mirror ratio coefficient λ ( t ) [ 0 , 1 ] in real time and deeply couples it into the exoskeleton’s impedance control loop. This coefficient dynamically quantifies the intensity of the mapping from the motion of the unaffected limb to the training of the affected limb.
K d ( t ) = K b a s e · 1 λ ( t )
B d ( t ) = B b a s e · 1 + α λ ( t ) ( α = 0.5 )
The above formula indicates that, when λ increases,
  • K d (stiffness) decreases, requiring the patient to actively exert force to overcome positional deviations, thereby promoting neuroplasticity.
  • Simultaneously, B d (damping) increases, suppressing the exoskeleton’s motion speed to prevent tremors or uncontrolled acceleration caused by insufficient muscle strength.

2.2.1. Dual-Stream Encoding Architecture

To capture the specificity of heterogeneous data modalities, we employ a dual-stream encoding architecture. Human kinematic features (e.g., position, velocity) exhibit structured, low-dimensional, and high-signal-to-noise-ratio characteristics. For instance, joint angle sequences directly reflect the geometric trajectories of limb movement, with smooth variations adhering to mechanical dynamics. In contrast, sEMG signals manifest as non-stationary high-dimensional bioelectric signals prone to interference [29,30]. Key challenges include burstiness (e.g., sharp signal spikes at movement initiation) and signal attenuation due to muscle fatigue [31]. Directly mixing inputs into a single encoder would cause the following:
  • Misalignment between continuous kinematics and impulsive sEMG features in latent space;
  • High-frequency sEMG noise contaminating kinematic representations, degrading the trajectory and predictions [32,33];
  • Redundant parameter allocation across modalities, increasing training complexity.
Specifically, we process the user’s unaffected limb kinematic data and affected limb physiological signals separately to avoid interference between heterogeneous data modalities. These are termed the kinematic encoding stream (KineEncoder) and the physiological signal encoding stream (BioEncoder).
The kinematic data of the unaffected limb mainly includes joint angles q H ( t ) R 5 and joint velocities q ˙ H ( t ) R 5 . These are normalized to [ 1 , 1 ] respectively, and then concatenated into X h ( t ) R 10 . Since the self-attention mechanism of transformers [34] inherently lacks awareness of sequence order, positional encoding is used to inject position information into the sequence data. A four-layer transformer is adopted for the temporal modeling of motion information.
For an input sequence X R T × d , the output of the l-th layer is calculated as follows:
Q l = X ( l 1 ) W Q l , K l = X ( l 1 ) W K l , V l = X ( l 1 ) W V l
Attn l = Softmax Q l ( K l ) d V l
X mid l = LayerNorm X ( l 1 ) + Attn l
X l = LayerNorm X mid l + FFN ( X mid l )
The physiological signals primarily consist of eight-channel sEMG signals sEMG(t), which are generated during muscle contraction. Their time domain characteristics reflect muscle activation states and fatigue features. A bandpass filter is applied to remove noise from the raw signals. Subsequently, full-wave rectification and low-pass filtering are used to extract the signal envelope. Finally, normalization is performed:
s norm ( t ) = s ( t ) μ baseline σ baseline
where μ baseline and σ baseline denote the mean and standard deviation of baseline resting-state signals.
In a biosignal-encoding pipeline that uses the local receptive fields and weight-sharing properties of the Convolutional Neural Network (CNN) [35], two convolutional layers extract transient amplitude variations and root mean square (RMS) changes to identify the onset of muscle activation, fatigue levels, and other physiological states. Given the significant temporal dependencies in muscle activity (for example, contraction–relaxation cycles and cumulative fatigue effects), a bidirectional Gated Recurrent Unit (GRU) is adopted for temporal modeling [36].
The forward GRU computation at timestep t is as follows:
z t = σ ( W z · [ h t 1 , x t ] )
r t = σ ( W r · [ h t 1 , x t ] )
h t = tanh ( W · [ r t h t 1 , x t ] )
h t = ( 1 z t ) h t 1 + z t h t
The backward GRU processes the sequence in reverse order. The final output is the concatenation of bidirectional states:
H bi = [ H H ]

2.2.2. Cross-Modal Attention Fusion Mechanism

Building upon the dual-stream encoding architecture, we introduce a cross-modal attention mechanism to capture latent relationships between kinematic and physiological signals. This mechanism enables weighted fusion across modalities, achieving feature-level complementarity and enhancement [37,38]. It accurately reflects the real-time state of the affected limb, supporting dynamic mapping adjustments.
The kinematic features H h R T × 256 from the kinematic encoder, and the sEMG features H p R T × 128 from the biological encoder. The cross-attention module generates fused features that align the user’s movement intent with safe exoskeleton operation (avoiding hazardous joint angles/velocities):
H fusion = CrossAttn E h ( q h ) , E p ( sEMG p )
The dynamic coupling coefficient is then computed via a fully connected layer:
λ ( t ) = σ W λ · MLP ( H fusion )

2.3. Control System and Algorithm

The dynamics of the exoskeleton mechanism follow the equation
M d ( q ¨ q ¨ d ) + D d ( q ˙ q ˙ d ) + K d ( q q d ) = τ e x t
Parameters:
M d , D d , K d : The desired inertia, damping, and stiffness matrices;
q d , q ˙ d , q ¨ d : The joint angle, velocity, and acceleration generated by DMPs;
τ e x t : The interaction torque between the user and environment.
For upper-limb rehabilitation tasks, the target trajectory is defined as a smooth motion curve in joint space. A rehabilitation action comprises N key points, with the end-effector trajectory expressed as
T = { P t R 3 t = 1 , , T }
P t = [ x t , y t , z t ] T
P t : The position of the end effector at time t; x t , y t , z t : 3D Cartesian coordinates of the end effector.

2.3.1. Trajectory Planning

DMPs can generate adjustable trajectories for one side of the exoskeleton based on the trajectory of the other side, allowing personalized trajectory generation to adapt to individual differences. DMPs can also learn the dynamic characteristics of an action (including velocity and acceleration in addition to position). During exoskeleton mirror rehabilitation, trajectory planning is categorized into two types.
  • Bimanual trajectory planning based on human symmetry plane: This transfers the unaffected limb’s motion to the affected limb through mirroring. The exoskeleton drives the affected limb to perform symmetric movements relative to the unaffected limb.
  • Bimanual asymmetric task trajectory planning: This engages the affected limb’s motor participation for better generalization to daily activities.
In early rehabilitation stages, the affected limb has limited mobility [39] and requires guidance from the unaffected limb [40]. The unaffected limb drives its exoskeleton to generate appropriate trajectories for the affected exoskeleton, preventing potential harm. DMPs generate trajectories for asymmetric tasks, focusing on discrete movements for robotic trajectory planning.
τ 2 y ¨ = α y ( β y ( g y ) τ y ˙ ) + f
τ : Time constant;
α y , β y : Constants;
g: Target position;
f: Nonlinear shaping function.
The nonlinear function is shown as
f ( t ) = i = 1 N Ψ i ( t ) w i i = 1 N Ψ i ( t )
Ψ i : Basis functions ;
w i : Corresponding weights ;
N : Number of basis functions .
Discrete DMP formulation:
f ( x , g ) = i = 1 N Ψ i ( x ) w i i = 1 N Ψ i ( x ) x ( g y 0 )
Constraint:
τ x ˙ = α x x
α x : Constant .
Gaussian basis functions:
Ψ i ( x ) = exp h i ( x c i ) 2 = exp 1 2 σ i 2 ( x c i ) 2
σ i : Gaussian width ;
c i : Center point .
The exoskeleton trajectory generation principles are as follows:
  • Minimize the position tracking error between the ideal and actual trajectories;
  • Ensure smooth joint motor angles, velocities, and accelerations to prevent secondary injury;
  • Adapt to individual anatomical differences and varying rehabilitation-stage mobility ranges.

2.3.2. Algorithm

The motion trajectory of the unaffected upper limb is processed by a transformer encoder to extract multi-joint synergistic movement features (see Figure 2). This model employs a four-layer self-attention mechanism to capture long-term temporal dependencies. The physiological signals from the affected limb are processed by a bidirectional GRU encoder to extract forward–backward temporal features. The cross-attention mechanism achieves dynamic mapping through the following steps.
For the kinematic encoder, the input consists of kinematic features from the unaffected side, including the positions and velocities of five joint motors: X h ( t ) = q H 1 , q H 2 , , q H 5 , q ˙ H 1 , q ˙ H 2 , , q ˙ H 5 R 10 . A four-layer transformer encoder with four-head attention is adopted, with a hidden-layer dimension: d = 64. The final output is a temporal contextual feature H h R T × d . For the affected-side sEMG signal encoder, the input is the physiological signal sequence: sEMG ( t ) = [ v 1 ( t ) , v 2 ( t ) , , v 8 ( t ) ] R 8 . A bidirectional GRU architecture is utilized, with a hidden layer dimension of d / 2 (32 dimensions per direction). This is followed by layer normalization and a dropout layer (p = 0.2). The output is a temporal feature H p R T × d .

2.3.3. Offline Training

Using input trajectory data and predefined DMP parameters, the first output is generated: the DMP imitation learning trajectory for the unaffected side’s exoskeleton. This trajectory undergoes a mirror coordinate transformation in the human sagittal plane (x = 0) to obtain the ideal motion trajectory for the exoskeleton of the affected side. This constitutes the second output. The joint angles and velocities of the exoskeleton on the unaffected side are input into the kinematic encoder, revealing kinematic features H h R T × 256 . The sEMG data from the affected side are input into the biological encoder, yielding biological features H p R T × 128 . These two features are fed into the cross-attention module to compute the dynamic mirroring ratio coefficient λ ( t ) , and Figure 3 illustrates the model’s loss decrease during training.

2.3.4. Admittance Control

To enable the exoskeleton to comply with human guidance while providing stable, predictable interaction behavior, an inverse dynamics framework with feedforward compensation is adopted:
τ = M ( q ) q ¨ r + C ( q , q ˙ ) q ˙ r + G ( q ) + J T F ext
τ : The joint torque vector;
M ( q ) : The inertia matrix;
C ( q , q ˙ ) : The Coriolis and centrifugal force matrix;
G ( q ) : The gravity vector;
J: The Jacobian matrix;
F e x t : The external force vector.
The reference acceleration is computed as
q ¨ r = q ¨ d M d 1 D d ( q ˙ q ˙ d ) + K d ( q q d )
q ¨ d , q ˙ d , q d : The desired acceleration, velocity, and position;
M d , D d , K d : The desired inertia, damping, and stiffness matrices.
The task-space admittance control law is defined by
M d ( x ¨ d x ¨ ) + B d ( x ˙ d x ˙ ) + K d ( x d x ) = F ext
x d , x ˙ d , x ¨ d : The desired end-effector position, velocity, and acceleration;
x , x ˙ , x ¨ : The actual end-effector position, velocity, and acceleration;
B d : The task-space damping matrix.

2.4. Experiment

2.4.1. Experiment Setup

Motion 1: Passive assist mode. During the initial rehabilitation stage, the affected limb exhibits minimal voluntary mobility. Consequently, movement is initiated by the unaffected limb that drives the contralateral exoskeleton. Upon reaching the target position, the contralateral exoskeleton applies impedance forces to the unaffected limb. To ensure minimal trajectory tracking error during this guidance, the contralateral exoskeleton operates in a high-stiffness mode while simultaneously collecting kinematic data. Currently, the affected side’s exoskeleton generates an imitation trajectory via DMPs, driving the affected limb toward the target position.
Motion 2: Active-adaptive cooperative mode. As the patient regains partial muscle strength in the affected limb, allowing the initiation of basic movements, but showing coordination deficits, the patient can actively trigger motion using residual sEMG signals from the affected limb. However, the exoskeleton must provide dynamic assistance to overcome insufficient force generation and motor discoordination. When the intensity of the sEMG signal from the affected limb muscles exceeds three times the baseline level of rest, the system detects motor intent and initiates the bilateral cooperative mode.
For the contralateral exoskeleton, the mode progressively transitions from a high-stiffness to a medium–low-stiffness mode. It temporarily increases stiffness only after detecting significant lag in the movement of the affected limb, which is defined as a velocity difference that exceeds 25% to suppress the excessive compensatory motion of the unaffected limb. The ipsilateral exoskeleton (affected side) implements an EMG–mechanics hybrid control strategy. The intensity of the patient’s EMG signals is mapped in real time to the magnitude of the assistive torque provided by the exoskeleton. A stronger EMG signal results in proportionally less active exoskeleton assistance, thus encouraging the patient to progressively exert more voluntary force.
For the starting posture, both arms are fitted with the upper-limb exoskeleton and positioned at the designated start location on the table, as set by the assistant. The unaffected limb autonomously executes the movement from the start point to the target point at a controlled velocity (0.1–0.3 m/s). For the affected limb, a dynamic mirror ratio controller generates a coefficient λ to modulate the exoskeleton’s impedance parameters. During the arm movement towards points a, b, and c, sEMG signals from both limbs are acquired under the complete movement pattern. The RMS value of the acquired sEMG signals is calculated. The variation in λ is utilized to establish a control group for analysis.

2.4.2. Hardware

Table 1 summarizes the hardware setup, including the joint modules, degrees of freedom, peak torque, and adjustment mechanisms. For each side of the exoskeleton, the driving force is provided by five direct-drive motors, including one DM-J8009 (DaMiao, Shenzhen, China) and four DM-J4340 (DaMiao, China). The exoskeleton accommodates anthropometric variations through two key adaptations: Shoulder width adjustment is achieved via a linear slider mechanism (53 to 193 mm range for each side), while the forearm segment length adaptation utilizes telescopic sleeves (260 to 300 mm) secured by passive locking pins at 10 mm intervals. For this experimental setup, wrist joint rotation remains disabled, with the end-effector position defined as the centroid of the distal plane of the wrist joint complex. The sEMG acquisition device used is the BC124 (BrainClos, Shenzhen, China).

2.4.3. Multimodal Dataset

Five healthy participants were recruited, aged 20–25 years, with a mean age of 23 ± 1.6 years, including four males and one female, without daily upper-limb pain or activity limitations. Upper-limb joint angles were recorded via joint motor encoders. sEMG signals were acquired using an 8-channel system sampled at 2000 Hz. The total task duration T was measured from movement initiation until stable positioning within the target region was achieved and maintained. This metric quantifies the spatiotemporal coordination of the end-effector trajectories of both limbs in 3-dimensional space. A higher covariance value indicates greater synchrony between the trajectories of the unaffected and affected limbs. A value approaching 1 signifies highly coordinated bilateral movement, suggesting a successful promotion of symmetry through the rehabilitation strategy. A value approaching 0 indicates a lack of association between the limb movements, potentially signifying compensatory movements or control failure.
The temporal axes of the bilateral trajectories are first aligned using dynamic time warping. Subsequently, the covariance is calculated for each dimension x , y , z of the unaffected limb trajectory coordinates relative to the affected limb trajectory coordinates.

3. Results

As shown in Figure 4, the system configuration, motion trajectory, and experimental workflow are illustrated.
In Figure 5, a single-subject case is presented, where panels (a)–(d) demonstrate the motion trajectories of subject 1 from the start position to predefined targets A, B, and C, respectively.

4. Discussion

In Figure 6, the bilateral trajectory covariance (expressed as Pearson correlation coefficients) for all four trajectories (Start-A, A–B, B–C, and C-Start) exceeds 0.998 across all three spatial dimensions. In Figure 7, the analysis reveals the following:
  • Trajectory Start–A: Symmetry index (SI) median = 0.97 (range: 0.93–1.00), with the data concentrated between 0.95 and 1.00.
  • Trajectory A–B: SI median = 0.99 (range: 0.87–1.00), showing dispersed distribution and outliers, indicating mild mirroring asymmetry. However, the SI values remain close to 0.90, suggesting minimal trajectory fluctuations.
  • Trajectory B–C: SI median = 0.97 (range: 0.88–1.00), with distribution patterns similar to those of trajectory A–B but with greater dispersion.
  • Trajectory C–Start: SI median = 0.98 (range: 0.92–1.00).
Figure 6. The blue, red, and green colors represent the covariance magnitudes (expressed as Pearson correlation coefficients) along the x-, y-, and z-axes of the bilateral exoskeleton endpoints, respectively. Panel (a) displays the values during movement from the start point to point A; panel (b) displays the values in the trajectory from point A to point B; panel (c) displays the values in the trajectory from point B to point C; and panel (d) displays the values in the trajectory from point C to point Start.
Figure 6. The blue, red, and green colors represent the covariance magnitudes (expressed as Pearson correlation coefficients) along the x-, y-, and z-axes of the bilateral exoskeleton endpoints, respectively. Panel (a) displays the values during movement from the start point to point A; panel (b) displays the values in the trajectory from point A to point B; panel (c) displays the values in the trajectory from point B to point C; and panel (d) displays the values in the trajectory from point C to point Start.
Sensors 25 05659 g006
Figure 7. The variation trend of mirror coefficient values and their distribution characteristics. (a) illustrates the variation of the SI values for each of the four trajectories across the temporal sampling points; (b) presents the distribution characteristics of the SI values for each trajectory.
Figure 7. The variation trend of mirror coefficient values and their distribution characteristics. (a) illustrates the variation of the SI values for each of the four trajectories across the temporal sampling points; (b) presents the distribution characteristics of the SI values for each trajectory.
Sensors 25 05659 g007
Figure 8 presents the velocity and position of the end effector during the movement phases, along with RMS trajectories for the A–B, B–C, and return movements.
The experimental results demonstrate that, in Figure 9, the highest RMS values of the compared trajectories exhibit reduction ratios of 10.8%, 16.1%, 9.8%, and 12.4% in four movement segments, respectively. The mean RMS reduction ratio for all the segments is 12.3%. Compared to the original λ values, the RMS of the sEMG amplitudes was consistently lower when calculated using the dynamic mirror ratio controller in Motion2. Experiments with healthy subjects demonstrated that dynamic λ control enabled bilateral trajectory co-variation. In accordance with stroke rehabilitation theory, the motion synchronization achieved by the exoskeleton may provide neural activation conditions for patients. The primary goal of this stage of the research was to validate the functionality of the core algorithm under ideal conditions (i.e., healthy subjects), rather than to evaluate clinical efficacy. The current results merely indicate the system’s technical potential to support rehabilitation and do not address clinical application.

5. Conclusions

A cross-attention mechanism is introduced into mirror therapy to achieve real-time alignment between patient motor capability and the required assistance level. Through the online adjustment of impedance parameters, the proposed approach addresses a key limitation of traditional mirror therapy, which typically focuses on positional tracking while neglecting force-related interactions.
This study proposes a novel dynamic mirror therapy framework for bilateral upper-limb exoskeleton rehabilitation, addressing the limitations of traditional static mirroring approaches. By integrating a cross-attention network and adaptive DMPs, the system enables the real-time modulation of mirroring intensity. The primary contributions include the following.
Patient-specific motion mapping via cross-attention: The fusion of the kinematic features of the unaffected limb and surface electromyography signals of the affected limb allows the dynamic calculation of a mirroring ratio coefficient λ ( t ) [ 0 , 1 ] using a mechanism of cross-attention, thereby achieving patient-specific motion mapping. The generation of adaptable trajectories for the affected limb is achieved using DMPs, which preserve spatiotemporal coordination while accommodating asymmetric motor capabilities. The adjustment of exoskeleton impedance parameters is based on multimodal feature extraction. Compared to fixed-impedance methods, this adaptive approach results in a reduction in the RMS of EMG signals. While this framework demonstrates potential for early-stage stroke rehabilitation, current limitations include limited adaptability to severe spasticity and unverified long-term neuroplastic effects. Our experiments also revealed that, when the exoskeleton end effector moves to different preset target points, asymmetry persists in the trajectory curves generated for the contralateral side. The potential reasons for this include deviations induced during exoskeleton donning and alignment, as well as suboptimal parameter settings within the DMPs used to generate the contralateral trajectory curves.
Future work will focus on optimizing the mechanical structure of the exoskeleton, particularly by increasing the DOF of the shoulder joint, integrating vision modules, increasing the number of electromyography (EMG) sensors, and incorporating electroencephalography (EEG)-based cortical activity monitoring to establish a comprehensive multimodal fusion dataset. Additionally, clinical validation will be extended to patients with varying degrees of upper-limb dysfunction.

Author Contributions

Conceptualization, J.C. and Y.Z.; methodology, J.C., Z.C., and Y.Z.; software, J.C. and Z.C.; validation, J.C. and Y.C.; formal analysis, J.C., Z.C., and Y.C.; investigation, Y.C.; resources, Y.Z.; data curation, J.C. and S.Z.; writing—original draft preparation, J.C. and Y.C.; writing—review and editing, J.C. and Z.C.; visualization, J.C. and Y.C.; supervision, Z.C., C.Z., and Y.Z.; project administration, S.Z. and Y.Z.; funding acquisition, C.Z. and Y.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported in part by the Natural Science Foundation of Top Talent of SZTU [Grant: GDRC202328] and in part by the National Key R&D Program of China [Grant: 2024YFB4709900].

Institutional Review Board Statement

This work involved human subjects in its research. Ethical approval of all the experiment procedures and protocols was granted by the Medical Ethics Committee of Shenzhen Technology University (No. 2025-MD-56).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data is unavailable due to privacy and ethical restrictions.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
DMPsDynamic Movement Primitives
sEMGSurface Electromyography
DOFDegree of Freedom
CNNConvolutional Neural Network
GRUGated Recurrent Unit
RMSRoot Mean Square

References

  1. Miyabara, H.; Takesita, J. Motor Abilities in Patients with Osteoarthritis of the Spine and Hemiplegia after Stroke. Rigakuryoho Kagaku 2005, 20, 325–328. [Google Scholar] [CrossRef]
  2. Cieza, A.; Causey, K.; Kamenov, K.; Hanson, S.W.; Chatterji, S.; Vos, T. Global estimates of the need for rehabilitation based on the Global Burden of Disease study 2019: A systematic analysis for the Global Burden of Disease Study 2019. Lancet 2021, 397, 2006–2017. [Google Scholar] [CrossRef] [PubMed]
  3. Noronha, B.; Ng, C.Y.; Little, K.; Xiloyannis, M.; Kuah, C.W.K.; Wee, S.K.; Kulkarni, S.R.; Masia, L.; Chua, K.S.G. Soft, Lightweight Wearable Robots to Support the Upper Limb in Activities of Daily Living: A Feasibility Study on Chronic Stroke Patients. IEEE Trans. Neural Syst. Rehabil. Eng. 2022, 30, 1401–1411. [Google Scholar] [CrossRef]
  4. Sainburg, R.L.; Good, D.; Przybyla, A. Bilateral Synergy: A Framework for Post-Stroke Rehabilitation. J. Neurol. Transl. Neurosci. 2013, 1, 1025. [Google Scholar]
  5. Cauraugh, J.H.; Summers, J.J. Neural plasticity and bilateral movements: A rehabilitation approach for chronic stroke. Prog. Neurobiol. 2005, 75, 309–320. [Google Scholar] [CrossRef]
  6. Nojima, I.; Mima, T.; Koganemaru, S.; Thabit, M.N.; Fukuyama, H.; Kawamata, T. Human motor plasticity induced by mirror visual feedback. J. Neurosci. 2012, 32, 1293–1300. [Google Scholar] [CrossRef]
  7. Stippich, C.; Ochmann, H.; Sartor, K. Somatotopic mapping of the human primary sensorimotor cortex during motor imagery and motor execution by functional magnetic resonance imaging. Neurosci. Lett. 2002, 331, 50–54. [Google Scholar] [CrossRef]
  8. Germanotta, M.; Cortellini, L.; Insalaco, S.; Aprile, I. Effects of Upper Limb Robot-Assisted Rehabilitation Compared with conventional therapy in patients with stroke: Preliminary results on a Daily Task Assessed using motion analysis. Sensors 2023, 23, 3089. [Google Scholar] [CrossRef]
  9. Fei, S.; Sun, Q.; Zhang, Y.; Cai, H.; Guo, S.; Li, X. Performance-based Assistance Control for Upper Limb Robotic Mirror Therapy. J. Bionic Eng. 2024, 21, 2291–2301. [Google Scholar] [CrossRef]
  10. Klinkwan, P.; Kongmaroeng, C.; Muengtaweepongsa, S.; Limtrakarn, W. The effectiveness of mirror therapy to upper extremity rehabilitation in acute stroke patients. Appl. Sci. Eng. Prog. 2021, 5, 45–53. [Google Scholar]
  11. Beom, J.; Koh, S.; Nam, H.S.; Kim, W.; Kim, Y.; Seo, H.G.; Oh, B.M.; Chung, S.G.; Kim, S. Robotic Mirror Therapy System for Functional Recovery of Hemiplegic Arms. J. Vis. Exp. 2016, 114, e54521. [Google Scholar]
  12. Shakeriaski, F.; Mohammadian, M. Enhancing Upper Limb Exoskeletons Using Sensor-Based Deep Learning Torque Prediction and PID Control. Sensors 2025, 25, 3528. [Google Scholar] [CrossRef]
  13. Nasr, A.; Dickerson, C.R.; McPhee, J. Experimental Study of Fully Passive, Fully Active, and Active–Passive Upper-Limb Exoskeleton Efficiency: An Assessment of Lifting Tasks. Sensors 2024, 24, 63. [Google Scholar] [CrossRef]
  14. Zhang, K.; Chen, X.; Liu, F.; Tang, H.; Wang, J.; Wen, W. System framework of robotics in upper limb rehabilitation on poststroke motor recovery. Behav. Neurol. 2018, 2018, 6737056. [Google Scholar] [CrossRef]
  15. Chang, J.; Tung, W.L.; Wu, W.L.; Huang, M.H.; Su, F.C. Effects of robot-aided bilateral force-induced isokinetic arm training combined with conventional rehabilitation on arm motor function in patients with chronic stroke. Arch. Phys. Med. Rehabil. 2007, 88, 1332–1338. [Google Scholar] [PubMed]
  16. Lum, P.S.; Burgar, C.G.; Shor, P.C. Use of the MIME robotic system to retrain multi joint reaching in poststroke hemiparesis: Why some movement patterns work better than others. In Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Cancún, Mexico, 17–21 September 2003; pp. 511–514. [Google Scholar]
  17. Zhang, S.; Guan, X.; Ye, J.; Chen, G.; Zhang, Z.; Leng, Y. Gait deviation correction method for gait rehabilitation with a lower limb exoskeleton robot. IEEE Trans. Med. Robot. Bionics. 2022, 4, 754–763. [Google Scholar] [CrossRef]
  18. Zhang, S.; Fan, L.; Ye, J.; Chen, G.; Fu, C.; Leng, Y. An intelligent rehabilitation assessment method for stroke patients based on lower limb exoskeleton robot. IEEE Trans. Neural Syst. Rehabil. Eng. 2023, 31, 3106–3117. [Google Scholar] [CrossRef] [PubMed]
  19. Zhang, S.; Zhang, Y.; Luan, M.; Peng, A.; Ye, J.; Chen, G.; Fu, C.; Leng, Y.; Wu, X. Generation & clinical validation of individualized gait trajectory for stroke patients based on lower limb exoskeleton robot. IEEE Trans. Autom. Sci. Eng. 2025, 22, 6463–6474. [Google Scholar]
  20. Kim, H.; Miller, L.; Fedulow, I.; Simkins, M.; Abrams, G.M.; Byl, N.; Rosen, J. Kinematic Data Analysis for Post-Stroke Patients Following Bilateral Versus Unilateral Rehabilitation With an Upper Limb Wearable Robotic System. IEEE Trans. Neural Syst. Rehabil. Eng. 2013, 21, 153–164. [Google Scholar] [CrossRef]
  21. Wang, X.; Li, X.; Wang, J.; Luo, T. A Kinect-Based Trajectory Capturing and Tracking Scheme for Upper-Limb Robot-Aided Rehabilitation; CYBER: Honolulu, HI, USA, 2017; pp. 249–254. [Google Scholar]
  22. Liu, T.-H.; Chein, C.-H.; Hsu, H.-Y.; Lin, C.-W. EEG-Based Assessment of Bilateral Brain Activation Comparison and Hand Functional Improvement Using Virtual Reality Mirror Therapy Combined with Robot-Assisted Upper Limb Intervention; i-CREATe: Shanghai, China, 2024; pp. 1–6. [Google Scholar]
  23. Wang, W.-W.; Fu, L.-C. Mirror therapy with an exoskeleton upper-limb robot based on IMU measurement system. In Proceedings of the 2011 IEEE International Symposium on Medical Measurements and Applications, Bari, Italy, 30–31 May 2011; pp. 370–375. [Google Scholar]
  24. Lin, H.; Cheng, X.; Wu, X.; Shen, D. CAT: Cross Attention in Vision Transformer. In Proceedings of the 2022 IEEE International Conference on Multimedia and Expo (ICME), Taipei, Taiwan, 18–22 July 2022; pp. 1–6. [Google Scholar]
  25. Legg, L.A.; Lewis, S.R.; Schofield-Robinson, O.J.; Drummond, A.; Langhorne, P. Occupational therapy for adults with problems in activities of daily living after stroke. Cochrane Database Syst. Rev. 2017, 7, CD003585. [Google Scholar] [CrossRef]
  26. Ijspeert, A.J.; Nakanishi, J.; Hoffmann, H.; Pastor, P.; Schaal, S. Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors. Neural Comput. 2013, 25, 328–373. [Google Scholar]
  27. Gams, A.; Petrič, T. Adapting periodic motion primitives to external feedback: Modulating and changing the motion. In Proceedings of the 23rd International Conference on Robotics in the Alpe-Adria-Danube Region (RAAD), Smolenice, Slovakia, 3–5 September 2014; pp. 1–6. [Google Scholar]
  28. Xu, J.; Xu, L.; Ji, A.; Li, Y.; Cao, K. A DMP-Based Motion Generation Scheme for Robotic Mirror Therapy. IEEE/ASME Trans. Mechatron. 2023, 28, 3120–3131. [Google Scholar]
  29. Sul, J.-H.; Piyathilaka, L.; Moratuwage, D.; Dunu Arachchige, S.; Jayawardena, A.; Kahawa, G.; Preethichra, D.M.G. Electromyography Signal Acquisition, Filtering, and Data Analysis for Exoskeleton Development. Sensors 2025, 25, 4004. [Google Scholar] [CrossRef]
  30. Zangene, A.R.; Abbasi, A.; Nazarpour, K. Estimation of Lower Limb Kinematics during Squat Task in Different Loading Using sEMG Activity and Deep Recurrent Neural Networks. Sensors 2021, 21, 7773. [Google Scholar] [CrossRef]
  31. Pei, D.; Olikkal, P.; Adali, T.; Vinjamuri, R. Reconstructing Synergy-Based Hand Grasp Kinematics from Electroencephalographic Signals. Sensors 2022, 22, 5349. [Google Scholar] [CrossRef]
  32. Othman, A.D.; Zakaria, N.A.C.; Hashim, N.M.; Mohamaddan, S. Post-Stroke Rehabilitation Using Exoskeleton Approach in Mirror Therapy Technique. In Human Factors and Ergonomics Toward an Inclusive Sustainable Future; Ng, Y.G., Daruis, D.D., Abdul Wahat, N.W., Eds.; Springer: Berlin/Heidelberg, Germany, 2024; Volume 46, pp. 123–136. [Google Scholar]
  33. Ait Yous, M.; Agounad, S.; Elbaz, S. Detection, Identification and Removal of Artifacts from sEMG Signals: Current Studies and Future Challenges. Comput. Biol. Med. 2025, 186, 109651. [Google Scholar] [CrossRef]
  34. McKenzie, L.R.; Pretty, C.G.; Fortune, B.C.; Chatfield, L.T. Low-cost stimulation resistant electromyography. HardwareX 2021, 9, e00178. [Google Scholar] [CrossRef] [PubMed]
  35. Vaswani, A.; Shazeer, N.M.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention is All you Need. Adv. Neural. Inf. Process. Syst. 2017, 30, 6000–6010. [Google Scholar]
  36. Ghosh, A.; Sufian, A.; Sultana, F.; Chakrabarti, A.; De, D. Fundamental Concepts of Convolutional Neural Network. In Recent Trends and Advances in Artificial Intelligence and Internet of Things; Balas, V., Kumar, R., Srivastava, R., Eds.; Springer: Cham, Switzerland, 2020; Volume 172. [Google Scholar]
  37. Rana, R. Gated Recurrent Unit (GRU) for Emotion Classification from Noisy Speech. arXiv 2016, arXiv:1612.07778. [Google Scholar] [CrossRef]
  38. Chen, Z.; Zhang, B. Application of Multimodal Deep Learning Algorithm in Image and Text Fusion Recognition. In Proceedings of the 2025 IEEE 5th International Conference on Power, Electronics and Computer Applications (ICPECA), Shenyang, China, 17–19 January 2025; pp. 599–604. [Google Scholar]
  39. Srivastava, A.P.; Gupta, P.; Raj, V.H.; Gupta, M.; Khare, N.; Almusawi, M. Bridging the Gap Between Modalities with Cross-Modal Generative AI and Large Model. In Proceedings of the 2024 IEEE 13th International Conference on Communication Systems and Network Technologies (CSNT), Jabalpur, India, 6–7 April 2024; pp. 965–971. [Google Scholar]
  40. Chen, J.C.; Shaw, F.Z. Recent progress in physical therapy of the upper-limb rehabilitation after stroke: Emphasis on thermal intervention. J. Cardiovasc. Nurs. 2006, 21, 469–473. [Google Scholar] [CrossRef]
Figure 2. Control block diagram of the system.
Figure 2. Control block diagram of the system.
Sensors 25 05659 g002
Figure 3. The training curve in 50 epochs.
Figure 3. The training curve in 50 epochs.
Sensors 25 05659 g003
Figure 4. Panel (a) illustrates the structural configuration of the bilateral upper-limb exoskeleton system. Panel (b) displays the motion trajectory of the arm-driven exoskeleton from a top–down perspective. Panel (c) schematically outlines the experimental workflow.
Figure 4. Panel (a) illustrates the structural configuration of the bilateral upper-limb exoskeleton system. Panel (b) displays the motion trajectory of the arm-driven exoskeleton from a top–down perspective. Panel (c) schematically outlines the experimental workflow.
Sensors 25 05659 g004
Figure 5. The figure illustrates the raw trajectory of the exoskeleton’s active endpoint, the mirrored trajectory under ideal conditions, and the actual trajectory generated via DMPs. (a) Endpoint trajectory from the start position to point A; (b) trajectory between points A and B; (c) trajectory between point B and C; (d) trajectory between point C and Start.
Figure 5. The figure illustrates the raw trajectory of the exoskeleton’s active endpoint, the mirrored trajectory under ideal conditions, and the actual trajectory generated via DMPs. (a) Endpoint trajectory from the start position to point A; (b) trajectory between points A and B; (c) trajectory between point B and C; (d) trajectory between point C and Start.
Sensors 25 05659 g005
Figure 8. Panel (a) presents the velocity and position of the end effector during movement from the start position to target A. Panels (bd), respectively, demonstrate the RMS trajectories for the A–B movement, the B–C movement, and the return path from C to the start position.
Figure 8. Panel (a) presents the velocity and position of the end effector during movement from the start position to target A. Panels (bd), respectively, demonstrate the RMS trajectories for the A–B movement, the B–C movement, and the return path from C to the start position.
Sensors 25 05659 g008
Figure 9. Panel (a) presents the EMG RMS variation profile during movement from the start position to target A. Panels (bd), respectively, demonstrate the RMS trajectories for the A–B movement, the B–C movement, and the return path from C to the start position.
Figure 9. Panel (a) presents the EMG RMS variation profile during movement from the start position to target A. Panels (bd), respectively, demonstrate the RMS trajectories for the A–B movement, the B–C movement, and the return path from C to the start position.
Sensors 25 05659 g009
Table 1. The joint module configuration and technical details for a single-arm assembly of one side of this upper limb’s exoskeleton.
Table 1. The joint module configuration and technical details for a single-arm assembly of one side of this upper limb’s exoskeleton.
Joint ModuleDOF TypePeak TorqueAdjustment Mechanism
Shoulder girdle1 Active DOF40 Nm/
Shoulder complex3 Active DOFs27 NmLinear slider
Elbow joint1 Active DOF27 NmTelescopic sleeve
Wrist joint complex2 Passive DOFs/Telescopic sleeve
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chen, J.; Cheng, Z.; Cai, Y.; Zhang, S.; Zhu, C.; Zhang, Y. Robot-Assisted Mirror Rehabilitation for Post-Stroke Upper Limbs: A Personalized Control Strategy. Sensors 2025, 25, 5659. https://doi.org/10.3390/s25185659

AMA Style

Chen J, Cheng Z, Cai Y, Zhang S, Zhu C, Zhang Y. Robot-Assisted Mirror Rehabilitation for Post-Stroke Upper Limbs: A Personalized Control Strategy. Sensors. 2025; 25(18):5659. https://doi.org/10.3390/s25185659

Chicago/Turabian Style

Chen, Jiayue, Zhongjiang Cheng, Yutong Cai, Shisheng Zhang, Chi Zhu, and Yang Zhang. 2025. "Robot-Assisted Mirror Rehabilitation for Post-Stroke Upper Limbs: A Personalized Control Strategy" Sensors 25, no. 18: 5659. https://doi.org/10.3390/s25185659

APA Style

Chen, J., Cheng, Z., Cai, Y., Zhang, S., Zhu, C., & Zhang, Y. (2025). Robot-Assisted Mirror Rehabilitation for Post-Stroke Upper Limbs: A Personalized Control Strategy. Sensors, 25(18), 5659. https://doi.org/10.3390/s25185659

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop