Next Article in Journal
Evaluation of the Azure Kinect and Its Comparison to Kinect V1 and Kinect V2
Next Article in Special Issue
Driving Stress Detection Using Multimodal Convolutional Neural Networks with Nonlinear Representation of Short-Term Physiological Signals
Previous Article in Journal
Application of Skeleton Data and Long Short-Term Memory in Action Recognition of Children with Autism Spectrum Disorder
Previous Article in Special Issue
Digital Health in Cardiac Rehabilitation and Secondary Prevention: A Search for the Ideal Tool
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Prediction of Motion Intentions as a Novel Method of Upper Limb Rehabilitation Support

by
Bogusz Lewandowski
*,
Sławomir Wudarczyk
,
Przemysław Sperzyński
and
Jacek Bałchanowski
Department of Mechanical Engineering, Wroclaw University of Science and Technology, 30-370 Wroclaw, Poland
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(2), 410; https://doi.org/10.3390/s21020410
Submission received: 18 December 2020 / Revised: 2 January 2021 / Accepted: 3 January 2021 / Published: 8 January 2021
(This article belongs to the Collection Sensing Technologies for Diagnosis, Therapy and Rehabilitation)

Abstract

:
This article is devoted to the novel method of upper limb rehabilitation support using a dedicated mechatronic system. The mechatronic rehabilitation system’s main advantages are the repeatability of the process and the ability to measure key features and the progress of the therapy. In addition, the assisted therapy standard is the same for each patient. The new method proposed in this article is based on the prediction of the patient’s intentions, understood as the intentions to perform a movement that would be not normally possible due to the patient’s limited motor functions. Determining those intentions is realized based on a comparative analysis of measured kinematic (range of motion, angular velocities, and accelerations) and dynamic parameter values, as well as external loads resulting from the interaction of patients. Appropriate procedures were implemented in the control system, for which verification was conducted via experiments. The aim of the research in the article was to examine whether it is possible to sense the movement intentions of a patient during exercises, using only measured load parameters and kinematic parameters of the movement. In this study, the construction of a mechatronic system prototype equipped with sensory grip to measure the external loads, control algorithms, and the description of experimental studies were presented. The experimental studies of the mechanism were aimed at the verification of the proper operation of the system and were not a clinical trial.

1. Introduction

Nowadays, an increasing number and variety of physical activities can be observed in societies around the world. The consequence of this is a significant increase in the number of injuries, which are difficult to avoid even when only taking into consideration normal life and recreational physical activity. Another phenomenon is the ageing of the population, which combined with adverse health-related changes in lifestyle, bring about an increase in the number of strokes, causing, among other issues, upper limb dysfunction. Therefore, the demand for more effective and faster treatment methods has increased.
Rehabilitation is one of the most important areas of medicine. It is intended for people who have lost some of their motor functions due to disease or injury or those whose motor functions are limited due to congenital disabilities. Rehabilitation helps to avoid potential complications associated with eventual surgery. The effectiveness of therapy is significantly increased by using dedicated supporting devices, which also contributes to a reduction in treatment time and greatly enhances the final outcome [1,2,3,4,5,6,7,8]. Research concentrating on increasing the effectiveness of upper limb rehabilitation have been carried out in many centers [3], e.g., in Germany in the 1990s [7]. They were based on the pioneering works at Massachusetts Institute of Technology (MIT) (Figure 1a,b) [4,9,10] where, among others, the Bi-Manu-Track system (Figure 1c) was invented and implemented.
All the motion parameters of these systems were chosen individually, and devices recorded the progress of the rehabilitation of the upper limbs. The disadvantage of these solutions was the lack of possibility to achieve a full range of motion of supported movements. Systems called exoskeletons deal with this problem. The axes of rotation of these devices are compatible with the human anatomical axes, and therefore exoskeletons resemble a human limb. Moreover, such a system can be attached to a limb in several places on each limb segment.
This results in the better cooperation of the limb with the device. Exoskeleton devices are mainly fixed to a wheelchair (Figure 2a) [11] or the floor (Figure 2b) [1,2,5,12]. The main disadvantage of exoskeleton solutions is the significantly complicated mechanism, which results in their very high production cost. This causes a problem with regards to widespread availability in rehabilitation centers.
Another approach to rehabilitation support is represented by reconfigurable systems, characterized by changeable mobility W (in some articles understood as degrees of freedom (DoF) of a kinematic chain). Even with lower mobility (e.g., W = 3 [13]), it is possible to perform palmar and dorsal flexion, adduction and abduction of the wrist, and pronation and supination of the forearm. The main advantage of these systems is the ability to fix some kinematic joints so that simple movements can be conducted via a lower number of drives. However, the supporting of complex movements is not possible. Hand movement tracking and supporting systems are also currently being strongly elaborated [12,14,15].
Therapy assisted by the use of rehabilitation devices may eliminate some of the limitations of manual therapy, such as movement repetition quality or progress recording. Placing the patient in a virtual environment allows rehabilitation to be customized to the patient’s individual needs. Many research works confirm the effectiveness of using virtual reality and psychological factors in rehabilitation supporting devices [8].
Rehabilitation is a very long and complex process, and therefore also expensive. It needs engagement and cooperation from both the rehabilitated person and the physiotherapist. What is more, it requires an individual approach to each patient, making the automation of exercises difficult. In all the given examples of devices that support rehabilitation, a subsystem described as mechatronic (technology synergically combining electronics, mechanical engineering and software development) is required [16].
In all the above described examples of rehabilitation supporting devices, the treatment movement program was implemented rigidly or manually by the physiotherapist. In the new solution of mechatronic rehabilitation system (MWR) proposed in this work, the patient supervised by the therapist decides on the characteristics of the exercise. The rapid development of sensory techniques, drives, and programming allows extending the functionality of programmed devices that support the rehabilitation process by giving some autonomy to the device. After sensing movement intentions, MWR is to decide whether to support the patient in the movement or hinder the exercise by applying additional load if the patient achieves higher angular velocities of the movement than established by the physiotherapist. The movement intentions are understood as the intention to perform an appropriate supported movement of the upper limb: pronation/supination of forearm; palmar/dorsiflexion; abduction/adduction of the hand (Figure 3). The essence of MWR operation is the ability to measure external loads acting on the device’s grip and at the same time the kinematic parameters of the movement. On this basis, the movement prediction is being made. With properly sensed movement intention, the device will enable proper rehabilitation movements. This is a completely new approach that has the potential for a new quality of treatment.
The main function of the proposed MWR system is to support the rehabilitation process. The paper identifies two cases of using the system in relation to known rehabilitation exercises in order to extend these therapies with measurement and support, and one new method of predicting the patient’s intentions.
The first known exercise is used when the patient’s muscle strength, in states of partial or complete muscle denervation, does not allow for independent movement in a given joint (e.g., in conditions after spinal cord injuries, injuries of the central nervous system, or peripheral nerves—causing paralysis or muscle paresis). In this case, proper passive exercises are essential. These are exercises in which movement is triggered by another person’s appropriate work or a device that moves a part of the patient’s body. Passive exercises are performed in appropriate painless, fully accepted by the patient’s range of motion. The main contraindications for performing passive exercises are:
  • acute inflammation of joints and periarticular tissues,
  • a lack of full bone union after fracture,
  • significantly increased body temperature,
  • post-sprain condition,
  • the occurrence of pain during exercise.
The second type of proposed supported therapies are active exercises. These refer to the patient’s self-control of muscle tension, which can cause joint movement or conscious muscle tension with the intention to move without performing the exercise (isometric exercises). In this case, the task of the mechanism is to control the movement performed by the patient.
In active exercises, resistance to movement is created by:
  • own body weight (active free exercises),
  • a therapist who cannot be overcome by the patient (isometric exercises),
  • a therapist who hinders the movement of the patient,
  • the use of additional weights, rubber bands, expanders (active exercises with resistance),
  • specialized mechanisms to support rehabilitation.
As a result of the exercises, the number of shrinking muscle fibers increases, which helps to enhance the efficiency of the work of the muscle pump. An active muscle pump increases the circulation of blood, lymph, and tissue fluids, which improves the nutrition of tissues, and in the case of injury accelerates the healing of damaged tissues. Active exercises involve observing the individual phases of movement: starting position, a movement towards the end position, returning to the starting position. A short break at the end of one repetition of movement improves the blood supply, which in turn supplies nutrients to weakened and damaged tissues, while at the same time accelerating their regeneration. Contraindications to active exercises are:
  • the absolute necessity to immobilize parts of the body,
  • severe pain sensations,
  • acute inflammation of the joints and periarticular tissues,
  • when patients are immediately after injuries or operations,
  • a significant level of circulatory and respiratory failure,
  • when patients are in an unstable or generally severe condition.
The core rehabilitation task is to improve the quality of life of the patient. The greatest negative impact on the quality of life is the inability to perform everyday activities, such as preparing meals, eating, opening the door, and so on. These activities mainly involve three movements: forearm pronation/supination (Figure 3a), and palmar/dorsiflexion and adduction/abduction of the hand (Figure 3b). As a consequence, the mobility W of the MWR that is the subject of this research is equal to three (W = 3).
The general concept of the mechatronic system supporting the rehabilitation of upper limbs (MWR) is presented in Figure 4. The proposed MWR system provides the ability to perform these movements throughout the full range of motion (RoM) for a human limb. In all the examples of devices supporting rehabilitation, a subsystem that can be considered mechatronic is indispensable.
Research on a novel rehabilitation system began in 2014 at the Wroclaw University of Science and Technology [17]. The presented device had a modular structure, and in assumptions it was possible to be used as two separated rehabilitation devices. This conception was developed [18], and a new sensor system tasked with measuring two forces resulting from patient interaction, was added. The mechanical structure of the mechanism was developed using structural and geometrical synthesis methods [19].
The MWR system enables two known rehabilitation exercises to be supported: passive and active. The essential feature in this innovative system is the ability to measure, record and analyze the motion parameters and external loads coming from the patient during exercises. With these features, the device is able to predict the movement intentions of the patient during uncharted exercises, e.g., the movement the patient wants to make at a particular moment.
The prediction program is realized based on a comparative analysis of the measured kinematic and dynamic parameters values, as well as the external loads of the mechanism. Prediction is understood as the calculation of motion parameters based on the external loads on the device’s grip. Then, the control system, knowing the current motion parameters and the patient’s intentions, generates the appropriate control signal to support or hinder the predicted movement (Figure 5). The decision between these two reactions is taken by comparing the actual measured motion parameters and the parameters given by the physiotherapist at the start of the program.
This article presents the basics of the mechanical structure development and operation algorithms of the MWR system with the conducted experimental studies’ results. The aim of the research was the experimental verification of the MWR system operation. Especially, the proper operation of the sensory grip and prediction algorithms.

2. Materials and Methods

At first, the authors formed a scheme of the MWR mechanism by type and geometrical synthesis. The system is controlled by three drives φ 1 , φ 2 , and φ 3 , one for each axis. Its main advantage is the ability to support the rehabilitation of the full range of motion of the human upper limb for pronation/supination of the forearm ( φ 3 ), palmar and dorsiflexion of the hand ( φ 2 ), and adduction and abduction of the hand ( φ 1 ) (Figure 6).
An indispensable and first step in the complex design process of all mechanisms is the development of their structure. This stage concerns the establishment of an overall solution concept. The task set in this synthesis was to develop a structure, and then a kinematic mechanism scheme, that will support rehabilitation in selected joints of the upper limb. The basic goal of the synthesis was to develop such geometry of the mechanism that would provide the full range of motion in:
  • adduction/abduction of the hand: 20 ° < φ 1 ( t ) 30 ° ( Δ φ 1 = 50 ° ) ,
  • palmar/dorsiflexion of the hand: 50 ° < φ 2 ( t ) 60 ° ( Δ φ 2 = 110 ° ) ,
  • pronation   supination   of   the   forearm : 90 ° < φ 3 ( t ) 80 ° ( Δ φ 3 = 170 ° ) .
As a result of type and geometrical synthesis, rehabilitation support mechanisms were developed [17], further investigated in the next stage of the work (Figure 6).
In order to ensure the most accurate measurement of the external loads resulting from a patient’s hand interaction with the MWR device, a new sensor grip (SG) was built. It was designed to measure F x along the grip axis and F y perpendicular load forces, as well as torque M S , with which the patient acts on the SG. The special sensors were added do the grip (Figure 7). Force sensor S1 and S2 form a planar joint between parts 3 and 3a. They are set at right angles to each other. In this situation, during movement in the φ 2 axis, only the S1 sensor is loaded (bent), while the S2 sensor should barely give any reading. Moreover, only the S2 sensor will be loaded during rotation in φ 1 . Furthermore, φ 3 torque is measured directly via the S3 sensor. With this arrangement of sensors, the external loads F x , F y ,     M o , read as F S 1 , F S 2     and   M S 3 , resulting from the patient’s interaction, can be easily and precisely adjusted to separate supported movements. In this case, reading F S 1 results from patient interaction during palmar/dorsiflexion movement, F S 2 during adduction/abduction movement, and M S 3 results from the forearm’s pronation/supination. As the force sensors S1 and S2 in the sensory grip SG, two strain gauge beams NA1 were used. The maximum capacity of NA1 beams is within +/− 200 N range with output sensitivity 2.0 mV/V. Moreover, as S3 sensor a bidirectional torque NCTE DFM22 series, with nominal torque +/−8.5 Nm was used. NA1 beams were connected to a 4-channel measuring module for load cells ADT4U, while torque sensor was connected directly to the controller.
The main requirement from the MWR mechanism is to ensure any angular displacement in the range of motion of the selected human joints. The view of the developed prototype is presented in Figure 8a. The scope of this movement is understood as the working space of the device.
The system responsible for the operation of the mechanism, and all its decisions and movements, is called the control module. Its task is to excite the movement of active parts by generating appropriate driving moments M 1 ,     M 2 ,     M 3 so that it is possible to achieve the set trajectory of the actuator (effector-device grip) with the required accuracy (Figure 8b). The device has a designed response to specific situations according to patients’ intentions. After recognition, the mechanism initiates the appropriate procedure. Five such procedures were implemented in the device: (1) beginning/end of the exercise, (2) maintaining position, (3) supporting/hindering movement, (4) relapse, (5) approaching the range of motion. A general diagram of the control algorithm is shown in Figure 9 and Figure 10.
After starting the system, the position of the mechanism is verified in all axes. The initial position φ 1 S is set at 0 ° , which corresponds to the anatomical position. The initial position of the third axis φ 3 is set at φ 3 S = 90 ° (maximum supination). The initial position of the second axis φ 2 equals φ 2 S = 13.1 °   (Figure 11). Verification is positive if the angular position φ 1 , φ 2 and φ 3 does not exceed ±2% of the initial position φ 1 S , φ 2 S and φ 3 S . Moreover, a physiotherapist must define the following parameters: φ i m i n ,   φ i m a x —the range of motion for the patient in all i axis, ω i R —the appropriate angular velocity for each axis, ω i m a x —the maximal angular velocity for each axis. The next step is to set the starting position. It is very important to ensure the safety of the patient during exercise. The main criterion for this phase is setting the starting position φ 1 P , φ 2 P and φ 3 P , which is either done by the physiotherapist or manually. The condition for a correctly set initial position needs to be within a person’s range of motion (RoM).
If no error occurs, then the position maintenance procedure begins. It involves reading the position of the mechanism φ i in real-time and applying the appropriate moment M i so that the system remains motionless. This allows any (within the range of motion φ i m i n ,     φ i m a x ) starting position to be set. The position maintenance procedure will be maintained until the external load is detected on the device handle. If this happens, the system will determine the patient’s movement intentions and then choose to respond to one of three possibilities by implementing the appropriate procedure. The algorithm of predicting patient movement intentions is presented in Figure 10. Generally, it comes down with reading load components F S 1 ,     F S 2 and M S 3 and refer them to device actual movement, with predefined threshold levels.
The mechanism performs motion support (helps the exercising person to perform the movement) in two situations. In the first case, when the person performing the exercise acts on the handle but does not move the mechanism, F i 0 ,   ω i = 0 . In the second case, when the system is in motion, and the patient wants to relapse. The system helps to overcome the inertia of the parts. The support level is closely related to the movement parameters and the external load reading from the handle (the system compares the read motion parameters ω i and compares them with the set values ω i R ). Additionally, a safety parameter φ S R , defining the normal working area, was introduced into the system ( 0 < φ S R 1 ) . Its modification enables reaching the maximum range of motion to be avoided, e.g., during warm-up. The individual conditions and reactions of the mechanism are presented in Table 1.
Hindering of the movement procedure is realized when the measured motion kinematic and dynamic parameters are greater than the average data ω i R for the patient. The level of difficulty depends, in the same way as for the assist procedure, on the comparison of motion parameters with the set patterns. The relapse procedure is one of the special procedures. It is activated when the system detects a change in the direction of the force acting on the handle s g n ( F i ) s g n ( ω i ) .
The procedure of approaching the range of motion belongs to the superior procedures. If the system is brought to a position near the limit of the range of motion, this procedure generates a returning moment in such a way that it prevents the range of motion being exceeded. In extreme cases, it stops the mechanism.

3. Results

The experimental research of the MWR device was divided into two parts. The first part consists of sensory grip SG studies, where the assumptions and functionality were examined. The second part consists of experimental research carried out to assess the correct operation of the MWR prototype and to assess the possibility of using the proposed method in the rehabilitation of human hand motor dysfunction.

3.1. Experimental Studies of Sensory Grip SG

The first study conducted by the authors concerned the operation of sensory grip SG. Readings from S1, S2, and S3 sensors can be directly assigned to the supported movements of a human upper limb:
  • Reading from S1 sensor corresponds to the load generated in palmar/dorsiflexion of the hand movement,
  • Reading from S2 sensor corresponds to the load generated in abduction/adduction of the hand movement,
  • Reading from S3 sensor corresponds to the load generated in pronation/supination of the forearm movement.
The first verification of the SG assumptions was conducted via simulation studies. A 3D model of the sensory grip was built in MD Adams system. Extensive simulation studies were carried out for various loads and ranges of motion. Examples of simulation research results are presented in this work. Sensors S1 and S2 were modelled as flexible beam components. The simulation lasting 6 s was divided into 3 parts:
  • 0 t < 2 s the grip was loaded only with F y force, simulating dorsiflexion movement,
  • 2 s t < 4 s the grip was loaded only with F x force, simulating the abduction movement,
  • 4 s t < 6 s the grip was loaded only with M o torque, simulating pronation movement.
Load characteristics in compliance with Figure 7 are presented in Figure 12. The results of simulation studies F S 1 , F S 2 , M S 3 , as a response on applied loads in S1, S2, and S3 sensors are presented in Figure 13.
The conducted simulation studies confirmed correct operation of the sensory grip. Obtained results indicate that, when SG is loaded with F y force, reading F S 1 from S1 sensor can be observed, while no signal is present at S2 and S3 sensor. Moreover, when SG is loaded only with F x force, reading F S 2 from S2 sensor can be observed. The torque M o was determined using the sensor S3. However non-zero readings F S 1 and F S 2 can be observed for 4 s t < 6 s , when loads F y = 0 and F x = 0 . It results from deformation of sensor modelled elements (torsion). Interference with readings F S 1 and F S 2 resulting from M o load did not exceed 6% of the F y and F x level. The conducted simulation studies indicated that reading F S 1 stands for load resulting from palmar or dorsiflexion, while F S 2 reading can be associated with adduction or abduction movement. On the other hand, M S 3 readings are related to pronation or supination of the forearm.
In the next stage of research, experimental studies of the sensory grip SG were carried out. Three experiments were performed for three load cases:
  • the grip was loaded with force F y = 49.05 N (loaded with m 1 = 5 kg) (Figure 14),
  • the grip was loaded with force F x = 68.67 N (loaded with m 2 = 7 kg),
  • the grip was loaded with force M o = 7.0 Nm (the grip was locked in place, load M o was generated by the M 3 drive).
The first two experimental research consisted of applying m 1 or m 2 mass on the properly oriented sensory grip and measure readings from S1, S2, and S3 sensors. In third research, the grip was locked and M o load was added via M 3 drive. Measurements were made with a frequency of 50 Hz. Results of experimental research for SG loaded with F y = 49.05 N are presented in Figure 15.
The experimental studies of the sensory grip loaded with F y force showed that almost all the load was read by sensor S1. Maximal value of the force F S 1 R = 49.48 N. It can be noticed that non-zero values of F S 2 R readings occurred. The maximal value F S 2 R = 1.10 N.
In a subsequent study, the grip was rotated 90 ° and loaded with m 2 = 7   kg . This corresponds to F x = 68.67 N force load in x direction. The measurement results are shown in Figure 16. The results of the experiment of SG loaded in x axis showed the expected data dependencies. S2 sensor maximal reading F S 2 R = 70.25 N, while non-zero S2 reading F S 1 R = 1.48 N can be observed.
The last research concerning SG consisted on locking the grip in place and generating M 3 = 7   Nm torque, which is considered as M o in this research. The experiment consisted in examining the influence of M o on F S 1 R and F S 2 R readings. The measurement results are shown in Figure 17.
The M o torque load resulted in F S 1 R and F S 2 R readings. The maximal values F S 1 R = 1.46 N while F S 2 R = 0.47 N occurred. They result from torsion of the sensors (strain gauges) under a given load. The values of these forces are negligible compared to the results of previous research on the SG.
The conducted experimental studies indicated, that reading F S 1 R stands for load resulting from palmar or dorsiflexion, while F S 2 R reading can be associated with adduction or abduction movement. On the other hand, M S 3 R reading is related to pronation or supination of the forearm.

3.2. Experimental Research of MWR Mechanism

Experimental studies of the MWR mechanism were carried out in order to assess the correctness of the prototype’s operation and to assess the applicability of the proposed method in the rehabilitation of human hand motor dysfunctions. The study was conducted on a person that does not have any motor dysfunction (male, 30 years old, height 179, mass 83 kg, BMI 25.9). The measurements were carried out with 50 Hz frequency.
Concerning the device’s mass forces (gravity), the most challenging situation occurs when one on the axis is horizontal. In such a configuration, the greatest influence of mass forces interacts with one driven axis of the device. This is the most extreme load case. For this reason, this article presents experimental studies for the case when the φ 2 axis is horizontal. Research on the MWR mechanism began with manually setting the initial position (Figure 18). The range of motion in this axis is 55 ° φ 2   60 ° , where a positive value refers to the hand’s dorsiflexion.
The first experiment, lasting 10   s , consisted of achieving maximum dorsiflexion φ 2 =   60 ° . The mechanism position was set manually, without interaction with the sensory grip, to unknown φ 2 P within RoM. The task of the MWR was to detect the direction of movement, assist the exerciser during acceleration and slow down the device when approaching the RoM. The results of the experiment are shown in Figure 19.
The measured initial position was equal to φ 2 P = 32.7 ° . In the time interval from 0   s t < 3   s , the system remained stationary (position retention procedure in operation). At time t = 2.7   s , the external load F 2 appears for the next Δ t = 0.3   s , and despite the increasing external load value, the mechanism stayed stationary (due to sensitivity level). At that time, the program algorithm detected the dorsiflexion movement’s intention and started assisting, gradually increasing the assisting moment. The maximum external force F 2   = 36.1   N was measured in t = 3.6   s . The time error related to of measurement of the force sensor is 0.1 s. The MWR reached its maximal angular position φ 2 =   59.6 ° in t = 8.4   s . The maximum end position error Δ φ 2 < 0.4 ° . Despite the external load in 8.4   s < t 10   s , the system did not allow the set maximal angular position to be exceeded.
Another experiment involved examining the intention to change the movement direction (relapse procedure). The experiment lasted 10 s. The device position was set at maximal dorsiflexion. The exercising person’s task was to make two changes in the direction of movement followed by a return to the starting position. The results of the experiment are shown in Figure 20.
The measured initial position value φ 2 P = 58.7 ° for this experiment. Relapse is detected if the system is in an angular position outside the values determining the range of motion φ 2   60 ° and φ 2   50 ° in tolerance of ± 2 % . The relapse procedure is carried out when the system detects a change in the external load direction. In this experiment, there are two such intentions detections at time t = 1.26   s and t = 6.84   s . The relapse procedure’s side effect is a momentary leap in the angular velocity value ω 2 to a maximal value of ω 2 = 50.4 ° / s at time t = 6.84   s .
The last experiment was aimed at verifying the procedure of preventing the movement from exceeding the range of motion φ 2 60 ° . To that end, the angular position of the device was set near the upper range of motion. The task of the exercising person was to try to exceed the ROM three times. To make this experiment possible, the hand during the exercises was free. The results of the experiment are shown in Figure 21.
During this experiment, the measured value φ 2 P = 56.9 ° . Three pulsed attempts to exceed the range of motion were detected at t 1 = 2.88   s ,   t 2 = 4.62   s ,   and   t 3 = 6.66   s . The greatest force F 2 = 58.0 N was measured during the first attempt. During this test, a slight deviation of the position ( Δ φ 2 = 0.87 ° ) was observed. During the remaining attempts, no change in the angular position of the mechanism was observed.

4. Discussion

The authors developed a sensor system and software in such a way that the maximum response time of the mechanism was 0.12 s. This response time did not disturb the patient during exercises. This time is related to the averaging of the force sensors readings measured in the grip. It is a compromise between maintaining the appropriate measurement accuracy and mechanism response time. It is planned to test a system and a higher frequency of measurement, which will allow to reduce the response time of the system to 0.05   s .
The disturbances F S 2 R at Figure 15 and F S 1 R at Figure 16 are caused by the friction force in the planar joint mounting of S1 and S2 sensor. However, the values of these forces are negligible.
When a patient suffers some motor dysfunctions, the organism tries to compensate it using other motor units. Therefore, impacts and sudden pulls with the use of body weight may appear. For this reason, the sensor system must be protected. The MWR structure may seem oversized, however, it is designed to protect both the patient and sensors. The authors are currently working on optimization of the MWR mass and structure. The authors estimate that it is possible to reduce inertia impact of the device for about 30%.
Supporting the rehabilitation process can significantly increase the results of therapy and patient comfort. Any dysfunction of the upper limb can lead to a significant deterioration in a person’s quality of life. In the course of experimental research, compliance with the assumptions and correctness of system operation was demonstrated.
Many studies regarding joint loads in human hand were carried out [20] especially in sports like golf [21] or volleyball [22], upper limb pathologies research works [2], or kinematic parameters measurement systems [14]. Still, there is a lack of information on the healthy person performing reaching RoM tasks, and forces during normal functionality movements. Robotics assisted loads can be found in other sources. Average joint torques in the elbow and wrist are approximately one-tenth and one-hundredth, respectively, of those experienced at the shoulder, with median torques at the shoulder ranging from 0.4 to 4 Nm [23]. Reach to grasp movements are also measure in literature, however using EMG method, at peak reaching about 16 N [24]. Considering the order of magnitude, the achieved in this article values are correct. The provided results of human joint loads might be valuable for psychotherapists.
The research results presented in the work prove the correct functioning of the MWR system and sensing movement intentions method. Moreover, they prove the safety of the exercises themselves. The presented prototype does not allow to exceed the RoM, which was proved in the third experiment.
The proposed method can help patients without severe paresis. The authors expect that the possibility of “independent” decisions about the movement, with the supervision of a physiotherapist, may positively impact the rehabilitation process. When designing the device, the authors also took into account the economic aspects, having in mind that the device should be accessible to a wide group of patients.

5. Conclusions

The prediction of movement intention is a new method of rehabilitation support which holds great potential. Not only does it allow for customization of the load to the individual patient needs, but it also does not need to know the specific exercise. The patient can decide what action he wants to perform by himself. The device provides comfort, safety and recorded information for the physiotherapist to analyze. In addition, it is possible to assess the effectiveness of specific therapies due to the possibility of comparing numerical results.
In further work, the authors plan to examine the developed method of predicting patient intentions on a specific group of patients in order to assess its effectiveness in relation to specific dysfunctions or diseases.

Author Contributions

Conceptualization, B.L. and J.B.; methodology, B.L., S.W. and J.B.; software, B.L. and P.S.; validation, B.L., S.W. and J.B.; formal analysis, J.B.; investigation, B.L. and S.W.; resources, B.L. and P.S.; data curation, B.L.; writing—original draft preparation, B.L.; writing—review and editing, B.L. and J.B.; visualization, B.L. and P.S.; supervision, J.B.; project administration, B.L. and J.B.; funding acquisition, J.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data is contained within this article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Carignan, C.; Liszka, M. Design of an Arm Exoskeleton with Scapula Motion for Shoulder Rehabilitation. In Proceedings of the 12th International Conference on Advanced Robotics, Seattle, WA, USA, 18–20 July 2005. [Google Scholar]
  2. Jurkojć, J.; Piotr, W.; Robert, M.; Katarzyna, N.; Andrzej, B.; Marek, G. The Upper Limb Motion Deviation Index: A new comprehensive index of upper limb motion pathology. Acta Bioeng. Biomech. 2017, 19, 175–185. [Google Scholar] [PubMed]
  3. Laut, J.; Porfiri, M.; Raghavan, P. The Present and Future of Robotic Technology in Rehabilitation. Curr. Phys. Med. Rehabil. Rep. 2016, 4, 312–319. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Krebs, H.I.; Hogan, N.; Volpe, B.T.; Aisen, M.L.; Edelstein, L.; Diels, C. Overview of clinical trials with MIT-MANUS: A robot-aided neuro-rehabilitation facility. Technol. Health Care 1999, 7, 419–423. [Google Scholar] [CrossRef] [PubMed]
  5. Nef, T.; Mihelj, M.; Kiefer, G.; Perndl, C.; Muller, R.; Riener, R. ARMin—Exoskeleton for Arm Therapy in Stroke Patients. In Proceedings of the IEEE 10th International Conference on Rehabilitation Robotics, Noordwijk, The Netherlands, 13–15 June 2007; pp. 68–74. [Google Scholar]
  6. Nef, T.; Mihelj, M.; Riener, R. ARMin: A robot for patient-cooperative arm therapy. Med. Biol. Eng. Comput. 2007, 45, 887–900. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Hesse, S.; Schmidt, S.; Werner, C. Machines to support motor rehabilitation after stroke: 10 years experience in Berlin. J. Rehabil. Res. Dev. 2006, 43, 671–678. [Google Scholar] [CrossRef] [PubMed]
  8. Kwakkel, G.; Kollen, B.; Lindeman, E. Understanding the pattern of functional recovery after stroke: Facts and theories. Restor. Neurol. Neurosci. 2004, 22, 281–299. [Google Scholar] [PubMed]
  9. Hogan, H.; Krebs, H.I.; Charnarong, J.; Sharon, A. Interactive Robotic Therapist. U.S. Patent No. 5,466,213, 14 November 1995. [Google Scholar]
  10. Krebs, H.I.; Ferraro, M.; Buerger, S.P.; Newbery, M.J.; Makiyama, A.; Sandmann, M.; Lynch, D.; Volpe, B.T.; Hogan, N. Rehabilitation robotics: Pilot trial of a spatial extension for MIT-Manus. J. Neuroeng. Rehabil. 2004, 1, 1–5. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Sanchez, R.; Wolbrecht, E.; Smith, R.; Liu, J.; Rao, S.; Cramer, S.; Rahman, T.; Bobrow, J.E. A pneumatic robot for re-training arm movement after stroke: Rationale and mechanical design. In Proceedings of the 2005 IEEE 9th International Conference on Rehabilitation Robotics, Chicago, IL, USA, 28 June–1 July 2005; pp. 500–504. [Google Scholar]
  12. Kortier, H.G.; Schepers, H.M.; Veltink, P.H. Identification of Object Dynamics Using Hand Worn Motion and Force Sensors. Sensors 2016, 16, 2005. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Oblak, J.; Perry, J.C.; Jung, J.H.; Cikajlo, I.; Keller, T.; Matjačić, Z. A variable structure pantograph mechanism for comprehensive upper extremity haptic movement training. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, Argentina, 31 August–4 September 2010; pp. 5859–5862. [Google Scholar]
  14. Lin, B.S.; Lee, I.; Yang, S.Y.; Lo, Y.C.; Lee, J.; Chen, J.L. Design of an Inertial-Sensor-Based Data Glove for Hand Function Evaluation. Sensors 2018, 18, 1545. [Google Scholar] [CrossRef] [Green Version]
  15. Salchow-Hömmen, C.; Callies, L.; Laidig, D.; Valtin, M.; Schauer, T.; Seel, T. A Tangible Solution for Hand Motion Tracking. Sensors 2019, 19, 208. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Trochimczuk, R.; Kuźmierowski, T. Kinematic Analysis of CPM Machine Supporting to Rehabilitation Process after Surgical Knee Arthroscopy and Arthroplasty. Int. J. Appl. Mech. Eng. 2014, 19. [Google Scholar] [CrossRef]
  17. Lewandowski, B.; Olinski, M.; Gronowicz, A. A novel device for functional rehabilitation of a human wrist. In Proceedings of the 10th International Conference on Mechatronic Systems and Materials, Opole, Poland, 7–10 July 2014; pp. 1–12. [Google Scholar]
  18. Lewandowski, B.; Olinski, M.; Wudarczyk, S.; Gronowicz, A. A conceptual project of a device for human wrist functional rehabilitation. Int. J. Appl. Mech. Eng. 2016, 21, 923–932. [Google Scholar] [CrossRef] [Green Version]
  19. Lewandowski, B. Mechatroniczny System Wspomagania Rehabilitacji Kończyn Górnych. Ph.D. Dissertation, Wydział Mechaniczny Politechniki Wrocławskiej, Wrocław, Poland, 2019. [Google Scholar]
  20. Morita, Y.; Furuhashi, Y.; Nagasaki, M.; Aoki, T.; Ukai, H.; Matsui, H. Development of muscle test system for upper limbs using 3D force display robot. IFAC Proc. Vol. 2009, 42, 657–662. [Google Scholar] [CrossRef]
  21. Hyeob, C.; Sukyung, P. Three Dimensional Upper Limb Joint Kinetics of a Golf Swing with Measured Internal Grip Force. Sensors 2020, 20, 3672. [Google Scholar] [CrossRef]
  22. Shirko, A.; Gustavo, L.G.; Marco, C.U. Correlation between handgrip and isokinetic strength of shoulder muscles in elite sitting volleyball players. J. Bodyw. Mov. Ther. 2020, 24, 159–163. [Google Scholar]
  23. Perry, J.; Rosen, J.; Burns, S. Upper-Limb Powered Exoskeleton Design. IEEE/ASME Trans. Mechatron. 2007, 12, 408–417. [Google Scholar] [CrossRef]
  24. Louis, N.; Gorce, P. Upper limb muscle forces during a simple reach-to-grasp movement: A comparative study. Med. Biol. Eng. Comput. 2009, 47, 1173–1179. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Examples of the first mechatronic rehabilitation supporting devices: (a) MIT-MANUS [4], (b) Nudelholz [9], (c) Bi-Manu-Track [9].
Figure 1. Examples of the first mechatronic rehabilitation supporting devices: (a) MIT-MANUS [4], (b) Nudelholz [9], (c) Bi-Manu-Track [9].
Sensors 21 00410 g001
Figure 2. Examples of rehabilitation exoskeletons: (a) WREX [11], (b) Armin [5].
Figure 2. Examples of rehabilitation exoskeletons: (a) WREX [11], (b) Armin [5].
Sensors 21 00410 g002
Figure 3. Supported movements of the upper limb with ranges of motion (RoM): (a) forearm pronation and supination; (b) palmar/dorsiflexion and adduction/abduction of the hand.
Figure 3. Supported movements of the upper limb with ranges of motion (RoM): (a) forearm pronation and supination; (b) palmar/dorsiflexion and adduction/abduction of the hand.
Sensors 21 00410 g003
Figure 4. General concept of the novel mechatronic system supporting the rehabilitation of upper limbs.
Figure 4. General concept of the novel mechatronic system supporting the rehabilitation of upper limbs.
Sensors 21 00410 g004
Figure 5. The general concept of predicting movement intentions using the mechatronic rehabilitation system (MWR) mechatronic system.
Figure 5. The general concept of predicting movement intentions using the mechatronic rehabilitation system (MWR) mechatronic system.
Sensors 21 00410 g005
Figure 6. Structure diagram of the second developed mechanism [17].
Figure 6. Structure diagram of the second developed mechanism [17].
Sensors 21 00410 g006
Figure 7. Sensory grip for the MWR mechatronic device—kinematic scheme.
Figure 7. Sensory grip for the MWR mechatronic device—kinematic scheme.
Sensors 21 00410 g007
Figure 8. The developed prototype of MWR mechanism: (a) view of the MWR prototype; (b) control diagram of the MWR mechanism.
Figure 8. The developed prototype of MWR mechanism: (a) view of the MWR prototype; (b) control diagram of the MWR mechanism.
Sensors 21 00410 g008
Figure 9. Block diagram of the MWR mechanism operation.
Figure 9. Block diagram of the MWR mechanism operation.
Sensors 21 00410 g009
Figure 10. Algorithm of the MWR operation during intentions prediction method.
Figure 10. Algorithm of the MWR operation during intentions prediction method.
Sensors 21 00410 g010
Figure 11. MWR mechanism: (a) initial position φ 2 S ; (b) example end position φ 2 m a x .
Figure 11. MWR mechanism: (a) initial position φ 2 S ; (b) example end position φ 2 m a x .
Sensors 21 00410 g011
Figure 12. Simulation research results for the sensory grip–characteristics of input loads F y ,   F x ,   M o .
Figure 12. Simulation research results for the sensory grip–characteristics of input loads F y ,   F x ,   M o .
Sensors 21 00410 g012
Figure 13. Simulation research results for the grip sensors F S 1 ,   F S 2 ,   M S 3 .
Figure 13. Simulation research results for the grip sensors F S 1 ,   F S 2 ,   M S 3 .
Sensors 21 00410 g013
Figure 14. First experimental research of sensor grip (SG): applied m 1 = 5 kg load F y in y direction.
Figure 14. First experimental research of sensor grip (SG): applied m 1 = 5 kg load F y in y direction.
Sensors 21 00410 g014
Figure 15. Experimental research results for the grip loaded with 5 kg mass in y direction.
Figure 15. Experimental research results for the grip loaded with 5 kg mass in y direction.
Sensors 21 00410 g015
Figure 16. Experimental research results for the grip loaded with 7 kg mass in x direction.
Figure 16. Experimental research results for the grip loaded with 7 kg mass in x direction.
Sensors 21 00410 g016
Figure 17. Experimental research results for the grip loaded with 7 Nm torque.
Figure 17. Experimental research results for the grip loaded with 7 Nm torque.
Sensors 21 00410 g017
Figure 18. Setting the start position for the φ 2 P axis.
Figure 18. Setting the start position for the φ 2 P axis.
Sensors 21 00410 g018
Figure 19. Result of the first experiment-achieving maximum dorsiflexion φ 2 =   60 ° .
Figure 19. Result of the first experiment-achieving maximum dorsiflexion φ 2 =   60 ° .
Sensors 21 00410 g019
Figure 20. Results of MWR relapse procedure experiments.
Figure 20. Results of MWR relapse procedure experiments.
Sensors 21 00410 g020
Figure 21. Result of preventing the movement from exceeding the range of motion ( φ 2 m a x = 60 ° ) .
Figure 21. Result of preventing the movement from exceeding the range of motion ( φ 2 m a x = 60 ° ) .
Sensors 21 00410 g021
Table 1. Simplified principle of the prediction mode.
Table 1. Simplified principle of the prediction mode.
Control SignalStatus of the DeviceProcedure
F i = 0 ω i = 0 φ S R * φ i m i n < φ i
φ S R * φ i m a x > φ i
ω i m a x > ω i
Maintain position
F i > 0 ω i R > ω i > 0 Assist movement proportionally
ω i < 0 Relapse procedure
ω i R < ω i Hinder movement proportionally
ω i R > ω i > 0 φ i φ S R * φ i m a x Approaching the range of motion
F i < 0 ω i R < ω i < 0 φ S R * φ i m i n < φ i
φ S R * φ i m a x > φ i
ω i m i n > ω i
Assist movement proportionally
ω i > 0 Relapse procedure
ω i R > ω i Hinder movement proportionally
ω i R < ω i < 0 φ i φ S R * φ i m i n Approaching the range of motion
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lewandowski, B.; Wudarczyk, S.; Sperzyński, P.; Bałchanowski, J. Prediction of Motion Intentions as a Novel Method of Upper Limb Rehabilitation Support. Sensors 2021, 21, 410. https://doi.org/10.3390/s21020410

AMA Style

Lewandowski B, Wudarczyk S, Sperzyński P, Bałchanowski J. Prediction of Motion Intentions as a Novel Method of Upper Limb Rehabilitation Support. Sensors. 2021; 21(2):410. https://doi.org/10.3390/s21020410

Chicago/Turabian Style

Lewandowski, Bogusz, Sławomir Wudarczyk, Przemysław Sperzyński, and Jacek Bałchanowski. 2021. "Prediction of Motion Intentions as a Novel Method of Upper Limb Rehabilitation Support" Sensors 21, no. 2: 410. https://doi.org/10.3390/s21020410

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop