Next Article in Journal
Towards Real-Time Detection of Gait Events on Different Terrains Using Time-Frequency Analysis and Peak Heuristics Algorithm
Next Article in Special Issue
Two-Time Scale Virtual Sensor Design for Vibration Observation of a Translational Flexible-Link Manipulator Based on Singular Perturbation and Differential Games
Previous Article in Journal
A Power-Optimized Cooperative MAC Protocol for Lifetime Extension in Wireless Sensor Networks
Previous Article in Special Issue
Modeling and Control of the Redundant Parallel Adjustment Mechanism on a Deployable Antenna Panel
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Design and Construction of a Bilateral Haptic System for the Remote Assessment of the Stiffness and Range of Motion of the Hand

1
Department of Management and Engineering, University of Padova, Stradella S. Nicola 3, 36100 Vicenza, Italy
2
Center for the Development of Nanoscience and Nanotechnology, Universidad de Santiago de Chile, Av. Lib. Bernardo O’higgins, 3363 Santiago, Chile
3
Department of Neuroscience, Universiy-General Hospital of Padova, Via Giustiniani 2, 35128 Padova, Italy
*
Author to whom correspondence should be addressed.
Sensors 2016, 16(10), 1633; https://doi.org/10.3390/s16101633
Submission received: 29 June 2016 / Revised: 21 September 2016 / Accepted: 27 September 2016 / Published: 1 October 2016
(This article belongs to the Special Issue Advanced Robotics and Mechatronics Devices)

Abstract

:
The use of haptic devices in the rehabilitation of impaired limbs has become rather popular, given the proven effectiveness in promoting recovery. In a standard framework, such devices are used in rehabilitation centers, where patients interact with virtual tasks, presented on a screen. To track their sessions, kinematic/dynamic parameters or performance scores are recorded. However, as Internet access is now available at almost every home and in order to reduce the hospitalization time of the patient, the idea of doing rehabilitation at home is gaining wide consent. Medical care programs can be synchronized with the home rehabilitation device; patient data can be sent to the central server that could redirect to the therapist laptop (tele-healthcare). The controversial issue is that the recorded data do not actually represent the clinical conditions of the patients according to the medical assessment scales, forcing them to frequently undergo clinical tests at the hospital. To respond to this demand, we propose the use of a bilateral master/slave haptic system that could allow the clinician, who interacts with the master, to assess remotely and in real time the clinical conditions of the patient that uses the home rehabilitation device as the slave. In this paper, we describe a proof of concept to highlight the main issues of such an application, limited to one degree of freedom, and to the measure of the stiffness and range of motion of the hand.

1. Introduction

Stroke is the third leading cause of death after cardiovascular diseases and cancer and represents the greatest cause of disability and impairment in the industrialized world [1]. The damage to the central nervous system caused by stroke can lead to impaired motor control on the affected side (hemiparesis). The available scientific literature suggests that the earlier is the rehabilitative intervention (as well as an intensive and prolonged multisensory stimulation), the more effective is the functional recovery [2,3].
The conventional approach to upper limb impairment can be efficaciously integrated by using properly-designed robots that have a proven high effectiveness in promoting recovery [4,5]. Particularly, haptic technology constitutes a powerful tool for developing active training devices. Patients under treatment can be stimulated in several ways, ranging from passive mobilization to sophisticated interactions with the virtual world. These can be delivered by different types of feedbacks (haptic, visual, auditory, tactile, cutaneous), through computer screens, headphones and other systems [4,5,6,7,8,9,10,11]. In a standard scenario, a patient interacts with multi-feedback haptic devices in a rehabilitation center, following a precise medical therapy program. The devices used by the patients act as modern, effective and safe tools to reproduce motor and functional learning experience. These can perform intensive intervention; they can monitor the improvement recording kinematic/dynamic data (e.g., joint angles, forces, etc.), giving some kind of score related to patient performance, adjusting the intervention to patients’ progress [5,6].
However, as Internet access is now available at almost every home, the idea of moving robotic rehabilitation from the hospital to the house is gaining a wide consent. On the one hand, it bring a medical care program to the patient’s house where it could be carried out more comfortably. On the other hand, this type of rehabilitation can reduce the hospitalization time of the patient and, thus, therapy costs [12].
The systems that are able to provide rehabilitation at home are called tele-healthcare or tele-medicine systems [13]. They consist of: a home rehabilitation device (similar to those of the hospital), a central server at the hospital and a system management controller (split between home device and remote central server). Rehabilitation programs are synchronized with the home rehabilitation device by means of the system management controller that allows the home device to download information from the central server. The home device deals with setups that allow patients to train several hours a day, by performing the pre-programmed exercises at home, involving force feedback as a response, while interacting with a virtual environment. Finally, the system management controller monitors safety, helps the patient to solve possible issues and records the measurements of kinematic/dynamic parameters and performance scores during patient training. These data are then sent to the central server that could redirect information (even in real time) to the therapist laptop or smartphone, in order to monitor patient progress [13,14]. Since the therapist cannot interact with the patient, this type of applications is also called unilateral tele-rehabilitation (tele-rehabilitation can be defined as teleoperation in rehabilitation).
The controversial issue of tele-healthcare is that the recorded data of the therapy sessions of the patients do not actually represent the clinical conditions of their limbs. The assessment of the clinical conditions, in fact, involves well-defined clinical tests that have to be performed by clinicians, according to the medical assessment scales, as, e.g., the Fugl–Meyer Assessment scale (FMA) [15] and the Medical Research Council scale (MRC) [16]. Since the outcomes of such tests are the only ones providing to clinicians a direct and immediate feeling on patient conditions and, also, the degree of effectiveness of the exercises proposed, a patient should frequently go to the hospital to undergo them. Moreover, the therapists could need a tight, physical interaction with the patient with the impaired limb in the rehabilitation device to also finely trim the exercise, in order to maximize its effectiveness, mostly for the treatment of patients in the acute or sub-acute phase. Therefore, tele-healthcare is not able to perform a fully-remote rehabilitation program.
To answer the issue described above, especially the one related to a tight interaction, we propose the use of a bilateral master/slave haptic system. Such a system can allow the clinician, who interacts with a master haptic device, to assess remotely and in real time the clinical conditions of the patient that uses the home rehabilitation device, extended to the additional use as a slave device. This paper presents a proof of concept of such a system, with single-d.o.f. (degree of freedom) devices, to measure the stiffness and the range of motion of the hand, which are two parameters considered in the traditional clinical tests. The system was designed, constructed and preliminarily tested on healthy subjects. This study could represent a first analysis to highlight the main issues that must be dealt with, in order to create a system for the potential application case of the remote assessment of patients with impaired fingers of the hand. In the proposed system, control schemes have been made use of that stabilize the bilateral interaction, even in the case of variable network performance (as those for the Internet), in order to achieve safe operations.
To date, there are only some contributions presented in the literature that are focused on the system design of bilateral interaction for potential applications in real-time clinical remote assessments of impaired limb (and without the design of an ad hoc slave device). Preliminarily, some indications were provided by Park et al. [17,18] who described an example of the design of a tele-assessment system for the evaluation of elbow spasticity on patients with neurological impairments and showed some preliminary results. However, they focused on the design of an ad hoc portable system, and they used a simple control strategy that did not allow the system to deal with variable network performance, so the remote assessment of the degree of spasticity was performed by using a “record and replay” strategy, i.e., the spasticity test was automatically performed at the patient’s side and later replayed at the therapist side. More recently, some works have been addressing the problem of real-time bilateral tele-rehabilitation that considers at least the real-time scenario in which the therapist could guide a rehabilitation robot that imposes the motion of a second robot that is remotely used by the patient. Lanini et al. [19] presented a teleoperation system for two six-d.o.f. ARMin arm skeletons for tele-rehabilitation, which makes use of compliance control and torque feedback. Zhang et al. [20] proposed and preliminarily tested a system focused on elbow joint motor recovery. The system consists of a bilateral control scheme, a human-upper-limb-like device as the master device for the therapist and an exoskeleton device as the slave device. Both devices are characterized by the use of elastic elements, guaranteeing a compliance control of the telerehabilitation system.
Other reports on these concepts are related to more general bilateral master-slave tele-rehabilitation robotic systems, as the one proposed by Chiri et al. [21,22] that consisted of a glove acting as the master for the therapist and a powered hand exoskeleton acting as the slave rehabilitation device for the patient. A similar approach has been reported in Farulla et al. [23], but using a vision-based pose estimation, which makes the system more intuitive for untrained personnel. However, in both cases, the focus was remote rehabilitation with a bilateral interaction to allow the therapist to adjust the task of the patient based on a real-time feedback. In fact, clinical hand tests, as according to the medical assessment scales, could not be performed with such equipment.
The paper is organized as follows. In Section 2, all of the components of the tele-operation system are described, as well as the required specifications. In Section 3, the control-system design is explained, particularly the position-force control architecture. A study of such a system, in terms of transparency, stability and performance, is then presented in Section 4. Analytical results are then compared with some preliminary experimental results in Section 5; particularly, the evaluation of the maximum perceived stiffness is a key issue for the actual tele-robotic application. Finally, conclusions are drawn in Section 6.

2. Specifications and System Description

The main goal of the proposed tele-assessment system is to implement a bilateral interaction between two haptic devices (master and slave). These devices are connected through a data network (e.g., Internet), as shown in Figure 1. In the possible application of such a system for the clinical assessment of the hand, the master operator would be the clinician; vice versa, the patient would represent the slave operator.
A task-oriented design approach for both master and slave devices usually yields dedicated system solutions. A more flexible solution, which is highly desirable, could be achieved by combining a master device dedicated to the clinical assessment, with a slave device suitable not only for the remote assessment, but also for stand-alone rehabilitation. Actually, this solution could extend the possibilities of the post-stroke therapy program, usually made of periodical assessments followed by treatments, achieving a fully-remote rehabilitation program [24].
Taking into account these considerations, a one-d.o.f. prosthetic hand (master device) was interfaced with an existing active one-d.o.f. orthosis (slave device), designed for a stand-alone hand rehabilitation of post-stroke patients.
Since our aim consists of highlighting the main issues concerning a bilateral tele-assessment system and we focus here on the measurements of the state of the hand, we can say that considering devices with one d.o.f. is not too limiting for this type of study. In fact, the results of several authors have shown that simple devices, such as single-d.o.f. hand devices, can be enough for a basic rehabilitation of the fingers in severe to moderate stroke patients. For example, the hand module of the Gentle-G [25] includes one actuator for the thumb and two for the four fingers together. The Howard [26] has one actuator for the thumb, one for the four fingers together and one for the wrist. The IntelliArm [27] (hand module) was designed to drive the hand to open/grasp at the metacarpophalangeal (MCP) and thumb joints with one d.o.f only. The tele-assessment system that is presented here is based on the same concept: a single-d.o.f. mechanism is used to actuate the flexion/extension of the four fingers together about the MCP joint.

2.1. Specifications

A person who has suffered neurological disorders commonly has a reduced range of motion (ROM), as well as muscular weakness and spasms. The clinician must evaluate these situations, in order to define the therapy program. Performing a remote assessment of impaired hands with a haptic teleoperation system should always hold the same clinical criteria of a conventional assessment. With this aim and in collaboration with the Unit of Rehabilitation at the Hospital of Padua, we have examined the main clinical tests for patient’s hand. According to the most frequently-used stroke assessment scales, (the Fugl–Meyer Assessment scale (FMA) [15] and the Medical Research Council scale (MRC) [16]), five tests can be considered as suitable for the remote clinical evaluation of the fingers on the hand:
  • Passive range of motion (ROM) test: at the beginning of the evaluating session, the clinician slowly moves the fingers on the patient’s hand (to minimize the potential-reflected response) to find the range of motion.
  • Active ROM test: the patient is asked to move the fingers on the hand up to their moving limit.
  • Muscular resistance test: the patient is asked to keep the fingers on the hand fixed, while the clinician tries to either flex or extend them.
  • Muscular force test: the patient is asked to either flex or extend the fingers on the hand, while the clinician tries to keep them blocked.
  • Spasticity test with catch angle evaluation: the clinician holds the patient’s hand and moves their fingers at different velocities in order to feel the velocity-dependence of the resistance torque and the ‘catch’, defined as the angle at which the resistance to a movement abruptly grows.
Even if we limited the study to analyzing issues concerning tests of the range of motion and muscular resistance/force only, to perform all of them, the bilateral tele-assessment system should comply with the following technical specifications:
  • Patient’s hand position sent back to the master (ROM test);
  • Fair reproduction of force (muscular/resistance test);
  • Maximum transparency at each side;
  • Stability in the presence of, at least, small network delays (standard ADSLin a limited range);
  • Maximum versatility of the slave device, in order to guarantee an effective two-fold use of the active hand orthosis (remote assessment and rehabilitation).

2.2. Master Device

The master device was designed in order to provide the most realistic sensation, either physical or psychological, to the therapist, who should be remotely evaluating the condition of the patient’s hand.
The end mechanism is formed by a prosthetic hand, drilled at the level of the joints, to which metacarpal bones and phalanges are connected. The palm and the thumb are fixed to the reference frame, while the four fingers rotate together with the shaft. The shaft itself, supported by two bearings, is actuated by a brushless motor MB 082 GA210 with 2.8 -Nm peak torque, which is driven by a PWM current amplifier (Microstar SMB60 10/20 ARM: 20-A peak current), and an ELTRA 20,000-pprresolution incremental encoder measures its angular position. The maximum force at the fingertip is around 30 N, which is in the range of the maximum force applied by the orthosis (the slave device) on the patient’s hand. Figure 2 shows the mechanism, where the fingers can move in a range of about 40 . The master device is controlled via PC and MATLAB/Simulink, using a data acquisition board (PCI Multifunction I/O Sensoray 626). All variables are sampled at 1 kHz.

2.3. Slave Device with VS-SEA

An actuated orthosis, shown in Figure 3, was used as a single-d.o.f. slave unit of the teleoperation system. The device was designed for the rehabilitation of the fingers on the hand in patients with ischemic and/or hemorrhagic stroke outcomes [28].
The chassis of the slave hand orthosis consists of a stainless steel plate, on which the patient’s forearm is tied. The plate also carries a linear series elastic actuator (SEA) block, a mechanism for moving the fingers, the control electronics and the power supply.
Let us consider the motion of the fingers in a grasp/release exercise as a simple planar movement, by neglecting the abduction/adduction. As shown in Figure 4a, the fingers acting together can be considered as a single finger, made of three links (the phalanges: z 1 , z 2 , z 9 ) and three route joints (A, D, E). The fingers are moved by means of the four-bar linkage A B C D , representing the main mechanism of the orthosis. The proximal phalanx z 1 acts as one of the links of such a mechanism, while the intermediate phalanx z 2 is related to the second link z 3 , which is rigidly rotated with respect to z 2 . A third link z 5 rigidly connects the metacarpus to the forearm support (frame of the mechanism). The last link z 4 is connected to the frame and to the intermediate phalanx by means of a phalanx support (gray color). The length of this last vector is variable in order to fit different hand sizes. The mechanism is driven by a tendon z 6 that, sliding into the pipe in Q, pushes or pulls the link z 7 that is rigidly connected to z 4 . The rigid body represented by z 4 and z 7 works as the crank link of the four-bar linkage; the link z 8 represents instead the frame of the drive mechanism Q P B . In the mechanical design of the mechanism, z 6 was implemented by means of two push-pull flexible cables, enclosed in bent aluminum pipes, as shown in Figure 3.
The cables are moved by means of the linear SEA [29], as shown in Figure 4b. It consists of a solution with an elastic element placed between the motor and the load, whose displacement is measured to implement a good force control with minimum impedance [30]. The use of SEA enhances safety, thanks to a highly compliant behavior (a desirable feature for robotic therapy) [31], in addition to provide a good impact tolerance (necessary to avoid injury to the patient) and a high force/mass ratio [30,32]. In this mechanical solution, a velocity-controlled DC motor (motor Maxon Motor 354344: 29 Nmm of continuous torque; encoder Maxon Motor HEDL 5540: 500 ppr) drives a miniature ball screw with a 12.7 -mm lead via a transmission belt (1: 3.6 transmission ratio). The nut of the ball screw is fastened to one end of four springs in parallel connection (1290 N/m spring stiffness for each), whose opposite ends push the tendons that drive the mechanism, as shown in detail in Figure 4b. A SIKO linear encoder with 200-ppmm resolution is used to measure the displacement of springs as an indirect measure of tendon force. With this configuration, a maximum fingertip force of 30 N can be reached over a maximum metacarpophalangeal (MCP) joint rotation of nearly 60 .
As detailed in the next section, the SEA is here implemented by a combination of an inner velocity loop, provided by the motor driver, and an external force control loop, implemented in a Microchip dsPIC microcontroller. The overall control strategy results in a velocity-sourced SEA (VS-SEA) [33]. Wyeth [33] showed that the VS-SEA as implemented in the orthosis (outer force loop with inner velocity loop) has well-defined characteristics that the improve safety and performance over conventional high impedance actuators and traditional SEA systems (simple force loop), which show instead a detriment of the system performance.

2.4. Communication Line and Safety

An effective bilateral interaction for remote rehabilitation requires a real-time performance of the network, which must provide a high frequency data exchange. In order to set up the communication between the clinician and the patient, a bandwidth estimation and data flow handling between master and slave stations are needed. This problem has been addressed by one of the authors [34]; hence, the same procedure is used to estimate the maximum allowable data rate between master and slave. A lost data packet can be detected by using a simple sequential numbering for each sent packet, while round trip delays are obtained by comparing timestamps with a local clock. All measurements and detection features are supported within an enhanced-UDP protocol, as described in [34].
The proposed application is conceived of only for a limited distance between the slave station (patient site) and the diagnostic center, from where the clinician could control one or more patients. Measurements in short range connections (within 100 km) conducted in Italy show that even a standard ADSL connection achieves a 25-ms round trip delay (RTT), with a 400-kbit/s sustained upload rate [35], which allows data sampling at several hundreds of Hertz. Such a high rate, however, is not actually necessary in the proposed system. In fact, this system is used mostly in assessing the characteristics of the patient’s hand, which is perceivable in a low-frequency range. This issue relaxes the requirements for the underlying network connection, in terms of throughput and jitter.
In the proposed system, data are sent through the IP connection every 10 ms, while the actual observed jitter is around 3 ms [35]. As for the variable delay, it has been handled with a simple buffering procedure. It provides a constant end-to-end delay, with a small drawback due to the slight increase of the communication delay. On the other hand, having a constant delay makes the analysis of the overall stability more treatable.
From the point of view of safety, as reported in Section 2.3, the mechanical structure of the orthosis has been conceived of to limit excessive forces at the patient’s hand. Besides, the patient is tightly harnessed with adjustable belts to the orthosis. Additional safety has been achieved by implementing the force control loop at the patient’s side of the bilateral system. Furthermore, as missing data packet in the communication line can destabilize the force control loop at the patient’s side, the missing data packets are then replaced by null packets. This guarantees that the last command force received is used in the force control loop, so an interruption in the communication link cannot harm the patient. Safety was also preliminarily tested, as shown in Section 5.

3. Control-System Design

3.1. Definition of the Control Architecture

As explained in Section 2, the proposed bilateral system is composed of a dedicated master device interfaced by an already available stand-alone rehabilitation system, which was modified in order to work as the slave device, as well. This solution led to some constraints in choosing the control strategy. Moreover, several control specifications must satisfy the functional objectives of the system.
At the slave site, the hand orthosis has a well-defined mechanical structure, designed for integrating an SEA architecture that improves the performances by implementing a control scheme. It has also a velocity loop nested into a force control loop (the so-called VS-SEA system) [33]. Therefore, the VS-SEA structure, implemented in the hand orthosis, has proven to be a constrained solution for the slave control block to ensure safety and good performances in both tele-assessment and robotic rehabilitation (see the last specification in Section 2.1). Thus, a suitable tele-operation control scheme, should consider the force reference sent forward from the master device. Then, based on the slave structure, we considered a two-channel control architecture. This architecture is simple, in such a way that it can relax the communication requirements. Furthermore, it requires a fewer number of sensors. It is easy to analyze.
A two-channel control architecture with a force channel from the master to the slave can only assume two configurations (the schemes for a two-channel teleoperation system are considered as denominated by the variable, which is measured and sent to the opposite remote site respectively from slave and master), that is force-force (F-F) or position-force (P-F). However, due to the specifications about the ROM clinical test, the patient’s hand position should be sent back to the master. This has led to a P-F controller. Specifically, since a position controller with the patient’s hand coordinate as the reference at the master side would guarantee safe movements at the patient’s side, we implemented this control mode, known as “admittance mode haptic interface” [36,37].
Considering all of the above considerations, a transparency-optimized control law was implemented in a two-channel P-F tele-operation scheme with admittance mode, also satisfying the maximum-transparency specifications.
Figure 5 shows the block diagram of the defined architecture. T d indicates the communication-channel delay, whereas V, F represent velocity and force, respectively, and Z, Y impedance and admittance. It is worth noticing that the proposed P-F architecture is slightly different from the standard P-F teleoperation system (see Figure 5), since the master command force F c m is sent to the slave site, instead of the master contact force F h . However, this choice does not compromise the analysis, as long as it remains in a bounded range of operation.

3.2. Control Design: Four-Channel and Two-Port Network Models

In the literature, several methods and frameworks have been outlined to both design and analyze teleoperation systems. In this study, we employed the two-port network approach to find here a flow-effort representation of the system, similarly as used in the electrical networks [38,39,40], necessary to derive the transparency-optimized teleoperation control law through the master-slave two-port network (MSN) matrix.
Figure 6 shows the two-port representation of the P-F teleoperation system illustrated above. At the input port (master port), the MSN block interacts with the operator (therapist); at the output port (slave port), the MSN interacts with the environment (patient). At each port, the “flow” variables are respectively F h , F e , and the “effort” variables are V h , V e .
In Figure 6, the master device was modeled as an impedance system, whereas the slave device as an admittance system, treating the motor as a velocity generator instead of a torque generator, as suggested by Robinson et al. [29] and Zaad et al. [41]. In addition, it is worth noticing that both the clinician’s and patient’s dynamic models were considered. Referring to Figure 6, the models of the clinician (operator) and the patient (environment), respectively, are represented in terms of force and velocity by these equations:
F h = Z h V h * - V h = c h + k h / s V h * - V h
V e = F e / Z e - V e * = F e / c e + k e / s - V e *
where, neglecting the neural feedback, the impedances of the hand Z h and Z e represent only the dynamics of the muscular contraction and the passive tissues, which, in a passive model of a limb, outlined as a “position generator” [42,43], may be defined as a damper-spring system with stiffness k and viscosity c [37,44].
Considering F h and - V e as the input variables, its dynamic can be represented by the inverse hybrid matrix G :
O g = V h F e = g 11 g 12 g 21 g 22 F h - V e = G · I g
In order to compute G , it is necessary to obtain both the master and the slave control action ( F c m and V c s , respectively). For this purpose, we rearranged the tele-operation system of Figure 5 in order to get an impedance-admittance type of a two-channel P-F architecture, by relying on a simplified version of a generic four-channel bilateral controller [41]. As shown in Figure 7, the dashed lines and blocks represent the parts that were not implemented in the control scheme. T d indicates the communication-channel delay, whereas C, E represent the transfer functions of the control actions and V, F velocity and force, respectively.
However, the block diagram of Figure 7 differs from the one of Figure 5, as the force coordinate sent from the master to the slave side is F h , instead of being F c m . This difference is addressed in Equation (6).
By using the same symbols of Figure 7, the resulting control block diagrams of the master and the slave are shown in Figure 8 and Figure 9, respectively. The master is an impedance device (impedance Z m ) controlled by a position regulator (Figure 8). It follows the delayed position of the slave P e , d by means of force command F c m , which is generated by both the master local position controller C m and the slave coordinating force feedforward controller - C 4 ; then, it applies a force F h to the environment with which it is in contact, in response to the measured position P h [45].
At the slave side, a VS-SEA control structure was imposed, shown in Figure 9. Here, the slave local force controller E s - 1 is fixed equal to the master coordinating position feedforward controller E 1 - 1 , achieving the external force loop, which is regulated by the SEA controller R SEA . The external force loop generates the velocity reference V ^ c s that, in free motion, is only due to the delayed master contact force F h , d (used as the force reference), and in constrained motion, it goes to zero as the measured slave contact force F e converges to F h , d . Herein, a force control at the patient’s hand is achieved. Moreover, it was assumed that friction and the equivalent reduced-to-end-effector mass of the slave device were low and/or negligible. Actually, the transition from rate control to force control follows the naturally-transitioning rate to force control (NTRFC) concept [46], as similar to those implemented in [37].
In Figure 9, the inner velocity loop is reduced to the transfer function V s V ^ c s , approximated by a first order dynamic system, with the same bandwidth of the velocity control loop. The force applied to the patient F e is generated by the spring element k s , due to the displacement between the motor output ( P s ) and the patient’s hand position ( P e ).
Using the block diagram of Figure 7, the complete equations of the LTIdynamic model for the master (impedance model) and the slave (admittance model) are expressed respectively as:
Z m V h = F h + F c m = F h - C m V h - C 4 e - s T d V e
Y s F e = - V e + V c s = - V e + V ^ c s - E 5 V e = - 1 + E 5 V e + E 1 - 1 e - s T d F h - E s - 1 F e
In Equation (5), if the exchanged force signal from the master to the slave is the master command force F c m , precisely - F c m , instead of the master contact force F h (as actually happens in the actual implementation; see Figure 5), then the actual LTI dynamic model for the slave can be expressed as:
- 1 + E 5 V e + E 1 - 1 e - s T d F h - Z m V h - E s - 1 F e
in which Equation (6) differs from Equation (5) only for the term related to Z m V h . Therefore, Equation (6) shows that if the impedance of the master device Z m is low and movements are slow (tele-assessment), force - F c m can approximate F h , i.e., Equation (6) converges to Equation(5), which explains why F h is the variable sent by the master device to the slave site in Figure 7.
At the slave side, the velocity control loop and the presence of a spring element give the representation of the slave admittance Y s and the slave local position controller E 5 , respectively:
Y s = s A s + 1 k s
E 5 = A s
Notice that E 5 does not appear as a “control action”, but it is due to the low pass filter of the velocity transfer function. Calculating the values from Equations (4) and (5), the elements of inverse hybrid matrix G are reduced to the following:
g 11 = 1 Z c m g 12 = C 4 e - s T d Z c m g 21 = E 1 - 1 e - s T d Y e s g 22 = 1 + E 5 Y e s
where Z c m = Z m + C m and Y e s = Y s + E s - 1 .

3.3. Definition of the Control Law

In order to achieve good performance and stability, maximum transparency on each side of the system is considered. Thus, a sub-optimal law of a P-F two-channel teleoperation system, derived from the optimal law for a four-channel impedance-admittance controller, was implemented.
A tele-operation system is ideally transparent if the operator works in real contact with the environment. Considering the MSN diagram block in Figure 6, from an electrical point of view, this means directly connecting the operator to the environment through the two-port block. The interpretation in terms of the MSN matrix (Equation (3)) is given by [39]:
G = Y i n V . Scale F . Scale Z o u t = 0 - 1 1 0
If the communication delay T d is negligible, it can be demonstrated that the following control law [40,41]:
E 1 - 1 = Y e s C 2 = 1 + C 6 0 E 3 = 1 + E 5 0 C 4 = - Z c m
satisfies Equation (10). However, in the P-F-type two-channel architecture, E 3 = C 2 = 0 , so the optimal law for transparency reduces to:
E 1 - 1 = Y e s = Y s + E s - 1 C 4 = - Z c m = - Z m + C m
and this does not allow for the elimination of the dynamics from the master and slave, but only an unscaled bilateral transmission of both velocity and force, as investigated further. In addition, due the VS-SEA structure, the channel E 1 - 1 was imposed equal to E s - 1 ; also, Z m was not implemented in C 4 . However, being that the acceleration signals are difficult to measure precisely, the channels E 1 - 1 and C 4 actually never compensate the master and slave dynamics, but only the local control actions [41], resulting in this final control law:
R SEA = E 1 - 1 = E s - 1 C 4 = - C m
At the master side, we assumed a position PD regulator as the master controller, working on a mass-damper system Z m , which represents the master device, as expressed in Figure 8, that in turn produces:
C 4 = - C m = - k m s + b m
Without a measure of force F h , the master local force controller C 6 was not implemented.
Moreover, at the other side, the external force loop was regulated by means of a proportional gain Gwith a low-pass filter:
R SEA = E 1 - 1 = E s - 1 = G s 1 + τ s s
The numeric values of the controller parameters are reported in Table 1.
For the tuning of the system parameters, we followed the strategy of maximizing the bilateral transmitted stiffness, increasing the proportional gain of the master position local controller in a fixed position of the system until instability. Then, we tried to recover stability, either acting on the derivative gain or eventually reducing the proportional gain.

4. System Analysis

4.1. Transparency

The system transparency can be defined in terms of transmitted impedance at the system’s sides. In fact, the system is perfectly transparent if:
Z t o = F h V h | V e * = 0 = F e V e | V e * = 0 = Z e
Z t e = F e - V e | V h * = 0 = F h - V h | V h * = 0 = Z h
where Z t o and Z t e are respectively the impedances transmitted to the operator and to the environment in absence of external inputs (see Figure 7) or, considering Figure 6, the impedances seen from the input and from the output without the presence of generators.
For the case presented here, in which the control law (Equation (12)) has been implemented as described in Section 3.3, from Equation (9), the resulting inverse hybrid matrix gives:
G = 1 Z m + C m - C m e - s T d Z m + C m E s - 1 e - s T d Y s + E s - 1 1 + A s Y s + E s - 1
This equation indicates that the P-F two-channel proposed architecture cannot reach perfect transparency, defined by Equation (10), due to the absence of both channels ch2–ch3 ( C 2 , E 3 ) and the implementation of the inverse dynamics in the feedforward controllers of channels ch1–ch4 ( E 1 , C 4 ). Indeed, if the network delay is negligible, the proposed architecture may provide an unscaled version of both velocity and force, especially at low frequencies ( g 12 - 1 , g 21 1 ), but there is no possibility of canceling the dynamics of the master and slave.

4.2. Performance

The performance of a tele-operation system can be evaluated in terms of the impedance transmitted to the operator and to the environment. By using Equations (1)–(3), the transmitted impedances of the proposed architecture are:
Z t o = F h V h | V e * = 0 = Z e + g 22 g 11 Z e + g 22 - g 12 g 21
Z t e = F e - V e | V h * = 0 = g 22 - g 21 g 12 1 + g 11 Z h Z h
However, to analyze the performance of the system, the behavior of the system should be studied for an infinite spectrum of impedance, either from the operator side or from the environment side. Then, Z t o and Z t e were studied for extreme values of Z e and Z h in order to simplify the analysis. This means studying both master and slave performances when they are either in free motion ( Z e = 0 or Z h = 0 ) or clamped ( Z e or Z h ). By using Equation (9), the limits of the perceived-impedance range can be calculated as follows:
Z t o , m i n = Z t o | Z e = 0 = ( 1 + A s ) ( Z m + C m ) ( 1 + A s ) + E s - 1 C m e - 2 s T d Z t o , m a x = Z t o | Z e = Z m + C m Z t e , m a x = Z t e | Z h = 1 + A s + E s - 1 C m e - 2 s T d Y s + E s - 1 Z t e , m i n = Z t e | Z h = 0 = 1 + A s Y s + E s - 1
Good performance is then characterized by Z t , m i n 0 and Z t , m a x . In this case, the range of the perceived impedance at the master side considerably depends on the stiffness of the local position controller C m . A higher stiffness of this controller allows a better performance at hard contact, with the drawback of degrading performances in free motion and soft contact. Furthermore, the master local controller C m together with the slave local controller E s - 1 , due to the implemented control law, influence the sensibility.
At the slave side, the local force feedback E s - 1 directly participates om the sensibility, but altering the maximum perceivable impedance, whilst it improves hard contact along with the master local controller C m , through the feedforward control actions. Instead, the local velocity feedback E 5 = A s improves the maximum perceived impedance, but also deteriorates the minimum impedance.
It is worth noticing that in a tele-rehabilitation system for clinical assessments, the movements should be performed at very slow speeds; in this way, referring to stiffnesses rather than impedances appears as a more appropriate approach. From Equation (21), the perceived stiffness can be so obtained:
k t o , m a x = k t o | k e = b m s + k m + m m s 2 + c m s
k t e , m a x = k t e | k h = s + A s 2 + G s 1 + τ s s b m s + k m s A s + 1 k s + G s 1 + τ s s
Therefore, the maximum perceived stiffnesses in static conditions, that is for s 0 , can be expressed as follows:
k t o , m a x | s 0 = k m k t e , m a x | s 0 = k m
The maximum perceived stiffness by the clinician and by the patient would be then not infinite, but limited by the proportional gain of the position controller. This result appears as intuitive at the master side, but conversely, it does not look so at the slave side. In fact, its meaning is that in static conditions, the elastic element of the SEA is not perceived at all.

4.3. Stability

The stability of an impedance-admittance teleoperation system can be evaluated by Llewellyn’s criterion, which is expressed in terms of the elements of the immittance matrix that describes the MSN system [41,47]:
An LTI two-port network is absolutely stable if and only if:
  • p 11 and p 22 have no poles in the open right half-plane (RHP)
  • any pole of p 11 and p 22 on the imaginary axis are simple and have real positive residuals
  • η p ω = - cos p 12 p 21 + 2 R e p 11 R e p 22 p 12 p 21 1 and R e p 11 0
The absolute stability only depends on the network parameters, independently from the operator’s and environment’s linearity. A system that is not absolutely stable is called potentially unstable, that is there exists a particular passive pair of operator and environment that may destabilize the system. Obviously, such a system is not necessarily unstable.
For the P-F proposed teleoperation system, using the absolute stability condition with the inverse hybrid matrix G , the stability network parameter η p f can be evaluated, getting the following expression:
η p f ω = η p f 1 + η p f 2 = = - cos - E s - 1 C m e - 2 j ω T d Y e s Z c m + 2 R e 1 Z c m R e 1 + A s Y e s - E s - 1 C m e - 2 j ω T d Y e s Z c m
If ideally the inverse dynamics at each side of the system had been integrated into the feedforward controllers ( C 4 , E 1 - 1 ) and, furthermore, the time delay had been negligible, in order to achieve the absolute stability, it would have been enough that R e 1 Z c m R e 1 + A s Y e s 1 for any frequency. However, in our case, the analysis is more complex, and the absolute stability may be guaranteed in only a certain range of frequencies and in the presence of small delays. Indeed, it can be proven that the second term η p f 2 0 at low and high frequencies, when the control parameters and system models are defined as in the case considered here. On the other hand, the larger the delay, the more difficult is the design of the controllers, as the first term of Equation (25) rapidly changes its sign with the frequency ω.
Experimentally, we found that for the considered system, stable control systems can be designed up to a delay of 30 ms. However, the evaluation of Equation (25) shows that with the parameter values defined in Section 3.3, the system is always absolutely stable for overall communication delays up to 30 ms in a range of frequency of about 0 ÷ 2.5 Hz only, as shown in Figure 10, but with a value for the proportional gain of the master position controller ( k m ) assumed to be up to 20% of the actual one. This result is not misleading since a system that is not absolutely stable is not necessarily unstable. Anyhow, this difference may be due to the model assumed here for the slave device, which actually does not account for the friction, whereas it is known that friction causes steady effects on such a system. Indeed, this could explain an allowable more increased value for k m in the actual system implementation.
Otherwise, it would be always possible to extend the region of absolute system if for example k m were reduced, with the drawback of the maximum transmissible stiffness consistently cut down. However, in our context (mostly remote assessment), the transmissible stiffness at very low frequencies is the most relevant requirement when stability is guaranteed; for this reason, we opted for a tighter master regulator.

5. Preliminary Experimental Tests

5.1. Protocol

In order to preliminarily verify the experimental behavior of the developed device, a therapist replicated a practical session of the remote assessment of the state of the hand. Specifically, she/he applied to three healthy male subjects four of the total clinical tests defined in Section 2.1, i.e., the test of the range of motion (passive and active) and the muscular/resistance force tests. The clinician instructed subjects to move the hand slowly as in an actual assessment session, which we measured about 20 ÷ 30 /s. The tests of range of motion were repeated three times consecutively (i.e., three consecutive closing/opening movements of the hand), and the motion of the subject hand was limited by using two elements, which blocked hands to simulate a reduced range of motion. For the muscular and resistance tests, both flexion and extension movement were repeated two times after some seconds, during which a subject moved the hand in order to execute the next repetition at a random hand position. In addition to such tests, a safety test was performed by the clinician for each subject, by releasing suddenly the master handle during one repetition of either flexion or extension resistance test.
Healthy subjects were used instead of patients, because a first evaluation of the system performance could be obtained only with healthy hands and in the absence of spasticity. Before the experiments, the system was conveniently tuned.

5.2. Results

In the following, we present the results of the preliminary experimental tests. Table 2 summarizes the results by showing an index of performance both for each subject and for each test repetition. For the first type of tests (ROM), this index consists of a measure of the angular range of motion, considered at the MCP joint, for both clinician and subjects; for the muscular and resistance tests, the index represents the measure of the hand stiffness.
In addition to such tests, two technical tests were also performed to measure the maximum perceived stiffnesses, which were compared to the theoretical values found in the system analysis.

5.2.1. Active and Passive Range-Of-Motion Tests

During a conventional passive ROM test, the clinician identifies movements or positions that cause pain or discomfort to the patient. Similarly, during active ROM evaluations, the patient is asked to move his or her own fingers as much as possible.
A remote passive ROM test could be conceived of as a traditional evaluation in which the therapist moves the prosthetic hand at the master side while the patient relaxes the hand plugged into the slave orthosis. Then, the clinician may determine the range of motion of the hand fingers by either experiencing an increased force at the handle or by using additional feedbacks as an audio-video streaming of the patient assessment could provide. Similarly, a remote active ROM test may be performed.
The fundamental requirement for this kind of tests, as stated also in Section 2.1, is a good bilateral tracking performance of the system. Figure 11 shows an example of tracking performance of the proposed system with an input movement provided by either the clinician at the master side (passive ROM test, Figure 11a) or a subject at the slave side (active ROM test, Figure 11b). In the first case, a low force resistance is mostly due to the relaxed hand of the healthy subject. In the latter, the resistance is due to the clinician that grasps the prosthetic hand following the subject movement. The force resistance is maximum at the limits of the movement, in which the clinician moves over the limit of the subject hand (passive ROM) or keeps fixed the master handle when the subject changes the movement direction, i.e., from flexion to extension or vice versa (active ROM). This is also evidenced by different values of the range of motion by comparing one side of the teleoperation system to the other, as shown in Table 2a.

5.2.2. Muscular and Resistance Tests

These experimental tests consist of flexion-extension movements to evaluate the state of stiffness of the hand. In Figure 12, the results of some flexion-extension tests are depicted as torque-angle diagrams.
In the first exercise, shown in Figure 12a for one subject, the clinician tried to move the subject’s hand, namely open (left figure) or closed (right figure). Consider firstly the extension case (left figure). The clinician extended up, while the subject was asked to stay still with his hand at the current position. This exercise simulates a possible remote evaluation of the muscular resistance or the flaccidity/stiffness of the patient’s hand. Then, while the clinician was trying to extend (upper curve) and release (lower curve) the subject’s hand, a fair reproduction of the force could be needed, as that which seems to be obtained by the proposed master-slave system. The pushing and releasing curves differed from each other (hysteresis) because the subject was not able to remain with his hand perfectly fixed, yet he moved it while the clinician was performing the forced extension (slightly changing his hand stiffness), leading to a releasing curve with lower force values at the same angle values. In fact, referring to the scheme of Figure 7, the generated force by the master and slave (approximately equal to the one exchanged by the operator himself, especially if the impedances are neglected) is proportional to the difference between the slave and the master positions. Because of this, a lower horizontal offset between the subject and the clinician curves resulted in a consistent reduction of the perceived force. In the opposite movement (flexion test), i.e., the clinician forces the subject’s hand in order to flex it; similar results can be seen in Figure 12a (right): the stiffness was different at the two sides; precisely, one was a scaled version of the other. This was mainly due to the fact that the operators were performing different tasks, and the maximum reachable stiffness was limited. Indeed, the subject stiffened his hand (higher stiffness) in order to hold it fixed as much as possible. The therapist softened her/his muscles (lower stiffness) and tried to create a wider offset between the position input and the actual master position. Similarly, the therapist can apply a higher force to generate the same transmitted force either to the master or to the slave.
Figure 12b shows instead two active movements performed by a subject, who was asked to extend (left figure) or flex (right figure) the fingers of his hand, trying to overcome the therapist resistance, who aimed to maintain his position. The results are again comparable with the previous ones by switching the subject, who performed the “active” task in this case, with the clinician.
Different values of stiffness at one system side if compared to the other side are also visible in Table 2b. Specifically, the table shows that the stiffness assumes lower values at the system side where the active task was performed (flexion or extension), with respect to those at the side of the passive task (keeping the hand in the same position). These results highlight that these flexion-extension tests will have to be repeated with patients in order to actually understand if the remote sensations of the therapist regarding the state of patient’s hand are comparable to those of a close interaction during an actual practical session. The results of such tests will be crucial to explain how to tune the control system in order to achieve a clear and valid tele-assessment system.
Table 2b allows us to make also a few other observations. The first one is that stiffness appears largely variable in most cases by comparing the first with the second repetition for either the clinician or the subject, regardless of the type of test (resistance or muscular). This is mainly due to a different angular position of the phalanges of the hand fingers around which either the flexion or extension test was performed. In fact, the force of the fingers is related to the configuration of the phalanges [48,49]. In this way, flexion and extension tests will have to be replicated with patients and for different angular positions in order to test the performance of the system tuning in different configurations. A last mention should be made for the comparison between resistance and muscular tests. Due to the design of experiment that expected test repetitions at random positions, i.e., not the same angular positions for the muscular tests with respect to those of resistance tests, as well as due to a limited perceived stiffness, we cannot compare the results of these two tests. It can be said that healthy subjects should present similar force values in the two tests, neglecting individual differences [48,49], but the variation of the angular position values of the phalanges in the two cases may cause small differences in stiffness. However, the comparison would assume more importance if the subjects were post-stroke patients. In fact, in that case, we could expect differences in force, as well position that could result in larger differences in stiffness by comparing the two cases around the same angular positions, due to impairments following stroke. Moreover, the force would be more reduced [50], as well as the values of stiffness, which make this system more suitable to find differences.

5.2.3. Safety Tests and Maximum Perceived Stiffness

The next tests regarded safety. During an extension test, the clinician suddenly released the master while a subject was applying a force, with a random time delay of 20 ÷ 30 ms through the communication line. Figure 12c show two examples of the resulting curves, obtained with two different subjects. Notice how a small amplitude vibration was triggered in the system and immediately adsorbed.
Stability and performance showed equivalent results either in the presence or without a small time delay, confirming the effectiveness of the tuning control parameters.
In order to evaluate the performance of the teleoperation system, some tests were also conducted by recording the maximum transmitted impedances. These tests were performed under static conditions. Therefore, we simulated an infinite-impedance condition by moving either the prosthetic hand or the orthosis’ end-effector to a certain position and by turning off the opposite device. The resulting torque-angle curves are shown in Figure 12 (red curves), more precisely in Figure 12a,b, respectively.
Particularly interesting has been the estimation of the maximum stiffnesses transmittable to the clinician ( k t o , m a x ) and to the possible patient ( k t e , m a x ). Therefore, referring to Figure 12a, the maximum stiffness seen from the operator can be computed from the line slope of the master torque-angle curve and resulted as k t o , m a x = Δ τ Δ θ 17 Nm/rad. Furthermore, the maximum stiffness seen from the environment resulted as k t e , m a x = Δ τ Δ θ 17 Nm/rad.
These values confirm the theoretical results on the system performance explained in Section 4.2, since the maximum stiffnesses at both sides approximately assumed the same value of the proportional gain of the master position regulator ( k m ), as reported in Table 1.

6. Conclusions

In this paper, a proof of concept has been presented of a new application for real-time bilateral haptic interfaces, which may extend the use of real-time teleoperation systems to the remote motor and functional clinical assessment of the hand, in patients with neurological impairments. We believe that this kind of application could have an important role, since the current trend is to bring the rehabilitation treatment to the patient’s home.
The paper has reported an example of a bilateral tele-assessment architecture, obtained by adapting a pre-existent stand-alone hand rehabilitation system, thus avoiding a new ad hoc device. Technical specifications, methods and procedures have been suggested, outlining a design framework for this kind of application.
A two-channel bilateral control system architecture has been designed and implemented. The system was preliminarily tested in a replication of a bilateral haptic interaction for the remote assessment of the state of the hand of healthy subjects, limited to the range of motion and flexion/extension tests. In these experiments, the system has proven to be a reliable framework. Furthermore, it has shown the capability of maintaining the overall stability, even in the presence of small network delays.
The theoretical analysis has shown that the level of transparency and performance was limited by the use of a two-channel architecture. Additionally, the absence of a local force controller in the master device further limited the achievable performance and stability ranges. This suggests that future versions of such a system should rely on a four-channel architecture.
Finally, further studies should investigate the extended case of master/slave devices with more degrees of freedom.

Author Contributions

Stefano Masiero highlighted the limits of tele-healthcare or tele-medicine and defined the specifications of the system proposed. Fabio Oscari, Omar Andres Daud, Giulio Rosati and Roberto Oboe studied the control-system architectures and the control strategies suitable for the potential application of the remote assessment of the clinical state of the hand. Fabio Oscari and Roberto Oboe performed the theoretical analyses. Fabio Oscari and Omar Andres Daud implemented the tele-assessment system. All authors contributed in conceiving of, designing and performing the experiments. Fabio Oscari, Omar Andres Daud and Roberto Oboe wrote most of the paper, whereas Stefano Masiero and Giulio Rosati contributed to some parts. All authors read and approved the paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Writing Group Members; Roger, V.L.; Go, A.S.; Lloyd-Jones, D.M.; Benjamin, E.J.; Berry, J.D.; Borden, W.B.; Bravata, D.M.; Dai, S.; Ford, E.S.; et al. Heart disease and stroke statistics—2012 update: A report from the American Heart Association Statistics Committee and Stroke Statistics Subcommittee. Circulation 2012, 125, e2–e220. [Google Scholar] [PubMed]
  2. Masiero, S.; Celia, A.; Rosati, G.; Armani, M. Robotic-assisted rehabilitation of the upper limb after acute stroke. Arch. Phys. Med. Rehabil. 2007, 88, 142–149. [Google Scholar] [CrossRef] [PubMed]
  3. Oujamaa, L.; Relave, I.; Froger, J.; Mottet, D.; Pelissier, J.Y. Rehabilitation of arm function after stroke. Literature review. Ann. Phys. Rehabil. Med. 2009, 52, 269–293. [Google Scholar] [CrossRef] [PubMed]
  4. Timmermans, A.A.; Seelen, H.A.M.; Willmann, R.D.; Kingma, H. Technology-assisted training of arm-hand skills in stroke: Concepts on reacquisition of motor control and therapist guidelines for rehabilitation technology design. J. Neuroeng. Rehabil. 2009, 6, 1. [Google Scholar] [CrossRef] [PubMed]
  5. Rosati, G. The place of robotics in post-stroke rehabilitation. Expert Rev. Med. Devices 2010, 7, 753–758. [Google Scholar] [CrossRef] [PubMed]
  6. Harwin, S.; Patton, J.L.; Edgerton, V.R. Challenges and opportunities for robot-mediated neurorehabiltation. Proc. IEEE 2006, 94, 1717–1726. [Google Scholar] [CrossRef]
  7. Alamri, A.; Iglesias, R.; Eid, M.; Saddik, A.E.; Shirmohammadi, S.; Lemaire, E. Haptic exercises for measuring improvement of post-stroke rehabilitation patients. In Proceedings of the IEEE International Workshop on Medical Measurement and Applications, Warsaw, Poland, 4–5 May 2007; pp. 1–6.
  8. Rosati, G.; Oscari, F.; Pacchierotti, C.; Prattichizzo, D. Effects of kinesthetic and cutaneous stimulation during the learning of a viscous force field. IEEE Trans. Haptics 2014, 7, 251–263. [Google Scholar] [CrossRef] [PubMed]
  9. Rosati, G.; Oscari, F.; Reinkensmeyer, D.; Secoli, R.; Avanzini, S.; Spagnol, S.; Masiero, S. Improving robotics for neurorehabilitation: Enhancing engagement, performance, and learning with auditory feedback. In Proceedings of the 2011 IEEE International Conference on Rehabilitation Robotics (ICORR), Zurich, Switzerland, 29 June–1 July 2011.
  10. Rosati, G.; Oscari, F.; Spagnol, S.; Avanzini, F.; Masiero, S. Effect of task-related continuous auditory feedback during learning of tracking motion exercises. J. Neuroeng. Rehabil. 2012, 9, 79. [Google Scholar] [CrossRef] [PubMed]
  11. Oscari, F.; Secoli, R.; Avanzini, F.; Rosati, G.; Reinkensmeyer, D.J. Substituting auditory for visual feedback to adapt to altered dynamic and kinematic environments during reaching. Exp. Brain Res. 2012, 221, 33–41. [Google Scholar] [CrossRef] [PubMed]
  12. Outpatient Service Trialists. Therapy-based rehabilitation services for stroke patients at home. Cochrane Database Syst. Rev. 2003, 1, CD002925. [Google Scholar]
  13. Ghasemi, F. Developing a telerehabilitation system for Hand. Int. J. Inf. Educ. Technol. 2012, 2, 1–9. [Google Scholar]
  14. Durfee, W.; Carey, J.; Nuckley, D.; Deng, J. Design and implementation of a home stroke telerehabilitation system. In Proceedings of the 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA, 3–6 September 2009; pp. 2422–2425.
  15. Deakin, A.; Hill, H.; Pomeroy, V.M. Rough guide to the fugl-meyer assessment. Physiotherapy 2003, 89, 751–763. [Google Scholar] [CrossRef]
  16. Palmer, M.L.; Epler, M.E. Fundamentals of Musculoskeletal Assessment Techniques; Lippincott Williams and Wilkins: Philadelphia, PA, USA, 1998. [Google Scholar]
  17. Park, S.; Wu, Y.N.; Ren, Y.; Zhang, L.Q. A tele-assessment system for evaluating elbow spasticity in patients with neurological impairments. In Proceedings of the 2007 IEEE 10th International Conference on Rehabilitation Robotics, Noordwijk, The Netherlands, 13–15 June 2007; pp. 917–922.
  18. Park, H.S.; Ren, Y.; Zhang, L.Q. A portable telerehabilitation system for remote evaluations of impaired elbows in neurological disorders. IEEE Trans. Neural Syst. Rehabil. Eng. 2008, 16, 245–254. [Google Scholar] [CrossRef] [PubMed]
  19. Lanini, J.; Tsuji, T.; Wolf, P.; Riener, R.; Novak, D. Teleoperation of two six-degree-of-freedom arm rehabilitation exoskeletons. In Proceedings of the 2015 IEEE International Conference on Rehabilitation Robotics (ICORR), Singapore, 11–14 August 2015; pp. 514–519.
  20. Zhang, S.; Guo, S.; Gao, B.; Hirata, H.; Ishihara, H. Design of a novel telerehabilitation system with a force-sensing mechanism. Sensors 2015, 15, 11511–11527. [Google Scholar] [CrossRef] [PubMed]
  21. Chiri, A.; Cortese, M.; de Almeida Ribeiro, P.; Cempini, M.; Vitiello, N.; Soekadar, S.; Carrozza, M. A telerehabilitation system for hand functional training. In Converging Clinical and Engineering Research on Neurorehabilitationn; Springer: Berlin, Germany, 2013. [Google Scholar]
  22. Cortese, M.; Cempini, M.; de Almeida Ribeiro, P.; Soekadar, S.; Carrozza, M.; Vitiello, N. A mechatronic system for robot-mediated hand telerehabilitation. IEEE/ASME Trans. Mechatron. 2015, 20, 1753–1764. [Google Scholar] [CrossRef]
  23. Airò Farulla, G.; Pianu, D.; Cempini, M.; Cortese, M.; Russo, L.O.; Indaco, M.; Nerino, R.; Chimienti, A.; Oddo, C.M.; Vitiello, N. Vision-based pose estimation for robot-mediated hand telerehabilitation. Sensors 2016, 16, 208. [Google Scholar] [CrossRef] [PubMed]
  24. Duncan, P.W.; Zorowitz, R.; Bates, B.; Choi, J.Y.; Glasberg, J.J.; Graham, G.D.; Katz, R.C.; Lamberty, K.; Reker, D. Management of adult stroke rehabilitation care: A clinical practice guideline. Stroke 2005, 36, e100–e143. [Google Scholar] [CrossRef] [PubMed]
  25. Loureiro, R.C.V.; Harwin, W.S. Reach & grasp therapy design and control of a 9-DOF robotic. In Proceedings of the 2007 IEEE 10th International Conference on Rehabilitation Robotics, Noordwijk, The Netherlands, 12–15 June 2007.
  26. Takahashi, C.D.; Der-Yeghiaian, L.; Le, V.; Motiwala, R.R.; Cramer, S.C. Robot-based hand motor therapy after stroke. Brain 2008, 131, 425–437. [Google Scholar] [CrossRef] [PubMed]
  27. Ren, Y.; Park, H.S.; Zhang, L.Q. Developing a whole-arm exoskeleton robot with hand opening and closing mechanism for upper limb stroke rehabilitation. In Proceedings of the 2009 IEEE 11th International Conference on Rehabilitation Robotics, Kyoto, Japan, 23–26 June 2009.
  28. Rosati, G.; Cenci, S.; Boschetti, G.; Zanotto, D.; Masiero, S. Design of a single-dof active hand orthosis for neurorehabilitation. In Proceedings of the IEEE 11th International Conference on Rehabilitation Robotics, Kyoto, Japan, 23–26 June 2009; pp. 161–166.
  29. Robinson, W. Design and Analysis of Series Elasticity in Closed-Loop Actuator Force Control. Ph.D. Thesis, Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA, 2000. [Google Scholar]
  30. Robinson, W.; Pratt, J.E.; Paluska, D.J.; Pratt, G.A. Series elastic actuator development for a biomimetic walking robot. In Proceedings of the IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Atlanta, GA, USA, 19–23 September 1999; pp. 19–22.
  31. Krebs, H.I.; Hogan, N.; Aisen, M.L.; Volpe, B.T. Robot-aided neurorehabilitation. IEEE Trans. Rehabil. Eng. 1998, 6, 7587. [Google Scholar] [CrossRef]
  32. Pratt, G.A.; Willisson, P.; Bolton, C.; Hofman, A. Late motor processing in low-impedance robots: Impedance control of series elastic actuators. In Proceedings of American Control Conference, Boston, MA, USA, 30 June–2 July 2004.
  33. Wyeth, G. Demonstrating the safety and performance of a velocity sourced series elastic actuator. In Proceedings of the IEEE International Conference on Robotics and Automation, Pasadena, CA, USA, 19–23 May 2008; pp. 3642–3647.
  34. Oboe, R. Force-reflecting teleoperation over the internet: The JBIT project. Proc. IEEE 2003, 91, 449–462. [Google Scholar] [CrossRef]
  35. Oboe, R.; Daud, O.A.; Masiero, S.; Oscari, F.; Rosati, G. Development of a haptic teleoperation system for remote motor and functional evaluation of hand in patients with neurological impairments. In Proceedings of the 11th IEEE International Workshop on Advanced Motion Control, Niigata, Japan, 21–24 March 2010; pp. 518–523.
  36. Salcudean, S.E.; Vlaar, T.D. On the emulation of stiff walls and static friction with a magnetically levitated input/output device. J. Dyn. Syst. 1997, 119, 127–132. [Google Scholar] [CrossRef]
  37. Rossi, A.; Gallina, P.; Rosati, G.; Zanotto, V. Rate-to-force control in admittance mode bilateral teleoperation. In Proceeding of the 2004 the Eleventh World Congress in Mechanism and Machine Science, Tianjin, China, 1–4 April 2004; pp. 1373–1379.
  38. Raju, J.; Verghese, G.C.; Sheridan, T.B. Design Issues in 2-port network models of bilateral remote manipulation. In Proceedings of the IEEE International Conference on Robotics and Automation, Scottsdale, AZ, USA, 14–19 May 1989; pp. 1316–1321.
  39. Hannaford, B. A design framework for teleoperators with kinestethic feedback. IEEE Trans. Robot. Autom. 1989, 5, 426–434. [Google Scholar] [CrossRef]
  40. Lawrence, D.A. Stability and transparency in bilateral teleoperation. IEEE Trans. Robot. Autom. 1993, 9, 624–637. [Google Scholar] [CrossRef]
  41. Hashtrudi-Zaad, K.; Salcudean, S.E. Analisys of control architectures for teleoperation systems with impedance/admittance master and slave manipulators. Int. J. Robot. Res. 2001, 20, 419–445. [Google Scholar] [CrossRef]
  42. Wieneke, G.H.; van der Gon, J.J.D. Variations in the output impedance of the human motor system. Biol. Cybern. 1974, 15, 159–178. [Google Scholar] [CrossRef]
  43. Kazerooni, H.; Tsay, T.I.; Hollerbach, K. A controller design framework for telerobotic systems. IEEE Trans. Control Syst. Technol. 1993, 1, 50–62. [Google Scholar] [CrossRef]
  44. Parker, R.; Salcudean, S.E.; Lawrence, P.D. Application of force feedback to heavy duty hydraulic machines. In Proceedings of the IEEE International Conference on Robotics ans Automation, Tokyo, Japan, 2–6 May 1993; pp. 375–381.
  45. Adams, R.J.; Hannaford, B. Stable haptic interaction with virtual environments. IEEE Trans. Robot. Autom. 1999, 15, 465–474. [Google Scholar] [CrossRef]
  46. Williams, L.R.; Henry, J.M.; Murphy, M.A. Naturally-transitioning rate to force control in free and constrained motion. J. Dyn. Syst. Meas. Control 1999, 121, 425–432. [Google Scholar] [CrossRef]
  47. Haykin, S. Active Network Theory; Addison-Wesley Educational Publishers Inc.: Boston, MA, USA, 1970. [Google Scholar]
  48. Kapandji, I.A. The Physiology of the Joints: The Upper Limb: 1; Churchill Livingstone: London, UK, 2007. [Google Scholar]
  49. Astins, A.D. Finger Force Capability: Measurement and Prediction Using Anthropometric and Myoelectric Measures. Master’s Thesis, Virginia Polytechnic Institute and State University, Blacksburg, VA, USA, 1999. [Google Scholar]
  50. Boissy, P.; Bourbonnais, D.; Carlotti, M.M.; Gravel, D.; Arsenault, B.A. Maximal grip force in chronic stroke subjects and its relationship to global upper extremity function. Clin. Rehabil. 1999, 13, 354–362. [Google Scholar] [CrossRef] [PubMed]
Figure 1. A simplified scheme of the teleoperation control system architecture.
Figure 1. A simplified scheme of the teleoperation control system architecture.
Sensors 16 01633 g001
Figure 2. The prosthetic-hand master device.
Figure 2. The prosthetic-hand master device.
Sensors 16 01633 g002
Figure 3. The slave orthosis.
Figure 3. The slave orthosis.
Sensors 16 01633 g003
Figure 4. Details of the slave orthosis. (a) Schematic of the whole mechanism (gray-black) connected to the finger (pink), which shows the rigid links, the revolute joints and the slider (point Q). Joints with a darker color are fixed to the frame. (b) Identification of the components included in the linear series elastic actuator (SEA).
Figure 4. Details of the slave orthosis. (a) Schematic of the whole mechanism (gray-black) connected to the finger (pink), which shows the rigid links, the revolute joints and the slider (point Q). Joints with a darker color are fixed to the frame. (b) Identification of the components included in the linear series elastic actuator (SEA).
Sensors 16 01633 g004
Figure 5. The teleoperation control system architecture.
Figure 5. The teleoperation control system architecture.
Sensors 16 01633 g005
Figure 6. Master-slave two-port network (MSN) block diagram.
Figure 6. Master-slave two-port network (MSN) block diagram.
Sensors 16 01633 g006
Figure 7. Block diagram of an impedance-admittance four-channel teleoperation system. In dashed lines, the non-used channels in the position-force (P-F) type control architecture.
Figure 7. Block diagram of an impedance-admittance four-channel teleoperation system. In dashed lines, the non-used channels in the position-force (P-F) type control architecture.
Sensors 16 01633 g007
Figure 8. Control block diagram of the master.
Figure 8. Control block diagram of the master.
Sensors 16 01633 g008
Figure 9. Control block diagram of the slave.
Figure 9. Control block diagram of the slave.
Sensors 16 01633 g009
Figure 10. Curve of absolute stability with the parameter values defined in Subsection III-C, but with the proportional gain k m of the master position controller set to 20% of the actual one.
Figure 10. Curve of absolute stability with the parameter values defined in Subsection III-C, but with the proportional gain k m of the master position controller set to 20% of the actual one.
Sensors 16 01633 g010
Figure 11. Example of position (left) and torque (right) tracking performance for the position-force (P-F) two-channel controller operating in contact with a healthy subject during a trial of a passive range-of motion test (top) and an active range-of motion test (bottom), respectively. τ (Nm) is the torque, positive for the clinician (C, blue) extension and for the subject (P, green) flexion, respectively. θ ( ) is the angle, which increases with flexion.
Figure 11. Example of position (left) and torque (right) tracking performance for the position-force (P-F) two-channel controller operating in contact with a healthy subject during a trial of a passive range-of motion test (top) and an active range-of motion test (bottom), respectively. τ (Nm) is the torque, positive for the clinician (C, blue) extension and for the subject (P, green) flexion, respectively. θ ( ) is the angle, which increases with flexion.
Sensors 16 01633 g011
Figure 12. Examples of the torque-angle diagram during resistance (top) and muscular tests (middle) either in extension (left) or flexion (right). In addition, two examples of safety tests in the presence of a communication delay are shown during resistance tests in extension (bottom). The curves for both clinician (C, blue) and subject (P, green) are reported in the positive half-right plane. τ (Nm) indicates the torque; θ ( ) is the angle, which increases with flexion. The maximum-perceived-stiffness curves (see Section 5.2.3) are shown in red.
Figure 12. Examples of the torque-angle diagram during resistance (top) and muscular tests (middle) either in extension (left) or flexion (right). In addition, two examples of safety tests in the presence of a communication delay are shown during resistance tests in extension (bottom). The curves for both clinician (C, blue) and subject (P, green) are reported in the positive half-right plane. τ (Nm) indicates the torque; θ ( ) is the angle, which increases with flexion. The maximum-perceived-stiffness curves (see Section 5.2.3) are shown in red.
Sensors 16 01633 g012
Table 1. Control parameters of the master and the slave devices.
Table 1. Control parameters of the master and the slave devices.
Master ParametersSlave Parameters
Par.UnitsValuesPar.UnitsValue
k m Nm/rad 17.38 k s Nm/rad 22.93
b m Nm/(rad/s) 0.0178 As 0.2000
m m kgm 2 0.000588 τs 0.0083
c m Nm/(rad/s) 0.009 G(rad/s)/Nm 2.18
Table 2. Results of the preliminary experimental tests for each subject and each repetition. The parameter Δ θ (a) represents the angular range of motion at the MCP joint, whereas k (b) represents the stiffness of the hand. The subscripts o , e indicate the side of the system where the parameter is measured (operator, i.e., clinician; environment, i.e., patient); the subscripts from 1–3 identify the repetition of the test; the superscripts indicate the type of test: for the range of motion tests, passive ( p ) and active ( a ); for both the resistance ( r ) and muscular test ( m ), extension (e) and flexion ( f ).
(a) Range-of-motion (ROM) tests.
(a) Range-of-motion (ROM) tests.
Subj.Passive ROM TestActive ROM Test
Clinician ROM [ ]Subject ROM [ ]Clinician ROM [ ]Subject ROM [ ]
Δ θ o , 1 p Δ θ o , 2 p Δ θ o , 3 p Δ θ e , 1 p Δ θ e , 2 p Δ θ e , 3 p Δ θ o , 1 a Δ θ o , 2 a Δ θ o , 3 a Δ θ e , 1 a Δ θ e , 2 a Δ θ e , 3 a
S1 24.08 25.87 26.28 22.42 22.24 22.90 22.43 22.25 24.50 25.13 26.35 29.27
S2 22.31 23.58 23.15 19.34 19.37 20.94 21.57 22.58 21.83 26.68 26.85 24.89
S3 26.02 25.83 24.46 22.11 22.31 21.68 22.21 23.08 23.41 25.76 26.67 26.31
(b) Resistance and muscular tests.
(b) Resistance and muscular tests.
Subj.Resistance TestMuscular Test
Extension Stiffness [Nm/rad]Flexion Stiffness [Nm/rad]Extension Stiffness [Nm/rad]Flexion Stiffness [Nm/rad]
ClinicianSubjectClinicianSubjectClinicianSubjectClinicianSubject
k o , 1 r e k o , 2 r e k e , 1 r e k e , 2 r e k o , 1 r f k o , 2 r f k e , 1 r f k e , 2 r f k o , 1 m e k o , 2 m e k e , 1 m e k e , 2 m e k o , 1 m f k o , 2 m f k e , 1 m f k e , 2 m f
S1 13.46 10.73 46.72 35.44 11.60 11.87 37.11 31.70 35.01 23.89 12.80 14.21 12.94 13.88 8.10 7.53
S2 6.51 8.12 10.43 12.61 8.43 10.66 16.78 13.53 18.86 21.27 11.14 13.33 12.28 18.69 6.5 9.38
S3 8.25 8.42 13.05 13.12 12.65 10.98 27.49 22.30 22.17 30.81 10.05 15.03 20.43 12.95 9.8 8.25

Share and Cite

MDPI and ACS Style

Oscari, F.; Oboe, R.; Daud Albasini, O.A.; Masiero, S.; Rosati, G. Design and Construction of a Bilateral Haptic System for the Remote Assessment of the Stiffness and Range of Motion of the Hand. Sensors 2016, 16, 1633. https://doi.org/10.3390/s16101633

AMA Style

Oscari F, Oboe R, Daud Albasini OA, Masiero S, Rosati G. Design and Construction of a Bilateral Haptic System for the Remote Assessment of the Stiffness and Range of Motion of the Hand. Sensors. 2016; 16(10):1633. https://doi.org/10.3390/s16101633

Chicago/Turabian Style

Oscari, Fabio, Roberto Oboe, Omar Andres Daud Albasini, Stefano Masiero, and Giulio Rosati. 2016. "Design and Construction of a Bilateral Haptic System for the Remote Assessment of the Stiffness and Range of Motion of the Hand" Sensors 16, no. 10: 1633. https://doi.org/10.3390/s16101633

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop