<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xml:lang="en" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">Sensors</journal-id>
<journal-title>Sensors</journal-title>
<issn pub-type="epub">1424-8220</issn>
<publisher>
<publisher-name>Molecular Diversity Preservation International (MDPI)</publisher-name></publisher></journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3390/s120100215</article-id>
<article-id pub-id-type="publisher-id">sensors-12-00215</article-id>
<article-categories>
<subj-group>
<subject>Article</subject></subj-group></article-categories>
<title-group>
<article-title>Online Assessment of Human-Robot Interaction for Hybrid Control of Walking</article-title></title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>del-Ama</surname><given-names>Antonio J.</given-names></name><xref ref-type="aff" rid="af1-sensors-12-00215"><sup>1</sup></xref><xref ref-type="aff" rid="af2-sensors-12-00215"><sup>2</sup></xref><xref ref-type="corresp" rid="c1-sensors-12-00215"><sup>★</sup></xref></contrib>
<contrib contrib-type="author">
<name><surname>Moreno</surname><given-names>Juan C.</given-names></name><xref ref-type="aff" rid="af2-sensors-12-00215"><sup>2</sup></xref></contrib>
<contrib contrib-type="author">
<name><surname>Gil-Agudo</surname><given-names>Àngel</given-names></name><xref ref-type="aff" rid="af1-sensors-12-00215"><sup>1</sup></xref></contrib>
<contrib contrib-type="author">
<name><surname>de-los-Reyes</surname><given-names>Ana</given-names></name><xref ref-type="aff" rid="af1-sensors-12-00215"><sup>1</sup></xref></contrib>
<contrib contrib-type="author">
<name><surname>Pons</surname><given-names>José L.</given-names></name><xref ref-type="aff" rid="af2-sensors-12-00215"><sup>2</sup></xref></contrib></contrib-group>
<aff id="af1-sensors-12-00215">
<label>1</label> Biomechanics and Technical Aids Department, National Hospital for Spinal Cord Injury, Finca La Peraleda S/N, Toledo 45007, Spain</aff>
<aff id="af2-sensors-12-00215">
<label>2</label> Bioengineering Group, National Research Council (CSIC), Carretera Campo Real km 0.200, Arganda del Rey 28500, Spain</aff>
<author-notes>
<corresp id="c1-sensors-12-00215">
<label>★</label> Author to whom correspondence should be addressed; E-Mail: <email>ajdela@sescam.jccm.es</email>; Tel.: +34-92-524-7779; Fax: +34-92-524-7745.</corresp></author-notes>
<pub-date pub-type="collection">
<year>2012</year></pub-date>
<pub-date pub-type="epub">
<day>27</day>
<month>12</month>
<year>2011</year></pub-date>
<volume>12</volume>
<issue>1</issue>
<fpage>215</fpage>
<lpage>225</lpage>
<history>
<date date-type="received">
<day>3</day>
<month>11</month>
<year>2011</year></date>
<date date-type="rev-recd">
<day>7</day>
<month>12</month>
<year>2011</year></date>
<date date-type="accepted">
<day>16</day>
<month>12</month>
<year>2011</year></date></history>
<permissions>
<copyright-statement>© 2012 by the authors; licensee MDPI, Basel, Switzerland</copyright-statement>
<copyright-year>2012</copyright-year>
<license>
<p>This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).</p></license></permissions>
<abstract>
<p>Restoration of walking ability of Spinal Cord Injury subjects can be achieved by different approaches, as the use of robotic exoskeletons or electrical stimulation of the user’s muscles. The combined (hybrid) approach has the potential to provide a solution to the drawback of each approach. Specific challenges must be addressed with specific sensory systems and control strategies. In this paper we present a system and a procedure to estimate muscle fatigue from online physical interaction assessment to provide hybrid control of walking, regarding the performances of the muscles under stimulation.</p></abstract>
<kwd-group>
<kwd>human-robot interaction</kwd>
<kwd>hybrid control</kwd>
<kwd>gait</kwd>
<kwd>exoskeleton</kwd>
<kwd>functional electrical stimulation</kwd>
<kwd>muscle fatigue</kwd></kwd-group></article-meta></front>
<body>
<sec sec-type="intro">
<label>1.</label>
<title>Introduction</title>
<p>Spinal cord injuries result in impaired motor and sensory capacities. Gait impairments are frequent consequences of spinal cord injuries and can result in partial or total absence of voluntary control of the lower limbs. A common method used to partially recover standing and walking functions is repetitive rehabilitation training over several months. Task-specific repetitive training in conventional rehabilitation therapies has been demonstrated to be beneficial. Robotic exoskeletons have been widely proposed as instruments for gait therapy [<xref ref-type="bibr" rid="b1-sensors-12-00215">1</xref>–<xref ref-type="bibr" rid="b4-sensors-12-00215">4</xref>].</p>
<p>First generations of rehabilitation robotics for gait training have been designed to allow for repetitive training over longer sessions. Further improvements have been focused on increasing the active role of the patients. This has been mainly solved by allowing the users to deviate from predefined trajectories while providing visual and force feedback.</p>
<p>Hybrid control of walking consists of the combination of motorized exoskeletons and electrical stimulation of the patient’s muscles. With this approach, artificial control of biological muscle reduces the power demand of a motorized exoskeleton and more importantly, promotes several benefits in terms of increased muscle strength and cardiorespiratory fitness. Hybrid control of walking can be then defined as the technique aimed to compensate and/or rehabilitate gait by means of delivering and controlling power to the lower limb joints where total joint power is the result of induced muscle contraction and electromechanical actuation. Hybrid control of walking requires a method for online assessment of human-robot interaction which takes into account the effects of muscle fatigue. This assessment is required for continuous generation of biofeedback values for control according to the performance of biological and artificial actuators to the specific demands of the training task. Recently developed exoskeletons that allow for repetitive delivery of physiological gait patterns to patients have been equipped with sensors and computerized feedback to give precise information to the clinician and patients regarding the performance at each gait cycle. In [<xref ref-type="bibr" rid="b5-sensors-12-00215">5</xref>] a method to calculate quantitative biofeedback values based on man-machine interaction forces is presented. Deviation with respect to reference profiles of interaction are proposed as means to calculate patient’s degree of activity. Force-based biofeedback method is proposed in [<xref ref-type="bibr" rid="b6-sensors-12-00215">6</xref>,<xref ref-type="bibr" rid="b7-sensors-12-00215">7</xref>]. In this method, values calculated are average values of forces measured within the exoskeleton while it drives the leg according to the gait cycle phase. Some researchers use ground reaction forces as a biofeedback source [<xref ref-type="bibr" rid="b4-sensors-12-00215">4</xref>]. The center of pressure is determined during gait and used to adjust the assistance during the rehabilitation procedure. Regarding muscle fatigue, a recent study has attempted to extract muscle fatigue from superficial electrical myography (EMG), concluding that muscle fatigue could not be predicted by EMG [<xref ref-type="bibr" rid="b8-sensors-12-00215">8</xref>]. Therefore other methods are need to estimate muscle performance under stimulation.</p>
<p>The aim of this paper is to present the design and preliminary study of online computerized assessment of the human-robot interaction for a hybrid gait trainer. The challenging design of force sensing in hybrid exoskeletons and the method for online computerized assessment of interaction are presented.</p></sec>
<sec sec-type="methods">
<label>2.</label>
<title>Methods</title>
<p>In a context of a more ambitious project, the target group of Spinal Cord Injured to whom the hybrid exoskeleton is directed are those whose lesion is referred as <italic>Conus Medularis</italic> [<xref ref-type="bibr" rid="b9-sensors-12-00215">9</xref>], an incomplete Spinal Cord Injury. Functional aspects of this type of lesion that affect user’s walking function are the following:
<list list-type="order">
<list-item>
<p>Hip flexor muscle (psoas) function is preserved, so the subjects can flex the hip.</p></list-item>
<list-item>
<p>The capability to generate torque at knee joint varies among subjects.</p></list-item>
<list-item>
<p>There is an absence of volitional control over ankle joint.</p></list-item></list></p>
<sec sec-type="methods">
<label>2.1.</label>
<title>Mechanical Design</title>
<p>The functional characteristics drives the exoskeleton design process. Only knee and ankle joint are actuated, given the preservation of hip flexors. The exoskeleton can be used by subjects up to 90 kg. The exoskeleton frame is based on a bi-lateral structure hinged at the knee and ankle joints, with a single external support bar, made of Aluminium 7075. It is customizable to the user due to telescopic rods built in the distal and proximal segments. Transmission of forces between the subject and the exoskeleton is secured by four girths and velcro straps, two at the thigh and two at the shank respectively.</p>
<p>The knee joint mechanism is made up of four-bar bio-inspired mechanism [<xref ref-type="bibr" rid="b10-sensors-12-00215">10</xref>,<xref ref-type="bibr" rid="b11-sensors-12-00215">11</xref>]. This mechanism allows the joint axis follow the translational motion of the physiological knee joint axis, improving kinematic compatibility between the orthosis and the subject with respect to a single-axis joint. This mechanism was modified to incorporate the actuator, comprising a DC flat motor (Maxon EC-90) and an Harmonic-Drive transmission (ratio 100:1). Motor and transmission were selected using non-pathological gait data at slow speed (0.5 m/s [<xref ref-type="bibr" rid="b12-sensors-12-00215">12</xref>]), from which maximum torque and power to drive the knee were extracted.</p>
<p>The ankle joint actuation is directed to avoid the droop foot during swing phase of walking. This function is implemented by a torsional spring, which allows a lightweight and compact design. The stiffness of the spring has been calculated from anthropometric data particularized for a 90 kg user [<xref ref-type="bibr" rid="b12-sensors-12-00215">12</xref>], in order to avoid drop foot during the swing phase, which resulted in 1.4 Nm/°. Such stiffness allows plantar and dorsal flexion during stance phases of gait with a low interference with the movement. The exoskeleton prototype is shown in <xref ref-type="fig" rid="f1-sensors-12-00215">Figure 1(a)</xref>.</p></sec>
<sec sec-type="methods">
<label>2.2.</label>
<title>Sensory System Design</title>
<p>Most of the sensory system is aimed to monitor the events and states of walking. As stated in Section 2.4, online interaction analysis makes necessary to complete the sensory system with a force sensor, which is shown in Section 2.3. An scheme of the hybrid exoskeleton’s sensory system is shown in <xref ref-type="fig" rid="f1-sensors-12-00215">Figure 1(b)</xref>.</p>
<p>Normal gait can be described as a series of states and transitions among them. Main states are <italic>stance</italic>, when the foot is contacting the floor, and <italic>swing</italic>, when the foot does not contact with the floor. These two main states impose different kinematic joint trajectory and stiffness to the exoskeleton joint actuators so the controller must be fed with the information regarding foot contact with the floor. Therefore we have implemented two <italic>Force Sensing Resistors</italic> (FSR) (Interlink Electronics Inc., 38.1 mm × 38.1 mm), placed at the heel and tip of the exoskeleton’s foot insoles, which provides an ON/OFF signal to the controller to discriminate between swing and stance.</p>
<p>As mentioned, each gait state imposes a kinematic reference to the exoskeleton’s joint actuator, so it is necessary to monitor the actual joint angle. In our design, only knee joint is actively controlled, while ankle joint is passively controlled by a torsional spring. Monitoring of knee angle is done trough a rotational potentiometer (Vishay Espectrol). In order to assess gait biomechanics, we measure also shank and trunk orientation as well as hip joint angle. Orientation of shank segment is measured by an inertial measurement unit (TechIMU, TechnAid S.L.), which gives the 3D orientation in real time. This inertial measurement unit (IMU) uses information from a 3D accelerometer, a 3D gyroscope and a 3D magnetometer to calculate the orientation of the IMU in a world-referenced coordinate system. Another IMU is used to measure trunk orientation and, combined with the shank IMU, we calculate the 3D hip angle. Also, the trunk IMU is used to monitor trunk orientation, in order to provide information about user’s equilibrium and intention: if the trunk is tilted forward, the subject aims to keep walking, while if the trunk is extended or tilted backward, the subject aims to stop walking.</p>
<p>This set of sensors, in combination with the knee actuator, the ankle passive actuator and an adequate control strategy, allows to achieve an automatic walking. However, it has been described that the users of this technology does not feel comfortable with this kind of automatic behavior [<xref ref-type="bibr" rid="b13-sensors-12-00215">13</xref>]. Therefore, volitional control of the hybrid system is accomplished by two hand-switches, implemented by a small force-sensing resistor. This implementation allows placing a hand switch on the user’s grip of crutches or walker without interfering with it. Orders implemented are: sit to stand, right leg step, left leg step, stand, and stand to sit. Those orders are combined with the information form the inertial sensor placed at the trunk to avoid dangerous situations (<italic>i.e.</italic>, order of “step” when the trunk is tilted backwards)</p></sec>
<sec sec-type="methods">
<label>2.3.</label>
<title>Force Sensor Design</title>
<p>Extracting information regarding physical interaction can be achieved via a force sensor placed on the exoskeleton structure. The interaction force is the force developed at the leg-exoskeleton interface during the movement, that is, the girths’ inner surface over the leg skin. This force, depending on the distance at the girths are placed for a specific subject, can be transformed to a torque at the knee joint level.</p>
<p>There is a broad offer of commercially available force sensors. However, it is difficult to find an adequate force sensor, with adequate geometry and range of measure, that can be placed at the exoskeleton structure. Moreover, integration of a force sensor will result on introduction of discontinuities on the structure. Therefore, we instrumented the structure to turn the structure into the force sensor itself.</p>
<p>In order to instrument the structure, we have introduced a full gauge bridge over its distal part, below the knee joint and over the first girth of the distal segment of the exoskeleton. Measurement of forces through strain gauge is based on measuring the deformation of the structure caused by the own force [<xref ref-type="bibr" rid="b14-sensors-12-00215">14</xref>]. Therefore, the exoskeleton structure must deform adequately in order to measure the interaction torque. Of course, this deformation should be enough to provide adequate resolution, but must not be excessive to not overcome the strain limit of the aluminium.</p>
<p>We performed an analysis of the exoskeleton structure in order to design most adequate geometry to achieve a desirable deformation. This analysis had a two-fold objective: first, the geometry would should allow to place a full gauge bridge. Second, an adequate range of measure must be achieved, related with the forces involved during walking. An estimation of knee joint moment during non-pathological gait at low speed [<xref ref-type="bibr" rid="b12-sensors-12-00215">12</xref>] was taken to perform the analysis. Other conditions assumed were the following:
<list list-type="order">
<list-item>
<p>Muscle electrical stimulation will develop 25% of maximum knee joint torque during walking.</p></list-item>
<list-item>
<p>Position of shank straps is the one that maximize the deformation of the structure.</p></list-item>
<list-item>
<p>Transverse stiffness must be maximized.</p></list-item></list></p>
<p>Once the geometry was designed, a verification by finite-element analysis was conducted. A maximum strain of 0.2% was obtained (<xref ref-type="fig" rid="f2-sensors-12-00215">Figure 2(a)</xref>). The actual sensor is shown in <xref ref-type="fig" rid="f2-sensors-12-00215">Figure 2(b)</xref>.</p></sec>
<sec>
<label>2.4.</label>
<title>Human-Robot Physical Interaction Assessment</title>
<p>Our hybrid approach for control of walking is based on monitoring the physical interaction between the user and the exoskeleton. Although the design and implementation of the control architecture is out of the scope of this article, it is necessary a brief description. It is shown on <xref ref-type="fig" rid="f3-sensors-12-00215">Figure 3</xref>. The control architecture has two control loops: one performs closed loop control of knee trajectory (top loop at <xref ref-type="fig" rid="f3-sensors-12-00215">Figure 3</xref>), and the other control the muscle stimulator. Coordination between the two controllers (therefore the hybrid control) is performed by the state machine, which governs both controllers. This state machine (blue box) imposes kinematic pattern to the PID controller of the knee, and the stimulation pattern (defined by channel to activate and its characteristics of intensity, frequency and pulse width) to the stimulator, regarding the information given by the sensory system.</p>
<p>Closed loop control of muscle stimulation is difficult to perform due to the absence of appropriate signals from the muscle under stimulation that allow to perform direct closed loop control of the stimulation parameters. Instead indirect measures have been taken to close the stimulation control loop, such as joint angle due to the stimulation [<xref ref-type="bibr" rid="b15-sensors-12-00215">15</xref>,<xref ref-type="bibr" rid="b16-sensors-12-00215">16</xref>], the interaction torque developed due to muscle stimulation [<xref ref-type="bibr" rid="b17-sensors-12-00215">17</xref>,<xref ref-type="bibr" rid="b18-sensors-12-00215">18</xref>] or a combination of joint angle and interaction torque [<xref ref-type="bibr" rid="b19-sensors-12-00215">19</xref>,<xref ref-type="bibr" rid="b20-sensors-12-00215">20</xref>], to adjust stimulation intensity. However, none of these work has directly managed muscle fatigue due to stimulation, therefore system’s efficacy would decrease. Our approach aims to close the stimulation loop by monitoring muscle performance through user-exoskeleton physical interaction. This information will be used to modulate stimulation intensity regarding muscle performance.</p></sec>
<sec>
<label>2.5.</label>
<title>Experimental Setup</title>
<p>We performed a preliminary experiment with a healthy subject in order to corroborate that our design is able to assess human-robot interaction for fatigue estimation. Muscle performance is assessed from physical user-exoskeleton interaction under the hypothesis that user’s joint torque developed by muscle electrical stimulation will decrease due to fatigue, as the muscle will generate less force with time while the stimulation pattern (intensity, pulse width and frequency) is kept unchanged. This reduction in muscle force must be counterbalanced by the exoskeleton actuator, applying more force to the leg, which will result in an increase of the interaction torque. Therefore, interaction torque can be used to estimate muscle fatigue due to electrical stimulation.</p>
<p>In order to have a more robust muscle fatigue estimate than instantaneous interaction torque, we have developed a metric that would represent the mean interaction torque produced during a time interval. To provide an adequate basis of comparison, we have focused only on the swing phase of gait because, considering also that the stance phase would introduce uncertainties into force readings as the user can support its own weight with the other leg (or crutches if it is a SCI user), which may vary among steps. Therefore, as the muscle fatigue index is applied to swing phase, the experiments performed were focused on such phase.</p>
<p>This mean interaction torque is calculated by equations <xref ref-type="disp-formula" rid="FD1">(1)</xref> (mean interaction torque during leg flexion) and <xref ref-type="disp-formula" rid="FD2">(2)</xref> (mean interaction torque during leg extension). In a first approach, we have analyzed the mean interaction torque during flexion and extension separately given that the muscles involved in each movement are different.
<disp-formula id="FD1">
<label>(1)</label>
<mml:math display="block">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>T</mml:mi></mml:mrow>
<mml:mrow>
<mml:mi mathvariant="italic">flex</mml:mi></mml:mrow></mml:msub></mml:mrow>
<mml:mo>¯</mml:mo></mml:mover>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo>∫</mml:mo></mml:mrow>
<mml:mrow>
<mml:mi mathvariant="italic">flex</mml:mi></mml:mrow></mml:msub>
<mml:msub>
<mml:mrow>
<mml:mi>T</mml:mi></mml:mrow>
<mml:mrow>
<mml:mi mathvariant="italic">int</mml:mi></mml:mrow></mml:msub>
<mml:mo>⋅</mml:mo>
<mml:mi mathvariant="italic">dt</mml:mi></mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>t</mml:mi></mml:mrow>
<mml:mrow>
<mml:mi mathvariant="italic">flex</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac></mml:mrow></mml:math></disp-formula>
<disp-formula id="FD2">
<label>(2)</label>
<mml:math display="block">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:msub>
<mml:mi>T</mml:mi>
<mml:mi mathvariant="italic">ext</mml:mi></mml:msub></mml:mrow>
<mml:mo>¯</mml:mo></mml:mover>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo>∫</mml:mo></mml:mrow>
<mml:mrow>
<mml:mi mathvariant="italic">ext</mml:mi></mml:mrow></mml:msub>
<mml:msub>
<mml:mrow>
<mml:mi>T</mml:mi></mml:mrow>
<mml:mrow>
<mml:mi mathvariant="italic">int</mml:mi></mml:mrow></mml:msub>
<mml:mo>⋅</mml:mo>
<mml:mi mathvariant="italic">dt</mml:mi></mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>t</mml:mi>
<mml:mi mathvariant="italic">ext</mml:mi></mml:msub></mml:mrow></mml:mfrac></mml:mrow></mml:math></disp-formula></p>
<p>In those expressions, 
<inline-formula>
<mml:math>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>T</mml:mi></mml:mrow>
<mml:mrow>
<mml:mi mathvariant="italic">flex</mml:mi></mml:mrow></mml:msub></mml:mrow>
<mml:mo>¯</mml:mo></mml:mover></mml:mrow></mml:math></inline-formula> and 
<inline-formula>
<mml:math>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:msub>
<mml:mi>T</mml:mi>
<mml:mi mathvariant="italic">ext</mml:mi></mml:msub></mml:mrow>
<mml:mo>¯</mml:mo></mml:mover></mml:mrow></mml:math></inline-formula> are the mean interaction force, calculated by integrating the interaction force measured by the sensor (<italic>T<sub>int</sub></italic>), during both flexion and extension intervals, averaged by the interval time (<italic>t<sub>flex</sub></italic> and <italic>t<sub>ext</sub></italic>, respectively). This subject did not practice sports at least for 24 h prior to the experiment. The experiments lasted 10 min, with the leg free to swing. User was requested to not to move the leg and try to relax during the experiment, in order to avoid any voluntary movement. The kinematic pattern fed to the controller was a series of flexion-extension trajectories from a non-pathologic gait kinematics database, that is, only the swing phase of gait. This kinematic pattern was slightly accelerated to shorten the experiment duration.</p>
<p>While the exoskeleton controls the joint trajectory, a synchronized stimulator (Unafet8) delivered stimulation pulses to <italic>vastus lateralis</italic> muscle during extension and <italic>biceps femoris</italic> muscle during flexion. Stimulation pulses was monophasic compensated, 300 ms pulse width and 40 Hz frequency. Stimulation intensity was set regarding user comfort perception, but high enough to achieve a functional knee joint movement. The intensity achieved was 46 mA for flexors muscles and 28 mA for extensors muscles. The delivered stimulation pulses were synchronized with the kinematic pattern. <xref ref-type="fig" rid="f4-sensors-12-00215">Figure 4</xref> shows the experiment setup.</p></sec></sec>
<sec sec-type="results">
<label>3.</label>
<title>Results</title>
<p><xref ref-type="fig" rid="f5-sensors-12-00215">Figure 5</xref> displays two different time intervals of the experiment. In these figures are shown both the evolution of the knee joint angle (black curve) and the interaction torque at knee due to interaction torque (red curve). <xref ref-type="fig" rid="f5-sensors-12-00215">Figure 5(a)</xref> shows the evolution at the middle of the trial, while <xref ref-type="fig" rid="f5-sensors-12-00215">Figure 5(b)</xref> shows the last part of it. Comparing both figures, a change can be seen in the interaction strength, namely a decrease in maximum values and also the envelope of the curve itself, while joint trajectory remains constant. This increase in the interaction with time can be attributed to muscle fatigue.</p>
<p>The change on the interaction torque can be observed more clearly through the application of the metrics defined in the <xref ref-type="disp-formula" rid="FD1">equations (1)</xref> and <xref ref-type="disp-formula" rid="FD2">(2)</xref>. By applying these metrics during leg extension, we obtain the blue curve shown in <xref ref-type="fig" rid="f6-sensors-12-00215">Figure 6</xref>. This curve shows the average interaction torque at each swing cycle. Data displayed on this curve have certain variability, so a moving average of 5 samples improves data representation (<xref ref-type="fig" rid="f6-sensors-12-00215">Figure 6</xref>, black curve), in order to detect data trend (<xref ref-type="fig" rid="f6-sensors-12-00215">Figure 6</xref>, red curve). It can be seen an increasing trend of torque interaction in these data. When compared with <xref ref-type="fig" rid="f5-sensors-12-00215">Figure 5</xref>, values shown in <xref ref-type="fig" rid="f6-sensors-12-00215">Figure 6</xref> provide more robust information about muscle performance due to fatigue.</p>
<p><xref ref-type="fig" rid="f7-sensors-12-00215">Figure 7</xref> shows the application of this metric to both the flexion (red curve) and extension phase (blue curve). During flexion movement, the magnitude of the metric is highly similar to the extension phase, as both increase its magnitude. Taking the absolute value of each curve, both can be combined into a single metric that represents the interaction torque during the whole swing phase (<xref ref-type="fig" rid="f7-sensors-12-00215">Figure 7</xref>, black curve). Linear fit coefficients of fatigue trend are in <xref ref-type="table" rid="t1-sensors-12-00215">Table 1</xref>.</p></sec>
<sec sec-type="conclusions">
<label>4.</label>
<title>Conclusions</title>
<p>In this article, we have presented a system and developed a procedure to assess human-robot physical interaction for Hybrid Control of Walking in spinal cord injured subjects. The sensory system allow online monitoring of user-robot physical interaction to assess muscle fatigue during swing phase of gait. This approach will be used during walking with the fatigue estimator active during the swing phase of gait, being inactive during stance phase and waiting to collect again data when next swing phase occurs. This estimation of muscle fatigue allows modulating muscle electrical stimulation, regarding muscle performance, which in turn would result in longer periods of muscle stimulation. Therefore, the user would benefit from longer periods of training and walking. Also, information from physical interaction can be used to implement a control strategy in which the exoskeleton controller can collaborate with a muscle stimulation controller.</p>
<p>We have shown that a decrease in muscle performance due to fatigue is immediately reflected in a decrease of interaction torque (or torque at joint level). In order to have an estimate of muscle fatigue, we have developed a metric which compares the mean interaction torque at each swing cycle. While considering both trajectories during swing phase (flexion and extension), we have obtained a similar behavior from both directions. Therefore, we can combine these values to give a more robust estimate. The work presented in this article substantiate our initial hypothesis that muscle fatigue due to muscle electrical stimulation can be estimated from interaction torque. However, from this point on, some points must be stated and solved in future work.</p>
<p>First, this preliminary experiment has been conducted with a healthy subject. Therefore these results must be validated with injured subjects, although given the weak muscular condition of such subjects, we expect that muscle fatigue would be even more clear than in a healthy subject. Second, the application to hybrid gait control must be validated. Hybrid control of gait will be performed using pre-defined muscle stimulation patterns available in the literature, while online assessing of muscle fatigue shown in this article will modulate stimulation intensity.</p></sec></body>
<back>
<ack>
<p>The research for this manuscript has been partially funded by grant from the Spanish Ministry of Science and Innovation CONSOLIDER INGENIO, project HYPER (Hybrid NeuroProsthetic and NeuroRobotic Devices for Functional Compensation and Rehabilitation of Motor Disorders, CSD2009-00067), and project REHABOT, DPI2008-06772-C03-01.</p></ack>
<ref-list>
<title>References</title>
<ref id="b1-sensors-12-00215"><label>1.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Mohammed</surname><given-names>S.</given-names></name><name><surname>Amirat</surname><given-names>Y.</given-names></name></person-group><article-title>Towards Intelligent Lower Limb Wearable Robots: Challenges and Perspectives—State of the Art</article-title><conf-name>Proceedings of the IEEE International Conference on Robotics and Biomimetics, ROBIO ’08</conf-name><conf-loc>Bangkok, Thailand</conf-loc><conf-date>2008</conf-date><fpage>12</fpage><lpage>317</lpage></citation></ref>
<ref id="b2-sensors-12-00215"><label>2.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vallery</surname><given-names>H.</given-names></name><name><surname>Veneman</surname><given-names>J.</given-names></name><name><surname>van Asseldonk</surname><given-names>E.</given-names></name><name><surname>Ekkelenkamp</surname><given-names>R.</given-names></name><name><surname>Buss</surname><given-names>M.</given-names></name><name><surname>Van Der Kooij</surname><given-names>H.</given-names></name></person-group><article-title>Compliant actuation of rehabilitation robots</article-title><source>IEEE Robot. Autom. Mag</source><year>2008</year><volume>15</volume><fpage>60</fpage><lpage>69</lpage><pub-id pub-id-type="doi">10.1109/MRA.2008.927689</pub-id></citation></ref>
<ref id="b3-sensors-12-00215"><label>3.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Riener</surname><given-names>R.</given-names></name><name><surname>Lünenburger</surname><given-names>L.</given-names></name><name><surname>Colombo</surname><given-names>G.</given-names></name></person-group><article-title>Human-centered robotics applied to gait training and assessment</article-title><source>J. Rehabil. Res. Dev</source><year>2006</year><volume>43</volume><fpage>679</fpage><lpage>694</lpage><pub-id pub-id-type="doi">10.1682/JRRD.2005.02.0046</pub-id><pub-id pub-id-type="pmid">17123208</pub-id></citation></ref>
<ref id="b4-sensors-12-00215"><label>4.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Herr</surname><given-names>H.</given-names></name></person-group><article-title>Exoskeletons and orthoses: Classification, design challenges and future directions</article-title><source>J. Neuroeng. Rehabil</source><year>2009</year><volume>6</volume><pub-id pub-id-type="doi">10.1186/1743-0003-6-21</pub-id></citation></ref>
<ref id="b5-sensors-12-00215"><label>5.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Banz</surname><given-names>R.</given-names></name><name><surname>Bolliger</surname><given-names>M.</given-names></name><name><surname>Muller</surname><given-names>S.</given-names></name><name><surname>Santelli</surname><given-names>C.</given-names></name><name><surname>Riener</surname><given-names>R.</given-names></name></person-group><article-title>A method of estimating the degree of active participation during stepping in a driven gait orthosis based on actuator force profile matching</article-title><source>IEEE Trans. Neural Syst. Rehabil. Eng</source><year>2009</year><volume>17</volume><fpage>15</fpage><lpage>22</lpage><pub-id pub-id-type="doi">10.1109/TNSRE.2008.2008281</pub-id><pub-id pub-id-type="pmid">19211319</pub-id></citation></ref>
<ref id="b6-sensors-12-00215"><label>6.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Lunenburger</surname><given-names>L.</given-names></name><name><surname>Colombo</surname><given-names>G.</given-names></name><name><surname>Riener</surname><given-names>R.</given-names></name><name><surname>Dietz</surname><given-names>V.</given-names></name></person-group><article-title>Biofeedback in Gait Training With the Robotic Orthosis Lokomat</article-title><conf-name>Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, IEMBS ’04</conf-name><conf-loc>San Francisco, CA, USA</conf-loc><conf-date>1–4 September, 2004</conf-date><volume>2</volume><fpage>4888</fpage><lpage>4891</lpage></citation></ref>
<ref id="b7-sensors-12-00215"><label>7.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Lunenburger</surname><given-names>L.</given-names></name><name><surname>Colombo</surname><given-names>G.</given-names></name><name><surname>Riener</surname><given-names>R.</given-names></name><name><surname>Dietz</surname><given-names>V.</given-names></name></person-group><article-title>Clinical Assessments Performed During Robotic Rehabilitation by the Gait Training Robot Lokomat</article-title><conf-name>Proceedings of the 9th International Conference on Rehabilitation Robotics, ICORR 05</conf-name><conf-loc>Chicago, IL, USA</conf-loc><conf-date>28 June–1 July 2005</conf-date><fpage>345</fpage><lpage>348</lpage></citation></ref>
<ref id="b8-sensors-12-00215"><label>8.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Estigoni</surname><given-names>E.H.</given-names></name><name><surname>Fornusek</surname><given-names>C.</given-names></name><name><surname>Smith</surname><given-names>R.M.</given-names></name><name><surname>Davis</surname><given-names>G.M.</given-names></name></person-group><article-title>Evoked EMG and muscle fatigue during isokinetic FES-cycling in Individuals With SCI</article-title><source>Neuromodul. Technol. Neural Interface</source><year>2011</year><volume>14</volume><fpage>349</fpage><lpage>355</lpage><pub-id pub-id-type="doi">10.1111/j.1525-1403.2011.00354.x</pub-id></citation></ref>
<ref id="b9-sensors-12-00215"><label>9.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hayes</surname><given-names>K.</given-names></name><name><surname>Hsieh</surname><given-names>J.</given-names></name><name><surname>Wolfe</surname><given-names>D.</given-names></name><name><surname>Potter</surname><given-names>P.</given-names></name><name><surname>Delaney</surname><given-names>G.</given-names></name></person-group><article-title>Classifying incomplete spinal cord injury syndromes: Algorithms based on the international standards for neurological and functional classification of spinal cord injury patients</article-title><source>Arch. Phys. Med. Rehabil</source><year>2000</year><volume>81</volume><fpage>644</fpage><lpage>652</lpage><pub-id pub-id-type="doi">10.1016/S0003-9993(00)90049-2</pub-id><pub-id pub-id-type="pmid">10807106</pub-id></citation></ref>
<ref id="b10-sensors-12-00215"><label>10.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moreno</surname><given-names>J.</given-names></name><name><surname>Brunetti</surname><given-names>F.</given-names></name><name><surname>Rocon</surname><given-names>E.</given-names></name><name><surname>Pons</surname><given-names>J.</given-names></name></person-group><article-title>Immediate effects of a controllable knee ankle foot orthosis for functional compensation of gait in patients with proximal leg weakness</article-title><source>Med. Biol. Eng. Comput</source><year>2008</year><volume>46</volume><fpage>43</fpage><lpage>53</lpage><pub-id pub-id-type="doi">10.1007/s11517-007-0267-x</pub-id><pub-id pub-id-type="pmid">17926076</pub-id></citation></ref>
<ref id="b11-sensors-12-00215"><label>11.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bertomeu</surname><given-names>J.M.B.</given-names></name><name><surname>Lois</surname><given-names>J.M.B.</given-names></name><name><surname>Guillem</surname><given-names>R.B.</given-names></name><name><surname>Pozo</surname><given-names>A.P.D.</given-names></name><name><surname>Lacuesta</surname><given-names>J.</given-names></name><name><surname>Mollà</surname><given-names>C.G.</given-names></name><name><surname>Luna</surname><given-names>P.V.</given-names></name><name><surname>Pastor</surname><given-names>J.P.</given-names></name></person-group><article-title>Development of a hinge compatible with the kinematics of the knee joint</article-title><source>Prosthet. Orthot. Int</source><year>2007</year><volume>31</volume><fpage>371</fpage><lpage>383</lpage><pub-id pub-id-type="doi">10.1080/03093640601095842</pub-id><pub-id pub-id-type="pmid">18050008</pub-id></citation></ref>
<ref id="b12-sensors-12-00215"><label>12.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Winter</surname><given-names>D.</given-names></name></person-group><source>The Biomechanics and Motor Control of Human Movement</source><publisher-name>University of Waterloo</publisher-name><publisher-loc>Hoboken, NJ, USA</publisher-loc><year>2005</year></citation></ref>
<ref id="b13-sensors-12-00215"><label>13.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Popovic</surname><given-names>D.</given-names></name><name><surname>Radulovic</surname><given-names>M.</given-names></name><name><surname>Schwirtlich</surname><given-names>L.</given-names></name><name><surname>Jaukovic</surname><given-names>N.</given-names></name></person-group><article-title>Automatic <italic>vs</italic>. hand-controlled walking of paraplegics</article-title><source>Med. Eng. Phys</source><year>2003</year><volume>25</volume><fpage>63</fpage><lpage>73</lpage><pub-id pub-id-type="doi">10.1016/S1350-4533(02)00188-1</pub-id><pub-id pub-id-type="pmid">12485787</pub-id></citation></ref>
<ref id="b14-sensors-12-00215"><label>14.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Pons</surname><given-names>J.L.</given-names></name></person-group><source>Wearable Robots: Biomechatronic Exoskeletons</source><publisher-name>Wiley</publisher-name><publisher-loc>Hoboken, NJ, USA</publisher-loc><year>2008</year><fpage>338</fpage></citation></ref>
<ref id="b15-sensors-12-00215"><label>15.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jailani</surname><given-names>R.</given-names></name><name><surname>Tokhi</surname><given-names>M.O.G.S.</given-names></name></person-group><article-title>Hybrid orthosis: The technology for spinal cord injury</article-title><source>J. Appl. Sci</source><year>2010</year><volume>10</volume><fpage>2792</fpage><lpage>2875</lpage></citation></ref>
<ref id="b16-sensors-12-00215"><label>16.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Jailani</surname><given-names>R.</given-names></name><name><surname>Tokhi</surname><given-names>M.</given-names></name><name><surname>Gharooni</surname><given-names>S.</given-names></name></person-group><article-title>Fuzzy Logic Control of Knee Extension for FES-Assisted Walking with Spring Brake Orthosis</article-title><conf-name>Proceedings of the 2010 IEEE International Conference on Systems Man and Cybernetics (SMC)</conf-name><conf-loc>Istanbul, Turkey</conf-loc><conf-date>10–13 October 2010</conf-date><fpage>379</fpage><lpage>385</lpage></citation></ref>
<ref id="b17-sensors-12-00215"><label>17.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stauffer</surname><given-names>Y.</given-names></name><name><surname>Allemand</surname><given-names>Y.</given-names></name><name><surname>Bouri</surname><given-names>M.</given-names></name><name><surname>Fournier</surname><given-names>J.</given-names></name><name><surname>Clavel</surname><given-names>R.</given-names></name><name><surname>Metrailler</surname><given-names>P.</given-names></name><name><surname>Brodard</surname><given-names>R.</given-names></name><name><surname>Reynard</surname><given-names>F.</given-names></name></person-group><article-title>The WalkTrainer—A new generation of walking reeducation device combining orthoses and muscle stimulation</article-title><source>IEEE Trans. Neural Syst. Rehabil. Eng</source><year>2009</year><volume>17</volume><fpage>38</fpage><lpage>45</lpage><pub-id pub-id-type="doi">10.1109/TNSRE.2008.2008288</pub-id><pub-id pub-id-type="pmid">19211322</pub-id></citation></ref>
<ref id="b18-sensors-12-00215"><label>18.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Schmitt</surname><given-names>C.</given-names></name><name><surname>Métrailler</surname><given-names>P.</given-names></name><name><surname>Al-Khodairy</surname><given-names>A.</given-names></name><name><surname>Brodard</surname><given-names>R.</given-names></name><name><surname>Fournier</surname><given-names>J.</given-names></name><name><surname>Bouri</surname><given-names>M.</given-names></name><name><surname>Clavel</surname><given-names>R.</given-names></name></person-group><article-title>A Study of a Knee Extension Controlled by a Closed Loop Functional Electrical Stimulation</article-title><conf-name>Proceedings of the 9th Annual Conference of the International Functional Electrical Stimulation Society</conf-name><conf-loc>Bournemouth, UK</conf-loc><conf-date>6–9 September 2004</conf-date></citation></ref>
<ref id="b19-sensors-12-00215"><label>19.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Durfee</surname><given-names>W.K.</given-names></name><name><surname>Hausdorff</surname><given-names>J.M.</given-names></name></person-group><article-title>Regulating knee joint position by combining electrical stimulation with a controllable friction brake</article-title><source>Ann. Biomed. Eng</source><year>1990</year><volume>18</volume><fpage>575</fpage><lpage>596</lpage><pub-id pub-id-type="doi">10.1007/BF02368449</pub-id><pub-id pub-id-type="pmid">2281882</pub-id></citation></ref>
<ref id="b20-sensors-12-00215"><label>20.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goldfarb</surname><given-names>M.</given-names></name><name><surname>Korkowski</surname><given-names>K.</given-names></name><name><surname>Harrold</surname><given-names>B.</given-names></name><name><surname>Durfee</surname><given-names>W.</given-names></name></person-group><article-title>Preliminary evaluation of a controlled-brake orthosis for FES-aided gait</article-title><source>IEEE Trans. Neural Syst. Rehabil. Eng</source><year>2003</year><volume>11</volume><fpage>241</fpage><lpage>248</lpage><pub-id pub-id-type="doi">10.1109/TNSRE.2003.816873</pub-id><pub-id pub-id-type="pmid">14518787</pub-id></citation></ref></ref-list>
<sec sec-type="display-objects">
<title>Figures and Table</title>
<fig id="f1-sensors-12-00215" position="float">
<label>Figure 1.</label>
<caption>
<p>Hybrid exoskeleton prototype. <bold>(a)</bold> Real prototype; <bold>(b)</bold> Scheme of the sensory system.</p></caption>
<graphic xlink:href="sensors-12-00215f1.gif"/></fig>
<fig id="f2-sensors-12-00215" position="float">
<label>Figure 2.</label>
<caption>
<p>Force sensor. <bold>(a)</bold> FEM analysis result: maximum deformation during extension; <bold>(b)</bold> Actual sensor: full bridge implementation.</p></caption>
<graphic xlink:href="sensors-12-00215f2.gif"/></fig>
<fig id="f3-sensors-12-00215" position="float">
<label>Figure 3.</label>
<caption>
<p>Hybrid control architecture.</p></caption>
<graphic xlink:href="sensors-12-00215f3.gif"/></fig>
<fig id="f4-sensors-12-00215" position="float">
<label>Figure 4.</label>
<caption>
<p>Experiment setup.</p></caption>
<graphic xlink:href="sensors-12-00215f4.gif"/></fig>
<fig id="f5-sensors-12-00215" position="float">
<label>Figure 5.</label>
<caption>
<p>Knee joint kinematics and interaction torque during an experiment. <bold>(a)</bold> Middle cycles of the experiment; <bold>(b)</bold> Last cycles of the experiment.</p></caption>
<graphic xlink:href="sensors-12-00215f5.gif"/></fig>
<fig id="f6-sensors-12-00215" position="float">
<label>Figure 6.</label>
<caption>
<p>Mean interaction torque.</p></caption>
<graphic xlink:href="sensors-12-00215f6.gif"/></fig>
<fig id="f7-sensors-12-00215" position="float">
<label>Figure 7.</label>
<caption>
<p>Muscle fatigue estimation metrics.</p></caption>
<graphic xlink:href="sensors-12-00215f7.gif"/></fig>
<table-wrap id="t1-sensors-12-00215" position="float">
<label>Table 1.</label>
<caption>
<p>Linear fit coefficients.</p></caption>
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td align="left" valign="top">Flexion</td>
<td align="center" valign="top">0.0031 Nm/cycle</td></tr>
<tr>
<td align="left" valign="top">Extension (abs.)</td>
<td align="center" valign="top">0.0032 Nm/cycle</td></tr>
<tr>
<td align="left" valign="top"><bold>Total swing phase</bold></td>
<td align="center" valign="top"><bold>0.0063 Nm/cycle</bold></td></tr></tbody></table></table-wrap></sec></back></article>
