Next Article in Journal
Removal of Ionic Liquids from Oil Sands Processing Solution by Ion-Exchange Resin
Next Article in Special Issue
Real-Time Whole-Body Imitation by Humanoid Robots and Task-Oriented Teleoperation Using an Analytical Mapping Method and Quantitative Evaluation
Previous Article in Journal
Correlation between Coda Wave and Stresses in Uni-Axial Compression Concrete
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Towards Online Estimation of Human Joint Muscular Torque with a Lower Limb Exoskeleton Robot

1
State Key Laboratory of Robotics and System, Harbin Institute of Technology (HIT), Harbin 150001, China
2
Shenzhen Academy of Aerospace Technology, Shenzhen 518000, China
3
Department of Advanced Robotics, Istituto Italiano di Tecnologia, Via Morego 30, 16163 Genova, Italy
*
Authors to whom correspondence should be addressed.
Appl. Sci. 2018, 8(9), 1610; https://doi.org/10.3390/app8091610
Submission received: 9 August 2018 / Revised: 7 September 2018 / Accepted: 8 September 2018 / Published: 11 September 2018
(This article belongs to the Special Issue Human Friendly Robotics)

Abstract

:
Exoskeleton robots demonstrate promise in their application in assisting or enhancing human physical capacity. Joint muscular torques (JMT) reflect human effort, which can be applied on an exoskeleton robot to realize an active power-assist function. The estimation of human JMT with a wearable exoskeleton is challenging. This paper proposed a novel human lower limb JMT estimation method based on the inverse dynamics of the human body. The method has two main parts: the inverse dynamic approach (IDA) and the sensing system. We solve the inverse dynamics of each human leg separately to shorten the serial chain and reduce computational complexity, and divide the JMT into the mass-induced one and the foot-contact-force (FCF)-induced one to avoid switching the dynamic equation due to different contact states of the feet. An exoskeleton embedded sensing system is designed to obtain the user’s motion data and FCF required by the IDA by mapping motion information from the exoskeleton to the human body. Compared with the popular electromyography (EMG) and wearable sensor based solutions, electrodes, sensors, and complex wiring on the human body are eliminated to improve wearing convenience. A comparison experiment shows that this method produces close output to a motion analysis system with different subjects in different motion.

1. Introduction

Exoskeleton robots demonstrate promise in their application in assisting or enhancing human physical capacity [1,2,3,4]. Estimating the intention of the user is fundamental for collaborative control of such wearable robots [5,6,7,8,9]. For an intention-based, active, power-assist exoskeleton, such as the Hybrid Assistive Limb (HAL) [10] from Tsukuba University and the Soft Exosuit [4] form Harvard University, a estimation of human effort is required by the controller to actively generate and exert assistive force/torque onto the human body. In fact, the joint muscular torque (JMT) reflects the human effort of each joint [2]. It not only indicates the direction in which the human tends to move the limbs, but also reflects the intensity of the effort. Previous research has confirmed the effectiveness of using JMT for active power-assist control with various kinds of exoskeleton robots [11,12,13]. However, estimating JMT is challenging.
More recent research has focused on improving the portability, stability, and convenience of solutions for JMT estimation. Some pure mechanical walking assist exoskeletons have been developed for simplicity and practicability. Elastic elements and cams have been adopted in mechanical structures to mimic human joint torque in some motion patterns, such as walking and running. Through the use of this torque, the exoskeleton is able to help the human body to perform some specific motion. Cristian C. et al. designed a mechanical system to help users with a walking disability [14]. Collins SH et al. proposed an unpowered ankle exoskeleton to help with the reduction of the user’s metabolic rate during walking [3]. An orthotic knee-extension made use of the gravity balancing technique to compensate for the user’s body weight [15]. These simplified solutions are good for reducing the weight and cost, and increasing the reliability, but they are always not adaptable to complex and changeable motion patterns, because the JMT of the human body changes during different motions, and the mismatch of the torque curve can lead to motion interference. A general solution is required to support the voluntary motion of a human body. There are two general methods for JMT estimation: (1) the electromyography (sEMG) based biological method, and (2) the inverse dynamics approach (IDA) based physics solution.
sEMG is an intuitive biological signal for detecting muscle activity. Buchanan et al. estimated joint moments and muscle forces using sEMG signals and verified them with inverse dynamics [16]. HAL is a typical active power-assist exoskeleton that uses sEMG [2]. Electrodes are pasted on the human body to determine the sEMG of each muscle group, and muscle activities are estimated to derive JMT based on the HAL generated assistive torques. Many other exoskeletons also use sEMG [11,12,13,17]. However, some limitations of sEMG are still under research. For example, in [18], it was concluded that sEMG is susceptible to the variation of electrode–skin conductivity, positioning, muscle fatigue and interactions between nearby muscles, so calibration is always required which increases the inconvenience of this method’s use. Complex wiring on the human body also influences its wearing convenience.
IDA has been successfully applied in clinical gait analysis. In Ref. [19], IDA was adopted to calculate human JMT during sit-to-stand movement. In Ref. [20], a motion capture system and several force plates were used to sense motion information and foot contact force (FCF). The entire clinical gait analysis system is universal but lacks portability. Hence, many wearable solutions have been proposed in recent years. Goniometers, inertial measurement units (IMUs), and air bladder based ground reaction force (GRF) measurement insoles are commonly used for human kinematic and kinetic measurements [21,22]. The problem is that it is difficult to precisely locate the wearable sensors and maintain stability on the soft tissue of the human body. Insoles with air bladders have always been always adopted to detect foot contact state, but it is difficult to get a precise GRF, because uneven distortion during complex foot–ground contact states leads to nonlinearity. In addition, the horizontal GRF cannot be measured by the insole either, which can cause error during joint torque estimation. Suin Kim et al. [23] proposed a wearable sensing system including IMUs and GRF measurement insoles to estimate the JMT in the sagittal plane. T. Liu et al. [24] developed a mobile force plate and motion analysis units to estimate 3D JMT. These devices are specifically designed to acquire the motion data of a human body, but are used to control an exoskeleton robot; thus, both the motion data of the user and the robot itself are required. It is unnecessary to introduce two sensing systems to measure the motion information of the user and the exoskeleton, respectively.
An exoskeleton embedded sensing system has the potential to collect motion data from the user, but few have taken advantage of this. H. Kazerooni et al. developed Berkeley Lower Extremity Exoskeleton (BLEEX) with integrated linear position sensor and foot pressure sensors [25]. They focused on minimizing human–exoskeleton interaction forces. They did not fully investigate the estimation of JMT using those embedded sensors. Researchers also developed the manipulator based human stiffness features learning method [26]. Saccares et al. designed another embedded sensing system [27]. They used the positions of the exoskeleton thigh and shank, and ground reaction forces on human feet in their simplified static shank equilibrium method (SSE) to calculate the torque command to the knee joints. B. Hwang et al. developed rehabilitation exoskeletons to measure the user’s JMT. In this method, the required joint torques of both the human body and the exoskeleton are calculated by inverse dynamics, respectively. The JMT is derived by removing the required joint torque of both the exoskeleton and the human limbs from the measured joint torque by torque sensors in the exoskeleton joints. The method in Ref. [28] is valid only during swing motion, and was improved in reference [29]. An insole sensor with air bladders was introduced to measure the GRF, which extends their method to the stance phase. However, the insole cannot measure the horizontal GRF. This may lead to estimation error. Besides, the influence of hip acceleration was not discussed.
This work presents a novel implementation of the human lower limb JMT estimation method to devise an online JMT estimation solution that can be used to achieve active power-assist function on our prototype active power-assist lower limb exoskeleton (APAL) [30]. The main achievement of this paper is the design of an embedded sensing system and a specially designed inverse dynamics process. The sensing system is integrated in the exoskeleton structure which does not mount any sensors on the human body but obtains the motion data and interaction forces of the human body by mapping motion from the exoskeleton to a human model. Unlike traditional IDA, we solve the inverse dynamics of each human leg separately to shorten the serial chain and reduce the computational complexity. The JMT is divided into two parts which we call the mass-induced one and the FCF-induced one to avoid discontinuous dynamic equations due to different contact states of feet.
The rest of the paper is organized as follows. Section 2 presents a parameterized model of the human body and specially designed inverse dynamics for estimating JMT, and then presents the embedded sensing system including trunk posture, joint motion information, and foot contact force. Section 3 demonstrates and discusses the results of the JMT estimation experiments. Finally, the conclusions of this paper are presented in Section 4.

2. Methods

Human JMT cannot be measured directly, but within the framework of Newtonian mechanics, the interaction forces/torques in a rigid body system can be deduced from the motion information and external forces acting on it. This notion holds for the human body. For application to the control of an exoskeleton robot, a novel sensing system and the relevant IDA are designed to meet the requirements of portability and simplicity.

2.1. Parameterized Model of the Human Body

As shown in Figure 1, a parameterized model of a human body was adopted to solve the IDA in the sagittal plane. In this method, the human body is represented by a 5-bar model. There have been many relevant discussions about the calculation of body dimensions and inertial parameters. In Ref. [31,32], quadratic regression equations are presented to derive different subjects’ individual parameters using only his/her weight and height.

2.2. Inverse Dynamics of the Human Body

Generally, the human walking process includes several states, such as (i) single support, (ii) double support, and (iii) double off-the-ground. Dynamic models of these states are also different due to different constraints on the feet. Commonly, a finite-state-machine (FSM) should be employed to switch between the dynamic equations of each state. However, this can increase the complexity of the control algorithm for state classification.
To solve the JMT, this model considers the dynamics of each leg separately, instead of treating the dynamics of the human body as a whole, thereby shortening the kinematic chain from the 5-bar model of the entire body to a 2-bar model of each leg. This helps to reduce the computational complexity and local disturbances. In inverse dynamic formulas of joint torque, there are several components, including torques caused by inertial, coriolis, gravity, and external forces. Each component is linearly added. So, we are able to further factorize the inverse dynamics of a single leg into the mass-induced one and FCF-induced one. This helps to avoid switching dynamic equations due to different contact states of the feet.
The proposed method is limited by several assumptions: (1) it only investigates motion in the sagittal plane for simplicity, thereby neglecting motion and force in the coronal plane and the frontal plane; (2) inertial torque caused by ankle movement is neglected; and (3) the foot and shank are considered as one component in the human model during the swing phase.
In the estimation of mass-induced torques, the leg is considered to be suspended to component B by the hip joint where the coordinate origin is set as shown in Figure 2a. The Lagrange method is adopted on this two-bar dynamic model with floating pedestals. First, the coordinates of the center of mass of component T are determined in the global coordinate system O W .
x C T = x H + l C T s i n ( θ T ) z C T = z H + l C T c o s ( θ T ) .
Next, the motion velocity of the center of mass for component T is derived:
x ˙ C T = x C T x H x ˙ H + x C T θ T θ ˙ T z ˙ C T = z C T z H x ˙ H + z C T θ T θ ˙ T .
Then, the coordinates of the center of mass for component S in the global coordinate system O W are derived:
x C S = x H + l T s i n ( θ T ) + l C S s i n ( θ S ) z C S = z H + l T c o s ( θ T ) + l C S c o s ( θ S ) .
Next, the motion velocity of the center of mass for component S is derived:
x ˙ C S = x C S x H x ˙ H + x C S θ T θ ˙ T + x C S θ S θ ˙ S z ˙ C S = z C S z H z ˙ H + z C S θ T θ ˙ T + z C S θ S θ ˙ S .
Thereby, the total kinetic energy of the system is calculated:
K = 1 2 m T ( x ˙ C T 2 + z ˙ C T 2 ) + m S ( x ˙ C S 2 + z ˙ C S 2 ) + I T θ ˙ T 2 + I S θ ˙ S 2 .
In addition, the potential energy of the system is calculated:
P = m T g z T m s g z s .
The, we get the equation of the mass-induced torque:
τ T 1 = d d t ( K P ) θ ˙ T ( K P ) θ T τ S 1 = d d t ( K P ) θ ˙ S ( K P ) θ S .
In the estimation of FCF-induced JMT, the human feet contacting the shoes and the upper end of the leg support the entire trunk. The JMTs are calculated via the force equilibrium equation, as shown in Figure 2b. The FCF values, including F F x , F F z and τ F y , are measured, and the force balance equations are solved to derive the hip and knee JMTs τ T 2 and τ S 2 :
τ T 2 = F F x ( l T c o s ( θ T ) + l S c o s ( θ S ) ) + F F z ( l T s i n ( θ T ) l S s i n ( θ S ) ) + τ F y τ S 2 = F F x l S c o s ( θ S ) F F z l z s i n ( θ S ) + τ F y .
Finally, the mass- and FCF-induced JMTs are summed up and the total JMT of the hip and knee is derived:
τ T = τ T 1 + τ T 2 τ S = τ S 1 + τ S 2 .

2.3. Sensing System Design

A sensing system was designed to measure all signals required by the proposed IDA, including the posture of the trunk (B), the acceleration of hip joints ( O 1 and O 2 ), the angular displacement/velocity/acceleration of the hip and knee joints, and the foot contact forces (FCF). To avoid misalignment of the sensor and user discomfort, the motion information of the human body is not measured directly by mounting sensors on the human body. Instead, the entire sensing system is embedded into the exoskeleton structure to get the motion information about the exoskeleton. Then, according to the motion mapping from the exoskeleton to the human model, the user’s motion data are derived. The motion mapping is ensured by the structural design, the description of which can be found in Ref. [30]. The sensing system is described below.

2.3.1. Overall Hardware Architecture

The active power-assist lower limb exoskeleton APAL [30] is introduced in Figure 3. The central controller is a B & R PLC (Programmable Logic Controller by B & R Industrial Automation GmbH, Eggelsberg, Austria). The inertial measurement unit (IMU) data are read by the PCL through the RS-232 bus. The linear displacement sensors (LDS) placed on the hip and knee joints, as well as 1D and 3D force sensors in the sole, are connected to an AD converter. The inverse dynamics are solved online in the PLC. An external PC records the result from the PLC in real-time via an ethernet bus.

2.3.2. Trunk Posture and Hip Joint Acceleration Measurements

The human body is firmly connected to the exoskeleton via the trunk and feet, and a unique motion mapping from the exoskeleton to the human body is ensured by APAL kinematics and its structure design. Thus, we are able to derive motion data of the human body from the embedded sensing system in the exoskeleton. An IMU is adopted to measure the trunk posture and acceleration of the hip joints. As shown in Figure 4, the axis of the IMU is set parallel to the body coordinate axis, so IMU directly provides the attitude ( W θ I M U = { θ r o l l , θ p i t c h , θ y a w } ) in the world coordinate system (WCS), and the angular velocity ( B θ ˙ I M U = { ω r o l l , ω p i t c h , ω y a w } ) and acceleration ( B a I M U = { B x ¨ I M U , B y ¨ I M U , B z ¨ I M U } ) of the body coordinate system (BCS). The angular acceleration ( B θ ¨ I M U ) of the IMU in the BCS can be obtained via the first-order difference of B θ ˙ I M U . To improve the smoothness and reduce the high-frequency noise induced by quantization error, interpolation and a low pass filter are used.
For the trunk posture, since the IMU is fixed in the exoskeleton back frame which is securely connected to the human trunk, the posture of component B equals W θ I M U . The acceleration ( W x ¨ H , W y ¨ H , W z ¨ H ) of the hip joint cannot be measured directly in the WCS by the IMU because O 1 and O 2 do not coincide with O B , but they can be derived through kinematic relations. The acceleration ( B a I M U ) obtained by the IMU is first converted from the BCS to the WCS as W a I M U = B t o W R · B a I M U , where B t o W R is the rotation matrix for the BCS–WCS conversion. Let the coordinates of the IMU in the BCS be B P I M U , and those in the WCS be W P I M U . Thus, the coordinates of the left hip joint in the BCS are B P H , and those in the WCS should be W P H = B t o W R · ( B P H B P I M U ) + W P I M U . The acceleration in the WCS is W a H = W P ¨ H = B t o W R ¨ · ( B P H B P I M U ) + W a I M U . Here, B t o W R ¨ is the second-order differential of the rotation matrix ( B t o W R ). The required W x ¨ H and W z ¨ H are components of W a H on axes x W and z W , respectively.

2.3.3. Hip and Knee Joint Kinematics Information Measurement

The angles of the hip and knee joints are derived from the respective measurements of the cylinder displacement of the exoskeleton. The displacement signals ( S H and S K ) from LDSs are converted into hip and knee joint angles ( θ H and θ K ), according to the geometry of the joints, as shown in Figure 5. The angular velocities ( θ ˙ H and θ ˙ K ) are obtained via the first-order differences of θ H and θ K . Similarly, the angular accelerations ( θ ¨ H and θ ¨ K ) are obtained from the first-order differential of θ ˙ H and θ ˙ K .
The exoskeleton is design with its hip and ankle axes close to those of the user. The back frame and shoes are firmly connected to the user. So, we can assume that the coordinates of the exoskeleton ankle joints in the BCS are nearly the same as those of the human body. This can be expressed as follows:
x F = l T e s i n ( θ H e ) l S e s i n ( θ K e θ H e ) = l T s i n ( θ H ) l S s i n ( θ K θ H ) z F = l T e c o s ( θ H e ) + l S e c o s ( θ K e θ H e ) = l T c o s ( θ H ) + l S c o s ( θ K θ H )
where θ H e and θ K e are the hip and knee joint angles of the exoskeleton; l T e and l S e are the lengths of the thigh and shank of exoskeleton, which are 450 m m and 440 m m , respectively; and l T and l S are the lengths of components T and S of the simplified human model, which are 424 m m and 422 m m , respectively. Equation (10) allows us to derive the joint angles of the human body ( θ H and θ K ), as well as θ ˙ H , θ ˙ K , θ ¨ H , and θ ¨ K .

2.3.4. Foot Contact Forces (FCFs) Measurements

A special shoe was developed to measure FCF in the sagittal plane. Note that the FCF is an interaction force between the foot and shoe. It is different from GRF. GRFs only appear when the foot touches the ground, but FCFs exist in both the stance and swing phases. There are three components of FCF in the sagittal plane, which include F F x in the front–rear direction, F F z in the up–down direction, and torque T F y on the dorsiflexion axis. The force condition of the sole is complex. There are many contact states of the sole during exercise, such as heel strike, full foot landing, forefoot landing, and toe landing, while ground unevenness can also cause unpredictable deformation of the sole. Moreover, rotational freedom of the human toe joint is required for walking stability and energy saving [33], so the sole should be flexible. Thus, a double-layer elastic steel sole structure was designed, as shown in Figure 6a.
The proposed design utilizes a combination of a 3D force sensor and two 1D force sensors. The 3D force sensor is arranged slightly behind the toe joint, and the sensor can obtain the up–down direction force ( F z 2 ) and the front-rear direction force ( F x 2 ). A 1D force sensor with a high overload margin is set under the heel to measure the GRF ( F z 1 ) on the heel. A 1D force sensor is placed under the toe to measure the supporting force ( F z 3 ). The sensor layout and force analysis model are shown in Figure 6b.
For computational purposes, the force signals obtained from the force sensors are synthesized to the ankle joint. The resultant forces can be calculated based on the location of the force sensors:
F F x = F x 2 F F z = F z 1 + F z 2 + F z 3 τ F y = F x 2 l 4 F z 1 l 1 + F z 2 l 2 + F z 3 l 3 .

3. Experimental Results and Discussion

3.1. Motion Data Sampling and JMT Estimation

In this experiment, the user wearing the exoskeleton did ran in place with a stride frequency of approximately 2.8 Hz. The power unit of the exoskeleton was switched off and all joints were set free to avoid interference. The weight of the exoskeleton was assumed to be carried by the subject. The motion information of the human body was acquired by the embedded sensing system.The hip and knee JMTs were calculated by the controller of the exoskeleton and sent to a PC in real-time for recording and graphing. We had five subjects. Their parameters were calculated according to previous research [31,32] and are listed in Table 1. Only subject 1 participated in this experiment.
(1)
The Posture of the Trunk
Since we only studied the motion in the sagittal plane, just the pitch angle was required. The maximal sample frequency of the IMU is 100 Hz. For smoother IDA, a higher sample frequency, e.g., 1 kHz is required. So, a first-order-sample-and-hold, a linear interpolation, and a low-pass filter were adopted to deal with the original signal from the IMU. As shown in Figure 7, in each step of running in place, the trunk inclines forward and pitches slightly in the range of (−20 ,−16 ). The original signal ( ω 0 ) looks like a step wave with steep edges after each sampling. This can cause mutation on the on pitch angular acceleration. After linear interpolation and filtering, a smooth and high sample frequency pitch angle ( ω 2 ) was acquired.
(2)
The Acceleration of the Hip Joints
Figure 8 shows the acceleration on hip and knee joints in the sagittal plane. Both a L H x and a R H x vary around the zero axis in the range of (−5 m/s 2 , 5 m/s 2 ), and a L H z and a R H z have a − 9.8 m/s 2 bias caused by gravity.
(3)
The Joint Kinematics Information
Figure 9 shows the displacement of hydraulic cylinders and the angles of the hip and knee joints of the exoskeleton robot. The stroke range of the linear displacement sensor is (0 mm, 73 mm), corresponding to the knee joint angle range of ( 0 , 135 ), and that of the hip joint of ( 15 , 150 ). During running in place, the hip and knee joint angles varied from 38 to 65 and from 60 to 100 , respectively. The four joints did not reach the stroke limit. The lengths of the thighs and shanks of the exoskeleton were manually adjusted to be slightly larger than those of the user. This helps to avoid a dead point when the knee joint approaches 0 . Doing this does not affect the motion mapping.
Figure 10 shows the motion information of the human body. It can be seen that the joint angular velocity is relatively smooth, but sharp variations appear in the angular acceleration which are caused by the touchdown impact.
(4)
The Foot Contact Forces
The signals from the sensor and the resultant force are shown in Figure 11. During running in place, the toe touches the ground first, so a force ( F z 3 ) below the toe is generated. The appearance of F z 1 from the heel indicates that the entire foot is on the ground. The following is the push-off process. The resultant force in the vertical direction is significantly higher than the user ’s gravity, pushing the body to accelerate upwards and leap. Until the overall toe force drops to zero, the foot leaves the ground and switches to the swing phase. At this stage, FCF should be zero, but since the power system of the exoskeleton is not switched on, the gravity of the exoskeleton leg poses a negative vertical force on the human foot. This demonstrates that the force measurement shoe is adaptable to different foot contact states. It can measure the human FCF in both the stance and the swing phases.
(5)
JMT estimation
After all required parameters and variables for solving the human inverse dynamics equation were obtained, the mass-induced torques at the hip and knee joints τ T 1 and τ S 1 were derived via Equation (7), as shown in Figure 12a. The FCF-induced torques ( τ T 2 and τ S 2 ) were derived via Equation (8), as shown in Figure 12b. The resultant JMT ( τ T ) was calculated via Equation (9), as shown in Figure 12c.
In Figure 12c, LST means the left leg is in stance phase, LSW means the left leg is in swing phase, R means the right leg, and DST means both the left and the right legs are in the stance phase. As shown in Figure 12a, the left hip torque drops to −7.3 Nm in the stance phase and rises up to about 40 Nm just after the DST. It again drops to −12.3 Nm in the middle of swing phase, and rises up to about 51 Nm before the left leg enters the stance phase. The trend of the right hip torque is similar to the left one. The knee torques are significantly smaller than the hip torque, because the knee only drives the shank and foot, but the hip takes the entire mass of the leg. The amplitudes of mass-induced JMT show no significant difference between the swing and the stance phase.
The FCF-induced torque shown in Figure 12b is significantly larger than the mass-induced torque. All FCF-induced JMT in swing phase are very small. However, in the stance phase, the peak of the hip torques reach up to 90 Nm, while the peak of the knee torques rise up to about 270 Nm. Unlike the mass-induced torques, the knee torques are larger than the hip torques. Most of the time, FCF-induced hip and knee torques during running in place are positive because the knees usually bend during stance phase and the upper body leans forward. The total torques are combinations of the mass-induced torques and the FCF-induced torques. Their amplitudes and curves are close to the FCF-induced torques, which indicates that the FCF-induced torques are the major parts. The trend of the right leg is similar to the left leg, but some local differences still exist due to the asymmetric nature of the two legs.
From the results, we can declare that the proposed method successfully acquired the joint torque of the human body without any auxiliary devices. The integrated sensor system ensures its portability. Besides, there is no need to mount sensors on the human body. This makes it easier to wear and take off. The newly designed IDA process is also beneficial to the accuracy of torque estimation. The mass-induced joint torque is far smaller than the FCF-induced one. According to Equation (8), FCF and the joint angles are major factors that influence the FCF-induced torque. Since the FCF is directly measured by force sensors, and the joint angles are derived from the signals of the displacement sensors, errors caused by the differentiation and inaccuracy of the human model do not influence the major part of the final results. As shown in Figure 11, even though large impacts existed in the angular accelerations of the hip and knee joints, they did not cause noticeable mutations in the total torque curves. The torque curves were smooth and continuous, which allows an exoskeleton robot to provide compliant man–machine coordination, because whatever the foot contact status changes into, no switching of dynamic equations is required; thus, there is no sudden change in the output.

3.2. Comparison Experiments

We carried out comparison experiments with an independent motion analysis system (MAS) developed by Motion Analysis Corporation (Santa Rosa, CA, USA) to verify the overall accuracy and adaptability of the proposed method with different users in different motion. Five subjects were employed to wear the APAL exoskeleton, and 22 markers were attached to each subject. The subject performed squatting, running in place and jumping motions on the force plates of the MAS 30 times each. The hip, knee, and ankle joint torques of the human body were calculated by both the exoskeleton and the MAS independently. The performance of the proposed method was quantitatively evaluated by inspecting the root-mean-square error (RMSE) and the correlation coefficient (CC) of the torque from the exoskeleton and the MAS.
Note that differences existed in the output JMT between the exoskeleton and the MAS due to the fact that the weight of the exoskeleton influences the actual JMT of the human body, but the MAS does not incorporate the existence and influence of the exoskeleton. The influence should be eliminated to make the outputs from the MAS and the exoskeleton comparable. The force ( F E x o ) is caused by the weight that the exoskeleton exerts onto the human trunk and transfers to the force plate of the MAS. We calculated this force using the inverse dynamics of the exoskeleton and subtracted it from the force plates’ signals to avoid influencing the output of the MAS. We exerted a virtual inverted F E x o to the human trunk while calculating the JMT with our method. By doing this, the theoretical output of the two systems should be the same.
Figure 13 demonstrates the difference in joint torques of subject 1 calculated by the exoskeleton and the MAS. Three kinds of motion were measured. The gait cycles of squatting and jumping motions start when the trunk begins moving downward, and end at stand straight. The gait cycles of each leg during running in place start and end at stance-to-swing shifting. The average torque curve of each joint under the three different types of motion appear to have preferable accordance. The error bands of the knee and ankle torques from the exoskeleton are slightly smaller than the MAS, which means our method obtains more stable torque values for the knee and ankle than the MAS.
According to the RMES shown in Table 2, we can see three phenomenon: (1) The error of ankle torque is very small for all subjects in each motion, which means the FCF from contact force measurement shoe is quite accurate, and the neglect of inertial torque caused by ankle movement did not lead to a large error of ankle joints; (2) in general, the further the joint is from the foot plate, the larger the error appears, because of the cumulative error of the limb length and joint angle. The RMSE of the hip joint is larger than that of the knee joint, even though the maximal torque of hip is smaller, as shown in Figure 13, and the RMSE of the knee is also larger than that of the ankle. (3) Comparing the individual RMSE to the average RMSE of the five subjects, differences between individuals truly exist but are not significant—these differences are mainly caused by individual parameter error. If a more accurate result is required, individual parameters, such as limb length, mass, inertial, and the mass center of each limb, should be further investigated, like B. Hwang et al. did in Ref. [28].
Table 3 shows the CC of the torque from the exoskeleton and the MAS. The CC reveals the similarity between the torque curves. There are several phenomenon: (1) Most average CC values are larger than 0.81. The average CC values of the knees and ankles are all larger than 0.96; only the hip joint during running in place drops to 0.81. This means that the overall similarity is not too bad. (2) The standard deviation (SD) of CC of the five subjects are smaller than 0.091; in particular, those of knee and ankle joints are smaller than 0.04. This indicates that the proposed method is individual independent. (3) The lack of significant differences between the trends of each joint during different motions means that the proposed method is valid for relatively complex motion. (4) The data of the hip joint was shown to be more volatile than the knee and ankle joints, but no subversive data appeared.

4. Conclusions

This paper proposed a novel human lower limb JMT estimation solution based on an IDA. The method has two main parts: the sensing system and the inverse dynamic approach. The embedded sensing system makes the exoskeleton easier to use than the popular EMG based devices. All subjects only need several seconds to put on the exoskeleton and input his/her weight and height; no electrodes or other sensors are required to be fixed onto the human body. Comparison experiments show similar outputs to an independent motion analysis system. According to the quantitative analysis of the two outputs from the exoskeleton and the MAS, the result shows accordance accuracy with different subjects in different motions, which indicates the individual independent character of the proposed method and its adaptability to a variety of motion patterns. Benefitting from the measurement of the FCF, the shortening of the kinematic chain helps to reduce the computational complexity through the strategy of factorizing the JMT into mass-induced one, and FCF-induced one cancels the necessity of a finite-state-machine and ensures the continuity of the JMT output.
This study only investigated motion in the sagittal plane. In the future, we want to explore this method to random motion in 3 D space. In that time, the side-sway and supination/pronation of the hip joints should be measured, and the 6 D force/torque of the feet should be measured. The IDA equation should take the coronal and frontal motion into account. In addition, automatic identification of the individual parameters may help to further improve the accuracy.

Author Contributions

J.D. conceived the method and wrote the paper; M.L., F.Z. and F.C. helped to modify it; S.Q. performed the experiments and analyzed the data; X.W. contributed theoretical justification and reference materials. All authors have read and approved the final manuscript.

Funding

This research was funded by Shenzhen Peacock Plan (KQTD2016112515134654), National Natural Science Foundation of China (No. U1713222, No.61773139 and No.61473015), and Natural Science Foundation of Heilongjiang Province, China (No.F2015008).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kazerooni, H.; Racine, J.L.; Huang, L.; Steger, R. On the control of the berkeley lower extremity exoskeleton (BLEEX). In Proceedings of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain, 18–22 April 2005; pp. 4353–4360. [Google Scholar]
  2. Hiroaki, K.; Yoshiyuki, S. Power assist method based on Phase Sequence and muscle force condition for HAL. Adv. Robot. 2005, 19, 717–734. [Google Scholar]
  3. Collins, S.H.; Wiggin, M.B.; Sawicki, G.S. Reducing the energy cost of human walking using an unpowered exoskeleton. Nature 2015, 522, 212–215. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Asbeck, A.T.; Rossi, S.M.M.D.; Holt, K.G.; Walsh, C.J. A biologically inspired soft exosuit for walking assistance. Int. J. Robot. Res. 2015, 34, 744–762. [Google Scholar] [CrossRef]
  5. Khan, A.M.; Yun, D.W.; Zuhaib, K.M.; Iqbal, J.; Yan, R.J.; Khan, F.; Han, C. Estimation of Desired Motion Intention and compliance control for upper limb assist exoskeleton. Int. J. Control Autom. Syst. 2017, 15, 802–814. [Google Scholar] [CrossRef]
  6. Chen, C.; Wu, X.; Liu, D.X.; Feng, W.; Wang, C. Design and Voluntary Motion Intention Estimation of a Novel Wearable Full-Body Flexible Exoskeleton Robot. Mob. Inf. Syst. 2017, 2017, 1–11. [Google Scholar] [CrossRef] [Green Version]
  7. Kenta, S.; Gouji, M.; Hiroaki, K.; Yasuhisa, H.; Yoshiyuki, S. Intention-based walking support for paraplegia patients with Robot Suit HAL. Adv. Robot. 2007, 21, 1441–1469. [Google Scholar]
  8. Yang, C.; Wang, X.; Li, Z.; Li, Y.; Su, C.Y. Teleoperation Control Based on Combination of Wave Variable and Neural Networks. IEEE Trans. Syst. Man Cybern. Syst. 2017, 47, 2125–2136. [Google Scholar] [CrossRef] [Green Version]
  9. Zhijun, L.I.; Zhao, T.; Chen, F.; Hu, Y.; Su, C.Y.; Fukuda, T. Reinforcement Learning of Manipulation and Grasping using Dynamical Movement Primitives for a Humanoid-like Mobile Manipulator. IEEE/ASME Trans. Mechatron. 2017. [Google Scholar] [CrossRef]
  10. Sankai, Y. HAL: Hybrid Assistive Limb Based on Cybernics. In Proceedings of the Isrr 2007 Robotics Research—The International Symposium, Hiroshima, Japan, 26–29 November 2007; pp. 25–34. [Google Scholar]
  11. Lloyd, D.G.; Besier, T.F. An EMG-driven musculoskeletal model to estimate muscle forces and knee joint moments in vivo. J. Biomech. 2003, 36, 765–776. [Google Scholar] [CrossRef] [Green Version]
  12. Krasin, V.; Gandhi, V.; Yang, Z.; Karamanoglu, M. EMG based elbow joint powered exoskeleton for biceps brachii strength augmentation. In Proceedings of the International Joint Conference on Neural Networks, Killarney, Ireland, 12–17 July 2015; pp. 1–6. [Google Scholar]
  13. Peternel, L.; Noda, T.; Petrič, T.; Ude, A.; Morimoto, J.; Babič, J. Adaptive Control of Exoskeleton Robots for Periodic Assistive Behaviours Based on EMG Feedback Minimisation. PLoS ONE 2016, 11, e0148942. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Cristian, C.; Marco, C.; Giuseppe, C. Design and numerical characterization of a new leg exoskeleton for motion assistance. Robotica 2015, 33, 1147–1162. [Google Scholar]
  15. Spring, A.N.; Kofman, J.; Lemaire, E.D. Design and evaluation of an orthotic knee-extension assist. IEEE Trans. Neural Syst. Rehabil. Eng. 2012, 20, 678–687. [Google Scholar] [CrossRef] [PubMed]
  16. Buchanan, T.S.; Lloyd, D.G.; Manal, K.; Besier, T.F. Estimation of muscle forces and joint moments using a forward-inverse dynamics model. Med. Sci. Sports Exerc. 2005, 37, 1911–1916. [Google Scholar] [CrossRef] [PubMed]
  17. Yang, C.; Zeng, C.; Liang, P.; Li, Z.; Li, R.; Su, C.Y. Interface Design of a Physical Human-Robot Interaction System for Human Impedance Adaptive Skill Transfer. IEEE Trans. Autom. Sci. Eng. 2017, 1–12. [Google Scholar] [CrossRef]
  18. Tucker, M.R.; Olivier, J.; Pagel, A.; Bleuler, H.; Bouri, M.; Lambercy, O.; Millán, J.R.; Riener, R.; Vallery, H.; Gassert, R. Control strategies for active lower extremity prosthetics and orthotics: A review. J. Neuroeng. Rehabil. 2015, 12. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Pal, A.R.; Pratihar, D.K. Estimation of Joint Torque and Power Consumption During Sit-to-Stand Motion of Human-being Using a Genetic Algorithm. Procedia Comput. Sci. 2016, 96, 1497–1506. [Google Scholar] [CrossRef]
  20. Camomilla, V.; Cereatti, A.; Cutti, A.G.; Fantozzi, S.; Stagni, R.; Vannozzi, G. Methodological factors affecting joint moments estimation in clinical gait analysis: A systematic review. Biomed. Eng. Online 2017, 16, 106. [Google Scholar] [CrossRef] [PubMed]
  21. Shull, P.B.; Jirattigalachote, W.; Hunt, M.A.; Cutkosky, M.R.; Delp, S.L. Quantified self and human movement: A review on the clinical impact of wearable sensing and feedback for gait analysis and intervention. Gait Posture 2014, 40, 11–19. [Google Scholar] [CrossRef] [PubMed]
  22. Abdul, R.A.H.; Aladin, Z.; Begg, R.K.; Yufridin, W. Foot Plantar Pressure Measurement System: A Review. Sensors 2012, 12, 9884–9912. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Kim, S.; Ro, K.; Bae, J. Real-time estimation of individual muscular forces of the lower limb using wearable sensors. In Proceedings of the 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM), Busan, Korea, 7–11 July 2015; pp. 432–436. [Google Scholar]
  24. Liu, T.; Inoue, Y.; Shibata, K.; Shiojima, K. Three-dimensional lower limb kinematic and kinetic analysis based on a wireless sensor system. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 9–13 May 2011; pp. 842–847. [Google Scholar]
  25. Kazerooni, H.; Steger, R.; Huang, L. Hybrid Control of the Berkeley Lower Extremity Exoskeleton (BLEEX); Sage Publications Inc.: Thousand Oaks, CA, USA, 2006; pp. 561–573. [Google Scholar]
  26. Yang, C.; Zeng, C.; Fang, C.; He, W.; Li, Z. A DMPs-based Framework for Robot Learning and Generalization of Human-like Variable Impedance Skills. IEEE/ASME Trans. Mechatron. 2018, 23, 1193–1203. [Google Scholar] [CrossRef]
  27. Saccares, L.; Brygo, A.; Sarakoglou, I.; Tsagarakis, N.G. A novel human effort estimation method for knee assistive exoskeletons. In Proceedings of the International Conference on Rehabilitation Robotics, London, UK, 17–20 July 2017; pp. 1266–1272. [Google Scholar]
  28. Hwang, B.; Jeon, D. A method to accurately estimate the muscular torques of human wearing exoskeletons by torque sensors. Sensors 2015, 15, 8337–8357. [Google Scholar] [CrossRef] [PubMed]
  29. Hwang, B.; Jeon, D. Estimation of the user’s muscular torque for an over-ground gait rehabilitation robot using torque and insole pressure sensors. Int. J. Control Autom. Syst. 2018, 16, 1–9. [Google Scholar] [CrossRef]
  30. Deng, J.; Wang, P.; Li, M.; Guo, W.; Zha, F.; Wang, X. Structure design of active power-assist lower limb exoskeleton APAL robot. Adv. Mech. Eng. 2017, 9. [Google Scholar] [CrossRef]
  31. Leva, P.D. Adjustments to Zatsiorsky-Seluyanov’s segment inertia parameters. J. Biomech. 1996, 29, 1223–1230. [Google Scholar] [CrossRef]
  32. Cheng, C.K.; Chen, H.H.; Chen, C.S.; Lee, C.L.; Chen, C.Y. Segment inertial properties of Chinese adults determined from magnetic resonance imaging. Clin. Biomech. 2000, 15, 559–566. [Google Scholar] [CrossRef]
  33. Wang, Q.; Wang, L.; Zhu, J. Effects of toe stiffness on ankle kinetics in a robotic transtibial prosthesis during level-ground walking. Mechatronics 2014, 24, 1254–1261. [Google Scholar]
Figure 1. Parameterized model of the human body.
Figure 1. Parameterized model of the human body.
Applsci 08 01610 g001
Figure 2. Dynamic model of a single leg. (a) Model for calculating mass-induced torques. (b) Model for calculating foot contact force (FCF)-induced torques.
Figure 2. Dynamic model of a single leg. (a) Model for calculating mass-induced torques. (b) Model for calculating foot contact force (FCF)-induced torques.
Applsci 08 01610 g002
Figure 3. Hardware system and the active power-assist lower limb (APAL) prototype.
Figure 3. Hardware system and the active power-assist lower limb (APAL) prototype.
Applsci 08 01610 g003
Figure 4. Trunk posture sensing with inertial measurement unit (IMU) and the limb posture definition.
Figure 4. Trunk posture sensing with inertial measurement unit (IMU) and the limb posture definition.
Applsci 08 01610 g004
Figure 5. Exoskeleton joint geometry and angle measurements for (a) the hip joint and (b) the knee joint.
Figure 5. Exoskeleton joint geometry and angle measurements for (a) the hip joint and (b) the knee joint.
Applsci 08 01610 g005
Figure 6. Foot force measurement device: (a) sole structure; (b) force sensor signals of the sole.
Figure 6. Foot force measurement device: (a) sole structure; (b) force sensor signals of the sole.
Applsci 08 01610 g006
Figure 7. Pitch angle of the trunk. ω 0 is the raw signal from the IMU, ω 1 is the linear interpolation of the first-order-sample-holder, and ω 2 is the filtered signal of ω 1 .
Figure 7. Pitch angle of the trunk. ω 0 is the raw signal from the IMU, ω 1 is the linear interpolation of the first-order-sample-holder, and ω 2 is the filtered signal of ω 1 .
Applsci 08 01610 g007
Figure 8. Acceleration of hip joints: (a) left hip joint; (b) right hip joint.
Figure 8. Acceleration of hip joints: (a) left hip joint; (b) right hip joint.
Applsci 08 01610 g008
Figure 9. Joint information of the exoskeleton robot.
Figure 9. Joint information of the exoskeleton robot.
Applsci 08 01610 g009
Figure 10. Joint information of the human lower limbs.
Figure 10. Joint information of the human lower limbs.
Applsci 08 01610 g010
Figure 11. (a) Force signals from each sensor on the left foot; (b) resultant force signals on the left foot; (c) force signals from each sensor on the right foot; (d) resultant force signals on the right foot.
Figure 11. (a) Force signals from each sensor on the left foot; (b) resultant force signals on the left foot; (c) force signals from each sensor on the right foot; (d) resultant force signals on the right foot.
Applsci 08 01610 g011
Figure 12. Human joint muscular torque (JMT) calculated from running in place: (a) mass-induced JMT; (b) FCF-induced JMT; (c) total torque of the hip and knee JMT.
Figure 12. Human joint muscular torque (JMT) calculated from running in place: (a) mass-induced JMT; (b) FCF-induced JMT; (c) total torque of the hip and knee JMT.
Applsci 08 01610 g012
Figure 13. Average joint torques of each motion (repeated 30 times) of Subject 1. (a) hip torque in squatting; (b) knee torque in squatting; (c) ankle torque in squatting; (d) hip torque in running; (e) knee torque in running; (f) ankle torque in running; (g) hip torque in jumping; (h) knee torque in jumping; (i) ankle torque in jumping. The result from the exoskeleton is shown in orange, and the result from the motion analysis system (MAS) is shown in blue. Shaded regions show ± 1 SD.
Figure 13. Average joint torques of each motion (repeated 30 times) of Subject 1. (a) hip torque in squatting; (b) knee torque in squatting; (c) ankle torque in squatting; (d) hip torque in running; (e) knee torque in running; (f) ankle torque in running; (g) hip torque in jumping; (h) knee torque in jumping; (i) ankle torque in jumping. The result from the exoskeleton is shown in orange, and the result from the motion analysis system (MAS) is shown in blue. Shaded regions show ± 1 SD.
Applsci 08 01610 g013
Table 1. Parameters of the simplified human model.
Table 1. Parameters of the simplified human model.
HM m T m S I T I S l T l S l CT l CS
(m)(kg)(kg)(kg)(kg·mm 2 )(kg·mm 2 )(mm)(mm)(mm)(mm)
S11.7576.57.654.650.1430.18424422183270
S21.6460.36.033.670.0990.124397395172253
S31.7261.56.153.740.1110.140416415180266
S41.7878.57.854.770.1520.192431429187275
S51.6570.27.024.270.1170.147399398173255
Table 2. Root-mean-square error (RMSE) of the torque from the exoskeleton and the motion analysis system (MAS).
Table 2. Root-mean-square error (RMSE) of the torque from the exoskeleton and the motion analysis system (MAS).
SquatRunJump
HipKneeAnkleHipKneeAnkleHipKneeAnkle
S1Left25.281.414.412.32.529.414.84.4
Right22.57.81.1156.92.230.115.85.5
S2Left6.85.81.121.16.92.315.592.1
Right7.16.11.224.96.92.714.29.42.2
S3Left7.32.9110.76.11.26.86.21.5
Right10.33.20.316.53.71.37.36.21.6
S4Left122.50.714.311.93.912.65.21.3
Right14.82.81.913.310.55.31453.7
S5Left16.12.30.86.35.8516.86.82.4
Right183.61.55.33.25.516.85.44.1
Mean SD144.51.114.27.43.216.48.42.9
6.52.20.563.21.67.93.91.4
Table 3. Correlation coefficient of the torque from the exoskeleton and the MAS.
Table 3. Correlation coefficient of the torque from the exoskeleton and the MAS.
SquatRunJump
HipKneeAnkleHipKneeAnkleHipKneeAnkle
S1Left0.8750.9850.9900.9280.9480.9980.8120.9580.963
Right0.8770.9880.9930.8500.9890.9980.8320.9540.955
S2Left0.7000.9830.9530.9030.9930.9940.6290.9740.979
Right0.8910.9760.9650.8620.9930.9910.7320.9620.982
S3Left0.9320.9950.9820.8740.9780.9990.8960.9780.986
Right0.8670.9960.9990.7070.9950.9990.9220.9820.990
S4Left0.9080.9980.9960.7050.8820.9930.9040.9880.995
Right0.8860.9970.9790.7100.9180.9890.8510.9850.963
S5Left0.8360.9980.9970.8390.9880.990.7830.9730.985
Right0.7040.9970.9930.7450.9960.9910.7430.9880.972
Mean SD0.8480.9910.9850.8120.9680.9940.8100.9740.977
0.0810.0080.0190.0820.0400.0040.0910.0120.013

Share and Cite

MDPI and ACS Style

Li, M.; Deng, J.; Zha, F.; Qiu, S.; Wang, X.; Chen, F. Towards Online Estimation of Human Joint Muscular Torque with a Lower Limb Exoskeleton Robot. Appl. Sci. 2018, 8, 1610. https://doi.org/10.3390/app8091610

AMA Style

Li M, Deng J, Zha F, Qiu S, Wang X, Chen F. Towards Online Estimation of Human Joint Muscular Torque with a Lower Limb Exoskeleton Robot. Applied Sciences. 2018; 8(9):1610. https://doi.org/10.3390/app8091610

Chicago/Turabian Style

Li, Mantian, Jing Deng, Fusheng Zha, Shiyin Qiu, Xin Wang, and Fei Chen. 2018. "Towards Online Estimation of Human Joint Muscular Torque with a Lower Limb Exoskeleton Robot" Applied Sciences 8, no. 9: 1610. https://doi.org/10.3390/app8091610

APA Style

Li, M., Deng, J., Zha, F., Qiu, S., Wang, X., & Chen, F. (2018). Towards Online Estimation of Human Joint Muscular Torque with a Lower Limb Exoskeleton Robot. Applied Sciences, 8(9), 1610. https://doi.org/10.3390/app8091610

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop