Next Article in Journal
Load-Bearing Performance of Non-Prismatic RC Beams Wrapped with Carbon FRP Composites
Next Article in Special Issue
Human Activity Recognition Using Attention-Mechanism-Based Deep Learning Feature Combination
Previous Article in Journal
Exploiting Pre-Trained Convolutional Neural Networks for the Detection of Nutrient Deficiencies in Hydroponic Basil
Previous Article in Special Issue
Deep SE-BiLSTM with IFPOA Fine-Tuning for Human Activity Recognition Using Mobile and Wearable Sensors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Prediction of Joint Angles Based on Human Lower Limb Surface Electromyography

1
Key Laboratory of Intelligent Control and Optimization for Industrial Equipment of Ministry of Education, Dalian University of Technology, Dalian 116024, China
2
School of Control Science and Engineering, Dalian University of Technology, Dalian 116024, China
3
Neurology Department, Dalian Municipal Central Hospital, Dalian 116024, China
*
Authors to whom correspondence should be addressed.
Sensors 2023, 23(12), 5404; https://doi.org/10.3390/s23125404
Submission received: 8 March 2023 / Revised: 2 June 2023 / Accepted: 5 June 2023 / Published: 7 June 2023
(This article belongs to the Special Issue Human Activity Recognition Using Sensors and Machine Learning)

Abstract

:
Wearable exoskeletons can help people with mobility impairments by improving their rehabilitation. As electromyography (EMG) signals occur before movement, they can be used as input signals for the exoskeletons to predict the body’s movement intention. In this paper, the OpenSim software is used to determine the muscle sites to be measured, i.e., rectus femoris, vastus lateralis, semitendinosus, biceps femoris, lateral gastrocnemius, and tibial anterior. The surface electromyography (sEMG) signals and inertial data are collected from the lower limbs while the human body is walking, going upstairs, and going uphill. The sEMG noise is reduced by a wavelet-threshold-based complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) reduction algorithm, and the time-domain features are extracted from the noise-reduced sEMG signals. Knee and hip angles during motion are calculated using quaternions through coordinate transformations. The random forest (RF) regression algorithm optimized by cuckoo search (CS), shortened as CS-RF, is used to establish the prediction model of lower limb joint angles by sEMG signals. Finally, root mean square error (RMSE), mean absolute error (MAE), and coefficient of determination (R2) are used as evaluation metrics to compare the prediction performance of the RF, support vector machine (SVM), back propagation (BP) neural network, and CS-RF. The evaluation results of CS-RF are superior to other algorithms under the three motion scenarios, with optimal metric values of 1.9167, 1.3893, and 0.9815, respectively.

1. Introduction

Recently, wearable exoskeleton technology has been continuously developed [1,2]. In real life, it is mainly used in medical rehabilitation, and has played an important role in assisting stroke and amputation patients to walk. Patients can complete a great deal of repetitive physiological gait training with mechanical lower limbs, so as to re-establish the correct movement pattern, improve the quality of life, and participate in daily activities like healthy people [3,4].
Human motion intention recognition technology is a method to predict human motion patterns through various sensing systems. This technology has attracted increasing attention from all over the world and has important applications in many fields [5]. Zhao et al. [6] collected human gait data through wearable inertial sensors, and hidden Markov models and neural networks were combined to identify gait phases. Zhao et al. [7] proposed a gait reconstruction method based on a gradient descent algorithm and a gait evaluation method based on weighted dynamic time warping, which can quantify the abnormalities of hemiplegic gait and monitor the rehabilitation process of patients’ walking ability. Qiu et al. [8] used a wearable gait analysis system to capture the limb motions and reconstructed a 3D human body model with high precision. Qiu et al. [9] also proposed an automatic phase segmentation method for kayak rowing. The results show that the combination of arm trunk joint angles and a support vector machine algorithm can better perform the task of kayak paddling phase segmentation with an accuracy of 98.1%. The above methods are mainly based on inertial data, which can only reflect the current state of the motion but cannot predict the motion in advance [10].
Surface electromyography (sEMG) signal is a superposition of motor unit action potentials in time and space. It is a physiological signal emitted by the activity of muscle neurons during active movement of the human body [11], which reflects neuromuscular activity to a certain extent [12]. sEMG signal has the advantages of easy extraction, easy identification, non-invasiveness, etc. [13,14]. More importantly, sEMG signals appear before visible motion, and contain rich information about human motion, and so have great advantages as a medium for perceiving human–computer interactions [15]. Therefore, it is possible to use sEMG signals to predict the joint angles of human lower extremities, and the joint angle prediction results can be used as input signals to control the exoskeleton, so as to determine the subject’s movement intention in advance [16,17].
Triwiyanto et al. [18] proposed a new EMG-based method for elbow joint angle prediction, which used time-domain features, zero-crossing, and a Kalman filter. The ranges of root mean square error (RMSE) and Pearson correlation coefficient (CC) were 6.9° to 17.5° and 0.93 to 0.99, respectively. Liang et al. [19] combined a nonlinear autoregressive (NARX) model to create a Gaussian process autoregressive model for the knee angle prediction of sEMG signals. The mean normalized root mean square errors (NRMSEs) of the model predictions for the left and right legs were 0.0063 ± 0.0081 and 0.0032 ± 0.0028, respectively. In addition, Chen et al. [20] used a deep belief network consisting of restricted Boltzmann machines to estimate the flexion/extension angles of hip, knee, and ankle joints. Raj et al. [21] constructed a NARX multilayer perceptron neural network model to predict elbow joint angles based on sEMG signals. Gautam et al. [22] used a long-term recursive convolutional network (LRCN) based on transfer learning for knee angle prediction, and the mean absolute error (MAE) of predicted joint angles was 8.1% and 9.2% for healthy subjects and subjects with knee lesions, respectively.
In this paper, the sEMG signal and inertial signal of human lower limbs are simultaneously collected by the sensors. The sensed data are used to build a mapping model of the sEMG signals and joint angles in three real scenarios: walking on flat ground, going upstairs, and walking uphill, so as to perform joint angle prediction. The main contributions of this paper are as follows:
(1) The human lower limb muscles are modeled using OpenSim, and the muscle sites for collecting sEMG signals are selected based on the correspondence between the tendon lengths of the muscles in each part of the limb and the knee joint angle.
(2) The sEMG noise is reduced by a noise reduction algorithm using a combination of wavelet thresholding and complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN), and then the time-domain features are extracted.
(3) The Shimmer sensors are used to collect the inertial signals of human lower limbs while collecting the sEMG signals to obtain the quaternion, and then the angles of the knee and hip joints are calculated using the quaternion based on coordinate transformation.
(4) The cuckoo search (CS) algorithm is used to optimize the random forest (RF), so as to construct a prediction model between the sEMG signal and the joint angle for joint angle prediction.

2. Data Acquisition and Processing

In this section, the inertial signal and sEMG signal of the lower limb were simultaneously collected by sensors. After filtering and denoising the collected raw data, the time-domain features of the sEMG were extracted, and the joint angles were calculated. The equipment and methods used are as follows.

2.1. Experimental Equipment

The Consensys bundle development kit is used in this paper for data correction, which is developed by the Shimmer technologies, Dublin, Ireland, and includes a complete set of Shimmer3 sensors, base, and software, as shown in Figure 1. Each Shimmer3 sensor can simultaneously measure the output of a triaxial accelerometer, a triaxial gyroscope, a triaxial magnetometer, and a two-channel sEMG, which has dimensions of 65 mm × 32 mm × 12 mm, and a weight of 31 g. Some specifications of the Shimmer3 sensors are shown in Table 1.

2.2. Muscle Selection

OpenSim, a free software developed by the Stanford team, was used to address the problem of muscle modeling and simulation [23]. It has been applied to muscle modeling, motion simulation, and nervous system research. In this section, OpenSim is used to build a model of the human lower extremity, with 19 bones and 92 muscles, as shown in Figure 2, where the model has a height of 1.8 m and a weight of 75 kg. Note that the purpose of building the model is to observe the muscle parts of the human lower extremities, so it has little relationship with the model’s height and weight.
As is known, too many measurement channels of sEMG can cause interference and reduce recognition performance [24]. Therefore, the selection of muscle sites for sEMG signals acquisition needs to consider the ease of acquisition as well as the active level of the muscles. According to the model constructed by the OpenSim software version 4.0.Beta, six muscles were selected for sEMG signal acquisition, i.e., rectus femoris, vastus lateralis, semitendinosus, biceps femoris, calf lateral gastrocnemius, and tibialis anterior. For each part of the lower limb, the relationship between the muscle−tendon length and the angles of the knee joint, hip joint, and ankle joint were established, respectively, as shown in Figure 3, Figure 4 and Figure 5.
From the joint angle and tendon length control charts, it can be seen that these six muscles work in concert during lower limb movements with different joint angle variations. These six muscles work in concert and the changes in tendon length can generate sEMG signals that reflect different movement states.
According to the muscle positions in the OpenSim software version 4.0.Beta, electrode patches were placed on the corresponding muscle parts of the subject’s lower limbs, as shown in Figure 6. The reference electrode for each sensor needs to be placed at the location where fewer lower limb muscles are present. In this experiment, the knee was chosen for the placement of the reference electrode.

2.3. sEMG Signal Filtering and Noise Reduction

The raw collected EMG signals often contain various noises, including power frequency noise, motion artifact noise, and electrocardiogram noise. As noise will mask the effective information in sEMG signals, it needs to be filtered out during data preprocessing [25]. Many noise reduction algorithms have been proposed for noise reduction in sEMG signals, such as wavelet thresholding, empirical modal decomposition (EMD), and ensemble empirical mode decomposition (EEMD). For noise reduction based on the wavelet thresholding method, the selection of the threshold value is very troublesome and affects the effect of noise reduction. For the noise reduction based on EMD decomposition, there exist endpoint effects and modal aliasing problems in the decomposition process.
In this paper, considering the shortcomings of the above noise reduction methods, wavelet thresholding and CEEMDAN combination algorithm is used for noise reduction in the sEMG signals. Based on the CEEMDAN, the sEMG signal is decomposed to find the Intrinsic Mode Function (IMF) component. The correlation coefficient between the IMF and the sEMG signal is calculated to find out the high-frequency component that is dominated by noise, and the high-frequency component is processed by wavelet threshold noise reduction. The noise-reduced components are reconstructed with the unprocessed components to obtain the denoised signal.
Unlike the EMD and EEMD methods, the CEEMDAN method uses adaptive white noise in the decomposition to smooth out impulse interference and uses the property of averaged Gaussian white noise with a mean equal to zero to make the decomposition of the data more complete, thus effectively avoiding IMF aliasing within a certain range [26]. The specific algorithmic steps of CEEMDAN are as follows:
(1)
A set of white Gaussian noise sequences are added to the original signal x ( t ) to form the new signal x n ( t ) as
x n ( t ) = x ( t ) + ε 0 G i
where t is the time index, i is the number of trials, G i is the Gaussian noise series with normal distribution, and ε 0 is the ratio of data versus noise to control the additional noise of the original data set.
(2)
The first IMF component can be obtained by decomposing the sEMG signal using the conventional EMD method as
I M F 1 ( t ) = 1 k i = 1 k I M F 1 i ( t )
where k is the number of times that Gaussian white noise with a mean of 0 is added to the original signal.
(3)
The first residual r 1 ( t ) is calculated as
r 1 ( t ) = x ( t ) I M F 1 ( t )
(4)
To generate the jth pattern, the operator E j ( ) is defined first, then the new data sequence r 1 ( t ) + ε 0 E 1 ( G i ) is decomposed and the second IMF component is obtained using the EMD method as
I M F 2 ( t ) = 1 k i = 1 k E 1 [ r 1 ( t ) + ε 2 E 1 ( G i ) ]
(5)
The kth remaining residue can be calculated for each of the remaining steps. The (k + 1)th IMF component is calculated by cycling through step 4, which is as follows:
r j ( t ) = r j 1 ( t ) I M F j ( t )
I M F j + 1 ( t ) = 1 k i = 1 k E 1 [ r j ( t ) + ε j E j ( G i ) ]
(6)
Step (5) is computed cyclically until the obtained residual is no longer able to be decomposed to obtain the final residual R ( t ) as
R ( t ) = x ( t ) m = 1 N I M F m ( t )
where N is the number of decomposed IMFs.
(7)
The CEEMDAN method is used to decompose the original signal x(t) to obtain K IMF components and a residual component as
x ( t ) = m = 1 N I M F m ( t ) + R ( t )
The steps of the wavelet thresholding and CEEMDAN sEMG signal denoising method are as follows: firstly, the IMF components from high frequency to low frequency are decomposed by CEEMDAN; secondly, the IMF components and the original sEMG signal are correlated, a suitable threshold is selected for the noisy components, and the sEMG signal is denoised by the wavelet thresholding algorithm; finally, the denoised components are reconstructed with the unprocessed components to obtain the denoised signal.
In this section, the rectus femoris muscle during flat walking is taken as an example, and the raw sEMG signal is decomposed by CEEMDAN to obtain the IMF component and the residual component, as shown in Figure 7.
The resulting IMF quantities and the original signals are correlated to obtain the interrelationship numbers, as shown in Table 2.
If the correlation coefficient of the high-frequency IMF component is less than 0.5, the IMF component contains noise. In this paper, the noisy IMF components are processed for noise reduction using heuristic thresholding combined with the db5 wavelet thresholding method. The baseline drift signal in the low-frequency IMF component is the noisy part of the sEMG signal. The IMF components with frequencies less than 5 Hz are filtered out by setting the threshold. Finally, the noise-reduced IMF component is reconstructed with the unprocessed component to obtain the denoised signal, and the results are shown in Figure 8.
The sEMG signals are generated based on the contraction of the muscle, so a valid sEMG signal should oscillate for y = 0 at equal amplitude. It can be seen that there is a significant baseline drift in the raw sEMG signals with many spikes, which are mixed with a large amount of noise. After noise reduction, most of the noise signals are eliminated, and the sEMG signals with more effective information are obtained.
In this paper, MSE is used as the evaluation index of the noise reduction performance [27], which can be calculated as
M S E = i = 1 n ( X e , i X r , i ) 2 n
where n is the number of signals, X e , i is the original signal before noise reduction, and X r , i is the signal after noise reduction.
The wavelet thresholding method and CEEMDAN combined with the noise reduction method are compared with the Butterworth filtering method and wavelet thresholding noise reduction method. The comparative results for the rectus femoris muscle during flat walking are shown in Table 3, and the same for all muscle sites in different motion states.
From the results shown in Table 3, it can be seen that the wavelet thresholding method and CEEMDAN combined with noise reduction have a better noise reduction performance than other noise reduction methods.

2.4. sEMG Signal Feature Extraction

Feature extraction is an important process to extract the useful information hidden in EMG signals and remove the unwanted noise [28]. When preprocessing the sEMG signals, the sliding window method is used for signal segmentation. In this paper, the sliding window size is 10 ms.
The features extracted from sEMG signals are mainly time-domain features, frequency-domain features, and time–frequency-domain features. Among them, the most commonly used is the time-domain feature [29], which has the advantages of less complexity, low calculation cost, and good classification performance. In this study, four time-domain features were selected for each channel, including root mean square, variance, wavelength, and mean absolute value. The formulas for feature extraction are given below, where N is the size of the sliding window and x is the magnitude of the sEMG signal with a mean value of x ¯ .
(1)
Root Mean Square
R M S = 1 N i = 1 N x i 2
(2)
Variance
V A R = 1 N 1 i = 1 N ( x i x ¯ ) 2
(3)
Wavelength
W L = i = 1 N 1 | x i + 1 x i |
(4)
Mean Absolute Value
M A V = 1 N i = 1 N | x i |
After obtaining the selected features, the data preprocessing of sEMG signals can be achieved.

2.5. Joint Angle Calculation

In this section, the knee and hip angles in the sagittal plane of the human body are estimated using the sEMG signals. The two joint angles are shown in Figure 9, which are zero when the body is in a neutral position. The detailed definition is as follows:
(1)
The hip angle α is defined as the angle between the thigh U and its neutral position. The directions of hip flexion and extension are illustrated, respectively, in the figure, where flexion is positive and extension is negative.
(2)
The knee joint angle β is defined as the supplementary angle of the angle between the thigh U and the calf L. Due to the constraints of the musculoskeletal structure of the human body, only the flexion angle of the knee joint can be measured.
In order to calculate the joint angles, it is necessary to determine the coordinates of each limb segment in a unified coordinate system, as shown in Figure 10. Three right-handed coordinate systems are used in this paper, which are defined as follows:
(1)
The global coordinate system (GCS or G for short) is defined as the local geographic coordinate system, whose X, Y, and Z axes point to the north, east, and center of the Earth, respectively.
(2)
The body coordinate system (BCS or B for short) is fixed on the subject’s body and is defined at each joint to describe the relative position between the sensors and the limb.
(3)
The coordinate system of the Shimmer3 sensor is defined as the sensor coordinate system (SCS or S for short).
In this paper, quaternions are used to describe the posture in different coordinate systems. The rotational relationship from BCS to SCS is assumed to be constant. At the beginning of the experiment, the subjects wore sensors on the lower extremity and stood still facing north for a few seconds so that the BCS and GCS coincided. The rotational relationship from BCS to SCS is obtained with the following equation, where * represents the conjugate quaternions.
q B S = q B , i n i t S = q G , i n i t S = ( q S , i n i t G ) *
The rotational relationship from BCS to GCS at moment t can be found from the obtained q B S , with the following equation, where represents the product of the quaternions.
q B , t G = q S , t G q B S = q S , t G ( q S , i n i t G )
Suppose the vectors of the thigh, calf, and waist in BCS are UB, LB, and WB, respectively. Taking the thigh as an example, the rotation of the vectors from BCS to GCS can be obtained using q B , t G through the following equation:
U G , t = q B , t G U B ( q B , t G ) *
The joint angles can be obtained by calculating the angles between the two vectors adjacent to them. The equations for the hip angle α(t) and knee angle β(t) at moment t are shown below.
α ( t ) = arccos ( U G , t W G , t U G , t × W G , t )
β ( t ) = arccos ( U G , t L G , t U G , t × L G , t )
The above equations are used to calculate the knee and hip angles for walking, going upstairs, and going uphill. The results are shown in Figure 11, Figure 12 and Figure 13.

3. Cuckoo-Search-Optimized Random Forest Regression

In recent years, the regression problem has usually been based on some nonlinear prediction algorithms, such as neural networks, support vector machines (SVM), and RF. RF is a supervised machine learning algorithm based on integration learning. Integrated learning is a type of learning where different types of algorithms or the same algorithm can be added multiple times to form a more powerful predictive model. RF combines multiple decision trees to produce prediction results and each decision tree is built with only a portion of samples and features, which not only makes it effective in preventing low accuracy in the presence of noise and outliers, but also does not drain the information from the sample data, ensuring the diversity of decision trees and greatly improving the generalization ability. The main parameters of the RF include the number of trees (n_estimators) and the maximum number of randomly selected features per node (max_features). In order to obtain a better RF model, the cuckoo search algorithm is used to optimize the RF in this paper.
The CS algorithm, proposed by Yang et al. at the University of Cambridge in 2009, is a new intelligent optimization algorithm and a new meta-heuristic search algorithm, which has been used in many applications [30]. The idea of the CS algorithm is to solve the optimization problem based on the parasitic and juvenile characteristics of cuckoo birds and the overall optimization ability of Lévy flight. Parasitic brood rearing refers to the fact that cuckoos do not build nests during the breeding period, but rather place their eggs in the nests of similar birds and use these birds to reproduce and feed their offspring. Cuckoos seek out birds with similar incubation and brooding periods and quickly parasitize eggs while the bird is away, allowing the bird to raise their offspring instead [31]. Lévy flight is a random wanderer that balances local and global search by generating a certain number of long steps and a larger number of short steps, following a power-law step distribution with heavy tails. The method proposed by Mantegna in 1994 for solving random numbers with a positive-terrestrial distribution is mainly employed to generate random step lengths obeying a Lévy distribution, as shown in Equation (19) and Figure 14.
s = u | v | 1 β
where u and v are random numbers that conform to a normal distribution, i.e., u N ( 0 , σ 2 ) and v N ( 0 , 1 ) , and β takes a value in the range (0, 2) and generally 1.5.
σ = { Γ ( 1 + β ) sin ( π β 2 ) β Γ ( 1 + β 2 ) 2 β 1 2 } 1 β
The specific steps of the CS algorithm to optimize RF are as follows:
(1)
The number of nests and the number of iterations are set. One nest represents a set of parameters, which are n_estimators and max_features. Each set of parameters is randomly initialized before the start of the experiment.
(2)
The criterion of comparison is chosen as fitness. In this paper, the RMSE is used as the value of fitness defined in Equation (21). The parameters in each nest are used to construct an RF algorithm separately to predict the lower limb joint angles. The predicted and true value adaptations of each algorithm are compared, and the nests corresponding to the parameters of the algorithm with the best adaptation are optimal.
RMSE = i = 1 n ( X p , i X a , i ) 2 n
where n is the number of signals, X p , i is the observed value, and X a , i is the actual value.
(3)
The optimal nest is retained and the other nests are updated by random wandering. The path of updating the bird nest location is as follows.
x i ( t + 1 ) = x i ( t ) + α L e v y ( λ ) ; i = 1 , 2 , ... , n
where x i ( t ) is the value of the parameters of the ith nest in generation t , α is the step size factor whose value is usually 1, and L e v y ( λ ) is the Lévy random search path, as shown in the following equation, where s denotes the size of the random step acquired by the Lévy flight.
L ( s , λ ) s λ , ( 1 < λ 3 )
(4)
The fitness value of the current nest is compared with the fitness value of the previous generation of nests. If the current nest is better, it replaces the previous generation of nests.
(5)
A random number R between 0 and 1 is generated to be compared with the discovery probability Pa. If R > Pa, the nest is updated according to the set random wandering; if R < Pa, the nest is not updated.
(6)
If the set number of iterations or the value of fitness is not reached, return to step (2).
(7)
The final obtained global optimal solution is used as the parameter to construct the final RF algorithm in this paper.

4. Experiments and Results

In this study, the experiment was conducted outdoors. Subjects collected data using sEMG acquisition equipment and completed 3 movements in sequence, i.e., walking on flat ground, going upstairs, and going uphill. After data processing, the knee and hip angles during the 3 motion states could be estimated from the sEMG signals. The details are as follows.

4.1. Experimental Setup

Data collection was performed using Shimmer3 sensors, each of which can collect nine-axis inertial data and 2 channels of sEMG signal. The sampling frequency was set to 1000 Hz, and 4 healthy subjects aged 22–35 years were recruited for data collection. According to Figure 6 and Figure 10, subjects wore one sensor on the waist for inertial data collection and 3 sensors on the right leg for sEMG data collection, as shown in Figure 15. The 2 sensors on the right leg were used to collect inertial data simultaneously, and in combination with the lumbar sensor to calculate knee and hip angles during motion.
Each person collected data of 50 gait cycles per motion state, so there were 200 cycles of data per state. During the experiment, the subjects took a break every fifteen minutes to avoid muscle fatigue. The initial state and 3 motion patterns are shown in Figure 16.

4.2. Experimental Result

For the classification problem of sEMG signals, the sliding window size is permanently 50 ms–200 ms [32]. However, in this paper, the prediction of successive changes in joint angles was a regression problem. Thus, in order to obtain as many joint angles as possible in one exercise cycle, the sliding window size was set to be 10 ms for each cycle.
For the sEMG signals, the RMS, VAR, WL, and MAV features of each muscle were extracted using the sliding window, i.e., 6 muscles and 4 features in total, so each window constituted a 24-dimensional feature as the input signal of the algorithm. In addition, the average value of the joint angle of the lower limb at the same moment was calculated using the sliding window as the output of the algorithm. With a ratio of 4:1, 160 cycles were taken as the training set and 40 cycles as the test set.
For training, the 24-dimensional features in the training set were taken as the input and the corresponding joint angle averages were taken as the output to obtain the trained CS-RF model; for prediction, the 24-dimensional features in the prediction set were taken as the input to obtain the predicted joint angles. The five-point triple smoothing method was used to process the joint angle prediction results and compare them with the actual joint angles. The final results are shown in Figure 17, Figure 18 and Figure 19.
The CS algorithm parameters are mainly the number of nests and the number of iterations. The higher their values, the wider the search space as well as the higher the chance of search, but they also increase the computational overhead and computational time. In this paper, the number of nests of CS algorithm was set to 20, the number of iterations was set to 25, and the discovery probability was set to 0.25 through experiments.
In this section, three evaluation metrics are used to evaluate the results, i.e., RMSE, MAE, and coefficient of determination (R2) [33]. The formulas are as follows:
(1)
RMSE
RMSE = i = 1 n ( X p , i X a , i ) 2 n
(2)
MAE
MAE = 1 n i = 1 n | X p , i X a , i |
(3)
R2
R 2 = 1 i = 1 n ( X p , i X ¯ p ) 2 i = 1 n ( X a , i X ¯ a ) 2
where n is the number of signals, X p , i is the estimated value, X ¯ p is the average of the estimated values, X a , i is the actual value, and X ¯ a is the average of the actual values.
The results of the CS-RF algorithm are compared with those of the RF, SVM, and BP neural networks, as shown in Table 4, Table 5, Table 6, Table 7, Table 8 and Table 9.
From the above results, it can be seen that the evaluation index of CS-RF is significantly better than the remaining 3 algorithms under the three motion scenarios. The experimental results show that the prediction results of the CS-RF algorithm are superior compared to other algorithms.

5. Conclusions and Future Work

sEMG signals are physiological signals that are closely related to human movement and play an important role in human–computer interaction. In this paper, a model for predicting the knee and hip angles of the lower limbs based on sEMG signals was developed. sEMG signals and inertial data of lower limbs were collected during walking, going upstairs, and going uphill. The algorithm combining wavelet thresholding and CEEMDAN was used for noise reduction first, then the time-domain features were extracted from the noise-reduced sEMG signals, and finally the CS-RF regression algorithm was used to predict the lower limb joint angles based on the pre-processed sEMG signals. As the RF algorithm is an integrated learning algorithm with a model constructed based on multiple decision trees, the prediction results were averaged by summing the predictions of all decision trees. Compared with individual decision trees, the RF algorithm can avoid the problems of overfitting and high model variance, and has better generalization ability. Compared with the neural networks commonly used in the current literature, CS-RF has good interpretability, which can be computed in parallel with high computational efficiency. Moreover, the optimized RF of CS has better generalization ability, which can better handle the input data and improve the prediction accuracy. RMSE, MAE, and R2 were used as evaluation metrics for algorithm comparison. The results show that the method proposed in this paper significantly outperforms other algorithms and provides help for the future control design of exoskeletons. The research will contribute to exoskeleton control design and may eventually improve user–machine interactions.
However, the study in this paper has some limitations. The predictions were offline and further studies are needed to predict joint angles in real time. The recruited subjects were healthy and there were no subjects with walking difficulties. In future work, we will investigate the real-time prediction of joint angles. In addition, patients with walking difficulties, e.g., hemiplegia, will be included in the experiments to enrich the data.

Author Contributions

H.Z. drafted the manuscript; D.P. was responsible for the equipment configuration; Z.Q. performed the experiments and data analysis; D.P. and F.W. were responsible for the interpretation of the results; Z.W. and S.Q. made contributions to data visualization; X.S. and Q.C. completed the manuscript revision. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China under Grant No. 61903062, 62272081, the Natural Science Foundation of Liaoning Province, China under Grant 2021-MS-111, in part by the Fundamental Research Funds for the Central Universities, China under Grant No. DUT22YG240, and DUT22YG128.

Informed Consent Statement

Written informed consent was obtained from all subjects involved in this study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Liu, D.X.; Wu, X.; Du, W.; Wang, C.; Xu, T. Gait Phase Recognition for Lower-Limb Exoskeleton with Only Joint Angular Sensors. Sensors 2016, 16, 1579. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. De Looze, M.P.; Bosch, T.; Krause, F.; Stadler, K.S.; O’sullivan, L.W. Exoskeletons for industrial application and their potential effects on physical work load. Ergonomics 2016, 59, 671–681. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Dollar, A.M.; Herr, H. Lower Extremity Exoskeletons and Active Orthoses: Challenges and State-of-the-Art. IEEE Trans. Robot. 2008, 24, 144–158. [Google Scholar] [CrossRef]
  4. Fleming, A.; Stafford, N.; Huang, S.; Hu, X.; Ferris, D.P.; Huang, H.H. Myoelectric control of robotic lower limb prostheses: A review of electromyography interfaces, control paradigms, challenges and future directions. J. Neural Eng. 2021, 18, 041004. [Google Scholar] [CrossRef]
  5. Qiu, S.; Zhao, H.; Jiang, N.; Wang, Z.; Liu, L.; An, Y.; Zhao, H.; Miao, X.; Liu, R.; Fortino, G. Multi-sensor information fusion based on machine learning for real applications in human activity recognition: State-of-the-art and research challenges. Inf. Fusion 2022, 80, 241–265. [Google Scholar] [CrossRef]
  6. Zhao, H.; Wang, Z.; Qiu, S.; Wang, J.; Xu, F.; Wang, Z.; Shen, Y. Adaptive gait detection based on foot-mounted inertial sensors and multi-sensor fusion. Inf. Fusion 2019, 52, 157–166. [Google Scholar] [CrossRef]
  7. Zhao, H.; Xu, H.; Wang, Z.; Wang, L.; Qiu, S.; Peng, D.; Li, J.; Jiang, J. Analysis and Evaluation of Hemiplegic Gait Based on Wearable Sensor Network. Inf. Fusion 2023, 90, 382–391. [Google Scholar] [CrossRef]
  8. Qiu, S.; Wang, H.; Li, J.; Zhao, H.; Wang, Z.; Wang, J.; Wang, Q.; Plettemeier, D.; Bärhold, M.; Bauer, T.; et al. Towards Wearable-Inertial-Sensor-Based Gait Posture Evaluation for Subjects with Unbalanced Gaits. Sensors 2020, 20, 1193. [Google Scholar] [CrossRef] [Green Version]
  9. Qiu, S.; Hao, Z.; Wang, Z.; Liu, L.; Liu, J.; Zhao, H.; Fortino, G. Sensor Combination Selection Strategy for Kayak Cycle Phase Segmentation Based on Body Sensor Networks. IEEE Internet Things J. 2022, 9, 4190–4201. [Google Scholar] [CrossRef]
  10. Li, K.; Zhang, J.; Wang, L.; Zhang, M.; Li, J.; Bao, S. A review of the key technologies for sEMG-based human-robot interaction systems. Biomed. Signal Process. Control 2020, 62, 102074. [Google Scholar] [CrossRef]
  11. Reaz, M.B.I.; Hussain, M.S.; Mohd-Yasin, F. Techniques of EMG signal analysis: Detection, processing, classification and applications. Biol. Proced. Online 2006, 8, 11–35. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Zhong, B.; Da Silva, R.L.; Li, M.; Huang, H.; Lobaton, E. Environmental Context Prediction for Lower Limb Prostheses with Uncertainty Quantification. IEEE Trans. Autom. Sci. Eng. 2021, 18, 458–470. [Google Scholar] [CrossRef]
  13. Wan, D.; Zhang, L.; Bai, Y.; Xie, Y. Research on Identification Algorithm Based on ECG Signal and Improved Convolutional Neural Network. In Proceedings of the International Conference on Computer Big Data and Artificial Intelligence, Changsha, China, 24–25 October 2020. [Google Scholar]
  14. Laport, F.; Iglesia, D.; Dapena, A.; Castro, P.M.; Vazquez-Araujo, F.J. Proposals and Comparisons from One-Sensor EEG and EOG Human-Machine Interfaces. Sensors 2021, 21, 2220. [Google Scholar] [CrossRef] [PubMed]
  15. Artemiadis, P. EMG-based Robot Control Interfaces: Past, Present and Future. Adv. Robot. Autom. 2012, 1, 1–3. [Google Scholar] [CrossRef]
  16. Coker, J.; Chen, H.; Schall Jr, M.C.; Gallagher, S.; Zabala, M. EMG and Joint Angle-Based Machine Learning to Predict Future Joint Angles at the Knee. Sensors 2021, 21, 3622. [Google Scholar] [CrossRef]
  17. Cimolato, A.; Driessen, J.J.; Mattos, L.S.; De Momi, E.; Laffranchi, M.; De Michieli, L. EMG-Driven Control in Lower LimbProstheses: A Topic-Based Systematic Review. J. Neuroeng. Rehabil. 2022, 19, 43. [Google Scholar] [CrossRef]
  18. Triwiyanto, T.; Wahyunggoro, O.; Nugroho, H.A.; Herianto, H. Evaluating the performance of Kalman filter on elbow joint angle prediction based on electromyography. Int. J. Precis. Eng. Manuf. 2017, 18, 1739–1748. [Google Scholar] [CrossRef]
  19. Liang, J.; Shi, Z.; Zhu, F.; Chen, W.; Chen, X.; Li, Y. Gaussian Process Autoregression for Joint Angle Prediction Based on sEMG Signals. Front. Public Health 2021, 9, 685596. [Google Scholar] [CrossRef]
  20. Chen, J.; Zhang, X.; Cheng, Y.; Xi, N. Surface EMG based continuous estimation of human lower limb joint angles by using deep belief networks. Biomed. Signal Process. Control 2018, 40, 335–342. [Google Scholar] [CrossRef]
  21. Raj, R.; Sivanandan, K.S. Elbow joint angle and elbow movement velocity estimation using NARX-multiple layer perceptron neural network model with surface EMG time domain parameters. J. Back Musculoskelet. Rehabil. 2017, 30, 515–525. [Google Scholar] [CrossRef]
  22. Gautam, A.; Panwar, M.; Biswas, D.; Acharyya, A. MyoNet: A Transfer-Learning-Based LRCN for Lower Limb Movement Recognition and Knee Joint Angle Prediction for Remote Monitoring of Rehabilitation Progress From sEMG. IEEE J. Transl. Eng. Health Med. 2020, 8, 2100310. [Google Scholar] [CrossRef] [PubMed]
  23. Seth, A.; Hicks, J.L.; Uchida, T.K.; Habib, A.; Dembia, C.L.; Dunne, J.J.; Ong, C.F.; Demers, M.S.; Rajagopal, A.; Millard, M.; et al. OpenSim: Simulating musculoskeletal dynamics and neuromuscular control to study human and animal movement. PLoS Comput. Biol. 2018, 14, e1006223. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Ai, Q.; Zhang, Y.; Qi, W.; Liu, Q.; Chen, K. Research on Lower Limb Motion Recognition Based on Fusion of sEMG and Accelerometer Signals. Symmetry 2017, 9, 147. [Google Scholar] [CrossRef] [Green Version]
  25. Bisi, S.; De Luca, L.; Shrestha, B.; Yang, Z.; Gandhi, V. Development of an EMG-Controlled Mobile Robot. Robotics 2018, 7, 36. [Google Scholar] [CrossRef] [Green Version]
  26. Colominas, M.A.; Schlotthauer, G.; Torres, M.E. Improved complete ensemble EMD: A suitable tool for biomedical signal processing. Biomed. Signal Process. Control 2014, 14, 19–29. [Google Scholar] [CrossRef]
  27. Nagasirisha, B.; Prasad, V.V.K.D.V. Noise Removal from EMG Signal Using Adaptive Enhanced Squirrel Search Algorithm. Fluct. Noise Lett. 2020, 19, 2050039. [Google Scholar] [CrossRef]
  28. Phinyomark, A.; Phukpattaranont, P.; Limsakul, C. Feature reduction and selection for EMG signal classification. Expert Syst. Appl. 2012, 39, 7420–7431. [Google Scholar] [CrossRef]
  29. Jang, G.; Kim, J.; Choi, Y.; Yim, J. Human shoulder motion extraction using EMG signals. Int. J. Precis. Eng. Manuf. 2014, 15, 2185–2192. [Google Scholar] [CrossRef]
  30. Yang, X.S.; Deb, S. Cuckoo search: Recent advances and applications. Neural Comput. Appl. 2013, 24, 169–174. [Google Scholar] [CrossRef] [Green Version]
  31. Pandey, A.C.; Rajpoot, D.S.; Saraswat, M. Twitter sentiment analysis using hybrid cuckoo search method. Inf. Process. Manag. 2017, 53, 764–779. [Google Scholar] [CrossRef]
  32. Tigrini, A.; Al-Timemy, A.H.; Verdini, F.; Fioretti, S.; Morettini, M.; Burattini, L.; Mengarelli, A. Decoding transient sEMG data for intent motion recognition in transhumeral amputees. Biomed. Signal Process. Control 2023, 85, 104936. [Google Scholar] [CrossRef]
  33. Chicco, D.; Warrens, M.J.; Jurman, G. The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation. PeerJ Comput. Sci. 2021, 7, e623. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Consensys bundle development kit.
Figure 1. Consensys bundle development kit.
Sensors 23 05404 g001
Figure 2. Model of human lower limb constructed by OpenSim software version 4.0.Beta.
Figure 2. Model of human lower limb constructed by OpenSim software version 4.0.Beta.
Sensors 23 05404 g002
Figure 3. Relationship between tendon length and knee joint angle.
Figure 3. Relationship between tendon length and knee joint angle.
Sensors 23 05404 g003
Figure 4. Relationship between tendon length and hip joint angle.
Figure 4. Relationship between tendon length and hip joint angle.
Sensors 23 05404 g004
Figure 5. Relationship between tendon length and ankle joint angle.
Figure 5. Relationship between tendon length and ankle joint angle.
Sensors 23 05404 g005
Figure 6. Comparison chart of selected muscle positions. (a) OpenSim frontal muscle sites; (b) human frontal muscle sites; (c) OpenSim back muscle sites; (d) human back muscle sites.
Figure 6. Comparison chart of selected muscle positions. (a) OpenSim frontal muscle sites; (b) human frontal muscle sites; (c) OpenSim back muscle sites; (d) human back muscle sites.
Sensors 23 05404 g006
Figure 7. CEEMDAN decomposition.
Figure 7. CEEMDAN decomposition.
Sensors 23 05404 g007
Figure 8. sEMG signals before and after noise reduction.
Figure 8. sEMG signals before and after noise reduction.
Sensors 23 05404 g008
Figure 9. Definition of joint angles.
Figure 9. Definition of joint angles.
Sensors 23 05404 g009
Figure 10. Definition of coordinate systems.
Figure 10. Definition of coordinate systems.
Sensors 23 05404 g010
Figure 11. Knee and hip joint angles for walking.
Figure 11. Knee and hip joint angles for walking.
Sensors 23 05404 g011
Figure 12. Knee and hip joint angles for going upstairs.
Figure 12. Knee and hip joint angles for going upstairs.
Sensors 23 05404 g012
Figure 13. Knee and hip joint angles for going uphill.
Figure 13. Knee and hip joint angles for going uphill.
Sensors 23 05404 g013
Figure 14. Lévy flight.
Figure 14. Lévy flight.
Sensors 23 05404 g014
Figure 15. Diagram of sensor wearing: (a) front view of sensor; (b) back view of the sensor.
Figure 15. Diagram of sensor wearing: (a) front view of sensor; (b) back view of the sensor.
Sensors 23 05404 g015
Figure 16. Comparison chart of selected muscle positions: (a) initial state; (b) walking; (c) going upstairs; (d) going uphill.
Figure 16. Comparison chart of selected muscle positions: (a) initial state; (b) walking; (c) going upstairs; (d) going uphill.
Sensors 23 05404 g016
Figure 17. Prediction results of knee and hip joint angle for walking.
Figure 17. Prediction results of knee and hip joint angle for walking.
Sensors 23 05404 g017
Figure 18. Prediction results of knee and hip joint angle for going upstairs.
Figure 18. Prediction results of knee and hip joint angle for going upstairs.
Sensors 23 05404 g018
Figure 19. Prediction results of knee and hip joint angles for going uphill.
Figure 19. Prediction results of knee and hip joint angles for going uphill.
Sensors 23 05404 g019
Table 1. Specifications of Shimmer3 sensor.
Table 1. Specifications of Shimmer3 sensor.
AccelerometerGyroscopeMagnetometerEMG
Range±16 g±2000 dps±49.152 gauss±8000 mv
Sensitivity1000 LSB/g131 LSB/dps667 LSB/gauss-
Frequency400 Hz400 Hz400 Hz1000 Hz
Table 2. Correlation coefficient after CEEMDANN decomposition.
Table 2. Correlation coefficient after CEEMDANN decomposition.
CEEMDAN ComponentCorrelation Coefficient
IMF10.1025
IMF20.1269
IMF30.1537
IMF40.1989
IMF50.2811
IMF60.3088
IMF70.4649
IMF80.3952
IMF90.4861
IMF100.6843
IMF110.5606
IMF120.0685
Table 3. MSE with different noise reduction methods.
Table 3. MSE with different noise reduction methods.
Noise Reduction MethodMSE
Wavelet thresholding—CEEMDAN0.6075
Wavelet thresholding0.6092
Butterworth filtering0.6093
Table 4. Comparative results of knee joint angle indexes during walking.
Table 4. Comparative results of knee joint angle indexes during walking.
AlgorithmRMSEMAER2
CS-RF2.58551.64420.9771
RF4.46223.77340.9297
SVR5.53284.42920.8958
BP8.36527.11660.7553
Table 5. Comparative results of hip joint angle indexes during walking.
Table 5. Comparative results of hip joint angle indexes during walking.
AlgorithmRMSEMAER2
CS-RF1.91671.53630.9815
RF2.84912.37400.9592
SVR6.49775.47050.8685
BP4.92834.14020.8762
Table 6. Comparative results of knee joint angle indexes during going upstairs.
Table 6. Comparative results of knee joint angle indexes during going upstairs.
AlgorithmRMSEMAER2
CS-RF4.08602.85710.9700
RF6.32283.99820.9030
SVR11.49908.21340.8824
BP10.06156.93190.7544
Table 7. Comparative results of hip joint angle indexes during going upstairs.
Table 7. Comparative results of hip joint angle indexes during going upstairs.
AlgorithmRMSEMAER2
CS-RF2.72902.05760.9708
RF3.77333.10520.9327
SVR5.02333.89080.9179
BP5.85664.91070.8287
Table 8. Comparative results of knee joint angle indexes during going uphill.
Table 8. Comparative results of knee joint angle indexes during going uphill.
AlgorithmRMSEMAER2
CS-RF1.93361.51020.9794
RF5.46104.58680.9511
SVR9.54088.46360.8883
BP8.35027.29500.8203
Table 9. Comparative results of hip joint angle indexes during going uphill.
Table 9. Comparative results of hip joint angle indexes during going uphill.
AlgorithmRMSEMAER2
CS-RF1.92761.38930.9769
RF3.29412.66680.9435
SVR6.41995.40120.9067
BP6.06895.11780.8249
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhao, H.; Qiu, Z.; Peng, D.; Wang, F.; Wang, Z.; Qiu, S.; Shi, X.; Chu, Q. Prediction of Joint Angles Based on Human Lower Limb Surface Electromyography. Sensors 2023, 23, 5404. https://doi.org/10.3390/s23125404

AMA Style

Zhao H, Qiu Z, Peng D, Wang F, Wang Z, Qiu S, Shi X, Chu Q. Prediction of Joint Angles Based on Human Lower Limb Surface Electromyography. Sensors. 2023; 23(12):5404. https://doi.org/10.3390/s23125404

Chicago/Turabian Style

Zhao, Hongyu, Zhibo Qiu, Daoyong Peng, Fang Wang, Zhelong Wang, Sen Qiu, Xin Shi, and Qinghao Chu. 2023. "Prediction of Joint Angles Based on Human Lower Limb Surface Electromyography" Sensors 23, no. 12: 5404. https://doi.org/10.3390/s23125404

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop