Next Article in Journal
Assessing the Influence of Buried Archaeology on Equine Locomotion Comparison with Ground Penetrating Radar Results
Next Article in Special Issue
Wearable Biofeedback Improves Human-Robot Compliance during Ankle-Foot Exoskeleton-Assisted Gait Training: A Pre-Post Controlled Study in Healthy Participants
Previous Article in Journal
A Safe Charging Algorithm Based on Multiple Mobile Chargers
Previous Article in Special Issue
Gait Characteristics under Imposed Challenge Speed Conditions in Patients with Parkinson’s Disease During Overground Walking
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Estimating Lower Extremity Running Gait Kinematics with a Single Accelerometer: A Deep Learning Approach

1
Menrva Research Group, Schools of Mechatronic Systems Engineering & Engineering Science, Simon Fraser University, Metro Vancouver, BC V5A 1S6, Canada
2
Department of Physical Therapy, University of British Columbia, Vancouver, BC V6T 1Z4, Canada
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(10), 2939; https://doi.org/10.3390/s20102939
Submission received: 13 April 2020 / Revised: 1 May 2020 / Accepted: 20 May 2020 / Published: 22 May 2020
(This article belongs to the Special Issue Smart Sensors: Applications and Advances in Human Motion Analysis)

Abstract

:
Abnormal running kinematics are associated with an increased incidence of lower extremity injuries among runners. Accurate and unobtrusive running kinematic measurement plays an important role in the detection of gait abnormalities and the prevention of injuries among runners. Inertial-based methods have been proposed to address this need. However, previous methods require cumbersome sensor setup or participant-specific calibration. This study aims to validate a shoe-mounted accelerometer for sagittal plane lower extremity angle measurement during running based on a deep learning approach. A convolutional neural network (CNN) architecture was selected as the regression model to generalize in inter-participant scenarios and to minimize poorly estimated joints. Motion and accelerometer data were recorded from ten participants while running on a treadmill at five different speeds. The reference joint angles were measured by an optical motion capture system. The CNN model predictions deviated from the reference angles with a root mean squared error (RMSE) of less than 3.5° and 6.5° in intra- and inter-participant scenarios, respectively. Moreover, we provide an estimation of six important gait events with a mean absolute error of less than 2.5° and 6.5° in intra- and inter-participants scenarios, respectively. This study highlights an appealing minimal sensor setup approach for gait analysis purposes.

1. Introduction

The kinematics of the lower extremity are an important area of research in human running gait analysis. Abnormal running kinematics are associated with an increased incidence of lower extremity injuries among runners [1,2]. While injuries may occur due to deviations in any plane, two of the most common kinematic patterns associated with injured runners occur in the sagittal plane (greater knee extension and ankle dorsiflexion at initial contact [2]). Correcting abnormal kinematics has been suggested to reduce the risk of injury [3,4]. Runners’ gait parameters can also change during a prolonged run due to fatigue [5,6,7], which may increase injury risk as the runner deviates from their normal gait pattern [8,9]. Reducing injury risk factors via altering running biomechanics has been demonstrated to be feasible in a lab environment [4,10], but this requires sophisticated equipment and software. Providing this feedback in an ecologically valid (in-field) context requires the ability to both measure and give feedback using wearable devices. This can be done currently only by using simple metrics such as cadence [11] or peak tibial acceleration [12], but the measurement of joint kinematics is much more complex. Developing an accurate, unobtrusive gait monitoring wearable system to measure running kinematics is still subject to research.
In contrast to optical motion-capture-based gait analysis, wearable sensors enable continuous and unobtrusive gait monitoring during in-field activity. Inertial measurement units (IMUs) have been widely employed as a portable system for the estimation of human gait kinematics and kinetics [13,14]. Consisting of an accelerometer, gyroscope, and magnetometer, IMUs measure the orientation of body segments by sensor data fusion.

1.1. IMU-Based Gait Kinematic Estimation

Inertial-based sensors have been employed to measure human kinematics based on three main approaches: (1) orientation-based methods that entail calculating the relative orientation of two adjacent segments based on the orientation of IMUs mounted on the distal and proximal segments; (2) model-based methods that take advantage of kinematic constraints; and (3) data-driven methods that employ supervised learning models to estimate reference joint angles.
The orientation-based method has traditionally been used to compute human kinematics [13,15] but has some limitations, including errors in sensor-to-segment alignment. The anatomical orientation of the bone is different from the local reference frame of the IMUs, requiring a calibration step to calculate the relative orientation of the IMU and the anatomical reference frame. However, the precision of the calibration also relies on performing predefined movements correctly, which may not be reliable, especially in injured populations [15,16]. Previous studies have used motion capture or RGB cameras to calculate the relative orientation of IMUs and the anatomical position before testing [17,18,19,20]. Although this method obtains lower errors, it requires prior calibration with cameras for each new session or participant. Another limitation of the orientation-based method is the drift in sensor signal that is due to signal integration operation, which is usually an essential step. Sensor data fusion using the Kalman filter is the main approach that has been proposed to overcome the drift problem [21]. However, the signal drift in noisy environments with ferromagnetic disturbances and during prolonged data recording is still problematic [13].
Kinematic or musculoskeletal model-based approaches consider the kinematic constraints of the human body to overcome the limitations of sensors such as drift and sensor-to-segment alignment. Optimization is driven to reduce the error between the orientation of the IMUs and body segments by taking into account the anatomical constraints of the human body [22]. Dorschky et al. [23] proposed estimating lower extremity joint angles using raw accelerometer and gyroscope data by solving optimization problems based on the musculoskeletal dynamics model introduced by van den Bogert et al. [24]. Joint constraints have also been proposed to overcome sensor-to-segment calibration [16].
The third method for lower extremity joint angle monitoring is a data-driven approach that relies on machine learning algorithms [25,26,27]. This approach feeds the raw signal [26] or orientation calculated by filtering methods into a machine learning model [27]. The machine learning model takes care of the sensor-to-segment calibration and calculates the joint angles. The main limitation of the data-driven method is the dependency on the supplied dataset and generalizability to other individuals or populations. Wouda et al. [27] used three IMUs to measure ground reaction forces and knee joint angles in running based on a neural network model. They demonstrated the potential of data-driven methods to estimate both kinematic and kinetic parameters during highly dynamic movement. Previous studies have reported root mean squared error (RMSE) values for sagittal plane lower extremity joint angles in walking ranging from 1.5° to 11° [15,28,29], while in running a range of 3.4°–13° for hip, knee, and ankle angle estimation has been reported [17,27]. When comparing the findings of previous studies, it is important to mention that many studies have included prior information for the model, such as a participant-specific optimized model [23], sensor-to-segment calibration [17,19,20,30], or sensor initial orientation on the body segment [20,31].

1.2. Reducing Number and Degrees of Freedom of IMUs:

Mounting an IMU on each segment for lower extremity kinematic estimation requires seven IMUs to provide full lower extremity joint angle measurement. This approach is cumbersome and obtrusive. Furthermore, it is unrealistic to expect a user at the consumer level to attach multiple IMUs due to the increased cost, reduced practicality, and probability of fixation error. Hence, there is a trend to reduce the number of required sensors for joint angle estimation. There are two approaches proposed so far to reduce the number of sensors: (1) model-based and (2) data-driven.
A model-based approach was proposed by Hu et al. [32] using four IMUs only to estimate the hip, knee, and ankle angles based on a serial chain model and solving the inverse kinematics. Bonnet et al. [31] used a single IMU on the shank to measure the hip and knee angles during several rehabilitation exercises by considering the mechanical constraints between proximal and distal segments. These methods demonstrated a greater error compared to a comprehensive sensor setup or were introduced for specific tasks. Data-driven methods have also been proposed for human full-body motion monitoring [33,34] and lower extremity walking analysis [35] with a reduced number of sensors. Recently, Lim et al. [35] proposed using a single IMU on the pelvis close to the center of mass to measure the lower limb kinematics and kinetics in walking. However, the application of a reduced number of inertial sensors to measure gait kinematics during a highly dynamic motion such as running has not yet been investigated.

1.3. Other Considerations

One issue with the use of IMUs for joint orientation measurement is the sensitivity of the magnetometer to ferromagnetic disturbances. For this reason, there is a trend towards magnetometer-free inertial-based systems for joint angle monitoring. Power consumption is also a significant concern during activities that occur over a prolonged period. Long distance running can have a duration of up to two hours or more. When comparing the power consumption of accelerometers and gyroscopes, the former has the advantage of a lower power consumption [36]. Therefore, the use of an IMU consisting of an accelerometer alone has the advantage of avoiding ferromagnetic disturbances and lasting throughout longer-duration activities.
The anatomical location of the IMU impacts the practicality of its use as well as the quality of the data. Rigid fixation of IMUs on the shank or thigh is less practical and more difficult than using a shoe-mounted system. The fixation that can be applied using a shoe- or lace-mounted IMU is likely to lead to more reliable data.
The ability to measure running kinematics outside of the lab and in real-world environments has the potential not only to allow researchers to study the impact of different terrain and fatigue states on running biomechanics, but also to prevent injuries when paired with real-time biofeedback [37]. In order to achieve this goal, accurate and unobtrusive monitoring of kinematics needs to be demonstrated in a controlled setting. In this study, we aimed to investigate the performance of a single shoe-mounted accelerometer to monitor lower extremity running kinematics in the sagittal plane. A secondary aim was to reduce the degrees of freedom of the IMU. A data-driven approach is presented based on convolutional neural networks. The performance of the method in inter- and intra-participant scenarios has been evaluated.

2. Materials and Methods

2.1. Experiment Setup

Twenty-five reflective markers were affixed to each participant prior to testing, and a static calibration trial was initially collected to form a musculoskeletal model based on Napier et al. (Figure 1) [38] using a 6-camera motion analysis system (Vicon, Oxford, UK). Ten static/calibration markers (anterior superior iliac spines, greater trochanters, left medial/lateral femoral condyles, left medial/lateral malleoli, and left first and fifth metatarsal heads) were removed following the static trial, and the 15 remaining markers (posterior superior iliac spines, iliac crests, clusters of 4 on the thigh and shank, and a triad on the heel) were by definition tracking and calibration markers, as they were on for both static and dynamic trials. The ankle joint center was identified as the midpoint between the 2 ankle malleoli markers; the knee joint center was identified as the midpoint between the 2 femoral condyle markers, and the hip joint center was identified using the method of Bell et al. [39].
The acceleration of the foot was measured by an Xsens inertial measurement unit (MTw Awinda, Xsens, Enschede, The Netherlands) mounted on the shoe, as shown in Figure 1. The Xsens unit has an accelerometer, gyroscope, and magnetometer; however, in this study only the raw data of the accelerometer were used for data processing. Both the motion capture and accelerometer data were recorded at a 100 Hz sampling rate. The accelerometer and motion capture data were synchronized using an analog signal from each of the Vicon and Xsens units.

2.2. Data Collection

Ten healthy male Caucasian participants (age 27 ± 4 years, height 177 ± 7 cm, and weight 72 ± 7 kg) participated in this study. The number of participants (sample size) was conducted in G*Power 3.1.9.3 to detect a strong (R2 > 0.80) association between our method and the gold standard optical motion capture method for computing joint kinematics. To obtain 80% power to detect significant (p < 0.05) associations, we determined that 10 participants were required. Sex was not expected to influence our results [40]. The study protocol was approved by the Office of Research Ethics at Simon Fraser University, and all participants provided informed consent.
The data recording protocol consisted of 15 trials of running at five different speeds—8, 9, 10, 11, and 12 km/h—with three trials of 60 s at each speed. The participants were given time to warm up and familiarize themselves with the treadmill before data recording started from the slowest speed. The participants were given a short break after each trial.

2.3. Data Preprocessing

The raw accelerometer data from all three axes were recorded by Xsens software and filtered using the SciPy Python library [41]. The accelerometer data were not normalized or standardized. A total of 6% of the dataset was excluded due to the asynchronized accelerometer and motion signals. The motion capture data were considered the gold standard reference for the kinematic data for this study. The marker trajectories were imported to Visual 3D software (C-Motion, Inc., Germantown, MD, USA) and the joint angles were computed and filtered with Visual 3D. The motion and accelerometer data were filtered by a fourth-order Butterworth low-pass filter with a cut-off frequency of 6 Hz following the recommendation of previous studies [42]. A sample of raw accelerometer data is shown in Figure 2.

2.4. Deep Learning Model

Convolutional neural networks (CNNs) have been recently applied to different signal processing problems and have also shown promising results in human motion estimation using wearable sensors [43]. In this study, a one-dimensional CNN(1D-CNN) was implemented in Keras blackened TensorFlow [44]. The input and output of the model were as follows:
[ θ h i p , θ k n e e , θ a n k l e ] = h ( X )
where the CNN model is denoted with h and X was a matrix of the shoe-mounted accelerometer’s data with a shape of 60 × 4 :
X T = [ a 1 x t n + 1 a 1 x t n + 1 a 1 y t n + 1 a 1 y t n + 1 a 1 z t n + 1 a 1 z t n + 1 a 1 x y z t n + 1 a 1 x y z t n + 1 a 1 x t + n a 1 y t + n a 1 z t n a 1 x y z t n ]
A time window was moved over the signal with a length of 2n = 600 ms that covered equal samples of the past and the future time steps. a x ,   a y , and a z were acceleration in three different axes. a x y z was the root sum squared of the acceleration with the following formula:
a x y z = a x 2 + a y 2 + a z 2 .
The a x y z is axis free and is less prone to changes in the IMU’s orientation on body segments from person to person.
The 1D-CNN model had four convolutional (Conv) layers and a max-pooling layer. The number of features at the first and second two Conv layers was 50 and 100, respectively. The architecture and layer shapes are summarized in Table 1. All the trainable layers were initialized with a Xavier normal initializer. The Conv and fully connected layers were activated with a rectified linear unit, while the output layer was activated with a linear function. The kernel size and stride values were selected to be 3 and 1, respectively. The parameters were optimized by an Adam optimizer with a learning rate of 0.001. The batch size for training the model was selected to be 512 and the number of epochs was fixed to 50. A dropout layer was defined as the first layer for inter-participant scenarios to help the model generalize while testing on a new participant. The dropout layer was not defined for intra-participant models. Since the errors of hip and ankle angle estimation were greater than the knee, a customized loss function was defined to improve the ankle and hip estimated joint angles as follows:
L o s s = 1 3 ( A × R M S E ( θ H i p ) + B × R M S E ( θ K n e e ) + C × R M S E ( θ A n k l e ) ) ,         R M S E = i = 1 n ( y y ^ ) 2
where A, B, and C are weight parameters selected empirically to be 3, 1, and 3, respectively.

2.5. Evaluation Methods

Two evaluation methods were considered: (1) intra-participant and (2) inter-participant. In the intra-participant method, CNN models were trained and tested using the running data of each participant. Running trials of each participant were randomly concatenated and then 80% of data was selected for training and the remaining 20% for the test. In the inter-participant method, the CNN models were trained on the data of nine participants and tested on the tenth participant, and this continued until all the participants were assigned to the test set. Figure 3 shows a schematic of splitting the data into training and test following a-leave-one-person-out cross-validation scheme for inter-participants In the intra-participants scenario (Figure 3), data were split into train and test regardless of the speeds and consequences of trials.
We also investigated the error of the estimated angles at six important gait events. The selected gait events were: peak knee flexion angle during stance phase, peak hip flexion/extension angle, peak ankle plantar/dorsiflexion angle, and ankle plantar/dorsiflexion angle at initial contact. Figure 4 shows the specified gait events in the gait cycle. Increasing the knee flexion angle during the stance phase has been suggested to attenuate shock [45]. The ankle angle at initial contact is also representative of the foot-strike pattern, which has relevance to running injuries. The initial contact during running was determined using the minimum vertical height of the heel markers for each stride [46]. The remaining gait events were detected using peak detection of the reference joint angles.
Three different evaluation metrics were considered in this study: (1) root mean squared error (RMSE), (2) normalized root mean squared error (NRMSE), and (3) root mean squared values (R2). The first two evaluation metrics reflect the measurement error, while the third evaluation metric reflects the goodness of predicted values. To calculate the NRMSE, the RMSE was divided by the range of angles in the test dataset. Equations of RMSE and NRMSE are as follows:
R M S E = i = 1 n ( y y ^ ) 2 ,           N R M S E = R M S E y m a x y m i n

3. Results

3.1. Intra-Participant Models

The average root mean squared value (R2) for ten participants for hip, knee, and ankle angles was greater than 0.97, while the RMSE and NRMSE were lower than 3.4° and 4.6%, respectively. The average intra-participant estimations among the ten participants are shown in Table 2.
The estimated and reference discrete angles among the participants and the mean absolute error (MAE) of estimated angles are reported in Table 3. The mean difference between the estimated and reference angles for all joints was less than 1°. However, the mean absolute error of the estimated values was up to 2.4 degrees.

3.2. Inter-Participant Models

In this section, the CNN model was trained on 9 participants and then tested on the 10th participant. The error of the estimated angles in the inter-participant scenario was less than 6.5°, with average R2 values of 0.84, 0.93, and 0.73 for hip, knee, and ankle, respectively (Table 4). The estimated RMSE was normalized with a range of angles for each participant and the average NRMSE between the 10 participants was less than 11% for the hip, knee, and ankle.
The estimated and reference discrete values for the inter-participant method are shown in Table 5. The mean difference between the estimated and reference values was less than 4°, with peak knee flexion during stance and peak hip flexion displaying the greatest mean absolute error.
Figure 5 shows the average estimated and reference joint angle trajectories for participant number 10, with the standard deviation (shaded region) of estimated and reference angles for all participants. The estimated angles follow a similar trajectory to the reference angles.

4. Discussion and Conclusions

In this study, we investigated the performance of a single shoe-mounted accelerometer for hip, knee, and ankle joint angle estimation. To the best of our knowledge, this is the first study that has used a single accelerometer for lower extremity joint angle estimation. A convolutional neural network was used to estimate joint angles in inter- and intra-participant scenarios. The accelerometer was placed on the shoe (lace-mount), which is a convenient position for runners and the most common site for consumer-grade IMUs in runners [47]. Mounting IMUs on the thigh and shank is less practical for runners, and IMUs mounted on the waist can be affected by the movements of both legs. Moreover, mounting accelerometers on the shank, thigh, or waist increases the likelihood of inflated values due to improper fixation or, in the case of the thigh, soft tissue artefact. The study in larger scope recommends the potential of deep learning-based approaches for inertial measurement unit data processing to tackle accurate human motion monitoring and reduce the number of sensors required.
In both inter- and intra-participant scenarios, the knee joint angle was better estimated than the hip and ankle joint angles. We reason that the lower error of the knee angle estimation was due to consistent knee angle trajectories among participants. Moreover, the degrees of freedom of the knee angle is lower compared to the ankle and hip joints. The ankle and hip have greater movements available to them in the frontal and transverse planes that may be obscured when we are only considering sagittal plane movements.
In the inter-participant scenario, the error of the ankle joint angle estimation was significant, with an NRMSE of 11% and an R2 of 0.78. We hypothesize that the greater variation in ankle joint angle throughout the gait cycle among participants was the reason for the significant ankle angle estimation error. The average standard deviations of joint angles through the gait cycle divided by the range of motion over ten participants were 0.09, 0.07, and 0.12 for the hip, knee, and ankle, respectively. Although there is an offset between the estimated ankle angle and the reference values in Figure 5, the estimated values are close to the reference value at initial contact (<1°). The ankle angle at initial contact is an important measure, since it can be used to determine the foot strike pattern of the individual [48]. This value was estimated with a mean absolute error of less than 3˚ in the inter-participant method.
In this study, the accuracy of this model at six key gait events was reported. All discrete values in the inter-participant evaluation were underestimated and the peak knee flexion estimation had the greatest difference from the reference value. For biomechanical analysis, the accuracy of the estimated angles at key gait events has importance in relation to injury risk and performance variables. Changes in these variables over time (throughout a prolonged run, for instance) may indicate the runner’s level of fatigue [5,6,7] and therefore the risk of developing injury [1,2,9]. A portable system that could accurately monitor the joint angles at key gait events over the course of a prolonged run, therefore, could be a valuable tool to prevent running-related overuse injuries.
The error of estimated angles in the intra-participant method was small, with an RMSE ranging between 1.8° and 3.4°. However, errors were greater for the inter-participant evaluation method (4.7°–6.5°). The reported error is in comparison to an optical motion capture system. While optimal motion capture is considered the gold standard measurement tool for gait analysis, these systems have been reported to have an error of 0.48°–7.36° in the sagittal plane hip, knee, and ankle measurement between two different sessions [49]. This error is mainly due to inaccurate marker placement and the marker-positioning error of the system during dynamic movement. The optical system’s error may propagate to the inter-participant estimated angles. In this study, one person placed markers on participants’ anatomical landmarks to minimize the inter-participant error of reference joint angles.
In comparison with previous studies, Wouda et al. [27] used three IMUs to estimate the knee joint angle and obtained an average error of ~4° and <13° in intra- and inter-participant evaluation methods, respectively. Previous studies have reported a smaller error in static movements compared with dynamic movements [15], since the range of motion, noise, and sensor movement are greater during activity. Table 6 compares previous studies that have reported inertial-based methods for joint angle measurement during running. The number of sensors, whether the method is intra/inter-participant, the computation methods, the number of joint angles that were measured, and the error of measurement are compared. Intra-participant methods require some input from the participant, such as initial sensor orientation on the segment [20] or a sample of reference gait kinematics during running [23,27] that requires motion capture data collection, which is not available to most runners, coaches, or clinicians. Our study used only a single inertial sensor with only accelerometer data. We also had fewer sensor degrees of freedom and a lower error in the inter-participant scenario thanks to the deep convolutional neural networks.

5. Limitations and Future Work

The generalization of the data-driven method is the main limitation. In the convolutional neural network, we used a drop-out layer for inter-participant analysis. The drop-out layer helps the model to generalize better, particularly when the dataset is small and there is a high possibility of overfitting the training data. The convolutional layers of CNN have the advantage of automatic feature extraction and outperform neural networks. An important aspect of data-driven methods is how the dataset is divided into training and test data. For instance, if the data has been recorded for one person in a single session and then has been split to train and test, the reliability of the results will be doubtful. In this study, we have also reported the inter-participant results, which are a better representation of the robustness of the model. Nevertheless, the accuracy of the estimated values is lower for the inter-participant method compared to previous studies [27].
In this study, we used a single shoe-mounted accelerometer. Shoe-mounted accelerometers are common among runners and multiple commercialized foot-pods measure gait features. However, future work should optimize sensor placement for lower extremity tracking based on a single accelerometer. Although mounting sensors on the shank or thigh might be less practical compared to shoe-mounted sensors, the position and number of sensors on the shoe need to be optimized in future studies. It may be possible to obtain more information by mounting multiple tiny accelerometers on shoes. In this study, the position of the accelerometer on the shoe was selected empirically; however, mounting an accelerometer above the heel or placing it in the insole could provide better information. This study was a preliminary study that focused on training deep learning models for a single session. The repeatability of the method between days and between sessions should be investigated in future studies. The generalizability of machine learning models for in-field use is challenging and needs to be investigated in future work. The gait kinematics of runners during outdoor running differ from indoor running, which might create challenges when testing the machine learning model outdoors based on an indoor running test.

Author Contributions

M.G. and C.M. designed the study conceptually, C.N. and M.G. designed and performed the experiment, and M.G. analyzed the data. All authors read, corrected, and reviewed the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Collaborative Health Research Grant (Natural Sciences and Engineering Research Council and the Canadian Institutes of Health Research) and the Canada Research Chairs Program.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Neal, B.S.; Barton, C.J.; Birn-Jeffery, A.; Morrissey, D. Increased hip adduction during running is associated with patellofemoral pain and differs between males and females: A case-control study. J. Biomech. 2019, 91, 133–139. [Google Scholar] [CrossRef]
  2. Bramah, C.; Preece, S.J.; Gill, N.; Herrington, L. Is there a pathological gait associated with common soft tissue running injuries? Am. J. Sports Med. 2018, 46, 3023–3031. [Google Scholar] [CrossRef]
  3. Bramah, C.; Preece, S.J.; Gill, N.; Herrington, L. A 10% increase in step rate improves running kinematics and clinical outcomes in runners with patellofemoral pain at 4 weeks and 3 months. Am. J. Sports Med. 2019, 47, 3406–3413. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Chan, Z.Y.S.; Zhang, J.H.; Au, I.P.H.; An, W.W.; Shum, G.L.K.; Ng, G.Y.F.; Cheung, R.T.H. Gait retraining for the reduction of injury occurrence in novice distance runners: 1-year follow-up of a randomized controlled trial. Am. J. Sports Med. 2018, 46, 388–395. [Google Scholar] [CrossRef]
  5. García-Pinillos, F.; Cartón-Llorente, A.; Jaén-Carrillo, D.; Delgado-Floody, P.; Carrasco-Alarcón, V.; Martínez, C.; Roche-Seruendo, L.E. Does fatigue alter step characteristics and stiffness during running? Gait Posture 2020, 76, 259–263. [Google Scholar] [CrossRef]
  6. Derrick, T.R.; Dereu, D.; McLean, S.P. Impacts and kinematic adjustments during an exhaustive run. Med. Sci. Sports Exerc. 2002, 34, 998–1002. [Google Scholar] [CrossRef]
  7. Sanno, M.; Willwacher, S.; Epro, G.; Brüggemann, G.-P. Positive work contribution shifts from distal to proximal joints during a prolonged run. Med. Sci. Sports Exerc. 2018, 50, 2507–2517. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Clermont, C.A.; Pohl, A.J.; Ferber, R. Fatigue-related changes in running gait patterns persist in the days following a marathon race. J. Sport Rehabil. 2019, 1, 1–8. [Google Scholar] [CrossRef]
  9. Clansey, A.C.; Hanlon, M.; Wallace, E.S.; Lake, M.J. Effects of fatigue on running mechanics associated with tibial stress fracture risk. Med. Sci. Sports Exerc. 2012, 44, 1917–1923. [Google Scholar] [CrossRef] [PubMed]
  10. Napier, C.; MacLean, C.L.; Maurer, J.; Taunton, J.E.; Hunt, M.A. Real-time biofeedback of performance to reduce braking forces associated with running-related injury: An exploratory study. J. Orthop. Sports Phys. Ther. 2018, 49, 136–144. [Google Scholar] [CrossRef]
  11. Willy, R.W.; Buchenic, L.; Rogacki, K.; Ackerman, J.; Schmidt, A.; Willson, J.D. In-field gait retraining and mobile monitoring to address running biomechanics associated with tibial stress fracture. Scand. J. Med. Sci. Sports 2016, 26, 197–205. [Google Scholar] [CrossRef] [PubMed]
  12. Sheerin, K.R.; Reid, D.; Taylor, D.; Besier, T.F. The effectiveness of real-time haptic feedback gait retraining for reducing resultant tibial acceleration with runners. Phys. Ther. Sport 2020, 43, 173–180. [Google Scholar] [CrossRef] [PubMed]
  13. Picerno, P. 25 years of lower limb joint kinematics by using inertial and magnetic sensors: A review of methodological approaches. Gait Posture 2017, 51, 239–246. [Google Scholar] [CrossRef] [PubMed]
  14. Jiang, X.; Gholami, M.; Khoshnam, M.; Eng, J.J.; Menon, C. Estimation of ankle joint power during walking using two inertial sensors. Sensors 2019, 19, 2796. [Google Scholar] [CrossRef] [Green Version]
  15. Weygers, I.; Kok, M.; Konings, M.; Hallez, H.; De Vroey, H.; Claeys, K. Inertial sensor-based lower limb joint kinematics: A methodological systematic review. Sensors 2020, 20, 673. [Google Scholar] [CrossRef] [Green Version]
  16. Seel, T.; Raisch, J.; Schauer, T. IMU-based joint angle measurement for gait analysis. Sensors 2014, 14, 6891–6909. [Google Scholar] [CrossRef] [Green Version]
  17. Kok, M.; Hol, J.D.; Schön, T.B. An optimization-based approach to human body motion capture using inertial sensors. IFAC Proc. Vol. 2014, 47, 79–85. [Google Scholar] [CrossRef] [Green Version]
  18. Dejnabadi, H.; Jolles, B.M.; Aminian, K. A new approach to accurate measurement of uniaxial joint angles based on a combination of accelerometers and gyroscopes. IEEE Trans. Biomed. Eng. 2005, 52, 1478–1484. [Google Scholar] [CrossRef]
  19. Tadano, S.; Takeda, R.; Miyagawa, H. Three dimensional gait analysis using wearable acceleration and gyro sensors based on quaternion calculations. Sensors 2013, 13, 9321–9343. [Google Scholar] [CrossRef]
  20. Cooper, G.; Sheret, I.; McMillian, L.; Siliverdis, K.; Sha, N.; Hodgins, D.; Kenney, L.; Howard, D. Inertial sensor-based knee flexion/extension angle estimation. J. Biomech. 2009, 42, 2678–2685. [Google Scholar] [CrossRef] [Green Version]
  21. Roetenberg, D.; Luinge, H.J.; Baten, C.T.M.; Veltink, P.H. Compensation of magnetic disturbances improves inertial and magnetic sensing of human body segment orientation. IEEE Trans. Neural Syst. Rehabil. Eng. 2005, 13, 395–405. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Koning, B.H.W.; van der Krogt, M.M.; Baten, C.T.M.; Koopman, B.F.J.M. Driving a musculoskeletal model with inertial and magnetic measurement units. Comput. Methods Biomech. Biomed. Engin. 2015, 18, 1003–1013. [Google Scholar] [CrossRef]
  23. Dorschky, E.; Nitschke, M.; Seifer, A.-K.; van den Bogert, A.J.; Eskofier, B.M. Estimation of gait kinematics and kinetics from inertial sensor data using optimal control of musculoskeletal models. J. Biomech. 2019, 95, 109278. [Google Scholar] [CrossRef] [PubMed]
  24. van den Bogert, A.J.; Blana, D.; Heinrich, D. Implicit methods for efficient musculoskeletal simulation and optimal control. Procedia IUTAM 2011, 2, 297–316. [Google Scholar] [CrossRef] [Green Version]
  25. Goulermas, J.Y.; Findlow, A.H.; Nester, C.J.; Liatsis, P.; Zeng, X.-J.; Kenney, L.P.J.; Tresadern, P.; Thies, S.B.; Howard, D. An instance-based algorithm with auxiliary similarity information for the estimation of gait kinematics from wearable sensors. IEEE Trans. Neural Netw. 2008, 19, 1574–1582. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Findlow, A.; Goulermas, J.Y.; Nester, C.; Howard, D.; Kenney, L.P.J. Predicting lower limb joint kinematics using wearable motion sensors. Gait Posture 2008, 28, 120–126. [Google Scholar] [CrossRef]
  27. Wouda, F.J.; Giuberti, M.; Bellusci, G.; Maartens, E.; Reenalda, J.; van Beijnum, B.J.F.; Veltink, P.H. Estimation of vertical ground reaction forces and sagittal knee kinematics during running using three inertial sensors. Front. Physiol. 2018, 9, 218. [Google Scholar] [CrossRef]
  28. Favre, J.; Jolles, B.M.; Aissaoui, R.; Aminian, K. Ambulatory measurement of 3D knee joint angle. J. Biomech. 2008, 41, 1029–1035. [Google Scholar] [CrossRef]
  29. Ohtaki, Y.; Sagawa, K.; Inooka, H. A method for gait analysis in a daily living environment by body-mounted instruments. JSME Int. J. C Mech. Syst. 2001, 44, 1125–1132. [Google Scholar] [CrossRef] [Green Version]
  30. Rouhani, H.; Favre, J.; Crevoisier, X.; Aminian, K. Measurement of multi-segment foot joint angles during gait using a wearable system. J. Biomech. Eng. 2012, 134, 061006. [Google Scholar] [CrossRef]
  31. Bonnet, V.; Joukov, V.; Kulić, D.; Fraisse, P.; Ramdani, N.; Venture, G. Monitoring of hip and knee joint angles using a single inertial measurement unit during lower limb rehabilitation. IEEE Sens. J. 2016, 16, 1557–1564. [Google Scholar] [CrossRef] [Green Version]
  32. Hu, X.; Yao, C.; Soh, G.S. Performance evaluation of lower limb ambulatory measurement using reduced inertial measurement units and 3R gait model. In Proceedings of the 2015 IEEE International Conference on Rehabilitation Robotics (ICORR), Singapore, 11–14 August 2015; pp. 549–554. [Google Scholar]
  33. Riaz, Q.; Tao, G.; Krüger, B.; Weber, A. Motion reconstruction using very few accelerometers and ground contacts. Graph. Models 2015, 79, 23–38. [Google Scholar] [CrossRef]
  34. Mousas, C. Full-body locomotion reconstruction of virtual characters using a single inertial measurement unit. Sensors 2017, 17, 2589. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Lim, H.; Kim, B.; Park, S. Prediction of lower limb kinetics and kinematics during walking by a single IMU on the lower back using machine learning. Sensors 2020, 20, 130. [Google Scholar] [CrossRef] [Green Version]
  36. Liu, Q.; Williamson, J.; Li, K.; Mohrman, W.; Lv, Q.; Dick, R.P.; Shang, L. Gazelle: Energy-efficient wearable analysis for running. IEEE Trans. Mob. Comput. 2017, 16, 2531–2544. [Google Scholar] [CrossRef]
  37. Napier, C.; Esculier, J.-F.; Hunt, M.A. Gait retraining: Out of the lab and onto the streets with the benefit of wearables. Br. J. Sports Med. 2017, 51, 1642–1643. [Google Scholar] [CrossRef] [Green Version]
  38. Napier, C.; MacLean, C.L.; Maurer, J.; Taunton, J.E.; Hunt, M.A. Kinetic risk factors of running-related injuries in female recreational runners. Scand. J. Med. Sci. Sports 2018, 28, 2164–2172. [Google Scholar] [CrossRef]
  39. Bell, A.L.; Brand, R.A.; Pedersen, D.R. Prediction of hip joint centre location from external landmarks. Hum. Mov. Sci. 1989, 8, 3–16. [Google Scholar] [CrossRef]
  40. Wille, C.M.; Lenhart, R.L.; Wang, S.; Thelen, D.G.; Heiderscheit, B.C. Ability of sagittal kinematic variables to estimate ground reaction forces and joint kinetics in running. J. Orthop. Sports Phys. Ther. 2014, 44, 825–830. [Google Scholar] [CrossRef] [Green Version]
  41. Virtanen, P.; Gommers, R.; Oliphant, T.E.; Haberland, M.; Reddy, T.; Cournapeau, D.; Burovski, E.; Peterson, P.; Weckesser, W.; Bright, J.; et al. SciPy 1.0—Fundamental algorithms for scientific computing in python. Nat. Methods 2019, 17, 261–272. [Google Scholar] [CrossRef] [Green Version]
  42. Żuk, M.; Pezowicz, C. Kinematic analysis of a six-degrees-of-freedom model based on ISB recommendation: A repeatability analysis and comparison with conventional gait model. Appl. Bionics Biomech. 2015, 2015, 9. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Gholami, M.; Rezaei, A.; Cuthbert, T.J.; Napier, C.; Menon, C. Lower body kinematics monitoring in running using fabric-based wearable sensors and deep convolutional neural networks. Sensors 2019, 19, 5325. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Chollet, F. Keras. Available online: https://keras.io/ (accessed on 10 August 2019).
  45. Edwards, W.B.; Derrick, T.R.; Hamill, J. Musculoskeletal attenuation of impact shock in response to knee angle manipulation. J. Appl. Biomech. 2012, 28, 502–510. [Google Scholar] [CrossRef] [PubMed]
  46. Chew, D.-K.; Ngoh, K.J.-H.; Gouwanda, D.; Gopalai, A.A. Estimating running spatial and temporal parameters using an inertial sensor. Sports Eng. 2018, 21, 115–122. [Google Scholar] [CrossRef]
  47. Cheung, R.T.H.; Zhang, J.H.; Chan, Z.Y.S.; An, W.W.; Au, I.P.H.; MacPhail, A.; Davis, I.S. Shoe-mounted accelerometers should be used with caution in gait retraining. Scand. J. Med. Sci. Sports 2019, 29, 835–842. [Google Scholar] [CrossRef]
  48. Almeida, M.O.; Davis, I.S.; Lopes, A.D. Biomechanical differences of foot-strike patterns during running: A systematic review with meta-analysis. J. Orthop. Sports Phys. Ther. 2015, 45, 738–755. [Google Scholar] [CrossRef] [Green Version]
  49. Stoneham, R.; Barry, G.; Saxby, L.; Wilkinson, M. Measurement error of 3D kinematic and kinetic measures during overground endurance running in recreational runners between two test sessions separated by 48 h. Physiol. Meas. 2019, 40, 024002. [Google Scholar] [CrossRef]
Figure 1. (A) Experimental setup including six motion capture cameras and a split-belt treadmill. The schematic of angles estimated using the raw signal of a foot-mounted accelerometer. (B) Reflective marker positions on the lower extremity.
Figure 1. (A) Experimental setup including six motion capture cameras and a split-belt treadmill. The schematic of angles estimated using the raw signal of a foot-mounted accelerometer. (B) Reflective marker positions on the lower extremity.
Sensors 20 02939 g001
Figure 2. Sample of raw accelerometer signal.
Figure 2. Sample of raw accelerometer signal.
Sensors 20 02939 g002
Figure 3. Splitting data for training and testing for (A) inter-participant method and (B) intra-participant method.
Figure 3. Splitting data for training and testing for (A) inter-participant method and (B) intra-participant method.
Sensors 20 02939 g003
Figure 4. Gait events over a sample participant’s gait cycle. Flexion (Flex)/Dorsiflexion (DF) are positive; extension (Ext)/Plantarflexion (PF) are negative. IC, initial contact.
Figure 4. Gait events over a sample participant’s gait cycle. Flexion (Flex)/Dorsiflexion (DF) are positive; extension (Ext)/Plantarflexion (PF) are negative. IC, initial contact.
Sensors 20 02939 g004
Figure 5. Average estimated and reference angles of participant 7 with standard deviations in shadow for (A) intra-participant model and (B) inter-participant model. Flexion (Flex)/Dorsiflexion (DF) are positive; extension (Ext)/Plantarflexion (PF) are negative.
Figure 5. Average estimated and reference angles of participant 7 with standard deviations in shadow for (A) intra-participant model and (B) inter-participant model. Flexion (Flex)/Dorsiflexion (DF) are positive; extension (Ext)/Plantarflexion (PF) are negative.
Sensors 20 02939 g005
Table 1. Layers of convolutional neural networks.
Table 1. Layers of convolutional neural networks.
IndexLayerOutput ShapeSetting
0Input(60,4)
1Dropout 0.1
21D-Conv(58,50)ReLU
31D-Conv(56,50)ReLU
4MaxPool(28,50)
51D-Conv(26,100)ReLU
61D-Conv(24,100)ReLU
7Flatten2400ReLU
8Dense100ReLU
9Dense3Linear
Table 2. Average error and accuracy of estimated angles (SD) in intra-participant models among 10 participants. RMSE, root mean squared error; NRMSE, normalized root mean squared error.
Table 2. Average error and accuracy of estimated angles (SD) in intra-participant models among 10 participants. RMSE, root mean squared error; NRMSE, normalized root mean squared error.
HipKneeAnkle
R20.97 (0.00)0.98 (1.30)0.97 (1.59)
RMSE (deg)2.3 (0.5)3.4 (1.2)1.8 (0.4)
NRMSE (%)4.6 (0.1)3.5 (0.1)4.3 (0.1)
Table 3. Estimated and reference joint angles (SD) at discrete gait events in the intra-participant model. MAE, mean absolute error; DF, dorsiflexion; PF, plantarflexion.
Table 3. Estimated and reference joint angles (SD) at discrete gait events in the intra-participant model. MAE, mean absolute error; DF, dorsiflexion; PF, plantarflexion.
HipHipKneeAnkleAnkleAnkle
Peak Flexion Peak Extension Peak Flexion
during Stance
Peak DF Peak PFPF/DF at
Initial Contact
Reference27.6 (7.3)15.3 (3.9)30.1 (6.4)12.8 (3.6)21.4 (5.0)2.2 (3.1)
Estimated28.3 (8.0)15.5 (4.8)30.2 (6.4)13.1 (3.9)20.9 (5.5)2.2 (3.2)
MAE2.4 (2.5)1.5 (0.3)1.2 (0.3)1.0 (0.6)1.0 (0.3)1.0 (0.3)
Table 4. Average error and accuracy of estimated angles (SD) in the inter-participant models among 10 participants. RMSE, root mean squared error; NRMSE, normalized root mean squared error.
Table 4. Average error and accuracy of estimated angles (SD) in the inter-participant models among 10 participants. RMSE, root mean squared error; NRMSE, normalized root mean squared error.
HipKneeAnkle
R20.84 (0.10)0.93 (0.04)0.78 (0.10)
RMSE (deg)5.6 (2.2)6.5 (2.1)4.7 (1.6)
NRMSE (%)9.9 (2.2)6.5 (1.8)11.1 (3.1)
Table 5. Estimated and reference joint angles at discrete gait events in the inter-participant model. MAE, mean absolute error; DF, dorsiflexion; PF, plantarflexion.
Table 5. Estimated and reference joint angles at discrete gait events in the inter-participant model. MAE, mean absolute error; DF, dorsiflexion; PF, plantarflexion.
HipHipKneeAnkleAnkleAnkle
Peak FlexionPeak ExtensionPeak Flexion
during Stance
Peak DFPeak PFPF/DF at
Initial Contact
Reference27.6 (5.6)15.6 (3.9)30.0 (5.7)13.1 (3.9)21.0 (5.5)2.4 (3.1)
Estimated25.9 (3.0)13.9 (1.4)26.4 (2.4)10.8 (2.0)19.8 (4.1)0.9 (1.5)
MAE5.9 (3.3)4.0 (1.5)6.4 (4.6)5.0 (2.3)4.0 (2.5)2.8 (1.3)
Table 6. Inertial-based methods for running kinematic estimation.
Table 6. Inertial-based methods for running kinematic estimation.
Ref.Number of SensorsInter/Intra
-Model
MethodJointRMSE
[23]7 (Gyro + Acc)Yes/NoMusculoskeletal modelingHip8.7
Knee5.3
Ankle4.6
[27]3 (Gyro + Acc + Mag)Yes/YesData-DrivenKnee~4/<13
[20]2 (Gyro + Acc)Yes/NoModel-basedKnee3.4
Ours1 (Acc)Yes/YesData-DrivenHip2.3/5.6
Knee3.4/6.5
Ankle1.8/4.7

Share and Cite

MDPI and ACS Style

Gholami, M.; Napier, C.; Menon, C. Estimating Lower Extremity Running Gait Kinematics with a Single Accelerometer: A Deep Learning Approach. Sensors 2020, 20, 2939. https://doi.org/10.3390/s20102939

AMA Style

Gholami M, Napier C, Menon C. Estimating Lower Extremity Running Gait Kinematics with a Single Accelerometer: A Deep Learning Approach. Sensors. 2020; 20(10):2939. https://doi.org/10.3390/s20102939

Chicago/Turabian Style

Gholami, Mohsen, Christopher Napier, and Carlo Menon. 2020. "Estimating Lower Extremity Running Gait Kinematics with a Single Accelerometer: A Deep Learning Approach" Sensors 20, no. 10: 2939. https://doi.org/10.3390/s20102939

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop