Next Article in Journal
Monolithic Integrated OLED–OPD Unit for Point-of-Need Nitrite Sensing
Next Article in Special Issue
IoT and AI-Based Application for Automatic Interpretation of the Affective State of Children Diagnosed with Autism
Previous Article in Journal
An Adaptive Learning Model for Multiscale Texture Features in Polyp Classification via Computed Tomographic Colonography
Previous Article in Special Issue
Tourist Experiences Recommender System Based on Emotion Recognition with Wearable Data
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reliability of IMU-Based Gait Assessment in Clinical Stroke Rehabilitation

by
Richard A. W. Felius
1,2,*,†,
Marieke Geerars
1,3,
Sjoerd M. Bruijn
2,
Jaap H. van Dieën
2,
Natasja C. Wouda
1,4 and
Michiel Punt
1
1
Research Group Lifestyle and Health, Utrecht University of Applied Sciences, 3584 CS Utrecht, The Netherlands
2
Faculty of Human Movement Sciences, Vrije Universiteit Amsterdam, 1081 HV Amsterdam, The Netherlands
3
Physiotherapy Department Neurology, Rehabilitation Center de Parkgraaf, 3526 KJ Utrecht, The Netherlands
4
Physiotherapy Department Neurology, De Hoogstraat Revalidatie, 3583 TM Utrecht, The Netherlands
*
Author to whom correspondence should be addressed.
Current address: Heidelberglaan 7, 3584 CS Utrecht, The Netherlands.
Sensors 2022, 22(3), 908; https://doi.org/10.3390/s22030908
Submission received: 17 December 2021 / Revised: 16 January 2022 / Accepted: 19 January 2022 / Published: 25 January 2022
(This article belongs to the Special Issue Use of Smart Wearable Sensors and AI Methods in Providing P4 Medicine)

Abstract

:
Background: Gait is often impaired in people after stroke, restricting personal independence and affecting quality of life. During stroke rehabilitation, walking capacity is conventionally assessed by measuring walking distance and speed. Gait features, such as asymmetry and variability, are not routinely determined, but may provide more specific insights into the patient’s walking capacity. Inertial measurement units offer a feasible and promising tool to determine these gait features. Objective: We examined the test–retest reliability of inertial measurement units-based gait features measured in a two-minute walking assessment in people after stroke and while in clinical rehabilitation. Method: Thirty-one people after stroke performed two assessments with a test–retest interval of 24 h. Each assessment consisted of a two-minute walking test on a 14-m walking path. Participants were equipped with three inertial measurement units, placed at both feet and at the low back. In total, 166 gait features were calculated for each assessment, consisting of spatio-temporal (56), frequency (26), complexity (63), and asymmetry (14) features. The reliability was determined using the intraclass correlation coefficient. Additionally, the minimal detectable change and the relative minimal detectable change were computed. Results: Overall, 107 gait features had good–excellent reliability, consisting of 50 spatio-temporal, 8 frequency, 36 complexity, and 13 symmetry features. The relative minimal detectable change of these features ranged between 0.5 and 1.5 standard deviations. Conclusion: Gait can reliably be assessed in people after stroke in clinical stroke rehabilitation using three inertial measurement units.

1. Introduction

Walking dysfunction is a common problem in people after stroke, restricting personal independence and affecting quality of life [1,2]. Walking dysfunction in people after stroke is characterised by decreased walking speed, shorter stride length, and gait asymmetry [3,4]. These changes in gait patterns are related to a higher fall risk among the elderly and people after stroke [5,6,7,8,9]. Falling can result in physical injury, emotional dysfunction, and is the number one cause of unexpected death [10]. Thus, to promote quality of life and reduce fall risk, improving gait is one of the main goals during stroke rehabilitation [11].
To monitor progression and to support clinical decision-making, reliable gait assessments during rehabilitation are essential. In current practice, gait is assessed using several walking tests, e.g., the ‘6-minute Walking Test’ or ‘10-metre walk test’ [12,13]. These walking tests have a high clinical relevance since they reflect functional capacity, and because the outcomes are associated with fall risk [14,15]. However, gait features during the assessment, e.g., asymmetry and variability, are not routinely recorded. These features may provide additional insights in the individual walking dysfunction of people after stroke, leading to more accurate fall-prediction models, and presumably improving clinical decision making [7,16,17].
In recent years, several studies have demonstrated that portable devices, such as electromygraphy, insole foot pressure sensors, motion capture systems, and inertial measurement units (IMUS), can objectively measure gait and be used to compute gait features [18,19,20,21,22,23]. Of all of these devices, IMUs might be the most feasible for clinical use because measuring with IMUs requires no expensive equipment, and they are easy to operate. Numerous studies showed that gait features can be accurately determined using IMUs among the elderly, people with Parkinson’s disease, and people in the chronic phase after a stroke [24,25,26]. Moreover, IMU-derived gait features can be used to discriminate between fallers and non-fallers and different types of dementia [17,27]. In addition, several studies demonstrated that changes in gait features during rehabilitation, such as improved dorsi-flexion and symmetry, can be registered using IMUs [23,28]. This indicates that IMUs can be used to monitor gait recovery; hence, they function as a clinical evaluation tool. Despite the advantages of using IMUs to assess gait, regular IMU-based measurements have yet to be adopted by clinicians [21,29]. This is because IMU data needs to be collected, processed, and converted to clinically relevant information, requiring time, processing tools, and expertise. As a result, there is a sizable gap between research and clinical practice.
We aim to explore the potential of measuring gait using IMUs to closely monitor gait recovery in people after stroke. Therefore, as a first step, we determined whether gait features can reliably be obtained by clinicians in clinical rehabilitation. In the present study, we determined the test–retest reliability of IMU-based gait features during a two-minute walk test in people after stroke who were in clinical rehabilitation. Additionally, we examined whether these features are sufficiently reliable to be used to monitor individual progression. The key contributions of this study can be summarised as follows: firstly, we investigated if numerous gait features can reliably be measured using IMUs by clinicians in people after stroke; secondly, a stride-detection algorithm was developed to detect strides in the majority of people after stroke, including slow and asymmetric gaits; thirdly, a platform was created in which clinicians could upload measurement data that was then automatically stored, processed, and returned gait features; lastly, the protocol was designed in collaboration with clinicians to promote feasibility of assessing gait using IMUs in stroke rehabilitation.

2. Materials and Methods

2.1. Participants

Thirty-one people after stroke were recruited in two rehabilitation centres in the Netherlands. Participants signed a written informed consent prior to participating. All participants were diagnosed with stroke, according to the definition of the World Health Organisation [30], and had been hospitalised for four to fourteen days before admission. Eligible participants were above the age of 18, in the sub-acute or chronic phase after stroke, able to comprehend and sign the informed consent, and capable of understanding and performing simple tasks. The ability to understand and perform simple tasks was estimated by clinicians prior to inclusion. Participants were excluded if they were unable to walk at least 0.05 metres per second (≈seven metres in two minutes) or when they had experienced a recent (<4 weeks) thrombolysis or re-perfusion. The medical ethical review committee of Utrecht (METC number: 20-462/C) approved this study.

2.2. Protocol

Demographic- and stroke-specific characteristics were collected, including gender, age, time since stroke, type of stroke, and hemiparetic side. Additionally, outcomes of the following tests were obtained prior to the assessment: Berg Balance Scale, Trunk Control Test, Motricity Index, Modified ranking scale at admission, Barthel index at admission, and the functional ambulation classification with and without a walking aid [13,31,32,33,34,35]. In the assessment, participants walked at a self-selected speed for two minutes on a 14-m walking path with cones at both ends. Participants started on the left side of the starting cone and took right turns around the cones. The assessment was performed with a test–retest interval of 24 h. The use of a walking aid was optional. The assessments were administered by one trained physiotherapist per rehabilitation centre. A measurement was excluded if the subject stopped walking, was visibly distracted, or in case of an observable clonus. Participants were allowed to retry the assessment in case of a faulty measurement.

2.3. Equipment

Prior to the assessments, the gyroscope bias of each IMU was estimated using a fifteen-minute stationary measurement. Participants were equipped with three inertial measurement units (manufactured by Aemics b.v. Oldenzaal, The Netherlands). The inertial measurement units (IMUs) consisted of an accelerometer and gyroscope, and were measured with a sampling rate of 104 samples per second. The first IMU was placed on the lower back at a height of L5/S1. Its range was set to ±4 m/s2 and ±500°/s. The second and third IMUs were placed on top of the left and right foot, with the range set to ±8 m/s2 and ±500°/s. The IMUs were aligned with the anatomical axis during sensor placement. Elastic bands were used to hold the IMUs in place. Before and after the assessment, participants stood still for five seconds to enable an accurate assessment of the start and end of the assessment. The path and equipment are depicted in Figure A2 in Appendix D.

2.4. Data Processing

The data were imported and calculations were completed using Python (version 3.7.3). Firstly, the signal was down-sampled to 100 samples per second. Secondly, the gyroscope was corrected by subtracting the gyroscope bias. Thirdly, the first and last two seconds were excluded from further analysis to account for movement during transitional phases. Fourthly, the prior- and post-assessment stationary periods were estimated using a threshold based on the mean magnitude of the acceleration and gyroscope. Lastly, the length of the residual signals of all three IMUs were compared to the expected signal length. If the residual signal length deviated more than ten seconds from the expected signal length, the measurement was excluded from further analysis. These data-processing steps are visualised in Figure 1.

2.5. Stride Detection

To determine gait events in the left and right foot, a custom-made stride-detection algorithm was created, since existing stride-detection algorithms, such as continuous wavelet transform [36] and template matching [37,38], were inadequate for accurately detecting strides in very slow, poor, or asymmetric gait. To detect the strides, firstly, the average time per stride was estimated based on the dominant frequency found in the medio-lateral acceleration, using the Fast Fourier Transform [39]. Secondly, a peak-detection algorithm was used to identify foot-contact in the vertical acceleration (scipy.signal.find_peaks with a minimal distance of 0.75 * average time per stride and minimal height of mean vertical acceleration + standard deviation vertical acceleration). Subsequently, a false-negative peak detection was applied to minimise errors by comparing the sample difference between peaks to the expected between-peak difference (average time per stride). In the negative peak detection, the between-peak sample difference was evaluated; if the difference exceeded more than 1.5 times the expected difference, then the previously described peak detection was applied with 0.75 * the minimal peak height. After the false-negative peak detection, the stance phases were determined based on the stationary periods between foot-touches (peaks), where a stationary period was defined minimally as 0.2 consecutive seconds below a gyroscope- and acceleration-threshold (mean acceleration magnitude + standard deviation acceleration magnitude and mean gyroscope magnitude). In case no stance phase between foot-touches could be identified, a false-positive peak detection was applied to remove the lowest peak before determination of the stance phase. Swing phases were defined as the periods between stance phases. These processing steps are visualised in Figure 2. To compute spatial gait features, the accelerometer and gyroscope data were aligned with the vertical (VT) (upward: positive), medial–lateral (ML) (right: positive), and anterior–posterior (AP) axes (anterior: positive), and corrected for the effects of gravity using a sensorfusion algorithm [40]. Lastly, a zero-velocity update (ZUPT) was applied to determine spatial gait features [41].
For the determination of gait events in the low back, a similar algorithm was used as for the feet. First, the accelerometer and gyroscope data were aligned with the vertical (upward: positive), medio-lateral (right: positive) and anterior–posterior (forward: positive) axes, and corrected for the effects of gravity. Second, the anterior–posterior acceleration (AP) of the low back was integrated and filtered twice, with a second-order Butterworth bandpass filter between 0.25 and 15 Hz. Third, the first foot contact was detected using a peak-detection algorithm (scipy.signal.find_peaks with a minimal distance of 0.75 * average time per stride and minimal height of mean anterior–posterior acceleration + standard deviation anterior–posterior acceleration). Based on the mean outcome of the medio-lateral acceleration during the first step, the corresponding foot was determined [42]. Fourth, the time periods between foot contacts, found in the stride detection of the foot, were used as a template to detect all strides of the corresponding foot in the signal. Last, the first foot contact of the other foot was found using a peak-detection algorithm with a window between the first and second foot contact. The time periods between foot contacts, found in the step-detection algorithm of the foot, were used as a template to detect all strides of the corresponding foot in the signal.

2.6. Calculations

A total of 166 gait features were calculated, consisting of 56 spatio-temporal, 26 frequency, 63 complexity, and 14 symmetry features. A detailed description of all sway features is given in Table A3 and Table A4 in Appendix C. The spatio-temporal features were computed as the mean outcome per 10 strides. The paretic side and height were used for normalisation. If the paretic side was undefined (unknown or both sides affected), the left foot was used. The algorithm to process the data, detect strides and calculate gait features is available on GitHub: https://github.com/RichardFel/Reliability-of-Gait (accessed on 10 December 2021).

2.7. Statistics

The intraclass correlation coefficients and their 95% confidence interval for the between-day reliability were calculated using the intraclass correlation coefficient (ICC 2.1). An ICC of 0.5–0.75 was seen as moderate reliability, 0.75–0.9 as good, and 0.9 as excellent [43]. Additionally, the confidence interval (CI), standard error of measurement (SEM), and the minimal detectable change (MDC) were calculated. The MDC represents the threshold in which changes in score exceed measurement errors [44]. To determine the MDC independent of the unit of measurement, thus as a relative minimal detectable change, the MDC was divided by the standard deviation of the observed values of pooled test and retest measurements. This allows for comparison between features [45].

3. Results

3.1. Descriptives

Thirty-one people after stroke participated in the study. Participant characteristics are described in Table 1. Two participants were excluded, one because the required gait speed of 0.05 m per second was not met, and a second because of a clonus during the assessment.

3.2. Reliability

The ICC values of the test–retest measurements are visualised in Figure 3 and Figure 4. The mean, standard deviation, and ICC values are described in Table A1 in Appendix A. In total, 107 out of 166 gait features were measured with good–excellent reliability (ICC ≥ 0.75). These consisted of 50 out of 56 spatio-temporal, 8 out of 26 frequency, 36 out of 63 complexity, and 13 out of 14 asymmetry features. In total, 31 out of 46 gait features measured with the left foot IMU demonstrated good–excellent reliability. These consisted of 19 spatio-temporal and 12 complexity features. In total, 34 out of 46 gait features measured with the left foot IMU demonstrated good–excellent reliability. These consisted of 19 spatio-temporal, 3 frequency, and 12 complexity features. In total, 29 out of 54 gait features measured with the low back IMU demonstrated good–excellent reliability. These consisted of 12 spatio-temporal, 5 frequency, and 12 complexity features.

3.3. Clinical Monitoring

The relative minimal detectable change is visualised in the bottom panels of Figure 3 and Figure 4. The vast majority of relative minimal detectable change-values fell within approximately 0.5 and 1.5 standard deviations, indicating that a change of 0.5–1.5 standard deviations is minimally required to detect a change that exceeds the measurement error.

4. Discussion

We examined the test–retest reliability of various gait features using three inertial measurement units in people after stroke during clinical stroke rehabilitation. Additionally, the potential of these gait features to monitor progression was assessed. In summary, we found that the majority of the computed gait features were reliable and could potentially be used to monitor progression.
The gait features in four domains were computed, namely: spatio-temporal, frequency, complexity, and asymmetry. In line with the achieved results of [46], we found that the majority of the spatio-temporal features of the feet IMUs (stride time, stride distance, cadence) could be measured with high reliability. The achieved ICC values in our study were slightly higher, presumably because of the great between-subject differences. For example, some participants were able to walk only ten metres, where others walked more than one-hundred metres. Overall, the frequency features were less reliable than expected, with only 8 out of 26 features having a good–excellent reliability. This might be explained by the fact that the majority of frequency features, such as the dominant frequency width and density, are, in essence, measures of variability. Since only 2 min of walking were recorded, likely too few data points were collected to estimate these features with sufficient precision. Of all complexity features, only the autocorrelation and autocovariance demonstrated good–excellent reliability, whereas the Lyapunov exponent, sample, and approximate entropy demonstrated a poor–moderate reliability in both feet and the lower back. The low reliability of the Lyapunov exponent (LDE) in the lower back was particularly unexpected, since previous studies found this feature to be reliable [47,48]. The difference in reliability is presumably a result of the low number of strides included (25) in the computation of these features in our study. Increasing the number of strides in the analysis would have resulted in the exclusion of some slow and poor walkers; thus, these features seem unsuitable for measuring people after stroke in rehabilitation. The majority of the features regarding the swing-time and stance-time asymmetry demonstrated good–excellent reliability. These results are in line with the outcomes of the studies of Moore et al. [49] and Lewek and Randall [50].
The ICC values of the lower back features were considerably lower than the ICC values of the feet features. Most likely, this is caused by the low back sensor being subjected to significantly more noise than the feet sensors (e.g., clothing, trunk movement), and because the ground contact forces are damped before reaching the sensor, making the detection of gait events more difficult. This was especially true when measuring participants with severe gait impairments. Nevertheless, only a few of the computed gait features relied on the detection of gait events; thus, this did not affect the majority of the computed gait features.
To indicate the ability of gait features to register changes during clinical rehabilitation, the relative minimal detectable change was computed. Generally, a change of approximately 0.5–1.5 standard deviations is considered a difference that exceeds the measurement error and are thus related to a significant improvement or decline. Considering the fact that significant changes can be found in the walking ability, such as the walking speed, balance, and physical functioning during clinical rehabilitation, it is imaginable that some described gait features will be responsive to rehabilitation as well [51,52,53]. Nevertheless, A longitudinal study is imperative to determine if people after stroke are able to show significant improvements, reflected by these features during clinical rehabilitation.
Despite the good–excellent reliability of the majority of the features, this study has some limitations. First, only a relatively small number of people after stroke were included in the study. This may have caused the ICC values and MDC to lack precision. Nevertheless, if we evaluate the consistency of the ICC outcomes between features per sensor and between sensors, the outcomes appear to be robust. Secondly, participants that were not able to walk at least seven metres in two minutes (0.2 km per hour) could not be measured. Therefore, the conclusions may not generalise to all people after stroke in rehabilitation that are able to walk. Lastly, the custom-made step-detection algorithm, despite being extensively tested (Appendix B), was not validated for people after stroke in rehabilitation. However, the outcomes of the tests prior to this study and the consistency and reliability of the gait features calculated using the stride-detection algorithm provide an indication that stride detection is a valid method of detecting strides in people after stroke during rehabilitation.
Our ultimate objective is to develop an instrumented test that clinicians can use in daily practice to monitor individual progression during clinical stroke rehabilitation. For this reason, we tried to design a feasible protocol in which the majority of people after stroke can be measured, and by which sufficient information is collected, that is also easy to follow and time-efficient. Therefore, clinicians played an important role in the development of this protocol. Additionally, an online platform was created where clinicians could upload the IMU data, which was then automatically stored, processed, and converted into gait features. This platform allowed for direct feedback about the performance of the participant in comparison to other stroke participants. Presumably, the protocol and the platform improve the adaptation of clinicians to routinely measure gait using IMUs. Future work is in progress to determine if the computed gait features are sensitive to changes over time, and if these changes are of clinical importance. Eventually, the predictive value of IMU measurements during stroke rehabilitation on the levels of independence at discharge and fall risk will be examined.

5. Conclusions

This study examined the reliability of gait assessment using three inertial measurement units in people after stroke in clinical rehabilitation. In summary, we found that spatio-temporal, frequency, complexity, and asymmetry of gait features can reliably be measured during a two-minute walking test using a single measurement. Based on the relative minimal detectable change, it is likely that the proposed method can be used to monitor progression during stroke rehabilitation.

Author Contributions

Conceptualization, R.A.W.F., M.P., M.G., N.C.W., S.M.B. and J.H.v.D.; methodology, R.A.W.F., M.P., M.G. and N.C.W.; software, R.A.W.F., M.P. and S.M.B.; validation, R.A.W.F. and M.P.; formal analysis, R.A.W.F.; investigation, M.G. and N.C.W.; resources, M.G. and N.C.W.; data curation, R.A.W.F. and M.P.; writing—original draft preparation, R.A.W.F.; writing—review and editing, R.A.W.F., M.P., M.G., N.C.W., S.M.B. and J.H.v.D.; visualization, R.A.W.F.; supervision, M.P., S.M.B. and J.H.v.D.; project administration, M.P.; funding acquisition, M.P. All authors have read and agreed to the published version of the manuscript.

Funding

This study is independent research and was funded by: SIA-RAAK (RAAK.PRO.03.006). SMB was funded by a VIDI grant (016.Vidi.178.014) from the Dutch Organization for Scientific Research (NWO).

Institutional Review Board Statement

The medical ethical review committee of Utrecht (METC number: 20-462/C) approved this study.

Informed Consent Statement

Informed consent was obtained from all participants involved in the study.

Data Availability Statement

Data will be made available on request in 2024.

Acknowledgments

We would like to thank all participants for their time and effort. This study is part of the ‘Making Sense of Sensor Data for Personalised Healthcare’ consortium.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Abbreviations

The following abbreviations are used in this manuscript:
IMUInertial measurement Unit
L5/S1Lumbosacral joint
m/s2Metres per second squared
/sDegrees per second
VTVertical
MLMedio-lateral
APAnterior–posterior
ICCIntraclass correlation coefficient
MDCMinimal detectable change
SEMStandard error of measurement
rMDCRelative minimal detectable change

Appendix A

Table A1. Test–retest results of IMU-based gait assessment in people after stroke.
Table A1. Test–retest results of IMU-based gait assessment in people after stroke.
Reliability TestRetest
ICC (−CI, CI)MDC (SEM)rMDCMean (STD)Mean (STD)
Left FootSpatio-Temporal1. Stride time mean L0.965 (0.92,0.98)0.355 (0.128)0.521.767 (0.72)1.701 (0.64)
2. Stride time std L0.823 (0.65,0.92)0.144 (0.052)1.170.168 (0.121)0.162 (0.126)
3. Stride time norm L0.798 (0.6,0.9)0.087 (0.031)1.260.092 (0.06)0.097 (0.078)
4. Stride dist mean L0.963 (0.92,0.98)0.142 (0.051)0.530.71 (0.258)0.706 (0.271)
5. Stride dist std L0.835 (0.67,0.92)0.038 (0.014)1.120.087 (0.034)0.089 (0.034)
6. KMPH L0.97 (0.94,0.99)0.482 (0.174)0.481.659 (0.991)1.715 (1.016)
7. Cadence L0.969 (0.93,0.99)5.829 (2.103)0.4938.556 (11.967)39.37 (11.864)
8. Stride vel mean L0.952 (0.9,0.98)0.389 (0.14)0.611.367 (0.638)1.358 (0.637)
9. Stride vel std L0.779 (0.56,0.89)0.312 (0.112)1.360.286 (0.168)0.347 (0.291)
10. Range acc AP L0.862 (0.72,0.93)17.733 (6.398)1.0349.86 (16.244)50.769 (18.121)
11. RMS acc AP L0.907 (0.81,0.96)2.323 (0.838)0.855.014 (2.716)5.201 (2.781)
12. Range acc ML L0.672 (0.4,0.84) 45.144 (12.288)44.367 (12.724)
13. RMS acc ML L0.761 (0.54,0.88)2.66 (0.96)1.364.024 (1.884)4.074 (2.041)
14. Range acc VT L0.758 (0.53,0.88)22.779 (8.218)1.3748.206 (16.406)47.376 (16.964)
15. RMS acc VT L0.96 (0.91,0.98)1.241 (0.448)0.563.652 (2.101)3.769 (2.342)
16. Range gyr AP L0.882 (0.76,0.94)2.98 (1.075)0.957.724 (3.058)7.982 (3.188)
17. RMS gyr AP L0.748 (0.52,0.88) 1.15 (0.637)1.176 (0.658)
18. Range gyr ML L0.918 (0.83,0.96)3.114 (1.123)0.799.338 (3.827)9.423 (4.031)
19. RMS gyr ML L0.923 (0.84,0.96)0.688 (0.248)0.771.558 (0.861)1.605 (0.929)
20. Range gyr VT L0.928 (0.85,0.97)1.597 (0.576)0.746.666 (2.183)6.898 (2.117)
21. RMS gyr VT L0.94 (0.87,0.97)0.198 (0.071)0.680.774 (0.28)0.81 (0.3)
Frequency22. Dominant peak freq L0.638 (0.34,0.82) 0.061 (0.035)0.061 (0.033)
23. Dominant peak width L−0.001 (−0.36,0.36) −3.105 (13.092)0.575 (0.096)
24. Dominant peak slope L0.599 (0.29,0.8) 0.001 (0.001)0.001 (0.001)
25. Dominant peak density L0.655 (0.37,0.83) 0.189 (0.104)0.183 (0.093)
Complexity26. ACOV acc AP L0.979 (0.94,0.99)0.074 (0.027)0.410.123 (0.174)0.141 (0.19)
27. ACOV acc ML L0.962 (0.92,0.98)0.026 (0.009)0.540.031 (0.045)0.035 (0.05)
28. ACOV acc VT L0.967 (0.92,0.99)0.07 (0.025)0.50.081 (0.13)0.096 (0.147)
29. ACOV gyr AP L0.881 (0.74,0.95)0.261 (0.094)0.970.219 (0.245)0.271 (0.297)
30. ACOV gyr ML L0.977 (0.93,0.99)1.588 (0.573)0.423.093 (3.592)3.534 (3.978)
31. ACOV gyr VT L0.884 (0.76,0.95)0.612 (0.221)0.960.478 (0.743)0.435 (0.533)
32. ACOR acc AP L0.979 (0.94,0.99)0.074 (0.027)0.410.123 (0.174)0.141 (0.19)
33. ACOR acc ML L0.962 (0.92,0.98)0.026 (0.009)0.540.031 (0.045)0.035 (0.05)
34. ACOR acc VT L0.967 (0.92,0.99)0.07 (0.025)0.50.081 (0.13)0.096 (0.147)
35. ACOR gyr AP L0.881 (0.74,0.95)0.261 (0.094)0.970.219 (0.245)0.271 (0.297)
36. ACOR gyr ML L0.977 (0.93,0.99)1.588 (0.573)0.423.093 (3.592)3.534 (3.978)
37. ACOR gyr VT L0.884 (0.76,0.95)0.612 (0.221)0.960.478 (0.743)0.435 (0.533)
38. LDE AP L0.322 (−0.06,0.62) 0.009 (0.002)0.009 (0.002)
39. LDE ML L0.587 (0.27,0.79) 0.007 (0.001)0.007 (0.002)
40. LDE VT L0.208 (−0.19,0.54) 0.009 (0.002)0.009 (0.002)
41. ApproxE AP L0.549 (0.22,0.77) 0.388 (0.118)0.377 (0.134)
42. ApproxE ML L0.69 (0.43,0.85) 0.514 (0.151)0.495 (0.167)
43. ApproxE VT L0.688 (0.43,0.84) 0.369 (0.11)0.352 (0.119)
44. SampE AP L0.698 (0.44,0.85) 0.08 (0.037)0.077 (0.039)
45. SampE ML L0.731 (0.49,0.87) 0.15 (0.068)0.145 (0.083)
46. SampE VT L0.716 (0.47,0.86) 0.091 (0.041)0.087 (0.048)
Right FootSpatio-Temporal47. Stride time mean R0.938 (0.86,0.97)0.469 (0.169)0.691.775 (0.73)1.69 (0.623)
48. Stride time std R0.636 (0.35,0.82) 0.184 (0.18)0.164 (0.108)
49. Stride time norm R0.686 (0.42,0.84) 0.099 (0.061)0.099 (0.062)
50. Stride dist mean R0.956 (0.91,0.98)0.144 (0.052)0.580.671 (0.233)0.676 (0.262)
51. Stride dist std R0.781 (0.57,0.89)0.073 (0.026)1.30.121 (0.061)0.119 (0.051)
52. KMPH R0.963 (0.92,0.98)0.494 (0.178)0.531.56 (0.881)1.642 (0.974)
53. Cadence R0.977 (0.95,0.99)4.992 (1.801)0.4238.407 (11.849)39.37 (11.833)
54. Stride vel mean R0.967 (0.93,0.98)0.289 (0.104)0.511.267 (0.555)1.28 (0.588)
55. Stride vel std R0.939 (0.87,0.97)0.17 (0.061)0.690.327 (0.23)0.347 (0.264)
56. Range acc AP R0.9 (0.8,0.95)17.789 (6.418)0.8853.188 (18.792)54.961 (21.676)
57. RMS acc AP R0.905 (0.8,0.96)2.14 (0.772)0.855.061 (2.446)5.067 (2.562)
58. Range acc MR R0.8 (0.61,0.9)20.705 (7.47)1.2447.718 (17.953)49.285 (15.333)
59. RMS acc MR R0.826 (0.64,0.92)2.351 (0.848)1.173.692 (1.838)4.16 (2.19)
60. Range acc VT R0.936 (0.87,0.97)18.685 (6.741)0.751.447 (25.79)51.871 (27.648)
61. RMS acc VT R0.971 (0.94,0.99)1.131 (0.408)0.473.78 (2.313)3.952 (2.487)
62. Range gyr AP R0.825 (0.65,0.92)3.707 (1.337)1.167.847 (3.024)8.398 (3.341)
63. RMS gyr AP R0.797 (0.61,0.9)0.812 (0.293)1.261.093 (0.593)1.21 (0.698)
64. Range gyr MR R0.907 (0.81,0.96)3.318 (1.197)0.859.94 (3.742)9.852 (4.097)
65. RMS gyr MR R0.863 (0.72,0.94)0.826 (0.298)1.031.695 (0.774)1.648 (0.834)
66. Range gyr VT R0.931 (0.86,0.97)1.52 (0.548)0.736.285 (2.079)6.46 (2.079)
Frequency68. Dominant peak freq R0.828 (0.65,0.92)0.053 (0.019)1.160.074 (0.048)0.065 (0.044)
69. Dominant peak width R−0.006 (−0.32,0.34) 0.609 (0.004)0.564 (0.108)
70. Dominant peak slope R0.823 (0.65,0.92)0.001 (0.0)1.170.001 (0.001)0.001 (0.001)
71. Dominant peak density R0.889 (0.77,0.95)0.117 (0.042)0.920.204 (0.126)0.193 (0.127)
Complexity72. ACOV acc AP R0.98 (0.95,0.99)0.077 (0.028)0.390.126 (0.187)0.145 (0.208)
73. ACOV acc MR R0.933 (0.85,0.97)0.035 (0.013)0.720.027 (0.045)0.034 (0.051)
74. ACOV acc VT R0.985 (0.97,0.99)0.047 (0.017)0.340.083 (0.133)0.09 (0.143)
75. ACOV gyr AP R0.95 (0.89,0.98)0.234 (0.084)0.620.235 (0.379)0.279 (0.375)
76. ACOV gyr MR R0.988 (0.97,0.99)1.102 (0.398)0.33.081 (3.572)3.318 (3.703)
77. ACOV gyr VT R0.916 (0.82,0.96)0.554 (0.2)0.80.415 (0.663)0.51 (0.715)
78. ACOR acc AP R0.98 (0.95,0.99)0.077 (0.028)0.390.126 (0.187)0.145 (0.208)
79. ACOR acc MR R0.933 (0.85,0.97)0.035 (0.013)0.720.027 (0.045)0.034 (0.051)
80. ACOR acc VT R0.985 (0.97,0.99)0.047 (0.017)0.340.083 (0.133)0.09 (0.143)
81. ACOR gyr AP R0.95 (0.89,0.98)0.234 (0.084)0.620.235 (0.379)0.279 (0.375)
82. ACOR gyr MR R0.988 (0.97,0.99)1.102 (0.398)0.33.081 (3.572)3.318 (3.703)
83. ACOR gyr VT R0.916 (0.82,0.96)0.554 (0.2)0.80.415 (0.663)0.51 (0.715)
84. LDE AP R0.487 (0.13,0.73) 0.01 (0.002)0.01 (0.002)
85. LDE MR R0.516 (0.19,0.74) 0.007 (0.001)0.007 (0.002)
86. LDE VT R0.056 (−0.34,0.43) 0.009 (0.002)0.009 (0.001)
87. ApproxE AP R0.441 (0.07,0.7) 0.388 (0.123)0.389 (0.136)
88. ApproxE MR R0.344 (−0.04,0.64) 0.53 (0.14)0.514 (0.159)
89. ApproxE VT R0.527 (0.19,0.75) 0.366 (0.103)0.38 (0.114)
90. SampE AP R0.731 (0.49,0.87) 0.08 (0.042)0.084 (0.043)
91. SampE MR R0.611 (0.3,0.8) 0.156 (0.066)0.154 (0.062)
92. SampE VT R0.55 (0.22,0.77) 0.095 (0.046)0.101 (0.044)
Low BackSpatio-Temporal93. Step time mean B0.955 (0.9,0.98)0.197 (0.071)0.590.877 (0.354)0.846 (0.317)
94. Step time std B0.698 (0.44,0.85) 0.3 (0.172)0.257 (0.135)
95. Step time norm B0.686 (0.42,0.84) 0.395 (0.157)0.352 (0.161)
96. Range acc AP B0.922 (0.84,0.96)0.191 (0.069)0.780.572 (0.245)0.579 (0.249)
97. Rms acc AP B0.949 (0.88,0.98)0.022 (0.008)0.630.093 (0.036)0.097 (0.035)
98. Range acc ML B0.845 (0.69,0.93)0.374 (0.135)1.110.657 (0.283)0.709 (0.392)
99. Rms acc ML B0.511 (0.17,0.74) 0.114 (0.026)0.117 (0.041)
100. Range acc VT B0.945 (0.88,0.97)0.253 (0.091)0.650.755 (0.362)0.763 (0.416)
101. Rms acc VT B0.804 (0.61,0.91)0.023 (0.008)1.240.998 (0.019)1.002 (0.018)
102. Range gyr AP B0.972 (0.94,0.99)0.313 (0.113)0.461.199 (0.646)1.228 (0.707)
103. Rms gyr AP B0.972 (0.94,0.99)0.049 (0.018)0.460.184 (0.1)0.193 (0.111)
104. Range gyr ML B0.76 (0.54,0.88)0.907 (0.327)1.381.527 (0.762)1.434 (0.556)
105. Rms gyr ML B0.849 (0.7,0.93)0.092 (0.033)1.080.227 (0.086)0.224 (0.085)
106. Range gyr VT B0.93 (0.85,0.97)0.629 (0.227)0.741.861 (0.782)1.929 (0.926)
107. Rms gyr VT B0.962 (0.92,0.98)0.087 (0.031)0.540.342 (0.151)0.356 (0.168)
Frequency108. Dominant peak freq AP B0.713 (0.46,0.86) 0.123 (0.055)0.117 (0.054)
109. Dominant peak width AP B−0.011 (−0.35,0.35) 0.609 (0.005)0.576 (0.096)
110. Dominant peak slope AP B0.735 (0.5,0.87) 0.002 (0.001)0.002 (0.001)
111. Dominant peak density AP B0.715 (0.46,0.86) 0.356 (0.152)0.356 (0.173)
112. HR AP B0.847 (0.69,0.93)1.162 (0.419)1.091.418 (1.034)1.497 (1.105)
113. IH AP B0.456 (0.09,0.71) 0.586 (0.089)0.588 (0.125)
114. Dominant peak freq ML B0.657 (0.26,0.85) 0.125 (0.052)0.101 (0.043)
115. Dominant peak width ML B−0.0 (−0.37,0.37) 0.608 (0.008)−1.276 (9.436)
116. Dominant peak slope ML B0.657 (0.23,0.85) 0.002 (0.001)0.002 (0.001)
117. Dominant peak density ML B0.771 (0.56,0.89)0.192 (0.069)1.340.344 (0.139)0.311 (0.148)
118. HR ML B0.86 (0.66,0.94)0.63 (0.227)1.061.824 (0.678)1.662 (0.515)
119. IH ML B0.809 (0.61,0.91)0.16 (0.058)1.220.474 (0.136)0.442 (0.126)
120. Dominant peak freq VT B0.584 (0.27,0.79) 0.104 (0.053)0.097 (0.052)
121. Dominant peak width VT B0.004 (−0.33,0.36) 0.609 (0.004)0.575 (0.096)
122. Dominant peak slope VT B0.614 (0.31,0.8) 0.002 (0.001)0.002 (0.001)
123. Dominant peak density VT B0.616 (0.31,0.81) 0.306 (0.156)0.301 (0.167)
124. HR VT B0.931 (0.86,0.97)0.732 (0.264)0.731.768 (0.999)1.794 (1.018)
Complexity126. ACOV acc AP B0.986 (0.97,0.99)0.004 (0.002)0.330.007 (0.013)0.008 (0.014)
127. ACOV acc ML B0.963 (0.91,0.98)0.001 (0.001)0.530.003 (0.003)0.004 (0.003)
128. ACOV acc VT B0.952 (0.9,0.98)0.004 (0.001)0.610.007 (0.006)0.007 (0.007)
129. ACOV gyr AP B0.978 (0.95,0.99)0.043 (0.016)0.420.091 (0.098)0.099 (0.109)
130. ACOV gyr ML B0.901 (0.8,0.95)0.026 (0.009)0.870.034 (0.028)0.037 (0.031)
131. ACOV gyr VT B0.948 (0.87,0.98)0.03 (0.011)0.630.031 (0.043)0.038 (0.051)
132. ACOR acc AP B0.986 (0.97,0.99)0.004 (0.002)0.330.007 (0.013)0.008 (0.014)
133. ACOR acc ML B0.963 (0.91,0.98)0.001 (0.001)0.530.003 (0.003)0.004 (0.003)
134. ACOR acc VT B0.952 (0.9,0.98)0.004 (0.001)0.610.007 (0.006)0.007 (0.007)
135. ACOR gyr AP B0.978 (0.95,0.99)0.043 (0.016)0.420.091 (0.098)0.099 (0.109)
136. ACOR gyr ML B0.901 (0.8,0.95)0.026 (0.009)0.870.034 (0.028)0.037 (0.031)
137. ACOR gyr VT B0.948 (0.87,0.98)0.03 (0.011)0.630.031 (0.043)0.038 (0.051)
138. LDE AP B0.612 (0.3,0.8) 0.014 (0.001)0.014 (0.001)
139. LDE ML B0.589 (0.28,0.79) 0.014 (0.001)0.014 (0.001)
140. LDE VT B0.205 (−0.2,0.54) 0.014 (0.001)0.014 (0.001)
141. ApproxE AP B0.124 (−0.24,0.47) 0.61 (0.146)0.554 (0.148)
142. ApproxE ML B0.716 (0.46,0.86) 0.606 (0.137)0.563 (0.16)
143. ApproxE VT B0.373 (0.02,0.65) 0.51 (0.155)0.458 (0.156)
144. SampE AP B0.118 (−0.25,0.46) 0.474 (0.179)0.41 (0.165)
145. SampE ML B0.692 (0.41,0.85) 0.488 (0.158)0.431 (0.181)
146. SampE VT B0.208 (−0.16,0.53) 0.363 (0.157)0.308 (0.131)
AsymmetrySpatio-Temporal147. SR Swing/stand0.982 (0.96,0.99)1.217 (0.439)0.372.234 (3.429)2.173 (3.116)
148. SR standphasess0.753 (0.53,0.88)0.278 (0.1)1.390.902 (0.224)0.904 (0.178)
149. SR swingphases0.54 (0.21,0.76) 1.278 (0.725)1.166 (0.291)
150. SI Swing/stand0.967 (0.93,0.98)92.302 (33.3)0.5169.709 (179.456)164.206 (186.235)
151. SI standphases0.948 (0.89,0.98)0.435 (0.157)0.631.351 (0.677)1.395 (0.703)
152. SI swingphases0.866 (0.73,0.94)0.422 (0.152)1.021.402 (0.454)1.405 (0.373)
153. GA Swing/stand0.939 (0.87,0.97)51.278 (18.499)0.6935.903 (73.448)34.233 (75.94)
154. GA standphases0.644 (0.36,0.82) −14.808 (33.798)−12.298 (21.988)
155. GA swingphases0.756 (0.54,0.88)40.972 (14.781)1.416.052 (35.568)12.617 (22.82)
156. SA Swing/stand0.897 (0.79,0.95)0.002 (0.001)0.890.49 (0.003)0.49 (0.003)
157. SA standphases0.719 (0.47,0.86) 0.492 (0.002)0.492 (0.001)
158. SA swingphases0.819 (0.64,0.91)0.002 (0.001)1.190.49 (0.002)0.491 (0.001)
159. Peak amp mean B: L/R0.684 (0.42,0.84) 0.141 (0.084)0.13 (0.068)
160. Peak amp std B: L/R0.244 (−0.14,0.57) 0.989 (0.096)1.012 (0.108)
161. Peak amp mean L/R0.478 (0.14,0.72) 0.536 (1.786)−0.194 (2.005)
162. Peak amp std L/R0.654 (0.38,0.83) 0.577 (0.249)0.653 (0.305)
163. Total Dist norm0.967 (0.93,0.98)0.093 (0.033)0.510.311 (0.178)0.323 (0.189)
164. Cadence norm0.976 (0.95,0.99)0.031 (0.011)0.430.224 (0.071)0.229 (0.07)
165. Stride dist mean norm0.964 (0.92,0.98)0.133 (0.048)0.520.69 (0.244)0.691 (0.266)
166. Stride time mean norm0.956 (0.9,0.98)0.047 (0.017)0.590.209 (0.084)0.202 (0.075)
The MDC and rMDC are only reported for variables with an ICC > 0.75. Abbreviations: L = Left foot; R = Right foot; B = low back; Gyr = Gyroscope; Acc = Acceleration; Dist = Distance; KMPH = kilometres per hour; Vel = Velocity; DF = Dominant Frequency; LDE = local divergence exponent; ApproxE = Approximate entropy; SampleE = Sample entropy; std = Standard deviation; rms = Root Mean Square; AP = Anterior–posterior; ML = Medio-lateral; VT = Vertical; ACOV = Autocovariance; ACOR = Autocorrelation; HR = Harmonic ratio; IH = Index of harmonicity; SR = Symmetry ratio; SI = Symmetry index; GA = Gait asymmetry; SA= Symmetry Angle; Amp = Amplitude; Norm = Normalised.

Appendix B. Testing of the Stride Detection Algorithm

Prior to the reliability study, the custom-made stride-detection algorithm was tested by measuring healthy participants and comparing the outcomes to a golden standard. In the test, we tried to imitate different gait patterns by creating different walking paths and instructing participants to walk symmetrically or asymmetrically at normal or slow speeds.

Appendix B.1. Protocol

In total, eight healthy participants walked a total of three to six times on three different walking paths. On every walking path, markings with ascending numbers were drawn on the ground to indicate where the participants should place their feet. On the walking paths, the markings were placed at a distance 20 cm, 40 cm, and 60 cm. Participants were instructed to place their feet in the markings. Additionally, participants were instructed to walk symmetrically or asymmetrically at a low frequency (1 step every 2 s) or high frequency (1 step every second). Extensive descriptions of the equipment and data-processing steps are provided in the Materials and Methods section. The walking paths are illustrated in Figure A1.
Figure A1. Participants walked on three 14-m walking paths with numbered markings at a distance of 20 cm, 40 cm, and 60 cm. Participants took right turns. The three inertial measurement units were placed at the low back and on top of the left and right feet. Elastic bands were used to hold the sensors in place. The depicted walking paths have fewer markings than the walking paths used for testing.
Figure A1. Participants walked on three 14-m walking paths with numbered markings at a distance of 20 cm, 40 cm, and 60 cm. Participants took right turns. The three inertial measurement units were placed at the low back and on top of the left and right feet. Elastic bands were used to hold the sensors in place. The depicted walking paths have fewer markings than the walking paths used for testing.
Sensors 22 00908 g0a1

Appendix B.2. Outcomes

In total, 37 measurements were collected. After the assessment, the number of strides was counted based on the number in the marking on which the participants ended, plus the number of completed rounds, times the markings on the walking path. The covered distance was calculated by multiplying the number of strides by the distance between strides on the walking path. The number of strides and total distance were considered the golden standard and compared to the outcomes of the custom-made stride-detection algorithm. Nine measurements were excluded from analysis, six because of missing data and three as a result of faulty measurements. The results are reported in Table A2. Based on the results, we concluded that there are no remarkable differences between the step-detection algorithm and the golden standard.
Table A2. Comparison between the outcomes of the golden standard and stride-detection algorithm.
Table A2. Comparison between the outcomes of the golden standard and stride-detection algorithm.
MeasurementMean (SD) (min, max)Pearson’s rRoot Mean Square ErrorAbsolute Average Difference
Strides left footGS49.3 (15.5) (27, 88)r(28) = 0.97, p < 0.013.901.96
SDA48.4 (16.1) (24, 88)
Strides right footGS49.3 (15.5) (27, 88)r(28) = 0.98, p < 0.013.361.60
SDA47.8 (16.2) (23, 88)
Steps low backGS98.5 (31.0) (53, 176)r(28) = 0.98, p < 0.016.512.46
SDA97.2 (32.7) (47, 178)
Distance left footGS29.9 (22,6) (7.6, 105.6)r(28) = 0.97, p < 0.015.934.11
SDA30.9 (21.0) (8.1, 97.8)
Distance right footGS29.9 (22.6) (7.6, 105.6)r(28) = 0.97, p < 0.015.693.90
SDA32.3 (22.1 (8.1, 109.6)
Abbreviations: GS = Golden standard; SDA = Step-Detection Algorithm; SD = Standard deviation; Min = Minimum; Max = Maximum.

Appendix C. Formulas

Table A3. Formulas: Spatio-Temporal and Frequency Features.
Table A3. Formulas: Spatio-Temporal and Frequency Features.
AbbreviationDescriptionFormulas: Spatio-Temporal and Frequency
Spatio-Temporal Features
RangeRange (m/s2, rad/s) (Features: 10, 12, 14, 16, 18, 20, 56, 58, 60, 62, 64, 66, 96, 98, 100, 102, 104, 106)
max x min x
STDStandard deviation (m/s2, rad/s) (Features: 2, 5, 9, 48, 51, 55, 94, 160, 162)
Σ ( x t x ¯ ) 2 N 1
RMSRoot mean square (m/s2, rad/s) (Features: 11, 13, 15, 17, 19, 21, 57, 59, 63, 65, 67, 97, 99, 101, 103, 105, 107)
Σ x t 2 N
VelocityVelocity per stride [41] (m/s) (Features: 8, 9, 54, 55)
v ( t ) : a ( t ) dt + C 1
DistanceDistance per stride (m) (Features: 4, 5, 50, 51)
x ( t ) : v ( t ) dt + C 2
KMPHKilometres per hour (km/h) (Features: 6, 52)
( ( Σ Displacement 30 ) / 1000 )
CadenceNumber of steps per minute (Features: 7, 53)
number of steps 2
Frequency features
FFTFast Fourier Transform of acceleration [39]
Σ t = 0 N 1 a t e i 2 π t k N k = 0 , . . . , N 1
Dominant peak freqDominant frequency in the signal indicating step or stride frequency (Hz) (Features: 22, 68, 108)
max ( FFT )
Dominant peak widthWidth of the peak of the dominant frequency (HZ) (Features: 23, 69, 109, 115, 121)Distance between the left and right base of the dominant peak frequency.
Dominant peak slopeSlope the dominant frequency (HZ) (Features: 24, 70, 110, 116, 122)Slope from the base to the top of the dominant frequency.
Dominant peak densityDensity of the peak of the dominant frequencyDensity from the base to the top of the dominant frequency
HRHarmonic ratio: Measure to quantify smoothness of walking (Features: 112, 118, 124) [54]Ratio of the sum of the amplitudes of the even harmonic to the sum of the amplitudes of the odd harmonics.
IHIndex of harmonicity: Measure to quantify symmetry of walking (Features: 113,119,125) [55]Ratio of the aplitude of the dominant frequency to the sum of the first five superharmonics.
Abbreviations: x = Input; t = 1 observation; N = Total number of observations; a = Acceleration; AP = Anterior–posterior; ML = Medio-lateral; All code is available on Github: https://github.com/RichardFel/Reliability-of-Gait (accessed on 10 December 2021).
Table A4. Formulas: Complexity and Asymmetry Features and Statistics.
Table A4. Formulas: Complexity and Asymmetry Features and Statistics.
AbbreviationDescriptionFormulas
Complexity features
ACOVAutocovariance (Features: 26–31, 72–77, 126–131)
Σ ( x i x ¯ ) ( x t 1 x ¯ ) n 1
ACORAutocorrelation (Features: 32–37, 78–83, 132–137)
1 n 1 Σ ( x i x ¯ ) ( x t 1 x ¯ ) σ x i σ x t 1
ApEnApproximate entropy, adjusted from [56] (Features: 41–43, 87–89, 141–143)Embedding dimensions = 2; Tolerance = 0.2 * SD.
SampEnSample entropy, adjusted from [56] (Features: 44–46, 90–92, 144–146)Embedding dimensions = 2; Tolerance = 0.2 * SD.
LDEMaximum finite time lyapunov exponent using Rosenstein’s algorithm, djusted from [57] (Features: 38–40, 84–86, 138–140)Statespace: (delay = 10, dimensions= 5). Rosenstein’s algorithm: period = 1; windowsize = 0.5 s; nearest neighbours = 5.
Asymmetry features
SRSymmetry ratio (Features: 147–149) [58]
V p a r e t i c V n o n p a r e t i c
SISymmetry index (Features: 150–152) [58]
V p a r e t i c V n o n p a r e t i c 0.5 ( V p a r e t i c + V n o n p a r e t i c ) 100 %
GAGait asymmetry (Features: 153–155) Adjusted from [58]
100 ln V p a r e t i c V n o n p a r e t i c
SASymmetry angle (Features: 156–158) Adjusted from [58]
45 arctan V p a r e t i c V n o n p a r e t i c 100 % 90
Statistics
ICCTwo-way random effects, absolute agreement, single rater/measurement [43]
M S R M S E M S R + k 1 M S E + k n M S C M S E
SEMStandard error of measurement
SD 1 I C C
MDCMinimal detectable change
SEM 1.96 2
rMDCMinimal detectable change expressed in standard deviations
MDC ( S T D t e s t + S T D r e t e s t ) 0.5
Abbreviations: SD = Standard deviation; MSR = mean square for rows; MSE = mean square for error; MSC = mean square for columns; n = number of subjects; k = number of raters/measurements; All code is available on Github:: https://github.com/RichardFel/Reliability-of-Gait (accessed on 10 December 2021).

Appendix D. Setting and Equipment

Figure A2. Participants walked on a 14-m path and took right turns around the cones (1,2). The use of a walking aid was optional. The three inertial measurement units were placed at the low back and on top of the left and right feet. Elastic bands were used to hold the sensors in place (3). A measurement was started and stopped by pressing the white start/stop button on the IMUs. After a measurement, the data was stored on the IMU and accessed by connecting the IMU to a computer. The person in the images did not participate in the study.
Figure A2. Participants walked on a 14-m path and took right turns around the cones (1,2). The use of a walking aid was optional. The three inertial measurement units were placed at the low back and on top of the left and right feet. Elastic bands were used to hold the sensors in place (3). A measurement was started and stopped by pressing the white start/stop button on the IMUs. After a measurement, the data was stored on the IMU and accessed by connecting the IMU to a computer. The person in the images did not participate in the study.
Sensors 22 00908 g0a2

References

  1. Li, S.; Francisco, G.; Zhou, P. Post-stroke Hemiplegic Gait: New Perspective and Insights. Front. Physiol. 2018, 9, 1021. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Park, J.; Kim, T.H. The effects of balance and gait function on quality of life of stroke patients. NeuroRehabilitation 2019, 44, 1–5. [Google Scholar] [CrossRef] [PubMed]
  3. Von Schroeder, H.; Coutts, R.; Lyden, P.; Billings, E.; Nickel, V. Gait parameters following stroke: A practical assessment. J. Rehabil. Res. Dev. 1995, 32, 25–31. [Google Scholar] [PubMed]
  4. Balaban, B.; Tok, F. Gait Disturbances in Patients With Stroke. PM R: J. Inj. Funct. Rehabil. 2014, 6, 635–642. [Google Scholar] [CrossRef] [PubMed]
  5. Viccaro, L.; Perera, S.; Studenski, S. Is Timed Up and Go Better Than Gait Speed in Predicting Health, Function, and Falls in Older Adults? J. Am. Geriatr. Soc. 2011, 59, 887–892. [Google Scholar] [CrossRef] [Green Version]
  6. Doi, T.; Hirata, S.; Ono, R.; Tsutsumimoto, K.; Misu, S.; Ando, H. The harmonic ratio of trunk acceleration predicts falling among older people: Results of a 1-year prospective study. J. Neuroeng. Rehabil. 2013, 10, 7. [Google Scholar] [CrossRef] [Green Version]
  7. Punt, M.; Bruijn, S.; van Schooten, K.; Pijnappels, M.; Port, I.; Wittink, H.; Van Dieen, J. Characteristics of daily life gait in fall and non fall-prone stroke survivors and controls. J. Neuroeng. Rehabil. 2016, 13, 1–7. [Google Scholar] [CrossRef] [Green Version]
  8. Toebes, M.; Hoozemans, M.; Furrer, R.; Dekker, J.; Van Dieen, J. Local dynamic stability and variability of gait are associated with fall history in elderly subjects. Gait Posture 2012, 36, 527–531. [Google Scholar] [CrossRef] [Green Version]
  9. Van Schooten, K.; Yang, Y.; Feldman, F.; Leung, M.; McKay, H.; Sims-Gould, J.; Robinovitch, S. The Association Between Fall Frequency, Injury Risk, and Characteristics of Falls in Older Residents of Long-Term Care: Do Recurrent Fallers Fall More Safely? J. Gerontol. Ser. A 2017, 73, 786–791. [Google Scholar] [CrossRef]
  10. Ramnemark, A.; Nilsson, M.; Borssén, B.; Gustafson, Y. Stroke, a Major and Increasing Risk Factor for Femoral Neck Fracture. Stroke J. Cereb. Circ. 2000, 31, 1572–1577. [Google Scholar] [CrossRef] [Green Version]
  11. Langhorne, P.; Bernhardt, J.; Kwakkel, G. Stroke Care 2Stroke rehabilitation. Lancet 2011, 377, 1693–1702. [Google Scholar] [CrossRef]
  12. Butland, R.; Pang, J.; Gross, E.; Woodcock, A.; Geddes, D. Two-, Six-, And 12-Minute Walking Tests in Respiratory Disease. Br. Med. J. 1982, 284, 1607–1608. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Collen, F.; Wade, D.; Bradshaw, C. Mobility after stroke: Reliability of measures of impairment and disability. Int. Disabil. Stud. 1990, 12, 6–9. [Google Scholar] [CrossRef]
  14. An, S.; Lee, Y.; Shin, H.; Lee, G. Gait velocity and walking distance to predict community walking after stroke. Nurs. Health Sci. 2015, 17, 533–538. [Google Scholar] [CrossRef] [PubMed]
  15. Peel, N.; Kuys, S.; Klein, K. Gait Speed as a Measure in Geriatric Assessment in Clinical Settings: A Systematic Review. J. Gerontol. Ser. A Biol. Sci. Med. Sci. 2012, 68, 39–46. [Google Scholar] [CrossRef] [PubMed]
  16. Wei, T.S.; Liu, P.T.; Chang, L.W.; Liu, S.Y. Gait asymmetry, ankle spasticity, and depression as independent predictors of falls in ambulatory stroke patients. PLoS ONE 2017, 12, e0177136. [Google Scholar] [CrossRef] [PubMed]
  17. Punt, M.; Bruijn, S.; Wittink, H.; Port, I.; Van Dieen, J. Do clinical assessments, steady-state or daily-life gait characteristics predict falls in ambulatory chronic stroke survivors? J. Rehabil. Med. 2017, 49, 402–409. [Google Scholar] [CrossRef] [Green Version]
  18. Hussain, I.; Park, S.J. Prediction of Myoelectric Biomarkers in Post-Stroke Gait. Sensors 2021, 21, 5334. [Google Scholar] [CrossRef]
  19. Park, S.J.; Hussain, I.; Hong, S.; Kim, D.; Park, H.; Benjamin, H. Real-time Gait Monitoring System for Consumer Stroke Prediction Service. In Proceedings of the 2020 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA, 4–6 January 2020; pp. 1–4. [Google Scholar] [CrossRef]
  20. Farid, L.; Jacobs, D.; Santos, J.; Simon, O.; Gracies, J.M.; Hutin, E. FeetMe® Monitor-connected insoles are a valid and reliable alternative for the evaluation of gait speed after stroke. Top. Stroke Rehabil. 2020, 28, 1–8. [Google Scholar] [CrossRef]
  21. Mohan, D.; Khandoker, A.; Wasti, S.; Alali, S.; Jelinek, H.; Khalaf, K. Assessment Methods of Post-stroke Gait: A Scoping Review of Technology-Driven Approaches to Gait Characterization and Analysis. Front. Neurol. 2021, 12, 885. [Google Scholar] [CrossRef]
  22. Lee, J.; Shin, S.; Ghorpade, G.; Akbas, T.; Sulzer, J. Sensitivity comparison of inertial to optical motion capture during gait: Implications for tracking recovery. In Proceedings of the 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR), Toronto, ON, Canada, 24–28 June 2019; Volume 2019, pp. 139–144. [Google Scholar] [CrossRef]
  23. Marin Bone, J.; Marin, J.; Blanco, T.; De la Torre, J.; Salcedo, I.; Martitegui, E. Is My Patient Improving? Individualized Gait Analysis in Rehabilitation. Appl. Sci. 2020, 10, 8558. [Google Scholar] [CrossRef]
  24. Nait Aicha, A.; Englebienne, G.; van Schooten, K.; Pijnappels, M.; Krose, B. Deep Learning to Predict Falls in Older Adults Based on Daily-Life Trunk Accelerometry. Sensors 2018, 18, 1654. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Patel, M.; Pavic, A.; Goodwin, V. Wearable Inertial Sensors to Measure gait & Posture Characteristic Differences in Older Adult Fallers and Non-fallers: A Scoping Review. Gait Posture 2019, 76, 110–121. [Google Scholar] [CrossRef] [PubMed]
  26. Punt, M.; Alphen, B.; Port, I.; Van Dieen, J.; Michael, K.; Outermans, J.; Wittink, H. Clinimetric properties of a novel feedback device for assessing gait parameters in stroke survivors. J. Neuroeng. Rehabil. 2014, 11, 30. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Mc Ardle, R.; Din, S.; Galna, B.; Thomas, A.; Rochester, L. Differentiating dementia disease subtypes with gait analysis: Feasibility of wearable sensors? Gait Posture 2019, 76, 372–376. [Google Scholar] [CrossRef]
  28. Zhao, H.Y.; Wang, Z.; Qiu, S.; Shen, Y.; Wang, J. IMU-based gait analysis for rehabilitation assessment of patients with gait disorders. In Proceedings of the 2017 4th International Conference on Systems and Informatics (ICSAI), Hangzhou, China, 11–13 November 2017; pp. 622–626. [Google Scholar] [CrossRef]
  29. Routhier, F.; Duclos, N.; Lacroix, E.; Lettre, J.; Turcotte, E.; Hamel, N.; Michaud, F.; Duclos, C.; Archambault, P.; Bouyer, L. Clinicians’ perspectives on inertial measurement units in clinical practice. PLoS ONE 2020, 15, e0241922. [Google Scholar] [CrossRef]
  30. Aho, K.; Harmsen, P.; Hatano, S.; Marquardsen, J.; Smirnov, V.; Strasser, T. Results of a WHO collaborative study. Bull. World Health Organ. 1980, 58, 113–130. [Google Scholar]
  31. Berg, K. Measuring balance in the elderly: Preliminary development of an instrument. Physiother. Can. 1989, 41, 304–311. [Google Scholar] [CrossRef]
  32. Wade, D. Measurement in Neurological Rehabilitation. Curr. Opin. Neurol. Neurosurg. 1992, 5, 682–686. [Google Scholar]
  33. Collin, C.; Wade, D.; Davies, S.; Horne, V. The Barthel ADL Index: A reliability study. Int. Disabil. Stud. 1988, 10, 61–63. [Google Scholar] [CrossRef]
  34. Swieten, J.; Koudstaal, P.; Visser, M.; Schouten, H.; van Gijn, J. Interobserver Agreement for the Assessment of Handicap in Stroke Patients. Stroke J. Cereb. Circ. 1988, 19, 604–607. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Holden, M.; Gill, K.; Magliozzi, M.; Nathan, J.; Piehl-Baker, L. Clinical Gait Assessment in the Neurologically Impaired Reliability and Meaningfulness. Phys. Ther. 1984, 64, 35–40. [Google Scholar] [CrossRef] [PubMed]
  36. Khandelwal, S.; Wickström, N. Identification of Gait Events using Expert Knowledge and Continuous Wavelet Transform Analysis. In Proceedings of the 7th International Conference on Bio-inspired Systems and Signal Processing (BIOSIGNALS 2014), Angers, France, 3–6 March 2014. [Google Scholar]
  37. Barth, J.; Oberndorfer, C.; Pasluosta, C.; Schülein, S.; Gaßner, H.; Reinfelder, S.; Kugler, P.; Schuldhaus, D.; Winkler, J.; Klucken, J.; et al. Stride Segmentation during Free Walk Movements Using Multi-Dimensional Subsequence Dynamic Time Warping on Inertial Sensor Data. Sensors 2015, 15, 6419–6440. [Google Scholar] [CrossRef] [PubMed]
  38. Micó-Amigo, M.E.; Kingma, I.; Ainsworth, E.; Walgaard, S.; Niessen, M.; Van Lummel, R.; Van Dieen, J. A novel accelerometry-based algorithm for the detection of step durations over short episodes of gait in healthy elderly. J. Neuroeng. Rehabil. 2016, 13, 1–2. [Google Scholar] [CrossRef] [Green Version]
  39. Cooley, J.; Tukey, J. An algorithm for the machine calculation of complex Fourier series. Math. Comput. 1965, 19, 297–301. [Google Scholar] [CrossRef]
  40. Madgwick, S. An Efficient Orientation Filter for Inertial and Inertial/Magnetic Sensor Arrays; Report x-io and University of Bristol: Bristol, UK, 2010. [Google Scholar]
  41. Abdulrahim, K.; Moore, T.; Hide, C.; Hill, C. Understanding the performance of zero velocity updates in MEMS-based pedestrian navigation. Int. J. Adv. Technol. 2014, 5, 53–60. [Google Scholar]
  42. Sejdic, E.; Lowry, K.; Roche, J.; Perera, S.; Redfern, M.; Brach, J. Extraction of Stride Events From Gait Accelerometry During Treadmill Walking. IEEE J. Transl. Eng. Health Med. 2015, 4, 1. [Google Scholar] [CrossRef]
  43. Koo, T.; Li, M. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15. [Google Scholar] [CrossRef] [Green Version]
  44. Portney, L.; Watkins, M. Foundation of Clinical Research. Application to Practice; Pearson/Prentice Hall: Upper Saddle River, NJ, USA, 2009; pp. 77–94. [Google Scholar]
  45. Flansbjer, U.B.; Holmbäck, A.; Downham, D.; Patten, C.; Lexell, J. Reliability of gait performance in men and women with hemiparesis after stroke. J. Rehabil. Med. Off. J. UEMS Eur. Board Phys. Rehabil. Med. 2005, 37, 75–82. [Google Scholar] [CrossRef] [Green Version]
  46. Teufl, W.; Lorenz, M.; Miezal, M.; Taetz, B.; Fröhlich, M.; Bleser, G. Towards Inertial Sensor Based Mobile Gait Analysis: Event-Detection and Spatio-Temporal Parameters. Sensors 2018, 19, 38. [Google Scholar] [CrossRef] [Green Version]
  47. Hamacher, D.; Hamacher, D.; Singh, N.; Taylor, W.; Schega, L. Towards the assessment of local dynamic stability of level-grounded walking in an older population. Med. Eng. Phys. 2015, 37, 1152–1155. [Google Scholar] [CrossRef] [PubMed]
  48. Van Schooten, K.; Rispens, S.; Pijnappels, M.; Daffertshofer, A.; Van Dieen, J. Assessing Gait Stability: The Influence of State Space Reconstruction on Inter- and Intra-day Reliability of Local Dynamic Stability during Over-ground Walking. J. Biomech. 2012, 46, 137–141. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Moore, S.; Hickey, A.; Lord, S.; Din, S.; Godfrey, A.; Rochester, L. Comprehensive measurement of stroke gait characteristics with a single accelerometer in the laboratory and community. A feasibility, validity and reliability study. J. Neuroeng. Rehabil. 2017, 14. [Google Scholar] [CrossRef] [PubMed]
  50. Lewek, M.; Randall, E. Reliability of Spatiotemporal Asymmetry During Overground Walking for Individuals Following Chronic Stroke. J. Neurol. Phys. Ther. JNPT 2011, 35, 116–121. [Google Scholar] [CrossRef]
  51. Buurke, J.; Nene, A.; Kwakkel, G.; Erren-Wolters, V.; IJzerman, M.; Hermens, H. Recovery of Gait After Stroke: What Changes? Neurorehabilit. Neural Repair 2008, 22, 676–683. [Google Scholar] [CrossRef]
  52. Ferrucci, L.; Bandinelli, S.; Guralnik, J.; Lamponi, M.; Bertini, C.; Falchini, M.; Baroni, A. Recovery of functional status after stroke: A postrehabilitation follow-up study. Stroke J. Cereb. Circ. 1993, 24, 200–205. [Google Scholar] [CrossRef] [Green Version]
  53. Blum, L.; Korner-Bitensky, N. Usefulness of the Berg Balance Scale in Stroke Rehabilitation: A Systematic Review. Phys. Ther. 2008, 88, 559–566. Available online: http://xxx.lanl.gov/abs/https://academic.oup.com/ptj/article-pdf/88/5/559/31667079/ptj0559.pdf (accessed on 10 December 2021). [CrossRef]
  54. Bellanca, J.; Lowry, K.; Vanswearingen, J.; Brach, J.; Redfern, M. Harmonic Ratios: A quantification of step to step symmetry. J. Biomech. 2013, 46, 828–831. [Google Scholar] [CrossRef] [Green Version]
  55. Lamoth, C.; Beek, P.; Meijer, O. Pelvis–thorax coordination in the transverse plane during gait. Gait Posture 2002, 16, 101–114. [Google Scholar] [CrossRef]
  56. Roerdink, M.; Haart, M.; Daffertshofer, A.; Donker, S.; Geurts, A.; Beek, P. Dynamical structure of center-of-pressure trajectories in patients recovering from stroke. Exp. Brain Res. Exp. Hirnforsch. Exp. Cereb. 2006, 174, 256–269. [Google Scholar] [CrossRef] [Green Version]
  57. Bruijn, S.; Bregman, D.; Meijer, O.; Beek, P.; Van Dieen, J. Maximum Lyapunov exponents as predictors of global gait stability: A modelling approach. Med. Eng. Phys. 2011, 34, 428–436. [Google Scholar] [CrossRef] [PubMed]
  58. Patterson, K.; Gage, W.; Brooks, D.; Black, S.; Mcllroy, W. Evaluation of gait symmetry after stroke: A comparison of current methods and recommendations for standardization. Gait Posture 2009, 31, 241–246. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Visualisation of the data-processing steps prior to calculating the gait features. In the figure, the acceleration magnitude (blue) and gyroscope magnitude (orange) of a two-minute walking assessment is depicted. Firstly, the first and last two seconds (red planes) were excluded from analysis. The remaining signal was then used to calculate the threshold to determine the prior- and post-walking stationary periods (yellow planes). The residual signal was included in further analysis. For demonstrative purposes, the magnitude of acceleration and gyroscope were normalised using a min–max normalisation.
Figure 1. Visualisation of the data-processing steps prior to calculating the gait features. In the figure, the acceleration magnitude (blue) and gyroscope magnitude (orange) of a two-minute walking assessment is depicted. Firstly, the first and last two seconds (red planes) were excluded from analysis. The remaining signal was then used to calculate the threshold to determine the prior- and post-walking stationary periods (yellow planes). The residual signal was included in further analysis. For demonstrative purposes, the magnitude of acceleration and gyroscope were normalised using a min–max normalisation.
Sensors 22 00908 g001
Figure 2. Visualisation of the custom-made stride-detection algorithm during 10 s of walking by a person after stroke. The vertical acceleration is depicted as a blue line. First, the strides were detected using a peak-detection algorithm; the threshold is depicted as the orange line and the search window is depicted as the black line above the peaks. The found peaks are marked with an orange circle. Then, a false-negative peak detection was applied, and the stance phases were identified as the stationary periods between peaks (green planes). Lastly, a false-positive peak detection was applied in case no stationary period between peaks could be identified. The signal that was not marked as part of the stance phase was considered to be the swing phase (yellow planes).
Figure 2. Visualisation of the custom-made stride-detection algorithm during 10 s of walking by a person after stroke. The vertical acceleration is depicted as a blue line. First, the strides were detected using a peak-detection algorithm; the threshold is depicted as the orange line and the search window is depicted as the black line above the peaks. The found peaks are marked with an orange circle. Then, a false-negative peak detection was applied, and the stance phases were identified as the stationary periods between peaks (green planes). Lastly, a false-positive peak detection was applied in case no stationary period between peaks could be identified. The signal that was not marked as part of the stance phase was considered to be the swing phase (yellow planes).
Sensors 22 00908 g002
Figure 3. The ICC values (top panels) and rMDC values (bottom panels) of the spatio-temporal and frequency features for the left foot (blue triangle), the right foot (orange triangle), and the low back (green triangle). All outcomes above the horizontal black line were measured with good–excellent reliability. The exact outcomes of all gait features are provided in Table A1 in the Appendix A.
Figure 3. The ICC values (top panels) and rMDC values (bottom panels) of the spatio-temporal and frequency features for the left foot (blue triangle), the right foot (orange triangle), and the low back (green triangle). All outcomes above the horizontal black line were measured with good–excellent reliability. The exact outcomes of all gait features are provided in Table A1 in the Appendix A.
Sensors 22 00908 g003
Figure 4. The ICC values (top panels) and rMDC values (bottom panels) of the complexity and asymmetry features for the left foot (blue triangle), the right foot (orange triangle), the low back (green triangle), and combined (red triangle). All outcomes above the horizontal black line were measured with good–excellent reliability. The exact outcomes of all gait features are provided in Table A1 in the Appendix A.
Figure 4. The ICC values (top panels) and rMDC values (bottom panels) of the complexity and asymmetry features for the left foot (blue triangle), the right foot (orange triangle), the low back (green triangle), and combined (red triangle). All outcomes above the horizontal black line were measured with good–excellent reliability. The exact outcomes of all gait features are provided in Table A1 in the Appendix A.
Sensors 22 00908 g004
Table 1. Characteristics.
Table 1. Characteristics.
DescriptionOutcome
GenderMale/Female15/15
Stroke typeHemorrhagic/Ischimic6/24
Hemiparetic SideLeft/Right/Both/Unknown12/14/2/2
Walking aidWith/Without/Both23/4/2
Age (years)Mean (SD) (min, max)69.2 (±10.3) [52, 85]
Time post stroke (weeks)Mean (SD) (min, max)10.4 ± 7.5 (3, 37)
Berg Balance ScaleMean (SD) (min, max)41 ± 11.7 (14, 56)
Motricity IndexMean (SD) (min, max)63.9 ± 32.3 (0, 100)
Trunk Control TestMean (SD) (min, max)94.4 ± 16.2 (25, 100)
Barthel Index (at admission)Mean (SD) (min, max)10.3 ± 4.6 (1, 20)
Modified ranking scale (at admission)Mean (SD) (min, max)4.0 ± 0.7 (3, 5)
Functional ambulation classificationMean (SD) (min, max)2.1 ± 1.6 (0, 5)
Functional ambulation classification (walking aid)Mean (SD) (min, max)3.7 ± 0.8 (3, 5)
Abbreviations: SD = Standard deviation; Min = Minimum; Max = Maximum.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Felius, R.A.W.; Geerars, M.; Bruijn, S.M.; van Dieën, J.H.; Wouda, N.C.; Punt, M. Reliability of IMU-Based Gait Assessment in Clinical Stroke Rehabilitation. Sensors 2022, 22, 908. https://doi.org/10.3390/s22030908

AMA Style

Felius RAW, Geerars M, Bruijn SM, van Dieën JH, Wouda NC, Punt M. Reliability of IMU-Based Gait Assessment in Clinical Stroke Rehabilitation. Sensors. 2022; 22(3):908. https://doi.org/10.3390/s22030908

Chicago/Turabian Style

Felius, Richard A. W., Marieke Geerars, Sjoerd M. Bruijn, Jaap H. van Dieën, Natasja C. Wouda, and Michiel Punt. 2022. "Reliability of IMU-Based Gait Assessment in Clinical Stroke Rehabilitation" Sensors 22, no. 3: 908. https://doi.org/10.3390/s22030908

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop