Next Article in Journal
Joint Semi-Blind Self-Interference Cancellation and Equalisation Processes in 5G QC-LDPC-Encoded Short-Packet Full-Duplex Transmissions
Next Article in Special Issue
Effects of Load Carriage on Postural Control and Spatiotemporal Gait Parameters during Level and Uphill Walking
Previous Article in Journal
Leveraging Computational Intelligence Techniques for Defensive Deception: A Review, Recent Advances, Open Problems and Future Directions
Previous Article in Special Issue
Visualization-Driven Time-Series Extraction from Wearable Systems Can Facilitate Differentiation of Passive ADL Characteristics among Stroke and Healthy Older Adults
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validity and Reliability of the Insole3 Instrumented Shoe Insole for Ground Reaction Force Measurement during Walking and Running

by
Leora A. Cramer
1,
Markus A. Wimmer
1,2,
Philip Malloy
1,3,
Joan A. O’Keefe
2,
Christopher B. Knowlton
1 and
Christopher Ferrigno
1,2,*
1
Department of Orthopedic Surgery, Rush University Medical Center, 1611 W Harrison Street, Suite 201, Chicago, IL 60612, USA
2
Department of Anatomy and Cell Biology, Rush University Medical Center, 600 S. Paulina St., Suite 507, Chicago, IL 60612, USA
3
Department of Physical Therapy, Arcadia University, 450 S. Easton Road, Glenside, PA 19038, USA
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(6), 2203; https://doi.org/10.3390/s22062203
Submission received: 24 February 2022 / Revised: 8 March 2022 / Accepted: 9 March 2022 / Published: 11 March 2022
(This article belongs to the Special Issue Wearable Sensors for Assessment of Gait in Older Adults)

Abstract

:
Pressure-detecting insoles such as the Insole3 have potential as a portable alternative for assessing vertical ground reaction force (vGRF) outside of specialized laboratories. This study evaluated whether the Insole3 is a valid and reliable alternative to force plates for measuring vGRF. Eleven healthy participants walked overground at slow and moderately paced speeds and ran at a moderate pace while collecting vGRF simultaneously from a force plate (3000 Hz) and Insole3 (100 Hz). Intraclass correlation coefficients (ICC) demonstrated excellent vGRF agreement between systems during both walking speeds for Peak 1, Peak 2, the valley between peaks, and the vGRF impulse (ICC > 0.941). There was excellent agreement during running for the single vGRF peak (ICC = 0.942) and impulse (ICC = 0.940). The insoles slightly underestimated vGRF peaks (−3.7% to 0.9% bias) and valleys (−2.2% to −1.8% bias), and slightly overestimated impulses (4.2% to 5.6% bias). Reliability between visits for all three activities was excellent (ICC > 0.970). The Insole3 is a valid and reliable alternative to traditional force plates for assessing vGRF during walking and running in healthy adults. The excellent ICC values during slow walking suggests that the Insole3 may be particularly suitable for older adults in clinical and home settings.

Graphical Abstract

1. Introduction

Three-dimensional motion analysis is a valuable tool for quantifying gait parameters, monitoring disease progression, and guiding rehabilitative and medical treatment decisions [1,2]. Motion analysis quantifies ground reaction forces (GRF) using highly accurate force plates along with specialized cameras for capturing motion [2,3]. Such equipment is expensive and requires dedicated space and extensive training to use, thereby limiting such gait assessments to select centers and laboratories [4,5], and restricting their use in most clinical settings. Due to its small capture volume, many motion analysis setups can only detect a few stride sequences, and the force plate is limited to detecting the GRF for only a single step [5,6]. These limitations warrant exploration and development of portable, less expensive, and more user-friendly devices for quantifying GRF in real-world settings like clinics and home environments. Additionally, researchers and clinicians are often interested in the vertical component of the GRF (vGRF), particularly in studies where the force in other planes is lower in priority [6,7].
Viable alternatives to force plates for calculating an estimate of the vGRF include other technologies such as pressure mats [8] and an array of instrumented shoe insoles [8,9,10]. Of these alternatives, instrumented shoe insoles offer the most potential for use outside of a laboratory setting [11]. Until recently, sensor-enabled insoles were bulky, often containing external wiring harnesses, telemetry units, and power sources [8,12] that require extensive technical expertise and set-up time and potentially alter natural gait, making them impractical for clinical and home use [13]. Technical advances have enhanced accuracy and now allow for insoles to be wireless, allowing for force assessment that is more affordable, more time efficient, and less obtrusive to patients. One such device is the Insole3 (Moticon ReGo AG, Munich, Germany), seen in Figure 1. The Insole3 is a completely wireless insole powered by a coin cell battery. It stores data onto an onboard memory card while transmitting data via Bluetooth to a computer or smartphone. The Insole3 is flexible and incorporates sixteen capacitive pressure sensors, a three-dimensional accelerometer, and a three-dimensional gyroscope for measuring plantar pressure and motion. The insoles’ firmware integrates pressure measurements under the foot to allow for the continuous computation of vGRF estimates.
Such technologically advanced insoles greatly improve their utility in rehabilitation science and in conducting studies in ecologically valid environments including the home and community [13]. These features are especially useful for evaluative diagnostics, particularly in patients with abnormal force parameters contributing to disease progression, pain, morbidity, and reduced quality of life. Another novel feature of the Insole3 device is the addition of real-time audio feedback capability via Bluetooth connectivity to a smartphone, which can be used as a tool to assist in modifying gait patterns [12] and vGRF [14] in patients for whom excess force parameters are a concern, such as in those with musculoskeletal disorders. However, prior to being used for these applications, such an insole must be validated to confirm that it accurately estimates force.
The purpose of this study was to evaluate whether the Insole3 is a valid and reliable alternative to an in-ground laboratory force plate for measuring vGRF during slow walking, moderate-paced walking, and running. We hypothesized that there would be good to excellent agreement between the vertical force estimates from the insoles and the measured vGRF from the force plates, and good to excellent test–retest reliability of the insoles between two study visits.

2. Materials and Methods

2.1. Participants

This study was approved by the Institutional Review Board (Rush ORA-12021506). An a priori power analysis was performed using intraclass correlation coefficients (ICC) in the determination of reliability [15]. The power analysis yielded a sample size of 11 subjects with a power of 0.9, alpha of 0.05, a null assumption of ICC = 0, and an alternative hypothesis of ICC = 0.75 to signify good agreement [16]. Individuals who self-reported as healthy, pain-free, functional in daily activities without the need of assistance, and absent of history of surgery on the ankles, knees, and hips were recruited through local university networks. During informed consent, subjects were asked to return for a second study visit within one to four weeks following their first visit.

2.2. Motion Capture: Force Plates and Cameras

Two force plates (Bertec Corporation, Columbus, OH, USA) embedded in a walkway recorded GRF at a sampling rate of 3000 Hz. Twelve optoelectronic cameras (Qualisys, Gothenburg, Sweden) recorded the position data of reflective markers at 120 Hz during walking and 300 Hz during running. Five markers were placed bilaterally on the lateral and medial malleoli, and on the shoe surface overlying the fifth metatarsal tuberosity, second metatarsal head, and posterolateral heel as previously described [12]. Following standing reference trials, the medial markers were removed for dynamic trials. Video data were used to facilitate synchronizing the data from both systems and marker data were used to confirm that speeds fell within desired ranges.

2.3. Insoles

The Insole3 sampling rate was set to its maximum of 100 Hz. The pressure sensors have a mean resolution of 0.25 N/cm2 with a range of 0–50 N/cm2 as per manufacturer’s documentation [17]. The insoles connect wirelessly via Bluetooth to an Android smartphone containing the insole manufacturer’s OpenGo mobile application (Moticon ReGo AG, Munich, Germany). Insole data were recorded to the insole’s onboard SD memory card and subsequently transferred wirelessly to the OpenGo Software (Moticon ReGo AG, Munich, Germany) on a laptop computer following each visit.
The insoles were fitted into a standardized shoe (Adidas low-cup VRX, model DB3176) after removing the shoe’s original insole. The athletic shoe has a flat footbed to minimize interference with the insole’s contour while providing ample cushioning for walk and run trials. Subjects wore a standardized sock without seams on the plantar surface. Subjects participated in a familiarization period of at least 30 min that consisted of the subject sitting, standing, and walking in the standard shoes and insoles. This period also allowed the temperature of the sensors in the insoles to warm-up, limiting drift and associated measurement errors [18]. An automatic zeroing process, which occurs continuously once the phone application connects to the insoles, was done to reduce drift during recordings and errors associated with high mechanical impacts.
The insoles were calibrated to the subject’s bodyweight, as measured by a balance beam scale. The insoles’ built-in calibration procedure involved four motion tasks prompted by the application: slow walking while maintaining fluid motion for 40 s, standing still for 10 s, repeated anterior-posterior weight shifts for 10 s, and repeated side-to-side weight shifts for 10 s. Successful auto-zeroing was confirmed by a zero total force reading under a raised foot while standing on the contralateral limb.

2.4. Gait Conditions

Three gait conditions were evaluated in the following order: (1) moderate-paced walking, (2) slow walking, and (3) running. The following speeds for gait trials were targeted to minimize temporal variability: 1.2–1.4 m/s for moderate-paced walking, 0.8–1.0 m/s for slow walking, and 3.3–3.7 m/s for running. Practice trials were performed before each condition to reach the predefined target speeds which were estimated in real-time using a stopwatch over a predefined distance of 20 feet, or 6.096 m [19].
After practice trials, dynamic trials were recorded simultaneously by the insoles, force plate, and motion capture system. Subjects repeated gait trials until a minimum of five successful recordings for each of the left and right leg were obtained at each of the two walking speeds and for running. Therefore, a minimum of 30 total trials were recorded for each subject. A trial was considered successful if the subject’s speed was within the target speed range, as determined with the stopwatch, and if their step of interest hit completely on the force plate. Subjects were provided rest periods between conditions and by request.

2.5. Data Processing

Motion data from the foot markers were processed in Visual 3D (C-Motion, Inc., Germantown, MD, USA) to better evaluate the gait speed for each trial; these speeds were used in the test–retest reliability analysis to compare for differences between the two visits. In cases where extra trials per side were collected, the five trials closest to the midpoint of the target speed range were selected for final validity and reliability analyses.
Data processing and analysis were performed using a custom code for R (R Version 4.0.3 (2020), Statistical Computing, Vienna, Austria). A flash of light from the phone controlling the insole, which was in clear view of a video camera from the motion capture system, marked the end of the recording. To synchronize relative timestamps between the force plates and the insoles, a flash of light from a smartphone communicating wirelessly with the Insole3 was captured by the video camera, marking the end of the trial recording. No smoothing, filtering, or interpolation were performed on the force datasets.
The discrete variables of interest for the walking trials included the first and second local maxima, defined as Peak 1 and Peak 2 of the stance phase, which indicate the initial contact and propulsion characteristics of the vGRF. Additionally, the local stance phase minima, defined as the valley, of the vGRF, which represents weight acceptance and mid stance, were analyzed. Since running includes a single maximum of the vGRF during stance phase, only this value was analyzed for the running trials. Impulse was calculated for walking and running trials as the area under the vGRF–time series data waveform during the duration of stance using a composite trapezoid method [20].

2.6. Statistical Analyses

Data from the first visit only were used to assess overall agreement between the Insole3’s force-estimated data and the measured force data from the force plate. Insole3 data from both Visit 1 and Visit 2 were used to evaluate its test–retest reliability. For both the validity and reliability analyses, classic methods of ICC, confidence intervals (CI), and Bland–Altman plots [21,22] were used.
For the validity assessment, ICC (3,k) was used for a mean-rating (k = 2), absolute agreement, and two-way mixed effects model between subject and device. ICC statistics were calculated using the psych package in R. For interpreting the strength of the ICC values, the following categories suggested and described by Koo et al. were used: excellent (>0.90), good (0.75–0.90), moderate (0.50–0.75), or poor (<0.50) [16]. For the validity analysis, percent biases were calculated as the mean difference of measurements between the devices, as a proportion of the force plate values. Modified Bland–Altman plots with limits of agreement (LOA) display mean differences in vGRF between the two devices for each of the eleven subjects’ values. LOA were calculated as two standard deviations of differences between the Insole3 and force plate means.
Test–retest reliability was assessed using a mean-rating (k = 2), consistency, with a two-way mixed effects model between subjects and visits [16]. For the reliability analysis, percent biases were calculated as the mean difference of measurements between visits, as a proportion of the mean of Visits 1 and 2. Walking and running speeds between visits were compared for significant differences using a paired two-tailed t-test.

3. Results

3.1. Subjects

Eleven subjects participated in this study. Subject demographics are presented in Table 1.

3.2. Absolute Agreement between Insole3 and Force Plate

Mean speeds were 0.94 ± 0.04 m/s for the slow walk, 1.31 ± 0.04 m/s for the moderate-paced walk, and 3.72 ± 0.22 m/s for the run; running was thus performed at or slightly above the upper limit of the targeted range. Five of each left and right foot-strike per condition were included in the final analysis.
Descriptive statistics and ICCs for the validity comparison of the Insole3’s estimated forces with the measured forces of the force plate are shown in Table 2. With ICC values at or above 0.940 for Peak 1, Peak 2, valley, and impulse, during slow and moderate-paced walking speeds and running, the Insole3 vGRF estimates demonstrate excellent agreement with the force plate vGRF. The highest ICC values were seen in slow walking, with slightly lower but still robust ICCs for moderate-paced walking and running. F-tests indicated significant intraclass correlations between devices (p < 0.0001).
Modified Bland–Altman plots of mean differences between the insoles and force plate demonstrate that the majority of points lie within the LOA (Figure 2). The average of mean differences across all subjects for metrics in each condition provides insight into possible measurement bias between the two systems. Close inspection of the plots suggests that the insoles tended to slightly underestimate peak forces and valleys during walking conditions (% bias = −3.7–1.1%). Peak force during running was split between over- and underestimations and had a relatively small mean bias (% bias = 0.9%). For all three conditions, the Insole3 tended to overestimate impulses when compared with the force plates (% bias = 4.2–5.6%). Although not directly assessed, bias of the insole appears independent of vGRF magnitude during walking conditions, while there is potentially an inverted relationship between vGRF and insole bias during running trials.
Representative vGRF–time curves from the force plate and insole for both walking conditions demonstrate a characteristic double-peak, and the running condition in all 11 subjects demonstrates a characteristic single peak (Figure 3). In a single representative sample, an overlay of the waveforms visibly shows high agreement along the force–time continuum, especially during slow walking speeds. Also noticeable is a small time-related lag in the vGRF signal at the end of the stance phase (Figure 3, dotted ellipses). During running trials when the vGRF slope is steepest, a lower insole sampling rate results in a low number of data points particularly during weight acceptance. A review of the two-dimensional videos for each runner revealed that 10 of the 11 subjects in the study ran with a rearfoot landing pattern [23], as confirmed by review of the video camera recordings. Those with a rearfoot landing pattern showed an initial spike in their representative vGRF–time curve, termed the impact transient [24], from the force plate while such impact transients were absent for the midfoot striker and from all 11 representative vGRF–time curves from the Insole3.

3.3. Test–Retest Reliability

No significant differences in mean speed were found between visits as determined by paired two-tailed t-tests for the slow walks (p = 0.2506) and moderate-paced walks (p = 0.6760). Mean running speed has a p-value of 0.0738 between visits. Excellent test–retest reliability was found for all dependent variables, including Peak 1, Peak 2, valley, and impulse, for the Insole3 between Visits 1 and 2, and results were comparable with the force plate’s test–retest reliability (Table 3). For all dependent variables, mean test–retest ICC values for the insoles ranged from 0.970–0.996 and F-tests indicated significant non-zero intraclass correlations between visits (p < 0.0001).

4. Discussion

The results of this study demonstrate that the fully wireless and compact Insole3, with 16 pressure sensors, has excellent absolute agreement with the force plate for estimating peak vGRF and impulse during walking and running, and excellent test–retest reliability between the two study visits. The Bland–Altman plots and percent bias values suggest that the Insole3 tends to slightly underestimate the vGRF Peak 1, Peak 2, and the valley between peaks during the stance phase during both speeds of walking, which is similar to previously reported findings from studies using other sensor-enabled insoles similar to the Insole3 [9,25]. This underestimation may be expected for insole measurements as the viscoelastic properties of a rubber sole attenuate the transference of GRFs to the interface between the top of the shoe sole and the plantar sole of the foot. Peak forces during running were nearly evenly over- and underestimated by the Insole3, suggesting that when using the Insole3 for running, it is likely beneficial to take averages of several trials in order to obtain the most accurate vGRF assessment. Other insoles have been shown to underestimate running vGRF peaks [9,25,26].
Vertical force impulses calculated by the Insole3 tended to be slightly higher than those measured by the force plate during all three conditions, whereas previously tested sensor-enabled insoles tended to output lower impulses [9,25]. A contributing factor to the Insole3’s overestimations of impulse is a slight time-related lag in the vGRF signal found by the Insole3 compared with the force plate in the region between terminal stance and an offloaded state. The tendency of the Insole3 to slightly overestimate impulse is relatively minor, though somewhat consistent between subjects and trials; it should therefore be considered if relying on the insole’s force output during the latest parts of the stance.
The Insole3 had higher levels of agreement for vGRF peaks during walking (ICC = 0.941–0.986) than its predecessor, the OpenGo (ICC = 0.886) [6], and lower percent biases than the OpenGo in estimations of vGRF peaks and impulses during walking and running [25]. Excellent consistency was found for the Insole3 as well as the OpenGo, which was evaluated between trials rather than between visits [6].
Direct comparison of this study’s results with other concurrent validation studies is difficult due to different methodologies, but the results and a review of the literature suggest that the Insole3 has improved estimations of vGRF measurements compared with the OpenGo during walking and running, which may be due to hardware and firmware improvements. The increased number of pressure sensors from 13 in the OpenGo to 16 in the Insole3 provides better sensor coverage of foot area, and the increased sampling rate from 50 Hz to 100 Hz results in higher data resolution. Improvements in measurements when increasing the sampling frequency were also noted in the loadsol® sensor insole when the recording rate was doubled from 100 Hz to 200 Hz [9]. The differences between the force plates’ sampling rate (3000 Hz) and the Insole3’s sampling rate (100 Hz) may account for some of the slight systematic biases in the insole’s estimations of vGRF [27]. This is most prevalent in the running curves seen in Figure 2, where the Insole3 was unable to record the impact transient of rearfoot landing during running. However, given its compactness, low cost, full integration, portability, and ease of use, our findings suggest that the Insole3 has great utility in most straight-lined gait applications where force measurements are needed outside of the laboratory.
Since a single insole size covers multiple shoe sizes, insole coverage underneath each foot will vary, as will the spatial distribution of the 16 sensors between insole sizes. Insole sizes tested in this study were limited by the availability of standardized footwear sizes. Study inclusion was limited to participants with shoe sizes between U.S. men’s/women’s sizes 6/7 through 12/13, restricting recruitment of otherwise eligible females with shoe sizes below US women’s 7. However, previous research suggests that there is little difference between males and females in their vGRF during running [28] and in their plantar pressures during walking [29]. Although few older subjects were recruited for this study, we evaluated slow walking conditions among participants. The highest ICC values and the lowest biases were obtained under those conditions, suggesting the Insole3′s applicability in older populations [30].
Potential sources of variance were reduced by standardized conditions, including standardized footwear and the use of pre-defined target speeds as opposed to self-selected paces. While the chosen gait speeds reflect normal self-selected paces of adults [31], and since vGRF parameters can vary with walking speeds [32,33], activities with higher ground-contact speeds such as fast walking, sprinting, cutting, or other agility movements could be further assessed for levels of agreement.
The high agreement of the Insole3 in estimating force during slow walking is promising for its use in older populations, since walking speeds progressively decline with aging and older populations demonstrate slow walking speeds similar to those used in the present study [30]. Motion analysis of older adults in a traditional motion analysis laboratory can be particularly difficult; a more portable and streamlined system would therefore be beneficial, especially considering the diminished functional capacity and decline in independence, general mobility, and transportation in many older adults. Assessing force in this population is important, especially in conditions related to osteoporosis, osteoarthritis, and post-traumatic fracture repair and hip replacement where partial weight bearing is often indicated and compliance is challenged [7].

5. Conclusions

This study demonstrates that the Insole3 is a valid and reliable alternative to the force plate for assessing discrete vGRF parameters during slow and moderate-paced walking, as well as moderately paced running in a healthy young adult population. These findings suggest that the Insole3 has applicability outside of specialized gait laboratories, such as in clinical and home settings. This insole may prove particularly beneficial in applications where subjects are bound to their homes and/or feedback about weight bearing is crucial, such as lower limb joint disease [11] and in the recovery periods following injury or surgery [34], or simply in the study of older adults who have difficulties travelling to specialized laboratories.

Author Contributions

Conceptualization, L.A.C., M.A.W. and C.F.; data curation, L.A.C. and C.B.K.; methodology, L.A.C., M.A.W., P.M., C.B.K. and C.F.; software development, L.A.C.; validation, M.A.W., C.B.K. and C.F.; formal analysis, L.A.C., M.A.W. and C.F.; investigation: L.A.C. and C.B.K.; resources, M.A.W. and C.F.; data curation, L.A.C. and C.B.K.; writing—original draft preparation, L.A.C., M.A.W. and C.F.; writing—review and editing, L.A.C., M.A.W., P.M., J.A.O., C.B.K. and C.F.; visualization, M.A.W. and C.F.; supervision, M.A.W., J.A.O., C.B.K. and C.F.; project administration, M.A.W. and C.F.; funding acquisition, M.A.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Grainger Chair of the Rush Arthritis and Orthopedics Institute.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, approved by the Rush University Institutional Review Board (Rush ORA-12021506).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available upon request from the corresponding author.

Acknowledgments

The authors would like to thank Jade He for providing technical assistance, Abhiroop Ganguly for assistance with data acquisition, Adam Wilson for his input on statistics and assistance with figures, and John Magnotti for his input on statistics.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Baker, R.; Esquenazi, A.; Benedetti, M.G.; Desloovere, K. Gait Analysis: Clinical Facts. Eur. J. Phys. Rehabil. Med. 2016, 52, 560–574. [Google Scholar] [PubMed]
  2. Lu, T.; Chang, C. Biomechanics of Human Movement and its Clinical Applications. Kaohsiung J. Med. Sci. 2012, 28, S13–S25. [Google Scholar] [CrossRef]
  3. Nagano, H.; Begg, R.K. Shoe-Insole Technology for Injury Prevention in Walking. Sensors 2018, 18, 1468. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Simon, S.R. Quantification of Human Motion: Gait Analysis—benefits and Limitations to its Application to Clinical Problems. J. Biomech. 2004, 37, 1869–1880. [Google Scholar] [CrossRef]
  5. Shahabpoor, E.; Pavic, A. Measurement of Walking Ground Reactions in Real-Life Environments: A Systematic Review of Techniques and Technologies. Sensors 2017, 17, 2085. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Braun, B.J.; Veith, N.T.; Hell, R.; Döbele, S.; Roland, M.; Rollmann, M.; Holstein, J.; Pohlemann, T. Validation and Reliability Testing of a New, Fully Integrated Gait Analysis Insole. J. Foot Ankle Res. 2015, 8, 54. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Kammerlander, C.; Pfeufer, D.; Lisitano, L.A.; Mehaffey, S.; Bocker, W.; Neuerburg, C. Inability of Older Adult Patients with Hip Fracture to Maintain Postoperative Weight-Bearing Restrictions. J. Bone Jt. Surg. Am. 2018, 100, 936–941. [Google Scholar] [CrossRef] [PubMed]
  8. Drăgulinescu, A.; Drăgulinescu, A.; Zincă, G.; Bucur, D.; Feieș, V.; Neagu, D. Smart Socks and in-Shoe Systems: State-of-the-Art for Two Popular Technologies for Foot Motion Analysis, Sports, and Medical Applications. Sensors 2020, 20, 4316. [Google Scholar] [CrossRef]
  9. Renner, K.E.; Williams, D.; Queen, R.M. The Reliability and Validity of the Loadsol® Under various Walking and Running Conditions. Sensors 2019, 19, 265. [Google Scholar] [CrossRef] [Green Version]
  10. Leal-Junior, A.G.; Domingues, M.F.; Min, R.; Vilarinho, D.; Theodosiou, A.; Tavares, C.; Alberto, N.; Leitão, C.; Kalli, K.; Frizera-Neto, A. Fiber Bragg Based Sensors for Foot Plantar Pressure Analysis. In International Joint Conference on Biomedical Engineering Systems and Technologies; Springer: Cham, Switzerland, 2019; pp. 3–25. [Google Scholar]
  11. He, J.; Ferrigno, C.; Shakoor, N.; Wimmer, M. Responses to Gait Retraining using Pressure-Based Auditory Feedback for Medial Knee Osteoarthritis. Osteoarthr. Cartil. 2021, 29, S81–S82. [Google Scholar] [CrossRef]
  12. Ferrigno, C.; Stoller, I.S.; Shakoor, N.; Thorp, L.E.; Wimmer, M.A. The Feasibility of using Augmented Auditory Feedback from a Pressure Detecting Insole to Reduce the Knee Adduction Moment: A Proof of Concept Study. J. Biomech. Eng. 2016, 138, 021014. [Google Scholar] [CrossRef] [PubMed]
  13. Braun, B.J.; Veith, N.T.; Rollmann, M.; Orth, M.; Fritz, T.; Herath, S.C.; Holstein, J.H.; Pohlemann, T. Weight-Bearing Recommendations After Operative Fracture Treatment—fact Or Fiction? Gait Results with and Feasibility of a Dynamic, Continuous Pedobarography Insole. Int. Orthop. 2017, 41, 1507–1512. [Google Scholar] [CrossRef] [PubMed]
  14. Braun, B.J.; Bushuven, E.; Hell, R.; Veith, N.T.; Buschbaum, J.; Holstein, J.H.; Pohlemann, T. A Novel Tool for Continuous Fracture Aftercare–clinical Feasibility and First Results of a New Telemetric Gait Analysis Insole. Injury 2016, 47, 490–494. [Google Scholar] [CrossRef]
  15. Bujang, M.A.; Baharum, N. A Simplified Guide to Determination of Sample Size Requirements for Estimating the Value of Intraclass Correlation Coefficient: A Review. Arch. Orofac. Sci. 2017, 12, 1–11. [Google Scholar]
  16. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. MoticonREGO AG. Sensor Insole Specification: Preliminary. 2021. Available online: https://moticon.com/wp-content/uploads/2021/09/OpenGo-Sensor-Insole-Specification-A4SQ-RGB-EN-03.02.pdf (accessed on 22 February 2022).
  18. Martini, E.; Fiumalbi, T.; Dell’Agnello, F.; Ivanić, Z.; Munih, M.; Vitiello, N.; Crea, S. Pressure-Sensitive Insoles for Real-Time Gait-Related Applications. Sensors 2020, 20, 1448. [Google Scholar] [CrossRef] [Green Version]
  19. Soangra, R.; Lockhart, T.E. Agreement in Gait Speed from Smartphone and Stopwatch for Five Meter Walk in Laboratory and Clinical Environments. Biomed. Sci. Instrum. 2014, 50, 254–264. [Google Scholar] [PubMed]
  20. Makowski, D.; Ben-Shachar, M.S.; Lüdecke, D. bayestestR: Describing Effects and their Uncertainty, Existence and Significance within the Bayesian Framework. J. Open Source Softw. 2019, 4, 1541. [Google Scholar] [CrossRef]
  21. Kottner, J.; Audigé, L.; Brorson, S.; Donner, A.; Gajewski, B.J.; Hróbjartsson, A.; Roberts, C.; Shoukri, M.; Streiner, D.L. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were Proposed. Int. J. Nurs. Stud. 2011, 48, 661–671. [Google Scholar] [CrossRef] [PubMed]
  22. Zaki, R.; Bulgiba, A.; Ismail, R.; Ismail, N.A. Statistical Methods used to Test for Agreement of Medical Instruments Measuring Continuous Variables in Method Comparison Studies: A Systematic Review. PLoS ONE 2012, 7, e37908. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Hasegawa, H.; Yamauchi, T.; Kraemer, W.J. Foot Strike Patterns of Runners at the 15-km Point during an Elite-Level Half Marathon. J. Strength Cond. Res. 2007, 21, 888. [Google Scholar]
  24. Gruber, A.H.; Edwards, W.B.; Hamill, J.; Derrick, T.R.; Boyer, K.A. A Comparison of the Ground Reaction Force Frequency Content during Rearfoot and Non-Rearfoot Running Patterns. Gait Posture 2017, 56, 54–59. [Google Scholar] [CrossRef]
  25. Stöggl, T.; Martiner, A. Validation of Moticon’s OpenGo Sensor Insoles during Gait, Jumps, Balance and Cross-Country Skiing Specific Imitation Movements. J. Sports Sci. 2017, 35, 196–206. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Low, D.; Dixon, S. Footscan Pressure Insoles: Accuracy and Reliability of Force and Pressure Measurements in Running. Gait Posture 2010, 32, 664–666. [Google Scholar] [CrossRef]
  27. Hori, N.; Newton, R.U.; Kawamori, N.; McGuigan, M.R.; Kraemer, W.J.; Nosaka, K. Reliability of Performance Measurements Derived from Ground Reaction Force Data during Countermovement Jump and the Influence of Sampling Frequency. J. Strength Cond. Res. 2009, 23, 874–882. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Queen, R.M.; Abbey, A.N.; Wiegerinck, J.I.; Yoder, J.C.; Nunley, J.A. Effect of Shoe Type on Plantar Pressure: A Gender Comparison. Gait Posture 2010, 31, 18–22. [Google Scholar] [CrossRef]
  29. Murphy, D.F.; Beynnon, B.D.; Michelson, J.D.; Vacek, P.M. Efficacy of Plantar Loading Parameters during Gait in Terms of Reliability, Variability, Effect of Gender and Relationship between Contact Area and Plantar Pressure. Foot Ankle Int. 2005, 26, 171–179. [Google Scholar] [CrossRef] [PubMed]
  30. Salbach, N.M.; O’Brien, K.K.; Brooks, D.; Irvin, E.; Martino, R.; Takhar, P.; Chan, S.; Howe, J. Reference Values for Standardized Tests of Walking Speed and Distance: A Systematic Review. Gait Posture 2015, 41, 341–360. [Google Scholar] [CrossRef] [PubMed]
  31. Bohannon, R.W.; Andrews, A.W. Normal Walking Speed: A Descriptive Meta-Analysis. Physiotherapy 2011, 97, 182–189. [Google Scholar] [CrossRef]
  32. Andriacchi, T.; Ogle, J.; Galante, J. Walking Speed as a Basis for Normal and Abnormal Gait Measurements. J. Biomech. 1977, 10, 261–268. [Google Scholar] [CrossRef]
  33. Jordan, K.; Challis, J.H.; Newell, K.M. Walking Speed Influences on Gait Cycle Variability. Gait Posture 2007, 26, 128–134. [Google Scholar] [CrossRef]
  34. Müßig, J.A.; Brand, A.; Kröger, I.; Klöpfer-Krämer, I.; Augat, P. Effects of Assistive Insole Feedback Training on Immediate and Multi-Day Partial Weight Bearing Retention during Walking: A Pilot Study. Gait Posture 2022, 93, 78–82. [Google Scholar] [CrossRef]
Figure 1. (A) The Insole3 (Moticon ReGo AG, Munich, Germany) and the OpenGo smartphone application. (B) Layout of the 16 pressure sensors and coordinate system. Figure 1B used and modified with permission from Moticon ReGo AG.
Figure 1. (A) The Insole3 (Moticon ReGo AG, Munich, Germany) and the OpenGo smartphone application. (B) Layout of the 16 pressure sensors and coordinate system. Figure 1B used and modified with permission from Moticon ReGo AG.
Sensors 22 02203 g001
Figure 2. Modified Bland–Altman plots of Visit 1. The difference in mean force measures for each subject between the “gold standard” force plate and Insole3 is plotted. The mean bias is indicated by a solid blue line, and upper and lower limits of agreement are indicated by dashed red lines. Absolute biases are indicated at the top of each plot. Each point represents each subject (n = 11).
Figure 2. Modified Bland–Altman plots of Visit 1. The difference in mean force measures for each subject between the “gold standard” force plate and Insole3 is plotted. The mean bias is indicated by a solid blue line, and upper and lower limits of agreement are indicated by dashed red lines. Absolute biases are indicated at the top of each plot. Each point represents each subject (n = 11).
Sensors 22 02203 g002
Figure 3. Representative vertical ground reaction force (vGRF) time plots from force plate (black) and Insole3 data (red) versus time. Both walks demonstrate characteristic double-peaked curves with two maxima (Peak 1 and Peak 2), and one minimum (valley), and the jogging trial represents a typical single-peaked curve with the presence of an impact transient prior to the peak. Target speed ranges were 1.2–1.4 m/s for the moderate-paced walk, 0.8–1.0 m/s for the slow walk, and 3.3–3.7 m/s for the jog. Gray dashed ellipses indicate regions that demonstrate a slight lag in the vGRF at the end of the stance phase with the insole.
Figure 3. Representative vertical ground reaction force (vGRF) time plots from force plate (black) and Insole3 data (red) versus time. Both walks demonstrate characteristic double-peaked curves with two maxima (Peak 1 and Peak 2), and one minimum (valley), and the jogging trial represents a typical single-peaked curve with the presence of an impact transient prior to the peak. Target speed ranges were 1.2–1.4 m/s for the moderate-paced walk, 0.8–1.0 m/s for the slow walk, and 3.3–3.7 m/s for the jog. Gray dashed ellipses indicate regions that demonstrate a slight lag in the vGRF at the end of the stance phase with the insole.
Sensors 22 02203 g003
Table 1. Subject characteristics (n = 11) and insole sizing. Each size of an Insole3 covers two European sizes (e.g., Size 4 covers European Sizes 38 and 39). The median European size was used for the insole size (e.g., for an individual wearing a Size 4 insole, their European insole size used was 42/43).
Table 1. Subject characteristics (n = 11) and insole sizing. Each size of an Insole3 covers two European sizes (e.g., Size 4 covers European Sizes 38 and 39). The median European size was used for the insole size (e.g., for an individual wearing a Size 4 insole, their European insole size used was 42/43).
DemographicMean ± Standard Deviation
Number of Females (%)3/11 (27%)
Height (inches)68.5 ± 3.5
Age (years)33.1 ± 16.7
Weight (kilograms)74.2 ± 14.6
BMI (kilograms/m2)24.6 ± 4.4
InsolesMedian (range)
Insole Size (European size)42/43 (36/37–44/45)
Insole Size (Manufacturer Size)Size 6 (3–7)
Table 2. Visit 1 agreement between the Insole3 and force plate for each vertical ground reaction force (vGRF) variable during slow walking, moderate-paced walking, and running trials. Absolute agreement between the devices is reported for two-way mixed effects and multiple measurements, with 95% confidence intervals (CI), F-test with p-value, and percent bias. ICC = Intraclass correlation coefficient.
Table 2. Visit 1 agreement between the Insole3 and force plate for each vertical ground reaction force (vGRF) variable during slow walking, moderate-paced walking, and running trials. Absolute agreement between the devices is reported for two-way mixed effects and multiple measurements, with 95% confidence intervals (CI), F-test with p-value, and percent bias. ICC = Intraclass correlation coefficient.
Gait
Condition
vGRF VariableForce PlateInsoleAbsolute Agreement
Mean ± Standard DeviationMean ± Standard DeviationICC (3,k)95% CIF(10,10)p-ValueMean Bias (%)
Slow WalkPeak 1 (N)737.01 ± 139.91726.69 ± 134.870.986(0.960, 0.995)72.7660.0000−1.4
Peak 2 (N)762.43 ± 133.45754.42 ± 123.150.978(0.938, 0.993)46.0670.0000−1.1
Valley (N)634.95 ± 120.53623.58 ± 115.800.981(0.946, 0.994)54.8370.0000−1.8
Impulse (N·s)481.71 ± 101.11501.76 ± 99.360.986(0.771, 0.996)210.5820.00004.2
Moderate-Paced WalkPeak 1 (N)815.70 ± 153.14787.35 ± 155.320.968(0.895, 0.990)38.630.0000−3.5
Peak 2 (N)818.13 ± 148.97787.85 ± 139.370.941(0.827, 0.980)19.1660.0000−3.7
Valley (N)545.99 ± 103.76534.16 ± 105.130.976(0.931, 0.992)44.0940.0000−2.2
Impulse (N·s)400.15 ± 72.23417.85 ± 69.660.970(0.803, 0.992)64.2780.00004.4
RunPeak Max (N)1814.98 ± 329.141831.42 ± 279.740.942(0.836, 0.980)17.3830.00000.9
Impulse (N·s)256.29 ± 54.75270.71 ± 44.960.940(0.777, 0.981)23.0010.00005.6
Table 3. Test–retest reliability between visits for each vertical ground reaction force (vGRF) variable during slow walking, moderate-paced walking, and running. Consistency between Visit 1 and Visit 2 is reported for two-way mixed effects and multiple measurements; Visit 1 and Visit 2 means were compared for peak and valley forces (N) and impulses (N·s). ICC = Intraclass correlation coefficient; CI = Confidence interval.
Table 3. Test–retest reliability between visits for each vertical ground reaction force (vGRF) variable during slow walking, moderate-paced walking, and running. Consistency between Visit 1 and Visit 2 is reported for two-way mixed effects and multiple measurements; Visit 1 and Visit 2 means were compared for peak and valley forces (N) and impulses (N·s). ICC = Intraclass correlation coefficient; CI = Confidence interval.
Insole3Test–Retest Consistency
ConditionvGRF VariableVisit 1 Mean ± SDVisit 2 Mean ± SDICC(3,k)95% CIF(10,10)p-Value% Bias
Slow-paced walkPeak 1 (N)726.69 ± 134.87727.24 ± 140.060.996(0.987, 0.999)224.4900.1
Peak 2 (N)754.42 ± 123.15745.05 ± 134.400.988(0.963, 0.996)81.050−1.2
Valley (N)623.58 ± 115.80631.70 ± 119.660.995(0.985, 0.998)193.6101.3
Impulse (N·s)501.76 ± 99.36510.66 ± 103.870.995(0.984, 0.998)182.4001.8
Moderate-paced walkPeak 1 (N)787.35 ± 155.32775.92 ± 161.950.983(0.951, 0.994)60.400−1.5
Peak 2 (N)787.85 ± 139.37779.08 ± 147.020.981(0.943, 0.994)52.550−1.1
Valley (N)534.16 ± 105.13540.71 ± 102.650.986(0.959, 0.995)72.1701.2
Impulse417.85 ± 69.66420.33 ± 79.530.983(0.950, 0.994)59.8300.6
RunMax vGRF (N)1831.42 ± 279.741812.07 ± 282.820.970(0.912, 0.990)33.830−1.1
Impulse (N·s)270.71 ± 44.96266.02 ± 48.000.983(0.950, 0.994)59.390−1.7
Force Plate
Slow-paced walkPeak 1 (N)737.01 ± 139.91735.55 ± 138.900.998(0.994, 0.999)491.400−0.2
Peak 2 (N)762.43 ± 133.45763.14 ± 135.320.999(0.996, 0.999)671.1800.1
Valley (N)634.95 ± 120.53642.20 ± 123.530.998(0.993, 0.999)403.9901.1
Impulse (N·s)481.71 ± 101.11492.60 ± 101.560.994(0.984, 0.998)180.8502.2
Moderate-paced walkPeak 1 (N)815.70 ± 153.14813.80 ± 160.770.990(0.970, 0.997)99.850−0.2
Peak 2 (N)818.13 ± 148.97817.67 ± 146.970.999(0.996, 1.000)765.100−0.1
Valley (N)545.99 ± 103.76550.67 ± 103.220.988(0.965, 0.996)84.6900.9
Impulse (N·s)400.15 ± 72.23405.25 ± 77.490.992(0.975, 0.997)119.7001.3
RunPeak vGRF (N)1814.98 ± 329.141832.57 ± 336.150.992(0.976, 0.997)123.6501
Impulse (N·s)256.29 ± 54.75256.39 ± 52.550.991(0.975, 0.997)117.2100.04
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Cramer, L.A.; Wimmer, M.A.; Malloy, P.; O’Keefe, J.A.; Knowlton, C.B.; Ferrigno, C. Validity and Reliability of the Insole3 Instrumented Shoe Insole for Ground Reaction Force Measurement during Walking and Running. Sensors 2022, 22, 2203. https://doi.org/10.3390/s22062203

AMA Style

Cramer LA, Wimmer MA, Malloy P, O’Keefe JA, Knowlton CB, Ferrigno C. Validity and Reliability of the Insole3 Instrumented Shoe Insole for Ground Reaction Force Measurement during Walking and Running. Sensors. 2022; 22(6):2203. https://doi.org/10.3390/s22062203

Chicago/Turabian Style

Cramer, Leora A., Markus A. Wimmer, Philip Malloy, Joan A. O’Keefe, Christopher B. Knowlton, and Christopher Ferrigno. 2022. "Validity and Reliability of the Insole3 Instrumented Shoe Insole for Ground Reaction Force Measurement during Walking and Running" Sensors 22, no. 6: 2203. https://doi.org/10.3390/s22062203

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop