Next Article in Journal
Clustering Transmission Opportunity Length (CTOL) Model over Cognitive Radio Network
Previous Article in Journal
A Novel Vision-Based Pose Measurement Method Considering the Refraction of Light
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Design of an Artificial Neural Network Algorithm for a Low-Cost Insole Sensor to Estimate the Ground Reaction Force (GRF) and Calibrate the Center of Pressure (CoP)

Motion Control Laboratory, School of Mechanical Engineering, Yonsei University, Seoul 03722, Korea
*
Author to whom correspondence should be addressed.
Sensors 2018, 18(12), 4349; https://doi.org/10.3390/s18124349
Submission received: 10 October 2018 / Revised: 29 November 2018 / Accepted: 5 December 2018 / Published: 10 December 2018
(This article belongs to the Section Physical Sensors)

Abstract

:
As an alternative to high-cost shoe insole pressure sensors that measure the insole pressure distribution and calculate the center of pressure (CoP), researchers developed a foot sensor with FSR sensors on the bottom of the insole. However, the calculations for the center of pressure and ground reaction force (GRF) were not sufficiently accurate because of the fundamental limitations, fixed coordinates and narrow sensing areas, which cannot cover the whole insole. To address these issues, in this paper, we describe an algorithm of virtual forces and corresponding coordinates with an artificial neural network (ANN) for low-cost flexible insole pressure measurement sensors. The proposed algorithm estimates the magnitude of the GRF and the location of the foot plantar CoP. To compose the algorithm, we divided the insole area into six areas and created six virtual forces and the corresponding coordinates. We used the ANN algorithm with the input of magnitudes of FSR sensors, 1st and 2nd derivatives of them to estimate the virtual forces and coordinates. Eight healthy males were selected for data acquisition. They performed an experiment composed of the following motions: standing with weight shifting, walking with 1 km/h and 2 km/h, squatting and getting up from a sitting position to a standing position. The ANN for estimating virtual forces and corresponding coordinates was fitted according to those data, converted to c script, and downloaded to a microcontroller for validation experiments in real time. The results showed an average RMSE the whole experiment of 31.154 N for GRF estimation and 8.07 mm for CoP calibration. The correlation coefficients of the algorithm were 0.94 for GRF, 0.92 and 0.76 for the X and Y coordinate respectively.

1. Introduction

Human postural control is used for maintaining a subject’s balance against the external force of gravity during locomotion [1,2]. By analyzing the sensory information and calculating the biomechanics for the coordinates of limb segments, we can determine the velocity of the center of mass of the segments or the joint torque that can be used for control. These methods are also used in rehabilitation exoskeletons and muscular power strengthening exoskeletons. We should know the state of the wearer for calculating the magnitude and direction of the assistive force for the wearers’ needs.
Foot plantar center of pressure (CoP) and ground reaction force (GRF) provide the most important information for postural control. Perry et al. showed that gravity, which is the only external force during human locomotion, creates the GRF on the insole, which is the end effector of the lower limbs, and contains important information like the state of the human, intention understanding [3]. We can predict the stage of the gait cycle by the change of vertical GRF [4]. It has two peak values: the first one is the maximal weight acceptance and second is the push-off. It starts with the heel contact and ends with the toe-off. The valley between the two peaks is in the mid stance. We can also calculate the velocity of the body mass from a three-dimensional center of mass acceleration, which is determined from the GRF by the center of mass mechanics [5]. After disassembling the GRF, we can get the magnitude of the horizontal force and can calculate the horizontal acceleration with dividing the horizontal force with the body mass. It can also be used for analyzing patients with abnormal gait patterns [6]. During the stance phase, we can judge the person’s gait normality from the trajectory of the x and y coordinates of the center of GRF and for controlling the exoskeletons which are used by those patients [7]. For example, Shaulian et al. proved that the GRF of patients with lower-limb diseases deviates substantially from the norm [8]. So, they concluded that GRF manipulation is a key parameter for treating the symptoms of those diseases. And Ma and Liao modeled and evaluated patients’ gait patterns based on GRF using a semi-Markov process [9]. Lim et al. used an FSR foot sensor for detecting the gait phase algorithm for controlling a lower extremity exoskeleton robot [10].
There are various methods for measuring the magnitude of the GRF. We can use the force plate and in-shoe measurement and the analysis system (e.g., the F-Scan system of TEKSCAN Inc., South Boston, MA, USA or the Insole plantar pressure feedback system of Shenzhen XFT Electronics Co., Ltd., Shenzhen, China). However, these systems can be used only in laboratory experiments, which hinders the mobility of the experiments. They are also expensive (approximately $20,000 for the entire system), so they have disadvantages in terms of cost-effectiveness.
The CoP, which is another informational element for postural control, is often used as much as the GRF. We can judge a person’s state for stability with the location and velocity of the CoP [11,12]. We can also predict the gait speed of a person with the forward velocity of the CoP in the midfoot [13] and get the user intention understanding of exoskeleton for controlling a robot system [14,15]. Nevertheless, we should use an in-shoe pressure sensor as for measuring the GRF, so the same problem exists for this case.
To solve the monetary problems, many alternative sensors have been developed. Park et al. made a Force Sensing Resistor (FSR) foot sensor with four FSR sensors on the insole and obtained the data of the force plate and the FSR sensors simultaneously during walking, running and jumping [16]. Moreover, they composed a linear multiple regression formula with four FSR sensor inputs for GRF estimation with the output of magnitude of GRF. However, they did not remove the hysteresis of the FSR sensors. So, the inputs of the algorithm cannot be corrected most of the time. They obtained the force loss during the stance phase of the gait cycle because they cannot estimate the pressure on the arch of the foot, which has no FSR sensors. So, they get the NRMS error of 14.68 during the walking which cannot be ignored. Moreover, the algorithm they developed can only be utilized during those three motions. For that method, we need to set the mode of motion for operation and cannot use the algorithm when we do not know the state of human locomotion. Forner-Cordero et al. estimated the magnitude of the GRF using the pressure value from limited areas of the FSR sensors [17]. However, they used inverse dynamics because they knew the subject was in the stance phase. Thus, the algorithm can be used only when the state of the subject is known, especially during the stance phase.
FSR sensors are also used for low-cost sensors that calculate the CoP. Normally, a weighted mean approach (WMA) is used for calculating the CoP. The values of FSR sensors are divided by the sum of the FSR sensor values and multiplied by their coordinates like a weight constant. Then they are all summed for the CoP calculation [18]. However, this method is not accurate because of the limited areas of the FSR sensors, which do not cover the entire insole area, and the error cannot be compensated for. To solve this issue, He et al. developed an algorithm estimating the foot plantar CoP with nonlinear models. The output value of nonlinear models is the location of the CoP and the input values are the voltages of the FSR sensors. The author fitted the algorithm with data from the F-Scan system for reference during several tasks [19]. A low-cost foot sensor with 12 FSR sensors was validated for the algorithm during the tasks. However, this method was fitted for static tasks like quiet standing or sit to stand, so its utilization is limited and it may not operate well in dynamic tasks. The researchers estimated the location of the CoP directly from the values of FSR sensors (not through the whole pressure value of the insole) to get the errors from that. Thus, it is not a fundamental solution.
We aimed to develop a low-cost flexible insole pressure measurement sensor that estimates the magnitude of the GRF and calibrates the location of the CoP during static and dynamic motions. We used a WMA, but we created the virtual forces and their coordinates for passing the bounds of limited sensing areas. Then an artificial neural network (ANN) system was used to estimate the magnitude and coordinates of the virtual forces. An ANN algorithm has the inputs of the values of the FSR sensors. For fitting the algorithms, the F-Scan system was used for several tasks. After predicting those values, we summed the virtual forces to estimate the magnitude of the GRF and used the WMA to calibrate the CoP. Validation was also done with the F-Scan system during several tasks.
The remainder of this paper is structured as follows: In Section 2 the hardware and our proposed algorithm design for estimating the virtual forces and moving coordinates are presented. And the settings for ANN are also shown in Section 2. In Section 3 experiments for data acquisition are presented. The experimental results are shown in Section 4 and they are discussed in Section 5. Lastly, conclusion is given in Section 6.

2. Methods

2.1. Hardware Design

The locations of the FSR sensors are the most important elements for composing the algorithms. Every algorithm needs the values of the FSR sensors as input values, so they should be located appropriately. We set the location of the FSR sensors according to the anatomical shape of a foot, and they are the protruding areas. These areas make contact with the ground earlier than the others and get more pressure than the others, so FSR sensors should be located at these areas for sensing the pressure most of time, and we can utilize these values to estimate the pressure of other areas. We used six FSR sensors, and their locations were at two phalanges, two of metatarsal bones, the calcaneus, and the arch of the foots as shown in Figure 1. The sensor at the arch of the foot(E) was used for another reason. Because pressure at this area is intermittently formed, estimation of it is very difficult without measurements, and because of its shape, this is the last area to get pressure during the locomotion. Therefore, this area for input value was helpful for algorithm fitting. FSR sensors were attached to a polypropylene insole of size US8, and the signals were transmitted to the microcontroller (STM32F407VG-discl1, STMicroelectronics, Geneva, Switzerland) through the circuit, which is recommended by the manufacturer [20].
FSR-A401 (TEKSCAN Inc., South Boston, MA, United States) with a sensing area of 2026.93 mm 2 was used, and we calibrated them using the system in Hall et al. [21]. After the FSR sensors are used, the electric resistances of the FSR sensors change. Therefore, we fitted the 4th-order polynomial function with the FSR voltage value and, its moving integral, offset to compensate for that and also for reducing the hysteresis effect. To reduce the noise from the sensors, we used an RC analogue high-pass filter with 335.06 Hz cutoff frequency, and on the computer, we also used a digital low-pass filter with 20 Hz cutoff frequency for the noise.

2.2. Virtual Force Algorithm (VFA) Design

The insole was divided into six areas to estimate the whole insole pressure. The areas were composed around the FSR sensors, and the FSR sensors were the center of the areas as in Figure 1. Every area had a force converted from the pressure of the area and its moving coordinate, which is shown in Table 1. These values can be predicted from algorithms for which inputs are the values of the FSR sensors. We used an ANN algorithm for the virtual force algorithm (VFA).
The ANN system is a statistical learning algorithm designed from the idea of the nerve network of humans. It is a model that estimates the output values from a node that is composed of numerous synapses and multiplied by fitted weight constants. A human cannot calculate the magnitude of the GRF and the location of the CoP for every moment, but he can maintain the balance of the body and perform locomotion by feeling it with a nerve network that is fitted with numerous frames that accumulated since birth. We can use this point for our algorithms.
We trained 18 ANN algorithms with 18 input values of magnitudes, 1st and 2nd derivatives of magnitudes of six FSR sensors for the magnitudes of virtual forces and coordinates of their locations like in Figure 2. We used those values to reduce drastic errors during experiments. They maintain the slope of the estimated values with velocities and accelerations so there can be no abrupt dominant change.
A neural network fitting toolbox in MATLAB (The MathWorks, Inc., Natick, MA, USA) was used for algorithm fitting. Tangent-sigmoid transfer function, which is an activation function for connecting the layers was used for hidden layer and output layer and a Levenberg‒Marquardt backpropagation algorithm was used for training the weighted constants of the algorithm. Collected dataset were divided into three parts: 70% for training, 15% for validation, and 15% for testing.
G R F = F E T + F E L + F E R + F E H + F E C + F E L T
The magnitudes of the GRF were calculated by summing the virtual forces as in Equation (1), and the location of the foot plantar CoP was calculated by a WMA with virtual forces and their locations as in Equation (2).
x C O P = x E T F E T + x E L F E L + x E R F E R + x E H F E H + x E C F E C + x E L T F E L T F E T + F E R + F E L + F E H + F E C + F E L T y C O P = y E T F E T + y E L F E L + y E R F E R + y E H F E H + y E C F E C + y E L T F E L T F E T + F E R + F E L + F E H + F E C + F E L T .

2.3. Artificial Neural Network Setting

Before doing the experiments for many subjects, we should decide the number of layers of an ANN. So, we did the scan experiment which is performed standing on two feet and moving the center of mass counter-clockwise and back and forth for one subject. Data for fitting the algorithms were acquired by the F-Scan system. Chen et al. confirmed that the F-Scan system was accurate for measuring GRF and CoP [22]. We used the F-Scan system for reference data. Every experiment was done with the subjects wearing an F-scan insole sensor and low-cost flexible insole pressure measurement sensor as in Hu et al. like Figure 3 [19]. The data acquisition rate was set to 50 Hz (20 ms). After data acquisition, we composed the matrices for algorithm fitting. One frame of 20 ms was converted to one data matrix. The matrix is composed of 19 columns with the six magnitudes of the FSR sensors, six 1st and 2nd derivatives of them for input values, and pressure values and coordinates of the divided. We fitted the ANN algorithm with different number of layers of hidden neurons for finding the optimum number.
We knew that time durations for all numbers of layers for estimating virtual forces are less than one second and we did not consider the variable for that reason. As to the mean of error and correlation coefficient, 10 layers had the best performance among all numbers of layers as shown in Figure 4. Therefore, we decided the number of layers would be 10 for estimating the virtual forces.
And for the coordinates, we did same process. Time durations were all less than five hundred seconds, so we also did not consider it and got the number of 200 layers as same reason for the virtual force.
We also determined the data amount for algorithm fitting by experiment. Figure 5 shows the result of the algorithm fitting with different numbers of data frames. After 10,000 frames, the rate of error decreasing slowed down. So, we collected 15,000 frames for algorithm fitting and the proportions of each experiment are the same in the data set.

3. Experimental Settings

Experiments were done with eight adult males who had a foot size of US8. Their body state indexes are shown in Table 1. Every subject performed five tasks for data acquisition: (1) The scan experiment is performed standing on two feet and moving the center of mass counter-clockwise and back and forth. (2‒3) In the gait cycle experiments the subject walks on a treadmill at 1 km/h and 2 km/h. (4) In the squatting experiment, the subjects squat 10 times. (5) In the Sit to Stand experiment, the subject sat down and got up 10 times.
After fitting the algorithms with acquired data, all algorithms are converted into MATLAB function block of simulink so we can use the algorithm in real time with the values of FSR sensors transmitted from microcontroller (STM32F407VG-disc1, STMicroelectronics, Geneva, Switzerland) board by serial communication (20 ms). We did the whole experimental process again with the algorithm for validation.

4. Results

Figure 6a and Figure 7a show examples of the CoP trajectory plots during the scan experiment, gait experiment of subject 3 by the WMA, the VFA and the reference data of the F-Scan system. We can see that the trajectory of the VFA is much closer to the F-Scan than the WMA. Figure 6b and Figure 7b show the estimation of the magnitude of the GRF during the experiments, and we can see that the estimations are close to the reference data.
Table 2 show the RMSE and correlation coefficients calculated by the VFA and the WMA with the reference data of the F-Scan system. For the GRF, the average RMSE during all the experiments is 29.34 N. There is a value of 8.29 mm for CoP calibration by the VFA and 16.89 mm by the WMA. The average correlation coefficients are 0.94 for the GRF estimation, 0.94 for the X coordinate of the CoP by the VFA, 0.76 for the Y coordinate of the CoP by the VFA, 0.89 for the X coordinate of the CoP by the WMA, and 0.64 for the Y coordinate of the CoP by the WMA.
Figure 8 shows the RMSE of the VFA and the WMA by the reference data of all the subjects during each experiment. The green bars of the WMA have higher values than the yellow bars of the VFA, so it is clear that the error decreased with the proposed algorithm.

5. Discussion

In this study, we proposed and validated an algorithm (VFA) for estimating GRF and calibrating CoP of an insole with several experiments. Using eight healthy males our validation experiments confirmed that the VFA can estimate the magnitude of the GRF of an insole during static and dynamic situations with a 29.34 N mean RMSE value and the location of the CoP with an 8.29 mm mean RMSE value. The results also confirmed that the VFA have high correlation coefficients like 0.94 for GRF, 0.94 for the X coordinate, and 0.76 for the Y coordinate. The correlation coefficient of 0.76 can be regarded as a low value but that is because of the low span of the Y coordinate, and it is not low compared with relevant studies. Hu et al. proposed a nonlinear model for estimation of the foot plantar CoP trajectories, and their research had the best success with estimating CoP so far [16]. They achieved an average RMSE value of 2.48 mm for the medial‒lateral direction, which equals the Y coordinate of this study, and 10.18 mm for the anterior‒posterior direction, which equals the X coordinate of this study. The exact distance error was 10.48 mm, which is higher than the 8.29 mm of this study. The experiments done in that study were composed of static experiments like quiet standing, sitting down, and standing up. Those static experiments had input signals of almost all the sensors with monotonous changes of magnitudes of the sensor signals. Those conditions are advantageous for algorithm performance. Moreover, the VFA described in this paper had an average RMSE of 8.28 mm, which is lower even with fewer sensors (six FSR sensors) than the study of Hu et al. (12 FSR sensors). For dynamic situations like walking, we achieved 9.45 mm for the average RMSE value during 1 km/h and 2 km/h gait experiments. Thus, VFA performed the best for estimating the CoP during all situations so far.
Studying the GRF, Park et al. found the NRMSE of estimating the GRF during walking, running, and jumping [13], with values of 14.68 for walking, 10.9 for running and 14.72 for jumping. During the walking, the maximum magnitude of GRF was 800 N. Then RMSE was calculated as 120 N, which was much higher than the error of this study (34.01 N). They had the biggest error during the experiment in 20 to 70% of the gait cycle, while in this study we can see that there is no loss of force during the gait cycle in 0.4 to 0.88 s in Figure 7b. These results confirm that for estimating the GRF, VFA is the best algorithm reported.
We concluded that the reason why our proposed algorithm (VFA) has a higher performance than any other algorithms is in virtual forces and moving coordinates. In Figure 6a, the gray circles with bolded black edges indicate the locations of the FSR sensors. With the limitation of the WMA model that has fixed coordinates with weighted constants, the CoP cannot get out of the region of the FSR sensor area, which has the FSR sensors as apexes. We can see that CoPs of WMA are located at the edge which is drawn by connecting the FSR sensors. However, with virtual coordinates, the CoP can move out of the FSR sensor area, as in Figure 6a, with green circles. However, with virtual forces and moving coordinates, CoP can get out of the FSR sensor area, as we can explain through Figure 9.
In Figure 9, we can see three points of CoP by VFA (Algorithm), WMA (No Algorithm) and reference data (F-Scan) of a certain frame during a scan experiment. Of course, the point of the VFA is closer to the F-Scan point than that of WMA. This is because the virtual force of D area which is getting bigger by VFA, drags the orange point of WMA backward. In Table 3, the proportional rate of ADC values of FSR sensors in the A, B, D area is 1:2.4:2.8. However, the proportional rate of the estimated virtual forces of areas is 1:4.45:12.24. The proportion of the force of D area is much bigger than before, so its effect is also higher. The estimated moving X coordinates of C and D areas are also dragged slightly backward compared to before. In the WMA for the calculation of CoP, like i F i F S U M x i , the weighted constant of x i is F i F S U M , so when F i gets bigger, the effect of x i is higher. So, bigger values of virtual forces resulted from the VFA let the coordinates which is slightly dragged backward have more power to drag the CoP to the actual location.
The principle of estimating the virtual forces from other FSR sensors can be explained by linear multiple regression which is regarded as an ANN with one neuron. We fitted the linear multiple regression which has six FSR sensor values for inputs and estimated force of B area for output, as in Equation (3):
F E R = a 0 + a 1 F T + a 2 F R + a 3 F L + a 4 F H + a 5 F C + a 6 F L T
We can get the constants for Equation (3) as in Table 4. We know that the constants of A, B, C areas are positive values and those of D, E, F are negative. A positive value means that if the FSR sensor of that constant gets a higher value, it gives the output, which is the estimated force, a positive effect to get higher force. A negative value means the opposite. For example, the constant a 4 of heel FSR sensor has a negative value, so if the heel FSR sensor gets a higher value, the estimated force of B area gets a lower value. The reason is clear: when the heel gets a higher value, that means the CoP is located in the back side of the foot and FSR sensors on the front side cannot help getting a lower value for pressure. This explains why the protruding areas can be chosen for the locations of the FSR sensors for input values of algorithms.
To sum up, the VFA lets the virtual forces get higher values of pressure than those measured by FSR sensors and also gives the virtual forces more reasonable coordinates than the fixed coordinates of the FSR sensors. So, the CoP that is calculated by a WMA with those virtual forces and moving coordinates can be closer to the actual value. Thus, we can overcome the fundamental limitations of the FSR sensor and use a low-cost sensor like the whole insole measurement pressure sensing system.
The VFA is very practical for the low-cost sensor field. We can use it for the wearable sensor market for weight measurement and daily step analysis with connections to smartphones or computers. Furthermore, in research, as we explained in the introduction, it can be used for rehabilitation engineering, medical engineering, biomechanics and so on. However, in this study, we set a restriction on the size of the foot, but we think it likely that there is an average foot shape for every person and we can make algorithms with the VFA that operate for every foot size. Our future work will be to normalize the algorithms of the virtual forces and coordinates for every size of foot and person to compose only one algorithm for all human beings.

6. Conclusions

The CoP and GRF of an insole are the most important parameters for robot and postural control. This study proposed a low-cost flexible insole pressure measurement sensor with FSR sensors that can estimate the foot plantar pressure and its location with very high accuracy compared to existing studies and the WMA. We hope that this algorithm will replace the commercial pressure measurement sensors that have very high prices for the engineering research of biomechanics, biomedical and rehabilitation engineering for fall prevention for the elderly, rehabilitation exoskeleton control, gait analysis and so on.

Author Contributions

Conceptualization, Formal analysis, Methodology, Validation, Writing—Original draft, H.S.C.; Funding acquisition, Project administration, Supervision, Y.S.B.; Data curation, Validation, C.H.L.; Investigation, M.S., J.I.H.

Funding

This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea Government (MSIP) (No. NRF-2017M1A3A3A02016507).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Massion, J. Postural control system. Curr. Opin. Neurobiol. 1994, 4, 877–887. [Google Scholar] [CrossRef]
  2. Horack, F.B. Macpherson, Postural orientation and equilibrium: What do we need to know about neural control of balance to prevent falls? Age Ageing 2006, 35, ii7–ii11. [Google Scholar] [CrossRef] [PubMed]
  3. Perry, J.; Davids, J.R. Gait Analysis: Normal and Pathological Function. J. Pediatr. Orthop. 1992, 12, 815. [Google Scholar] [CrossRef]
  4. Bouffard, V.; Nantel, J.; Therrien, M.; Vendittoli, P.A.; Lavigne, M.; Prince, F. Center of Mass Compensation during Gait in Hip Arthroplasty Patients: Comparison between Large Diameter Head Total Hip Arthroplasty and Hip Resurfacing. Rehabil. Res. Pract. 2011, 2001. [Google Scholar] [CrossRef] [PubMed]
  5. Donelan, J.M.; Kram, R.; Kuo, A.D. Simultaneous positive and negative external mechanical work in human walking. J. Biomech. 2002, 35, 117–124. [Google Scholar] [CrossRef]
  6. Bae, J.; Kong, K.; Byl, N.; Tomizuka, M. A Mobile Gait Monitoring System for Abnormal Gait Diagnosis and Rehabilitation: A Pilot Study for Parkinson Disease Patients. J. Biomech. Eng. 2011, 133. [Google Scholar] [CrossRef]
  7. Tucker, M.R.; Olivier, J.; Pagel, A.; Bleuler, H.; Bouri, M.; Lambercy, O.; del R Millán, J.; Riener, R.; Vallery, H.; Gassert, R. Control strategies for active lower extremity prosthetics and orthotics: A review. J. Neuroeng. Rehabil. 2015, 12. [Google Scholar] [CrossRef] [PubMed]
  8. Shaulian, H.; Solomonow-Avnon, D.; Herman, A.; Rozen, N.; Haim, A.; Wolf, A. The effect of center of pressure alteration on the ground reaction force during gait: A statistical model. Gait Posture 2018, 66, 107–113. [Google Scholar] [CrossRef] [PubMed]
  9. Ma, H.; Liao, W.-H. Human Gait Modeling and Analysis Using a Semi-Markov Process with Ground Reaction Force. IEEE Trans. Neural Syst. Rehabil. Eng. 2017, 25, 597–607. [Google Scholar] [CrossRef] [PubMed]
  10. Lim, D.H.; Kim, W.S.; Kim, H.J.; Han, C.S. Development of Real-Time Gait Phase Detection System for a Lower Extremity Exoskeleton Robot. Int. J. Precis. Eng. Manuf. 2017, 18, 681–687. [Google Scholar] [CrossRef]
  11. Di, P.; Huang, J.; Nakagawa, S.; Sekiyama, K.; Fukuda, T. Fall detection for elderly by using an intelligent cane robot based on center of pressure (COP) stability theory. In Proceedings of the 2014 International Symposium on Micro-NanoMechatronics and Human Science (MHS), Nagoya, Japan, 10–12 November 2014. [Google Scholar] [CrossRef]
  12. van Dijk, M.M.; Meyer, S.; Sandstad, S.; Wiskerke, E.; Thuwis, R.; Vandekerckhove, C.; Myny, C.; Ghosh, N.; Beyens, H.; Dejaeger, E.; et al. A cross-sectional study comparing lateral and diagonal maximum weight shift in people with stroke and healthy controls and the correlation with balance, gait and fear of falling. PLoS ONE 2017. [Google Scholar] [CrossRef] [PubMed]
  13. Fuchioka, S.; Iwata, A.; Higuchi, Y.; Miyake, M.; Kanda, S.; Nishiyama, T. The Forward Velocity of the Center of Pressure in the Midfoot is a Major Predictor of Gait Speed in Older Adults. Int. J. Gerontol. 2015, 9, 119–122. [Google Scholar] [CrossRef]
  14. Lim, D.H.; Kim, W.S.; Ali, M.A.; Han, C.S. Development of Insole Sensor System and Gait Phase Detection Algorithm for Lower Extremity Exoskeleton. J. Korean Soc. Precis. Eng. 2015, 32, 1065–1072. [Google Scholar] [CrossRef]
  15. Quintero, H.A.; Farris, R.J.; Goldfarb, M. Control and implementation of a powered lower limb orthosis to aid walking in paraplegic individuals. In Proceedings of the 2011 IEEE International Conference on Rehabilitation Robotics, Zurich, Switzerland, 29 June–1 July 2011. [Google Scholar] [CrossRef]
  16. Park, J.; Na, Y.; Gu, G.; Kim, J. Flexible insole ground reaction force measurement shoes for jumping and running. In Proceedings of the 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob), Singapore, 26–29 June 2016. [Google Scholar] [CrossRef]
  17. Forner-Cordero, A.; Koopman, H.J.F.M.; Van der Helm, F.C.T. Inverse dynamics calculations during gait with restricted ground reaction force information from pressure insole. Gait Posture 2006, 23, 189–199. [Google Scholar] [CrossRef] [PubMed]
  18. Claverie, L.; Ille, A.; Moretto, P. Discrete sensors distribution for accurate plantar pressure analyses. Med. Eng. Phys. 2016, 38, 1489–1494. [Google Scholar] [CrossRef] [PubMed]
  19. Hu, X.; Zhao, J.; Peng, D.; Sun, Z.; Qu, X. Estimation of Foot Plantar Center of Pressure Trajectories with Low-Cost Instrumented Insoles Using an Individual-Specific Nonlinear Model. Sensors 2018, 18. [Google Scholar] [CrossRef] [PubMed]
  20. Tekscan Inc. FlexiForce Standard Model A401 Datasheet. Available online: https://www.tekscan.com/products-solutions/force-sensors/a401 (accessed on 8 December 2018).
  21. Hall, R.S.; Desmoulin, G.T.; Milner, T.E. A technique for conditioning and calibrating force-sensing resistors for repeatable and reliable measurement of compressive force. J. Biomech. 2008, 41, 3492–3495. [Google Scholar] [CrossRef] [PubMed]
  22. Chen, B.; Bates, B.T. Comparison of F-Scan in-sole and AMTI forceplate system in measuring vertical ground reaction force during gait. Int. J. Phys. Ther. 2000, 16. [Google Scholar] [CrossRef]
Figure 1. Design of the low-cost flexible insole pressure measurement sensor with six FSR sensors. Gray circles with wires show the FSR sensors. White bolded numbers indicate the anatomically divided areas. Blue squares mean the areas of the virtual forces that contain the FSR sensors in them.
Figure 1. Design of the low-cost flexible insole pressure measurement sensor with six FSR sensors. Gray circles with wires show the FSR sensors. White bolded numbers indicate the anatomically divided areas. Blue squares mean the areas of the virtual forces that contain the FSR sensors in them.
Sensors 18 04349 g001
Figure 2. Flow chart of the ANN algorithm for estimating the GRF and calibrating the CoP of the insole.
Figure 2. Flow chart of the ANN algorithm for estimating the GRF and calibrating the CoP of the insole.
Sensors 18 04349 g002
Figure 3. Picture of experimental setup. All experiments were done wearing the F-Scan system in-shoe sensor and low-cost FSR foot sensor simultaneously. (1), (2), (3) represents the shoe, developed FSR foot sensor, and the F-Scan in-shoe sensor respectively. And they are piled up in order.
Figure 3. Picture of experimental setup. All experiments were done wearing the F-Scan system in-shoe sensor and low-cost FSR foot sensor simultaneously. (1), (2), (3) represents the shoe, developed FSR foot sensor, and the F-Scan in-shoe sensor respectively. And they are piled up in order.
Sensors 18 04349 g003
Figure 4. Results of Algorithm Fitting with Different Layers of Hidden Neurons for Virtual Forces. Left graph presents the mean of error resulted by each number of hidden layers and right graph is for correlation coefficient. Each colored circle means each virtual force (Blue- F E T , Orange- F E R , Grey- F E L , Yellow- F E H , Purple- F E C , Green- F E L T ).
Figure 4. Results of Algorithm Fitting with Different Layers of Hidden Neurons for Virtual Forces. Left graph presents the mean of error resulted by each number of hidden layers and right graph is for correlation coefficient. Each colored circle means each virtual force (Blue- F E T , Orange- F E R , Grey- F E L , Yellow- F E H , Purple- F E C , Green- F E L T ).
Sensors 18 04349 g004
Figure 5. Results of algorithm fitting with different numbers of data frames. Yellow circle means the RMS error and purple one means the time duration of each layer.
Figure 5. Results of algorithm fitting with different numbers of data frames. Yellow circle means the RMS error and purple one means the time duration of each layer.
Sensors 18 04349 g005
Figure 6. (a) The CoP trajectory plot during the scan experiment by the WMA, VFA and F-Scan. The gray circles with bold edges indicate the locations of the FSR sensors. (b) One Chosen GRF trajectory plot during the scan experiment by the VFA and F-Scan.
Figure 6. (a) The CoP trajectory plot during the scan experiment by the WMA, VFA and F-Scan. The gray circles with bold edges indicate the locations of the FSR sensors. (b) One Chosen GRF trajectory plot during the scan experiment by the VFA and F-Scan.
Sensors 18 04349 g006
Figure 7. (a) One chosen CoP trajectory plot during the stance phase of the 1 km/h gait cycle experiment by the WMA, VFA and F-Scan. (b) One chosen GRF trajectory plot during the stance phase of the 1 km/h gait cycle experiment by the VFA and F-Scan.
Figure 7. (a) One chosen CoP trajectory plot during the stance phase of the 1 km/h gait cycle experiment by the WMA, VFA and F-Scan. (b) One chosen GRF trajectory plot during the stance phase of the 1 km/h gait cycle experiment by the VFA and F-Scan.
Sensors 18 04349 g007
Figure 8. Bar graph of the average RMSE during experiments of all subjects by the VFA (Yellow bar) and the WMA (Green bar).
Figure 8. Bar graph of the average RMSE during experiments of all subjects by the VFA (Yellow bar) and the WMA (Green bar).
Sensors 18 04349 g008
Figure 9. One chosen frame of CoP trajectory plot during the scan experiment by WMA (No Algorithm) with orange point, the VFA (Algorithm) with green point, and the reference data (F-Scan) with pink point.
Figure 9. One chosen frame of CoP trajectory plot during the scan experiment by WMA (No Algorithm) with orange point, the VFA (Algorithm) with green point, and the reference data (F-Scan) with pink point.
Sensors 18 04349 g009
Table 1. Body state information of subjects.
Table 1. Body state information of subjects.
Subject No.GenderAgeHeight (cm)Weight (kg)Shoe Size
1Male2617967US8
2Male2718074US8
3Male2417371US8
4Male2418577US8
5Male3217372US8
6Male3417170US8
7Male3817379US8
8Male3516974US8
Table 2. The RMSE (Root Mean Square Error) of the estimated GRF and the calibrated CoP by VFA and correlation coefficient (CC) of the estimated GRF and the calibrated CoP by VFA and WMA.
Table 2. The RMSE (Root Mean Square Error) of the estimated GRF and the calibrated CoP by VFA and correlation coefficient (CC) of the estimated GRF and the calibrated CoP by VFA and WMA.
Subject No.RMSE of GRF(N) by VFARMSE of CoP(mm) by VFA
ScanGait 1Gait 2SquatSTSScanGait 1Gait 2SquatSTS
121.4326.4626.7925.0819.007.438.476.1410.567.44
223.9935.5546.2832.1716.975.385.798.717.369.56
327.6545.7028.1129.5117.399.9413.6510.284.380.80
428.8334.2840.3544.6038.309.7411.314.645.755.60
527.7023.5728.4140.4820.698.388.707.0515.510.29
633.7529.7432.9832.8815.669.4015.798.3711.9014.71
732.4554.5830.8032.5820.569.494.877.238.587.00
832.8622.1918.0420.9214.376.984.757.064.618.06
Avg.28.5834.0131.4732.2820.378.349.177.448.587.93
RMSE of CoP(mm) by WMACC of GRF by VFA
115.0714.2714.1514.7015.400.930.960.950.930.93
211.3423.0722.2018.7714.190.940.960.980.930.95
317.4023.0616.7116.5320.600.950.940.970.970.96
412.7520.8621.8012.7810.90.940.960.940.860.94
511.0312.0512.0017.419.440.940.990.990.720.96
618.8821.1114.2620.6820.100.840.940.960.900.96
710.8811.4917.5714.2518.050.920.890.970.940.95
814.6926.1718.5421.4319.120.940.990.990.970.95
Avg.14.0119.0117.1517.0717.230.930.950.970.900.95
CC of CoP X by VFACC of CoP Y by VFA
10.990.990.990.830.740.960.880.700.620.46
20.990.990.990.960.961.000.710.600.650.77
30.980.980.980.730.770.970.970.940.660.62
40.990.961.000.840.640.990.840.700.460.26
51.000.991.000.910.940.980.920.870.680.43
60.980.980.990.930.980.960.690.540.550.65
70.990.980.980.850.880.960.860.750.690.71
80.990.990.990.970.980.970.840.670.860.90
Avg.0.990.980.990.880.860.970.840.720.650.6
CC of CoP X by WMACC of CoP Y by WMA
10.980.970.980.890.650.940.650.400.060.33
20.960.950.940.920.940.990.670.350.580.69
30.970.960.980.590.680.960.910.750.600.62
40.980.930.960.700.180.980.610.850.420.13
50.990.970.980.920.920.820.690.710.720.31
60.950.940.970.740.960.930.500.490.510.58
70.980.960.960.850.890.950.800.550.520.55
80.980.970.950.950.950.930.780.310.780.86
Avg.0.970.960.970.820.770.940.700.550.520.51
Gait 1 means gait at 1 km/h, Gait 2 means walking at 2 km/h and STS means sit to stand.
Table 3. Numerical values of frame in Figure 9.
Table 3. Numerical values of frame in Figure 9.
Numerical ValueDivided Area of Insole
ABCDEF
ADC Value55132015400
Estimated Virtual Force (N)23.418104.2420286.74300
Proportional Rate of ADC Value12.402.800
Proportional Rate of Estimated Virtual Force14.45012.2400
X Coordinate of FSR Sensor7121225.59.253.5
Estimated Moving X Coordinate of Divided Area5.68412.034NaN25.692NaNNaN
NaN means “Not a Number” because we didn’t estimate the coordinates of areas if there were no pressure value on the FSR sensors.
Table 4. Fitted constants for multiple linear regression of estimated force of B area.
Table 4. Fitted constants for multiple linear regression of estimated force of B area.
Constants
a 0 a 1 a 2 a 3 a 4 a 5 a 6
Value79.1600.3163.1550.321−0.387−0.016−1.253

Share and Cite

MDPI and ACS Style

Choi, H.S.; Lee, C.H.; Shim, M.; Han, J.I.; Baek, Y.S. Design of an Artificial Neural Network Algorithm for a Low-Cost Insole Sensor to Estimate the Ground Reaction Force (GRF) and Calibrate the Center of Pressure (CoP). Sensors 2018, 18, 4349. https://doi.org/10.3390/s18124349

AMA Style

Choi HS, Lee CH, Shim M, Han JI, Baek YS. Design of an Artificial Neural Network Algorithm for a Low-Cost Insole Sensor to Estimate the Ground Reaction Force (GRF) and Calibrate the Center of Pressure (CoP). Sensors. 2018; 18(12):4349. https://doi.org/10.3390/s18124349

Chicago/Turabian Style

Choi, Ho Seon, Chang Hee Lee, Myounghoon Shim, Jong In Han, and Yoon Su Baek. 2018. "Design of an Artificial Neural Network Algorithm for a Low-Cost Insole Sensor to Estimate the Ground Reaction Force (GRF) and Calibrate the Center of Pressure (CoP)" Sensors 18, no. 12: 4349. https://doi.org/10.3390/s18124349

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop