<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xml:lang="en" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">Sensors</journal-id>
<journal-title>Sensors</journal-title>
<issn pub-type="epub">1424-8220</issn>
<publisher>
<publisher-name>Molecular Diversity Preservation International (MDPI)</publisher-name></publisher></journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3390/s110302611</article-id>
<article-id pub-id-type="publisher-id">sensors-11-02611</article-id>
<article-categories>
<subj-group>
<subject>Article</subject></subj-group></article-categories>
<title-group>
<article-title>User Identification Using Gait Patterns on UbiFloorII</article-title></title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Yun</surname><given-names>Jaeseok</given-names></name></contrib>
<aff id="af1-sensors-11-02611">U-embedded Convergence Research Center, Korea Electronics Technology Institute, 68 Yatap-dong Bundang-gu, Seongnam, Korea; E-Mail: <email>jaeseok@keti.re.kr</email>; Tel.: +82-31-789-7581; Fax: +82-31-789-7589</aff></contrib-group>
<pub-date pub-type="collection">
<year>2011</year></pub-date>
<pub-date pub-type="epub">
<day>1</day>
<month>3</month>
<year>2011</year></pub-date>
<volume>11</volume>
<issue>3</issue>
<fpage>2611</fpage>
<lpage>2639</lpage>
<history>
<date date-type="received">
<day>10</day>
<month>1</month>
<year>2011</year></date>
<date date-type="rev-recd">
<day>7</day>
<month>2</month>
<year>2011</year></date>
<date date-type="accepted">
<day>22</day>
<month>2</month>
<year>2011</year></date></history>
<permissions>
<copyright-statement>© 2011 by the authors; licensee MDPI, Basel, Switzerland.</copyright-statement>
<copyright-year>2011</copyright-year>
<license>
<p>This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).</p></license></permissions>
<abstract>
<p>This paper presents a system of identifying individuals by their gait patterns. We take into account various distinguishable features that can be extracted from a user’s gait and then divide them into two classes: walking pattern and stepping pattern. The conditions we assume are that our target environments are domestic areas, the number of users is smaller than 10, and all users ambulate with bare feet considering the everyday lifestyle of the Korean home. Under these conditions, we have developed a system that identifies individuals’ gait patterns using our biometric sensor, <italic>UbiFloorII</italic>. We have created UbiFloorII to collect walking samples and created software modules to extract the user’s gait pattern. To identify the users based on the gait patterns extracted from walking samples over UbiFloorII, we have deployed multilayer perceptron network, a feedforward artificial neural network model. The results show that both walking pattern and stepping pattern extracted from users’ gait over the UbiFloorII are distinguishable enough to identify the users and that fusing two classifiers at the matching score level improves the recognition accuracy. Therefore, our proposed system may provide unobtrusive and automatic user identification methods in ubiquitous computing environments, particularly in domestic areas.</p></abstract>
<kwd-group>
<kwd>user identification</kwd>
<kwd>gait recognition</kwd>
<kwd>walking pattern</kwd>
<kwd>stepping pattern</kwd>
<kwd>UbiFloorII</kwd></kwd-group></article-meta></front>
<body>
<sec sec-type="intro">
<label>1.</label>
<title>Introduction</title>
<p>For the past decade, we have increasingly depended on computers to store and process information pertinent to our daily lives. Thus, an effective method for securing access control to computers has been very important. In conventional computer systems, surrogate representations of identity such as a password and personal identification numbers (PINs) have proven successful. However, because passwords and PINs can be easily guessed, observed, or forgotten, they are not very practical or secure. Moreover, ubiquitous computing environments necessitate reliable user identification through automatic, transparent, and often remote means.</p>
<p>One possible solution to providing automatic, secure, and user-friendly personal identification lies in the area of biometrics, which refers to the automatic recognition of people based on their distinctive anatomical (e.g., face, fingerprint, iris, retina, hand geometry) and behavioral (e.g., signature, gait) characteristics [<xref ref-type="bibr" rid="b1-sensors-11-02611">1</xref>]. Of these characteristics, we focus on gait, which is a particular way or manner of moving on foot. Considerable evidence that gait is unique in its ability to determine one’s identity [<xref ref-type="bibr" rid="b2-sensors-11-02611">2</xref>,<xref ref-type="bibr" rid="b3-sensors-11-02611">3</xref>], thus supporting the use of one’s gait in recognition, has been reported in other domains such as biomechanics, mathematics, and psychology. Gait is attractive as a biometric identifier because it is unobtrusive and typifies the motion characteristics specific to an individual because it can be detected and measured at both a low resolution and a long distance [<xref ref-type="bibr" rid="b4-sensors-11-02611">4</xref>]. In this study, we present the practical design of a floor system and a user identification method that extracts various distinguishable features from the gaits of various users over the floor system.</p>
<p>We assume that the target application is a domestic environment, the number of users is smaller than 10, and all users walk in bare feet, a typical Korean custom in the home. Under these assumptions, we have created a floor-based system, UbiFloorII, which consists of a large number of photo interrupter sensors in wooden tiles. We have gathered walking samples while the experimental participants walk over the floor and extracted various features from the walking samples. In UbiFloorII, we employed not only the walking pattern such as stride length but also richer information on the human gait such as cadence or stepping pattern. We collected walking samples from ten participants that maintained their ordinary walking style. These walking datasets provide the input for the training and testing procedure of multilayer perceptron as well as other classifiers for evaluation. We next developed feature extraction procedures using MATLAB, from which we could extract both the walking and stepping patterns from the walking samples. For each of the patterns, we trained the neural network with supervised learning, in which the learning rule was provided with a set of examples of proper network behavior, and then identified unknown walking samples with the well-trained neural network. We also implemented the neural network using MATLAB together with the feature extraction procedures. In order to show the stability of our identification method, we performed experiments with different classification methods including support vector machine, <italic>k</italic>-nearest neighbor algorithm, decision tree, decision table, and Bayes net. Finally, inspired by multi-modal biometric identification systems, we explored the fusion of the walking pattern and the stepping pattern at the matching score level for robust identification performance.</p>
<p>The proposed design of the floor-based identification system—given in terms of sensors, floor tiles, data acquisition and transmission, feature extraction module, and user identification module—appears to be appropriate for a laboratory environment but not a home environment. However, we discuss the remaining challenges for developing practical floor systems that can be adopted in a real home as a device that identifies its occupants. From these experiments, we conclude with confidence that a device that identifies individuals based on their walking and stepping patterns extracted from gait over the floor systems is feasible in practical terms.</p>
<p>The organization of the paper is as follows. Section 2 introduces various user identification systems using gait. Section 3 demonstrates a variety of features in human gait available for user identification. Section 4 describes the UbiFloorII systems. Section 5 explains the feature extraction procedures and user identification methods. Section 6 presents our data collection procedure and the feature sets we used. Section 7 presents experimental results with our proposed methods and the walking samples gathered with the floor system we developed. Section 8 presents the evaluation study for performance analysis and the fusion of walking pattern and stepping pattern. Section 9 discusses our observations on the results, and we offer concluding remarks in Section 10.</p></sec>
<sec>
<label>2.</label>
<title>Related Work</title>
<p>Gafurov has demonstrated a good survey of biometric gait recognition based on the various approaches, including machine vision, floor sensor, and wearable sensor [<xref ref-type="bibr" rid="b5-sensors-11-02611">5</xref>]. As summarized by Gafurov, depending on the type of biometric sensors, gait recognition systems are classified into three main categories: (i) vision-based approach, (ii) floor-based approach, and (iii) portable sensor-based approach.</p>
<sec>
<label>2.1.</label>
<title>Vision-Based Gait Recognition</title>
<p>Vision-based gait recognition focuses on recognizing an individual with various features extracted from a video-sequence of the person walking. In comparison with other biometric features such as fingerprints, vision-based gait recognition has the advantage of being unobtrusive. For example, iris recognition systems have an obtrusive interface because an individual must exhibit specific behavior (e.g., gazing in a specific direction or remaining still during a recognition latency time) to be identified. However, vision-based gait recognition systems require no individual contact other than walking. So far, the gait is probably the only perceivable biometric feature from a great distance and at a low resolution in comparison with face recognition systems. Nixon <italic>et al.</italic> presented an extensive survey of the various vision-based identification methods based on human gait [<xref ref-type="bibr" rid="b6-sensors-11-02611">6</xref>]. Most current vision-based approaches are based on analysis of silhouettes in the sequences of images of walking human subjects. They may be explicitly classified into two main categories: (i) model-based analysis and (ii) model-free analysis.</p>
<p>The model-based analysis aims to explicitly model the human body or motion, and they usually perform model matching in each frame of a walking sequence so that the parameters such as trajectories are measured on the model. BenAbdelkader <italic>et al.</italic> estimated the cadence and stride length from low-resolution video based solely on the periodicity of the walking person and a calibrated camera [<xref ref-type="bibr" rid="b7-sensors-11-02611">7</xref>]. Bobick and Johnson extracted relative body parameters from action of waking to describe the subject’s body and stride [<xref ref-type="bibr" rid="b8-sensors-11-02611">8</xref>]. Tanawongsuwan <italic>et al.</italic> deployed joint angle trajectories extracted from markers placed on joint positions in the legs and on the thorax [<xref ref-type="bibr" rid="b9-sensors-11-02611">9</xref>]. Yam <italic>et al.</italic> explored the intimate relationship between walking and running that was expressed as a mapping based on the idea of phase modulation [<xref ref-type="bibr" rid="b10-sensors-11-02611">10</xref>]. Zhang <italic>et al.</italic> used the change in orientation of human limbs [<xref ref-type="bibr" rid="b11-sensors-11-02611">11</xref>].</p>
<p>The model-free analysis establishes a correspondence between successive frames based on the prediction or estimation of features related to position, velocity, shape, texture, and color. Kale <italic>et al.</italic> considered the width of the outer contour of a binarized silhouette [<xref ref-type="bibr" rid="b2-sensors-11-02611">2</xref>] while Sundaresan <italic>et al.</italic> considered the entire binary silhouette itself [<xref ref-type="bibr" rid="b12-sensors-11-02611">12</xref>]. Vega and Sarkar used the change in the relational statistics among the detected image features, removing the need for object models, perfect segmentation, or part-level tracking [<xref ref-type="bibr" rid="b13-sensors-11-02611">13</xref>]. Liu and Sarkar developed an average silhouette as the simplest recognition feature [<xref ref-type="bibr" rid="b14-sensors-11-02611">14</xref>]. Collins <italic>et al.</italic> deployed key frame analysis for sequence matching with innate viewpoint dependence [<xref ref-type="bibr" rid="b15-sensors-11-02611">15</xref>]. Lee and Grimson deployed ellipsoidal fits to human silhouettes [<xref ref-type="bibr" rid="b16-sensors-11-02611">16</xref>]. The feature vector is composed of parameters of moment features in image regions derived from silhouettes. Bhanu <italic>et al.</italic> considered kinematic and stationary features by estimating 3D walking parameters by fitting a 2D kinematic model to 2D silhouettes [<xref ref-type="bibr" rid="b17-sensors-11-02611">17</xref>]. Similarly, Han <italic>et al.</italic> used gait energy image formed by averaging silhouettes [<xref ref-type="bibr" rid="b18-sensors-11-02611">18</xref>].</p></sec>
<sec>
<label>2.2.</label>
<title>Floor-Based Gait Recognition</title>
<p>The main difference between the floor- and vision-based approaches lies in the biometric sensor used in the vision-based approach: a camera. This unobtrusive and transparent interface of vision-based gait recognition provides a strong advantage over other contact-type biometric recognition approaches such as iris recognition. Unfortunately, however, a camera is not always an optimal approach, as it is sensitive to environmental factors such as shadow and light intensity. Moreover, camera surveillance can compromise an individual’s privacy. Such an intrusion in privacy-sensitive environments such as one’s home has been the target of criticism in vision research. In the floor-based approach, by contrast, a floor is used as a biometric sensor that gathers the various features of one’s gait. Therefore, the floor-based approach not only preserves individual privacy but also withstands the effects of shadow and light. Like the vision-based approach, floor-based gait recognition begins from the notion that gait is observable, distinguishable, and idiosyncratic. Because a floor is the biometric sensor, measurable information is obtained from only the soles of an individual’s feet. Thus, the features for recognition are somewhat different from those of the vision-based approach.</p>
<p>Stride length and cadence are attributed to physical makeup such as height, body mass, and the lengths of limbs. Actually, many vision-based studies have examined how stride length and cadence in human walking can be employed for gait recognition [<xref ref-type="bibr" rid="b7-sensors-11-02611">7</xref>,<xref ref-type="bibr" rid="b19-sensors-11-02611">19</xref>,<xref ref-type="bibr" rid="b20-sensors-11-02611">20</xref>]. Demonstrating the effectiveness of stride length and cadence in discriminating the gait of individuals, these studies contended that stride length and cadence could be used as biometric identifiers. They estimated cadence and stride length from a video-sequence by using the periodicity of the walking person and calibrated cameras. This style of human recognition provided the motivation for the research into the feasibility of a floor-based identification system in which walking features such as stride length and cadence could be employed. The first use of walking features as a biometric identifier in floor-based gait recognition systems was UbiFloorI developed in [<xref ref-type="bibr" rid="b21-sensors-11-02611">21</xref>]. Strictly speaking, the feature they used was not stride length but center positions of footprints over multiple footsteps. However, considering the longitudinal and transversal differences between consecutive center positions of footsteps represent the variation of stride length and dynamic range respectively, UbiFloorI might be the first floor-based gait recognition system exploiting walking features including stride length and dynamic range. UbiFloorI consists of 144 inexpensive ON/OFF switch sensors (14 cm by 2.5 cm) fitted onto cushioned carpet and a data acquisition (DAQ) board for measuring and transmitting the data from the sensors. They extracted walking patterns, including stride length, dynamic range, and foot angle from a dataset of switch sensors and use a neural network to identify unknown walking samples. The experimental results showed about 90% recognition accuracy with 10 subjects. UbiFloorI provides users with a transparent and user-friendly interface because the only task users need to do is to walk naturally. However, time information such as stance and swing time (or cadence) was unavailable because of the unique mechanical characteristics of the switch sensors and the low resolution of the floor. Middleton <italic>et al.</italic> developed a prototype floor sensor (0.5 m by 3 m) composed of 1536 force sensitive resistors (FSR) and 3 PIC 16F84A microprocessors [<xref ref-type="bibr" rid="b22-sensors-11-02611">22</xref>]. They collected dataset from 15 individuals and extracted walking pattern such as stride length and cadence and stepping pattern such as time on toe to time on heel ratio. Based on the features, they achieved an 80% recognition rate. More recently, Qian <italic>et al.</italic> developed a high-resolution pressure sensing floor to obtain 1D pressure profile and 2D position trajectories of the centers of pressure (COP) of both feet, forming a 3D COP trajectories over a footstep. Based on the 3D COP trajectories, they extracted various features such as stride length and mean pressure, and showed an average recognition rate of 92.3% with walking dataset collected from 11 subjects and Fisher linear discriminant classifier [<xref ref-type="bibr" rid="b23-sensors-11-02611">23</xref>,<xref ref-type="bibr" rid="b24-sensors-11-02611">24</xref>].</p>
<p>When a body is in contact with the ground, the downward force due to gravity is reflected back onto the body as a reaction. This reflected force is referred to as <italic>ground reaction force</italic> (GRF). Several attempts to use GRF for gait recognition can be seen in [<xref ref-type="bibr" rid="b25-sensors-11-02611">25</xref>–<xref ref-type="bibr" rid="b27-sensors-11-02611">27</xref>]. However, the focus of these efforts has been in diagnose and therapy rather than recognition and identification. The first attempt to deploy GRF for human recognition was the active floor [<xref ref-type="bibr" rid="b28-sensors-11-02611">28</xref>], which consists of a 4 × 4 array of load cells. Each load cell supports the corners of four adjacent floor tiles. Addlesee extracted features from the vertical ground reaction force traces derived from an individual’s footsteps and used a hidden Markov model to recognize differences in their stepping patterns. Experimental results showed that the active floor correctly identified the footsteps of 15 subjects with 91% accuracy. Orr and Abowd’s work with the smart floor resembles that with the active floor [<xref ref-type="bibr" rid="b29-sensors-11-02611">29</xref>]. They extracted 10 features from the vertical ground reaction force profiles of individuals and used the nearest neighbor search in 10-dimensional feature space to identify unknown footsteps. The method correctly identified the footsteps of the 15 subjects with 93% accuracy. Suutala <italic>et al.</italic> demonstrated a floor composed of simple binary switch sensors to detect footsteps and extract walking characteristics, and showed 84% total recognition rate with walking profiles collected from 9 subjects and a Bayesian approach using a Gaussian Process classifier [<xref ref-type="bibr" rid="b30-sensors-11-02611">30</xref>].</p>
<p>Another method of identifying a person through gait recognition is using a static footprint, which is a footprint left after a person passes. Kennedy showed the possibility of identifying individuals through the pressure areas on the soles of their feet [<xref ref-type="bibr" rid="b31-sensors-11-02611">31</xref>]. Nakajima measured the pressure distribution of a footprint with a pressure-sensing mat [<xref ref-type="bibr" rid="b32-sensors-11-02611">32</xref>]. They showed an 85% recognition rate with 10 subjects. In this study, they assumed that the footprint-based identification and verification system would not work for the security application, but it could work for personal recognition in a small group such as that found in a home environment. Unlike the static footprint, a dynamic footprint can be defined differently depending on its biometric sensors. An example of a dynamic footprint is the GRF profile mentioned above. Jung defined a dynamic footprint as a COP (center of pressure) trajectory while stepping heel-strike to toe-off [<xref ref-type="bibr" rid="b33-sensors-11-02611">33</xref>]. They measured a quantized COP trajectory from a mat-type pressure sensor and used a hidden Markov model to create probability models for each foot of a user. Their experimental results showed an 80% recognition rate with 8 subjects. In this paper, we present a new dynamic footprint, an array of transitional footprints over the floor we developed for user identification.</p></sec>
<sec>
<label>2.3.</label>
<title>Portable Sensor-Based Gait Recognition</title>
<p>The most recent approach in gait recognition is the portable sensor-based approach, in which accelerometers are normally used as biometric sensors. Like the floor-based approach, the accelerometer-based approach has several advantages. One is that it has an unobtrusive interface, and it does not compromise a user’s privacy. On the other hand, it requires users to carry or attach an accelerometer and a motion-recording device on their bodies for identification. In the sensor-based method, accelerometers attached to several parts of the body such as the hip, the lower leg, or the waist, measure acceleration signal characteristics while the user is walking. Features are extracted from the output of the device accelerations in vertical, forward-backward, or sideways directions. Examples of accelerometer-based gait recognition systems include [<xref ref-type="bibr" rid="b34-sensors-11-02611">34</xref>–<xref ref-type="bibr" rid="b36-sensors-11-02611">36</xref>].</p></sec></sec>
<sec>
<label>3.</label>
<title>Features in Gait</title>
<p>We may assume that the human gait motion consists of a sequence of footsteps that an individual follows while walking. Thus, we expect that some distinguishable characteristics with respect to the footsteps in the sequence can be extracted and used for recognition by considering the spatiotemporal variations of the observations. Through this paper, we define <italic>walking pattern</italic> as a spatiotemporal variation (e.g., stride length, dynamic range, foot angle, and stance and swing time that can be extracted from a sequence of an individual’s footsteps, illustrated in <xref ref-type="fig" rid="f1-sensors-11-02611">Figure 1</xref>.</p>
<p><italic>Stepping pattern</italic> is defined as a temporal variation (e.g., transitional footprint and ground reaction force) that can be extracted from an individual’s footsteps during the stepping heel-strike to toe-off, illustrated in <xref ref-type="fig" rid="f2-sensors-11-02611">Figure 2</xref>. Thus, this paper will demonstrate whether the walking and stepping patterns extracted from one’s gait over our developed floor systems can be employed to identify the participants in domestic environments.</p></sec>
<sec>
<label>4.</label>
<title>UbiFloorII System</title>
<p>To acquire a dataset of the footsteps of the experimental participants walking normally, we have developed the UbiFloorII system composed of photo interrupter sensors and wooden floor tiles. <xref ref-type="fig" rid="f3-sensors-11-02611">Figure 3</xref> shows the overall structure of the UbiFloorII system, which consists of a 12 × 2 array of wooden tiles, each of which measures 30 cm × 30 cm and contains 64 uniformly-arranged photo interrupter sensors. A photo interrupter is non-contact and can convert the extent of reflective light to corresponding voltage. In our system, if an obstacle exists within detectable distance (3 mm), it generates 0 V voltage output, otherwise 5 V. We use DG-105 from Kodenshi Corp. and it measures 5 mm × 5 mm.</p>
<p><xref ref-type="fig" rid="f4-sensors-11-02611">Figure 4</xref> shows the appearances of the photo interrupters and a corresponding electric circuit. A micro-controller is responsible for data acquisition from a corresponding tile and transmits the obtained information to the host PC through the CAN (controller area network) cable. Then, the host PC extracts features from the data and using a well-trained neural network, recognizes the user. With the transparent and user-friendly interface inherited from UbiFloorI, UbiFloorII can more easily be extended and maintained due to its modularized architecture. <xref ref-type="fig" rid="f5-sensors-11-02611">Figure 5</xref> shows a wooden tile and the implemented UbiFloorII system. We have left out the full-detailed organization of the floor system, including the sensor, data acquisition, and data transmission [<xref ref-type="bibr" rid="b37-sensors-11-02611">37</xref>].</p></sec>
<sec>
<label>5.</label>
<title>User Identification with UbiFloorII</title>
<p>To identify individuals when they normally walk over the floor system, we need to extract the walking and stepping patterns, both distinguishable features mentioned previously. We presented the practical feasibility of the user identification method based on walking and stepping patterns over UbiFloorII in [<xref ref-type="bibr" rid="b37-sensors-11-02611">37</xref>] and [<xref ref-type="bibr" rid="b38-sensors-11-02611">38</xref>], respectively. Here, we present the full details of the walking and stepping features we used and the user identification method.</p>
<sec>
<label>5.1.</label>
<title>Walking Pattern Extraction</title>
<p>The software modules we develop for extracting a user’s walking pattern from data sets fall into two categories: (i) left footprint extraction and (ii) walking feature extraction. The left footprint extraction software is used to search for all footprints in the datasets received while one is walking over UbiFloorII, as shown in <xref ref-type="fig" rid="f6-sensors-11-02611">Figure 6</xref>.</p>
<p>We create an 8 × 4 footprint model that covers all probable footprints and choose three features as follows:
<list list-type="bullet">
<list-item>
<p>The <italic>X</italic> index of the backmost sensor in a footprint</p></list-item>
<list-item>
<p>The <italic>Y</italic> index of the backmost sensor in a footprint</p></list-item>
<list-item>
<p>The footprint model of a footstep</p></list-item></list></p>
<p><xref ref-type="fig" rid="f7-sensors-11-02611">Figure 7</xref> displays a footprint model extracted from the footprint in STEP 1 of <xref ref-type="fig" rid="f6-sensors-11-02611">Figure 6</xref>. As shown in <xref ref-type="fig" rid="f7-sensors-11-02611">Figure 7</xref>, the backmost sensor in a footprint becomes the seed sensor, from which the other features can be extracted.</p>
<p>We extract spatiotemporal walking features using the feature values obtained from left footprint extraction as inputs of the walking feature extracting software. We adopt seven walking features as follows:
<list list-type="bullet">
<list-item>
<p><italic>FX</italic> and <italic>FY</italic> : the physical <italic>X</italic> and <italic>Y</italic> coordinates of the backmost sensor in a footprint</p></list-item>
<list-item>
<p><italic>com_FX</italic> and <italic>com_FY</italic>: the compensated <italic>X</italic> and <italic>Y</italic> coordinates based on the footprint model</p></list-item>
<list-item>
<p><italic>nSensor</italic>: the number of pressed sensors in the footprint</p></list-item>
<list-item>
<p><italic>fStart</italic>: heel-strike time of the footstep</p></list-item>
<list-item>
<p><italic>fEnd</italic>: toe-off time of the footstep</p></list-item></list></p>
<p><italic>FX</italic> and <italic>FY</italic> represent the physical <italic>X</italic> and <italic>Y</italic> coordinates of the seed sensor in a footprint with the bottom-left corner of UbiFloorII as the origin. The coordinates <italic>com_FX</italic> and <italic>com_FY</italic> represent the center of the footprint based on the footprint model, as shown in <xref ref-type="fig" rid="f8-sensors-11-02611">Figure 8</xref>. Practically, <italic>com_FX</italic> and <italic>com_FY</italic> comprehend the user’s stride length, dynamic range, and foot angle. <italic>fStart</italic> and <italic>fEnd</italic> imply the user’s stance and swing time in walking. Finally, to create input vectors to the neural network, we need to generate the sequences of each walking feature in terms of the footsteps, such as [<italic>com_FX</italic>1, <italic>com_FX</italic>2, <italic>com_FX</italic>3, . . . ].</p></sec>
<sec>
<label>5.2.</label>
<title>Stepping Pattern Extraction</title>
<p>To extract the stepping pattern in each footprint, we need to analyze the temporal variation of each footstep. Transitional footprint extracting software is used to analyze the variation of transitional footprints from heel-strike to toe-off in each footstep. Based on the left footprint obtained from the walking pattern extraction procedure, we obtain an array of transitional footprints in terms of the occurrence times of the events (i.e., changes in the states of the sensors). The array of transitional footprints extracted from the STEP 1 footprint in <xref ref-type="fig" rid="f6-sensors-11-02611">Figure 6</xref> is shown in <xref ref-type="fig" rid="f9-sensors-11-02611">Figure 9</xref>, where the digit values denote the occurrence times (seconds) of the events. Finally, to make a standard of the stepping pattern, we extract the array of sampled transitional footprints at a uniform sampling time from the array of original transitional footprints. <xref ref-type="fig" rid="f10-sensors-11-02611">Figure 10</xref> shows the array of sampled transitional footprints extracted from <xref ref-type="fig" rid="f9-sensors-11-02611">Figure 9</xref> with a sampling time of 0.04 (s).</p>
<p>For user identification, we adopted two stepping features as follows:
<list list-type="bullet">
<list-item>
<p>The left footprint</p></list-item>
<list-item>
<p>The array of sampled transitional footprints</p></list-item></list></p>
<p>To create input vectors to our neural network, we need to convert the left footprint and the array of sampled transitional footprints to the vectors. In the case of the left footprint, each gray square in <xref ref-type="fig" rid="f7-sensors-11-02611">Figure 7</xref> is represented by a “−1”, and each dark square is represented by a “1”. Then, to create the input vectors, we scan the 8 × 4 left footprint of one column (<italic>i.e.</italic>, four sensors) at a time. For example, in <xref ref-type="fig" rid="f7-sensors-11-02611">Figure 7</xref>, the input vector to the neural network looks like [−1 −1 −1 1 −1 −1 −1 1 . . . ]. In the case of the sampled transitional footprints, the process is similar to that in the case of the left footprint, except that the number of rows is 8 multiplied by the number of elements in the array (e.g., 18 in <xref ref-type="fig" rid="f10-sensors-11-02611">Figure 10</xref>).</p></sec>
<sec>
<label>5.3.</label>
<title>User Identification</title>
<p>We use multilayer perceptron networks to identify individuals based on the extracted walking and stepping features [<xref ref-type="bibr" rid="b39-sensors-11-02611">39</xref>]. Inspired by biological neurons, neural networks (along with their components) consist of simple neurons, and the connections among them determine the function of the network. The network is trained to perform special tasks such as modifying the weights and biases of a network by applying the learning rule. The learning rule used in this work is the back-propagation algorithm. If well-trained with the back-propagation learning algorithms, the multilayer perceptron can correctly classify the samples even if they are unknown during network training.</p>
<p>The neural network that we deploy for identifying users by their walking patterns has the same structure as the neural network for identifying users by their stepping patterns, and both neural networks consist of three layers, as shown in <xref ref-type="fig" rid="f11-sensors-11-02611">Figure 11</xref>: (i) an input layer <italic>N</italic><sub>1</sub> with <italic>P</italic><sub>1</sub> neurons, (ii) a hidden layer <italic>N</italic><sub>2</sub> with <italic>P</italic><sub>2</sub> neurons, and (iii) an output layer <italic>N</italic><sub>3</sub> with <italic>P</italic><sub>3</sub> neurons. In the neural network for identifying an individual’s walking pattern, the number of neurons in the input layer is equal to the number of walking features <italic>F<sub>N</sub></italic> times the number of walking steps <italic>S<sub>N</sub></italic>. Likewise, in the neural network for identifying an individual’s stepping pattern, if the number of the elements in the step features is <italic>F<sub>N</sub></italic> and the number of footsteps used is <italic>S<sub>N</sub></italic>, then the total number of input neurons, <italic>P</italic><sub>1</sub> is equal to <italic>F<sub>N</sub> × S<sub>N</sub></italic>. The number of neurons <italic>P</italic><sub>2</sub> in the hidden layer <italic>N</italic><sub>2</sub> is selected by experiments and the number of neurons <italic>P</italic><sub>3</sub> in the output layer <italic>N</italic><sub>3</sub> is equal to the number of users <italic>M</italic>. Because the neural network is trained with supervised learning, the learning rule is provided with a set of examples (<italic>i.e.</italic>, the training set) of proper network behavior. We have used sigmoid activation functions trained with backpropagation.</p>
<p>The training procedure for our network is as follows. In the neural network for walking pattern-based identification, we need to perform preprocessing; that is, we must normalize the input values to the network. In contrast, in the neural network for stepping pattern-based identification, the preprocessing procedure is not needed in our neural network because all elements of the input vectors are digital values. Thus, the input vectors converted from the left footprints or the arrays of sampled transitional footprints will be direct inputs to the neurons of the input layer in our network. The learning rule is used to adjust the weights and biases of the network in order to move the network outputs closer to the targets. Given a test sample for the well-trained network, we can choose the index number of the output node with maximum output values as the user’s identification number.
<disp-formula id="FD1">
<label>(1)</label>
<mml:math display="block">
<mml:mrow>
<mml:mi mathvariant="italic">User</mml:mi>
<mml:mo>_</mml:mo>
<mml:mi mathvariant="italic">Number</mml:mi>
<mml:mo>=</mml:mo>
<mml:mi mathvariant="italic">max</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>O</mml:mi>
<mml:mn>1</mml:mn></mml:msub>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mi>O</mml:mi>
<mml:mn>2</mml:mn></mml:msub>
<mml:mo>,</mml:mo>
<mml:mo>…</mml:mo>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mi>O</mml:mi>
<mml:mi>M</mml:mi></mml:msub></mml:mrow>
<mml:mo>)</mml:mo></mml:mrow></mml:mrow></mml:math></disp-formula>where <italic>O<sub>i</sub></italic> denotes the output values of the <italic>i</italic>-th node, and <italic>M</italic> is the number of users (<italic>i.e.</italic>, 10).</p></sec></sec>
<sec>
<label>6.</label>
<title>Experiment Setup</title>
<sec sec-type="methods">
<label>6.1.</label>
<title>Data Collection and Experimental Conditions</title>
<p>Our experiments consisted of capturing walking samples from 10 experimental participants volunteered from the academic community. Data was collected from 10 males. Participants ranged in age from 27 to 35 (see <xref ref-type="table" rid="t1-sensors-11-02611">Table 1</xref>). For each subject, we gathered 50 walking samples. We collected a total of 500 walking samples from each participant walking on the UbiFloorII system. Depending on the user’s stride length, it takes from five or six footsteps to cross UbiFloorII. Therefore, we consider only the first five steps (STEP_1 – STEP_5). All the subjects were asked to walk as normally as possible and given the option to listen to soothing music. Moreover, they were asked to walk with bare feet, reflecting the daily custom followed in the Korean homes. In order to mitigate any variation in their gaits, we imposed all of these conditions on the participants while collecting the walking samples.</p></sec>
<sec>
<label>6.2.</label>
<title>Walking Feature Sets</title>
<p>To verify the dominant walking features, we use five feature sets as inputs to the network. <xref ref-type="table" rid="t2-sensors-11-02611">Table 2</xref> shows the combinations of these features. In Case 1, coordinates <italic>FX</italic> and <italic>FY</italic> are the inputs to the network. This case is used as the standard for evaluating the results with those of the other feature sets. The other feature sets comprise the combinations of our walking features.</p></sec>
<sec>
<label>6.3.</label>
<title>Stepping Feature Sets</title>
<p>To verify the dominant footsteps in stepping features, we use four feature sets as inputs to the network. <xref ref-type="table" rid="t3-sensors-11-02611">Table 3</xref> shows the combinations of the features. In Cases 1 and 2, the odd and even footsteps of the first four footsteps, respectively, are the inputs to the network. In Case 3, the first two footsteps are the inputs to the network, and in the last case, all four footsteps are inputs. In the experiments using the array of sampled transitional footprints, various input arrays can be extracted from the left footprint in terms of the sampling times. Thus, we use five sampling times, as shown in <xref ref-type="table" rid="t4-sensors-11-02611">Table 4</xref>, in which the elapsed times of all footsteps is assumed to be less than 0.8 s.</p></sec></sec>
<sec sec-type="results">
<label>7.</label>
<title>Experiment Results</title>
<p>All the experiments based on the neural network in this study are carried out using the Neural Network Toolbox developed by the MathWorks, Inc.</p>
<sec>
<label>7.1.</label>
<title>User Identification Based on Walking Pattern</title>
<p>We first demonstrate how the number of hidden nodes influences the performance of the neural network. In an effort to decide the optimal number of hidden nodes, we run an experiment in which we increase the number of hidden nodes while keeping other parameters fixed and observe the resulting recognition accuracy. The results of one experiment with <italic>com_FX</italic>, <italic>com_FY</italic>, <italic>fStart</italic>, and <italic>fEnd</italic> features are shown in <xref ref-type="fig" rid="f12-sensors-11-02611">Figure 12</xref>. The left side of <xref ref-type="fig" rid="f12-sensors-11-02611">Figure 12</xref> shows that about 30 hidden nodes are sufficient to obtain about a 95% recognition rate. We also conduct experiments to decide the <italic>epoch</italic> and the <italic>goal</italic>. The right side of <xref ref-type="fig" rid="f12-sensors-11-02611">Figure 12</xref> shows that after 800 epochs, the mean square error is smaller than 10<sup>−3</sup>, so this value is set to the goal.</p>
<p>We present the results of the test with our feature sets and a comparative analysis in <xref ref-type="table" rid="t5-sensors-11-02611">Table 5</xref>. In this experiment, the recognition accuracies are obtained by averaging 10 simulation results changing the seed value that determines the initial values of weights and biases of the network. First, we can note that the compensation procedure for <italic>com_FX</italic> and <italic>com_FY</italic> results in about a 10% improvement in recognition accuracy. Considering Cases 2 and 3, Case 3 is worse than Case 2 (<italic>i.e.</italic>, without <italic>nSensor</italic>) because <italic>nSensor</italic> information has already influenced the compensation procedure for <italic>com_FX</italic> and <italic>com_FY</italic>. We are able to achieve about a 96% recognition accuracy when <italic>com_FX</italic>, <italic>com_FY</italic>, <italic>fStart</italic>, and <italic>fEnd</italic> features are used. Therefore, we conclude that the stance and swing time is also a dominant feature for user identification.</p>
<p>In [<xref ref-type="bibr" rid="b21-sensors-11-02611">21</xref>], they chose the physical <italic>X</italic> and <italic>Y</italic> coordinates of the center of the footprint, which produced the stride length and the dynamic range for a given individual, as the walking pattern, illustrated in <xref ref-type="fig" rid="f1-sensors-11-02611">Figure 1(a)</xref>. Even though they could not use stance and swing time information due to the low density of UbiFloorI, the experimental results exhibited a recognition accuracy of about 90%. For UbiFloorII, we used not only the features that we employed for UbiFloorI but also stance and swing time information, illustrated in <xref ref-type="fig" rid="f1-sensors-11-02611">Figure 1(b)</xref>. To observe the potential of the new time information for improving recognition accuracy, we first performed the experiments without stance and swing time, which showed a recognition accuracy of approximately 90%, which is almost the same as that of UbiFloorI. However, we observed that the recognition accuracy could be improved to as much as 96% with stance and swing time. Here, we find it very important to note that except for stance and swing time, recognition accuracy with the previous walking pattern (the physical <italic>X</italic> and <italic>Y</italic> coordinates of the center of the footprint) might not improve any more with regard to the resolution of the floor.</p></sec>
<sec>
<label>7.2.</label>
<title>User Identification Based on Stepping Pattern</title>
<p>As we did when identifying users by their walking patterns, we first demonstrate how the number of hidden nodes influences the performance of the neural network. In general, the greater the number of hidden nodes, the longer the computation time. The results in this experiment with the arrays of sampled transitional footprints (Case 4, sampling time = 0.04 s) are shown in <xref ref-type="fig" rid="f13-sensors-11-02611">Figure 13</xref>, the left side of which shows that about 30 hidden nodes are sufficient for about a 90% recognition rate. We also conducted experiments to decide the epoch and the goal. The right side of <xref ref-type="fig" rid="f13-sensors-11-02611">Figure 13</xref> shows that after 115 epochs, the mean square error (MSE) is smaller than 10<sup>−5</sup>, so this value is set to the goal. In all these experiments, we train the network using Powell-Beale and scaled conjugate gradient algorithms.</p>
<p>We present the results of the tests with our feature sets and a comparative analysis in <xref ref-type="table" rid="t6-sensors-11-02611">Table 6</xref>. The first column shows the recognition accuracies with the left footprints, and the other columns show the recognition accuracies with the arrays of sampled transitional footprints in terms of various sampling times. In these experiments, the recognition accuracies are obtained by averaging the 10 simulation results changing the seed value. The experimental results with the left footprints show that the left footprint, which expresses the static shape of the sole of the user’s foot in UbiFloorII, is not distinctive enough to recognize individuals. In the experimental results with the arrays of sampled transitional footprints, most of them show a more than 80% recognition rate. We are able to achieve about 92% recognition accuracy with the arrays of the sampled transitional footprints (Case 4, sampling time = 0.04 s). Considering Cases 1, 2, and 3, two footsteps are not sufficient to achieve more than 90% recognition accuracy without regard to the order of the footsteps and sampling time. In addition, we can note that by shortening the sampling time for extracting the array of sampled transitional footprints from the array of original transitional footprints, the performance of recognition could be improved. Nevertheless, the small sampling time requires numerous inputs to the network, causing heavy computational load. Thus, we should consider limiting the sampling time for extracting the array of sampled transitional footprints.</p>
<p>In the UbiFloorII system, we chose static footprints and an array of sampled transitional footprints, or dynamic footprints, which represent the temporal variation of the shape of the bottom of the foot making contact with the floor from heel-strike to toe-off in each footstep, as the stepping pattern, illustrated in <xref ref-type="fig" rid="f2-sensors-11-02611">Figure 2</xref>. The experimental results from the static footprints, which express the static shape of the sole of the user’s foot in UbiFloorII, showed that they are not distinctive enough for human recognition, an expected finding based on the previous study [<xref ref-type="bibr" rid="b32-sensors-11-02611">32</xref>]. The experimental results with the array of sampled transitional footprints exhibited a recognition accuracy of about 92%, but some variation obviously occurred in the recognition accuracy as a result of the sampling time. By shortening the sampling time taken to extract, we determined that the array of sampled transitional footprints and the performance of recognition could be improved. Nevertheless, a small sampling time requires numerous inputs to the network, causing heavy computational load. Thus, we would have to consider limiting the sampling time for extracting the array of sampled transitional footprints.</p>
<p>The problem mentioned previously is the numerous input nodes in the neural network, causing heavy computational load, for example as in the case of the best recognition result,
<disp-formula id="FD2">
<label>(2)</label>
<mml:math display="block">
<mml:mrow>
<mml:mtable columnalign="left">
<mml:mtr columnalign="left">
<mml:mtd columnalign="left">
<mml:mrow>
<mml:mo>#</mml:mo>
<mml:mi> </mml:mi>
<mml:mi> </mml:mi>
<mml:mtext>of input nodes</mml:mtext></mml:mrow></mml:mtd>
<mml:mtd columnalign="left">
<mml:mo>=</mml:mo></mml:mtd>
<mml:mtd columnalign="left">
<mml:mrow>
<mml:mn>32</mml:mn>
<mml:mo> </mml:mo>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>footprint model</mml:mtext>
<mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr>
<mml:mtr columnalign="left">
<mml:mtd columnalign="left">
<mml:mrow/></mml:mtd>
<mml:mtd columnalign="left">
<mml:mo>*</mml:mo></mml:mtd>
<mml:mtd columnalign="left">
<mml:mrow>
<mml:mfrac>
<mml:mrow>
<mml:mn>0.8</mml:mn>
<mml:mo> </mml:mo>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>maximum stepping time</mml:mtext>
<mml:mo stretchy="false">)</mml:mo></mml:mrow>
<mml:mrow>
<mml:mn>0.04</mml:mn>
<mml:mo> </mml:mo>
<mml:mo stretchy="false">(</mml:mo>
<mml:mtext>sampling time</mml:mtext>
<mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mfrac></mml:mrow></mml:mtd></mml:mtr>
<mml:mtr columnalign="left">
<mml:mtd columnalign="left">
<mml:mrow/></mml:mtd>
<mml:mtd columnalign="left">
<mml:mo>*</mml:mo></mml:mtd>
<mml:mtd columnalign="left">
<mml:mrow>
<mml:mn>4</mml:mn>
<mml:mo> </mml:mo>
<mml:mo stretchy="false">(</mml:mo>
<mml:mo>#</mml:mo>
<mml:mi> </mml:mi>
<mml:mi> </mml:mi>
<mml:mtext>of used footsteps</mml:mtext>
<mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr>
<mml:mtr columnalign="left">
<mml:mtd columnalign="left">
<mml:mrow/></mml:mtd>
<mml:mtd columnalign="left">
<mml:mo>=</mml:mo></mml:mtd>
<mml:mtd columnalign="left">
<mml:mrow>
<mml:mn>2560</mml:mn></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:mrow></mml:math></disp-formula></p>
<p>One solution to this problem is training in principal components analysis (PCA). PCA is a way of identifying patterns in data and expressing the data in such a way as to highlight their similarity and differences [<xref ref-type="bibr" rid="b40-sensors-11-02611">40</xref>]. The purpose of PCA training is to obtain several principal components that represent the original stepping features from a high-dimensional measurement space to a low-dimensional eigenspace. PCA training has been employed on the vision-based gait recognition approaches [<xref ref-type="bibr" rid="b41-sensors-11-02611">41</xref>–<xref ref-type="bibr" rid="b43-sensors-11-02611">43</xref>]. In the floor-based gait recognition approaches, Suutala and Röning built a frequency domain presentation of GRF signal (camel-back curve) and deployed PCA to reduce high dimensionality of the amplitude spectrum presentations [<xref ref-type="bibr" rid="b44-sensors-11-02611">44</xref>]. We adopted an analogous method to that presented in [<xref ref-type="bibr" rid="b42-sensors-11-02611">42</xref>], reducing the original 2560-dimensional space to a vector with 248 coefficients. The accuracy of recognition with this PCA training technique was about 89%, which is reasonable considering the greatly reduced computational loads.</p></sec></sec>
<sec>
<label>8.</label>
<title>Evaluation</title>
<p>Although we have shown that the neural network classifier (multilayer perceptron) is working well on the stepping and walking pattern extracted from our dataset, we should perform experiments with different classification methods to be able to see the stability of the user identification systems. Among various available machine learning algorithms, We chose five classification methods in addition to multilayer perceptron we had used: instance-based learning (<italic>k</italic>-nearest neighbor algorithm), decision tree (C4.5), Bayes net, decision table, support vector machine. Generally, discriminative machine learning algorithms such as multilayer perceptron have shown better performance than generative models such as hidden Markov model (HMM) in footstep identification. Support vector machine is chosen as one of the state-of-the-art discriminative method with a good performance in many applications. We chose the simple <italic>k</italic>-nearest neighbor algorithm from instance-based learning algorithms, and decision tree and decision table from rule-based learning algorithms. In addition, Bayes net is chosen as one of generative models to show its performance in gait recognition experiments.</p>
<p>All the experiments based on these classifiers in the evaluation study were carried out using Weka developed by Machine Learning Group at University of Waikato [<xref ref-type="bibr" rid="b45-sensors-11-02611">45</xref>]. Weka is a data mining tool with open source machine learning software in Java. It supports all the classification methods we chose for evaluation, including multilayer perceptron we used with MATLAB in the previous section. Therefore, we would be able to compare the experimental results among various classifiers as well as between machine learning tools, <italic>i.e.</italic>, MATLAB and Weka. We also used Eclipse to build and run a Java program based on the Java classes supported by Weka [<xref ref-type="bibr" rid="b46-sensors-11-02611">46</xref>].</p>
<sec>
<label>8.1.</label>
<title>Walking Pattern</title>
<p><xref ref-type="table" rid="t7-sensors-11-02611">Table 7</xref> summarizes mean and standard deviation for classification accuracy over the selected classification methods based on walking pattern we extracted from the walking samples. We used 10 times 10-fold cross-validation, <italic>i.e.</italic>, 10 different 10-fold cross-validation experiments with the same learning method and dataset, averaging the 100 experimental results. Overall, recognition accuracy is highest for multilayer perceptron, which is consistent with the experimental result with MATLAB in the previous section. Support vector machine is the second most accurate algorithm, and <italic>k</italic>-nearest neighbor method shows good performance as well. However, rule-based learning algorithms, particularly decision table shows lower accuracy compared to other algorithms. After looking into the confusion matrix, we know that this is because some portion of the walking samples of each subject was misclassified as a particular user (User<sub>0</sub>), <italic>i.e.</italic>, False Positive rate of the subject is considerably higher than others.</p>
<p><xref ref-type="table" rid="t8-sensors-11-02611">Table 8</xref> shows an aggregate confusion matrix for multilayer perceptron classifier based on 10 subjects’ walking pattern. Recognition accuracy for User<sub>0</sub> is lower than others because some portion of the walking samples of User<sub>0</sub> was misclassified as User<sub>1</sub>, User<sub>3</sub>, User<sub>4</sub>, User<sub>9</sub>. We can also know that User<sub>2</sub> and User<sub>3</sub> are confused with User<sub>7</sub> and User<sub>6</sub> respectively since the subjects may have walked in similar style while collecting walking samples. However, it should be noted that the confusion between the users might not have been occurred by their height since there is very little correlation between them as shown in <xref ref-type="table" rid="t1-sensors-11-02611">Table 1</xref>.</p></sec>
<sec>
<label>8.2.</label>
<title>Stepping Pattern</title>
<p><xref ref-type="table" rid="t9-sensors-11-02611">Table 9</xref> summarizes mean and standard deviation for classification accuracy over the selected classification methods based on stepping pattern we extracted from the walking samples. We used 10 times 10-fold cross-validation, <italic>i.e.</italic>, 10 different 10-fold cross-validation experiments with the same learning method and dataset, averaging the 100 experimental results. Overall, recognition accuracy is highest for support vector machine. It should be noted that this result is not very surprising because the past work in [<xref ref-type="bibr" rid="b44-sensors-11-02611">44</xref>] recognized 11 subjects’ different single-footstep feature presentation with support vector machine classifier, and its recognition accuracy was higher than multilayer perceptron neural network. Multilayer perceptron is the second most accurate algorithm, and its accuracy is consistent with the experimental result with MATLAB in the previous section. As in case of walking pattern-based user identification, rule-based learning algorithms show lower performance than others because False Positive rate of User<sub>0</sub> is considerably higher than others. It also should be noted that Bayes net shows weak performance compared to the discriminative model, which is consistent with past works on footstep-based recognition.</p>
<p><xref ref-type="table" rid="t10-sensors-11-02611">Table 10</xref> shows an aggregate confusion matrix for support vector machine based on 10 subjects’ stepping pattern. We can know that User<sub>5</sub> is often misclassified as User<sub>4</sub> since the subjects may have foot-stepped in similar style while collecting walking samples. The confusion between users might not have been occurred by their foot size because there is very little correlation between them as shown in <xref ref-type="table" rid="t1-sensors-11-02611">Table 1</xref>.</p></sec>
<sec sec-type="methods">
<label>8.3.</label>
<title>Data Fusion</title>
<p>In the above section, we showed that both the walking and stepping patterns extracted from the human gait can be employed for the biometric identification of an individual. However, the recognition accuracy could be improved by combining two classifiers. In the last decade, a substantial amount of research has been devoted to multimodal biometric systems [<xref ref-type="bibr" rid="b47-sensors-11-02611">47</xref>,<xref ref-type="bibr" rid="b48-sensors-11-02611">48</xref>]. Such systems exhibit high performance when the biometric features stem from totally disparate sources such as faces, voices, and fingerprints. In the floor-based gait recognition method, Suutala and Röning presented a way of improving classification accuracy and the adaptability based on the conditional posterior probability outputs of classifiers, <italic>i.e.</italic>, efforts to combine classifiers trained with different feature sets and to combine multiple footstep instances of a single person walking on the floor [<xref ref-type="bibr" rid="b44-sensors-11-02611">44</xref>].</p>
<p>Disparate biometric identifiers are fused using three basic techniques [<xref ref-type="bibr" rid="b49-sensors-11-02611">49</xref>]: (i) fusion at the feature extraction level, (ii) fusion at the matching score level, and (iii) fusion at the decision level. The dimension of the feature vector of the stepping pattern is significantly higher than that of the walking pattern. Thus, it is not reasonable to concatenate the two feature vectors into a single vector for fusing at the feature level. Instead, we have adopted fusion at the matching score level. <xref ref-type="fig" rid="f14-sensors-11-02611">Figure 14</xref> presents a flow chart of two classifiers combined by fusion at the matching score level for gait recognition.</p>
<p>In our case, each neural network generates <italic>±</italic>1 max-min score values, so normalization of the output score is not necessary. We can combine the output score values from each system into a new score value using <xref ref-type="disp-formula" rid="FD3">Equation (3)</xref>:
<disp-formula id="FD3">
<label>(3)</label>
<mml:math display="block">
<mml:mrow>
<mml:msub>
<mml:mi>O</mml:mi>
<mml:mrow>
<mml:mi>G</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msub>
<mml:mo>=</mml:mo>
<mml:msub>
<mml:mi>W</mml:mi>
<mml:mi>W</mml:mi></mml:msub>
<mml:mo>×</mml:mo>
<mml:msub>
<mml:mi>O</mml:mi>
<mml:mrow>
<mml:mi>W</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msub>
<mml:mo>+</mml:mo>
<mml:msub>
<mml:mi>W</mml:mi>
<mml:mi>S</mml:mi></mml:msub>
<mml:mo>×</mml:mo>
<mml:msub>
<mml:mi>O</mml:mi>
<mml:mrow>
<mml:mi>S</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:msub></mml:mrow></mml:math></disp-formula>where <italic>O</italic><sub><italic>G</italic>(<italic>i</italic>)</sub> denotes new output values of the <italic>i</italic>-th node, and <italic>W<sub>W</sub></italic> and <italic>W<sub>S</sub></italic> represent the weighting parameters for the walking and stepping patterns, respectively. The weighting values <italic>W<sub>W</sub></italic> and <italic>W<sub>S</sub></italic> were chosen so that the recognition accuracy could be maximized by combining the two classifiers (in our experiment <italic>W<sub>W</sub></italic> = 0.96, <italic>W<sub>S</sub></italic> = 0.92). <italic>O</italic><sub><italic>W</italic>(<italic>i</italic>)</sub> and <italic>O</italic><sub><italic>S</italic>(<italic>i</italic>)</sub> depict the output values from the neural networks of the walking and stepping patterns, respectively. Finally, we can choose the index number of the output node with the maximum output values as the user’s identification number (See <xref ref-type="disp-formula" rid="FD1">Equation (1)</xref>). With this fusion technique, we could achieve a recognition accuracy of about 99%. From the experimental results, however, we cannot claim that our gait recognition technique will almost perfectly recognize all the participants in a domestic environment. Instead, we choose to focus on the potential of combining two classifiers for the robust performance of the identification system since the human walk, or gait, is likely to vary over time.</p></sec></sec>
<sec sec-type="discussion">
<label>9.</label>
<title>Discussion</title>
<p>We compare the proposed method to the existing floor-based user identification systems. We have tabulated and summarized the design and performance of all the methods in terms of sensors, features, the number of subjects, classifiers, and recognition accuracy in <xref ref-type="table" rid="t11-sensors-11-02611">Table 11</xref>.</p>
<p>The sensors used in the floor-based gait recognition systems can be mainly classified into two classes: switch sensors (binary switch [<xref ref-type="bibr" rid="b21-sensors-11-02611">21</xref>,<xref ref-type="bibr" rid="b44-sensors-11-02611">44</xref>], photo interrupter [<xref ref-type="bibr" rid="b37-sensors-11-02611">37</xref>,<xref ref-type="bibr" rid="b38-sensors-11-02611">38</xref>]) and pressure sensors (load cell [<xref ref-type="bibr" rid="b28-sensors-11-02611">28</xref>,<xref ref-type="bibr" rid="b29-sensors-11-02611">29</xref>,<xref ref-type="bibr" rid="b32-sensors-11-02611">32</xref>], ElectroMechanical Film [<xref ref-type="bibr" rid="b44-sensors-11-02611">44</xref>,<xref ref-type="bibr" rid="b50-sensors-11-02611">50</xref>–<xref ref-type="bibr" rid="b53-sensors-11-02611">53</xref>], Force Sensing Resistor [<xref ref-type="bibr" rid="b22-sensors-11-02611">22</xref>–<xref ref-type="bibr" rid="b24-sensors-11-02611">24</xref>]). In early works, load cells were used to measure GRF profile over a footstep. Recently, fine-grained sensor technologies have been widely adopted in the gait recognition systems to capture pressure profiles over a footstep. However, it should be noted that the recognition accuracy of the user identification system depends mainly on the features extracted from raw dataset–of course, they are closely related to which sensors are used–and the classification methods rather than the sensor itself.</p>
<p>The features used in the floor-based gait recognition systems can be mainly classified into three classes: pressure profiles, 2D positional COP trajectories, and walking features such as stride length, cadence, and dynamic range. Among these features, the methods only using 2D positional COP trajectories showed weak performance [<xref ref-type="bibr" rid="b33-sensors-11-02611">33</xref>]. However, when combining them with other features such as pressure profiles or walking features, the recognition accuracy was definitely improved as shown in [<xref ref-type="bibr" rid="b23-sensors-11-02611">23</xref>,<xref ref-type="bibr" rid="b24-sensors-11-02611">24</xref>]. Our transitional footprint is somewhat different from the dynamic footprint presented in [<xref ref-type="bibr" rid="b24-sensors-11-02611">24</xref>,<xref ref-type="bibr" rid="b29-sensors-11-02611">29</xref>,<xref ref-type="bibr" rid="b33-sensors-11-02611">33</xref>,<xref ref-type="bibr" rid="b44-sensors-11-02611">44</xref>]. While the dynamic footprints are a profile of the ground reaction force or the COP trajectory during footstepping heel-strike to toe-off, our dynamic footprint is composed of a sequence of transitional footprints while a user is walking. The grey-level image used in [<xref ref-type="bibr" rid="b30-sensors-11-02611">30</xref>] is somewhat similar to our transitional footprints. While they extracted more elaborate features such as minimum, maximum, mean, standard deviation, and sum of components from the grey-level image, we provided the sampled <italic>in situ</italic> footprint images as the input features to the classifiers. As mentioned above, the characteristics of the dynamic footprint strongly depend on the sensor deployed in each floor system. Thus, if we consider that all user identification methods based on the various dynamic footprints showed reasonable performance, we can conclude that numerous other sensors could be deployed in floor systems to sense and extract much more distinguishable dynamic footprints for identifying individuals in domestic environments.</p>
<p>As we used 5 consecutive footsteps for gait recognition, multiple footsteps have been used to improve the recognition accuracy. In particular, it has been shown that the method in [<xref ref-type="bibr" rid="b53-sensors-11-02611">53</xref>] deployed only footprint-based features over 5 consecutive footsteps (without walking features like stride length), achieving more than 95% recognition accuracy. They classified each footstep using a single classifier, combining the result of each classifier with sum and product rules. Instead, we concatenated the footprint images over multiple footsteps into a single feature vector, and then classified it with a single classifier. Although there would still be a question of which method is better in terms of recognition accuracy, the method of combining classifiers over multiple footsteps might be more practical in real environments because it would be able to start immediately identifying them once unknown footsteps are detected on the floor.</p>
<p>Various machine learning algorithms including hidden Markov model (HMM) [<xref ref-type="bibr" rid="b28-sensors-11-02611">28</xref>,<xref ref-type="bibr" rid="b33-sensors-11-02611">33</xref>,<xref ref-type="bibr" rid="b50-sensors-11-02611">50</xref>,<xref ref-type="bibr" rid="b54-sensors-11-02611">54</xref>], learning vector quantization (LVQ) [<xref ref-type="bibr" rid="b51-sensors-11-02611">51</xref>] and distinction-sensitive LVQ (DSLVQ) [<xref ref-type="bibr" rid="b52-sensors-11-02611">52</xref>], <italic>k</italic>-nearest neighbors (KNN) [<xref ref-type="bibr" rid="b29-sensors-11-02611">29</xref>], multilayer perceptron (MLP) [<xref ref-type="bibr" rid="b21-sensors-11-02611">21</xref>,<xref ref-type="bibr" rid="b37-sensors-11-02611">37</xref>,<xref ref-type="bibr" rid="b38-sensors-11-02611">38</xref>,<xref ref-type="bibr" rid="b44-sensors-11-02611">44</xref>,<xref ref-type="bibr" rid="b53-sensors-11-02611">53</xref>], Gaussian process (GP) [<xref ref-type="bibr" rid="b30-sensors-11-02611">30</xref>], Fisher linear discriminant (FLD) [<xref ref-type="bibr" rid="b23-sensors-11-02611">23</xref>,<xref ref-type="bibr" rid="b24-sensors-11-02611">24</xref>], and support vector machine (SVM) [<xref ref-type="bibr" rid="b44-sensors-11-02611">44</xref>] have been studied in the gait-based user identification systems. Generally, discriminative machine learning algorithms such as support vector machine have shown better performance than generative models such as hidden Markov model in footstep identification. In [<xref ref-type="bibr" rid="b44-sensors-11-02611">44</xref>], Suutala and Röning presented the comparison for the recognition performance of the various classification methods including KNN, LVQ, RBF, MLP, and SVM, demonstrating MLP and SVM are the recommended classifiers in footstep-based user identification, being consistent with our experimental results. However, recently, Qian <italic>et al.</italic> used FLD, one of generative models, as the classifier, and they showed good performance of the method based on comprehensive features over multiple footsteps including pressure profiles, 3D COP trajectories, and stride length [<xref ref-type="bibr" rid="b24-sensors-11-02611">24</xref>].</p>
<p>Unfortunately, previous research has shown that as gait databases continue to expand in size, it is conceivable that identifying an individual only by gait may become difficult. Thus, we assume conditions in which the target application is a home environment. However, we located several studies in which gait recognition was deployed for surveillance and for security in public areas. In these applications, gait provided only one of the multimodal biometric identifiers for the system, so it could serve as a useful filtering tool allowing one to narrow the search to a considerably smaller set of potential candidates. In contrast, in this study, we have focused on the identification techniques for unobtrusive interfaces and privacy-preserving devices rather than high-security systems. Thus, we have begun to recognize the feasibility of using our floor-based identification technique in home environments, accounting for reasonable accuracy, unobtrusive interface, and privacy-comfortable systems.</p>
<p>Although the floor systems we have developed presented the potential of serving as a sensor device for a gait-based identification system, we have identified several shortcomings that will limit its use to laboratory environments and preclude its use in home environments. For example, since UbiFloorII has a large number of holes drilled in its wooden tiles to house the photo interrupter sensors, so spilling water on the floor would obviously damage the electronic circuitry embedded inside UbiFloorII. Moreover, although UbiFloorII contains an electronic circuitry and micro-processor program that minimizes power consumption, it still continuously consumes considerable energy due to photo interrupter sensors. If an entire room is equipped with the floor tiles, it may be able to track multiple individuals. Nevertheless, considerable study will be needed to solve the problems caused from the overlapping of dynamic objects (e.g., activities of passing, gathering, or separating among occupants) and of dynamic and static objects (e.g., sitting on a chair). Future work that involves developing a new type of gait-based human recognition systems capable of tracking and identifying multiple occupants simultaneously should represent a significant, intriguing research area.</p></sec>
<sec sec-type="conclusions">
<label>10.</label>
<title>Conclusions</title>
<p>We have presented a method of identifying individuals by their gait patterns. We classified available features of gait into two categories: walking pattern and stepping pattern. The former is defined as the spatiotemporal variation in a sequence of footsteps such as stride length, dynamic range, foot angle, and stance and swing time; and the latter is defined as the temporal variation over a single footstep such as a dynamic footprint. We assume that the target application is a home environment, that the number of users is smaller than 10, and that all users walk with bare feet, reflecting the Korean custom. With these assumptions, we have developed a floor-based identification system using walking and stepping patterns that can be extracted from users’ walk over our biometric sensor, UbiFloorII. To collect walking samples, we have created UbiFloorII using photo interrupter sensors. We have also developed feature extraction modules and a user identification module using a neural network technique. Our findings show that the walking and stepping patterns extracted from the users’ gaits over the UbiFloorII are distinguishable enough to identify the users. We also found that by fusing two classifiers at the matching score level, the performance of the identification system may be robust against the likely variation in the human gait. With the advent of new low-power, fine-grained sensor technologies for measuring elaborate patterns of human gait or the discovery of a new distinguishable feature available for user identification, we expect the creation of a more accurate and robust gait-based human identification system in the near future.</p></sec></body>
<back>
<ref-list>
<title>References</title>
<ref id="b1-sensors-11-02611"><label>1.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Jain</surname><given-names>AK</given-names></name><name><surname>Pankanti</surname><given-names>S</given-names></name><name><surname>Prabhakar</surname><given-names>S</given-names></name><name><surname>Hong</surname><given-names>L</given-names></name><name><surname>Ross</surname><given-names>A</given-names></name></person-group><article-title>Biometrics: A grand challenge</article-title><conf-name>Proceedings of the 17th International Conference on Pattern Recognition (ICPR 2004)</conf-name><conf-loc>Cambridge, UK</conf-loc><conf-date>23–26 August 2004</conf-date><volume>2</volume><fpage>935</fpage><lpage>942</lpage></citation></ref>
<ref id="b2-sensors-11-02611"><label>2.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kale</surname><given-names>AA</given-names></name><name><surname>Sundaresan</surname><given-names>A</given-names></name><name><surname>Rajagopalan</surname><given-names>AN</given-names></name><name><surname>Cuntoor</surname><given-names>NP</given-names></name><name><surname>Roy-Chowdhury</surname><given-names>AK</given-names></name><name><surname>Krüger</surname><given-names>V</given-names></name><name><surname>Chellappa</surname><given-names>R</given-names></name></person-group><article-title>Identification of humans using gait</article-title><source>IEEE Trans. Image Processing</source><year>2004</year><volume>13</volume><fpage>1163</fpage><lpage>1173</lpage><pub-id pub-id-type="doi">10.1109/TIP.2004.832865</pub-id></citation></ref>
<ref id="b3-sensors-11-02611"><label>3.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Nixon</surname><given-names>MS</given-names></name><name><surname>Carter</surname><given-names>JN</given-names></name></person-group><article-title>Advances in automatic gait recognition</article-title><conf-name>Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition (AFGR 2004)</conf-name><conf-loc>Seoul, Korea</conf-loc><conf-date>17–19 May 2004</conf-date><fpage>139</fpage><lpage>144</lpage></citation></ref>
<ref id="b4-sensors-11-02611"><label>4.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Kale</surname><given-names>AA</given-names></name><name><surname>Rajagopalan</surname><given-names>AN</given-names></name><name><surname>Cuntoor</surname><given-names>N</given-names></name><name><surname>Krüger</surname><given-names>V</given-names></name></person-group><article-title>Gait-based recognition of humans using continuous HMMs</article-title><conf-name>Proceedings of the 5th IEEE International Conference on Automatic Face and Gesture Recognition (AFGR 2002)</conf-name><conf-loc>Washington, DC, USA</conf-loc><conf-date>May 2002</conf-date><fpage>336</fpage><lpage>341</lpage></citation></ref>
<ref id="b5-sensors-11-02611"><label>5.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Gafurov</surname><given-names>D</given-names></name></person-group><article-title>A survey of biometric gait recognition: Approaches, security and challenges</article-title><conf-name>Proceedings of the Annual Norwegian Computer Science Conference</conf-name><conf-loc>Oslo, Norway</conf-loc><conf-date>19–21 November 2007</conf-date></citation></ref>
<ref id="b6-sensors-11-02611"><label>6.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Nixon</surname><given-names>MS</given-names></name><name><surname>Tan</surname><given-names>T</given-names></name><name><surname>Chellappa</surname><given-names>R</given-names></name></person-group><source>Human Identification Based on Gait, International Series on Biometrics</source><publisher-name>Springer</publisher-name><publisher-loc>Berlin, Germany</publisher-loc><year>2006</year></citation></ref>
<ref id="b7-sensors-11-02611"><label>7.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>BenAbdelkader</surname><given-names>C</given-names></name><name><surname>Cutler</surname><given-names>R</given-names></name><name><surname>Davis</surname><given-names>L</given-names></name></person-group><article-title>Stride and cadence as a biometric in automatic person identification and verification</article-title><conf-name>Proceedings of the 5th IEEE International Conference on Automatic Face and Gesture Recognition (AFGR 2002)</conf-name><conf-loc>Washington, DC, USA</conf-loc><conf-date>May 2002</conf-date><fpage>372</fpage><lpage>377</lpage></citation></ref>
<ref id="b8-sensors-11-02611"><label>8.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Bobick</surname><given-names>AE</given-names></name><name><surname>Johnson</surname><given-names>AY</given-names></name></person-group><article-title>Gait recognition using static, activity-specific parameters</article-title><conf-name>Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001)</conf-name><conf-loc>Kauai, HI, USA</conf-loc><conf-date>8–14 December 2001</conf-date><volume>1</volume><fpage>423</fpage><lpage>430</lpage></citation></ref>
<ref id="b9-sensors-11-02611"><label>9.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Tanawongsuwan</surname><given-names>R</given-names></name><name><surname>Bobick</surname><given-names>A</given-names></name></person-group><article-title>Gait recognition from time-normalized joint-angle trajectories in the walking plane</article-title><conf-name>Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001)</conf-name><conf-loc>Kauai, HI, USA</conf-loc><conf-date>8–14 December 2001</conf-date><volume>2</volume><fpage>726</fpage><lpage>731</lpage></citation></ref>
<ref id="b10-sensors-11-02611"><label>10.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Yam</surname><given-names>C-Y</given-names></name><name><surname>Nixon</surname><given-names>MS</given-names></name><name><surname>Carter</surname><given-names>JN</given-names></name></person-group><article-title>On the relationship of human walking and running: Automatic person identification by gait</article-title><conf-name>Proceedings of the 16th International Conference on Pattern Recognition (ICPR 2002)</conf-name><conf-loc>Quebec, Canada</conf-loc><conf-date>11–13 August 2002</conf-date><volume>1</volume><fpage>287</fpage><lpage>290</lpage></citation></ref>
<ref id="b11-sensors-11-02611"><label>11.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Zhang</surname><given-names>R</given-names></name><name><surname>Vogler</surname><given-names>C</given-names></name><name><surname>Metaxas</surname><given-names>D</given-names></name></person-group><article-title>Human gait recognition</article-title><conf-name>Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2004)</conf-name><conf-loc>Washington, DC, USA</conf-loc><conf-date>27 June–2 July 2004</conf-date></citation></ref>
<ref id="b12-sensors-11-02611"><label>12.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Sundaresan</surname><given-names>A</given-names></name><name><surname>Roy-Chowdhury</surname><given-names>AK</given-names></name><name><surname>Chellappa</surname><given-names>R</given-names></name></person-group><article-title>A hidden Markov model based framework for recognition of humans from gait sequences</article-title><conf-name>Proceedings of the International Conference on Image Processing (ICIP 2003)</conf-name><conf-loc>Barcelona, Spain</conf-loc><conf-date>14–18 September 2003</conf-date><volume>3</volume><fpage>93</fpage><lpage>96</lpage></citation></ref>
<ref id="b13-sensors-11-02611"><label>13.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vega</surname><given-names>IR</given-names></name><name><surname>Sarkar</surname><given-names>S</given-names></name></person-group><article-title>Statistical motion model based on the change of feature relationships: Human gait-based recognition</article-title><source>IEEE Trans. Patt. Anal. Mach. Int</source><year>2003</year><volume>25</volume><fpage>1323</fpage><lpage>1328</lpage><pub-id pub-id-type="doi">10.1109/TPAMI.2003.1233906</pub-id></citation></ref>
<ref id="b14-sensors-11-02611"><label>14.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Liu</surname><given-names>Z</given-names></name><name><surname>Sarkar</surname><given-names>S</given-names></name></person-group><article-title>Simplest representation yet for gait recognition: Averaged silhouette</article-title><conf-name>Proceedings of the 17th International Conference on Pattern Recognition (ICPR 2004)</conf-name><conf-loc>Cambridge, UK</conf-loc><conf-date>23–26 August 2004</conf-date><volume>4</volume><fpage>211</fpage><lpage>214</lpage></citation></ref>
<ref id="b15-sensors-11-02611"><label>15.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Collins</surname><given-names>RT</given-names></name><name><surname>Gross</surname><given-names>R</given-names></name><name><surname>Shi</surname><given-names>J</given-names></name></person-group><article-title>Silhouette-based human identification from body shape and gait</article-title><conf-name>Proceedings of the 5th IEEE International Conference on Automatic Face and Gesture Recognition (AFGR 2002)</conf-name><conf-loc>Washington, DC, USA</conf-loc><conf-date>May 2002</conf-date><fpage>366</fpage><lpage>371</lpage></citation></ref>
<ref id="b16-sensors-11-02611"><label>16.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Lee</surname><given-names>L</given-names></name><name><surname>Grimson</surname><given-names>WEL</given-names></name></person-group><article-title>Gait analysis for recognition and classification</article-title><conf-name>Proceedings of the 5th IEEE International Conference on Automatic Face and Gesture Recognition (AFGR 2002)</conf-name><conf-loc>Washington, DC, USA</conf-loc><conf-date>May 2002</conf-date><fpage>148</fpage><lpage>155</lpage></citation></ref>
<ref id="b17-sensors-11-02611"><label>17.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Bhanu</surname><given-names>B</given-names></name><name><surname>Han</surname><given-names>J</given-names></name></person-group><article-title>Human recognition on combining kinematic and stationary features</article-title><conf-name>Proceedings of the International Conference on Audio- and Video-Based Biometric Person Authentication</conf-name><conf-loc>Guildford, UK</conf-loc><conf-date>9–11 June 2003</conf-date><fpage>600</fpage><lpage>608</lpage></citation></ref>
<ref id="b18-sensors-11-02611"><label>18.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Han</surname><given-names>J</given-names></name><name><surname>Bhanu</surname><given-names>B</given-names></name></person-group><article-title>Statistical feature fusion for gait-based human recognition</article-title><conf-name>Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2004)</conf-name><conf-loc>Washington, DC, USA</conf-loc><conf-date>27 June–2 July 2004</conf-date><volume>2</volume><fpage>842</fpage><lpage>847</lpage></citation></ref>
<ref id="b19-sensors-11-02611"><label>19.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Little</surname><given-names>JJ</given-names></name><name><surname>Boyd</surname><given-names>JE</given-names></name></person-group><article-title>Recognizing people by their gait: The shape of motion</article-title><source>Videre J. Comput. Vision Res</source><year>1998</year><volume>1</volume><fpage>1</fpage><lpage>32</lpage></citation></ref>
<ref id="b20-sensors-11-02611"><label>20.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zatsiorky</surname><given-names>VM</given-names></name><name><surname>Werner</surname><given-names>SL</given-names></name><name><surname>Kaimin</surname><given-names>MA</given-names></name></person-group><article-title>Basic kinematics of walking step length and step frequency: A review</article-title><source>J. Sports Med. Phys. Fitness</source><year>1994</year><volume>34</volume><fpage>109</fpage><lpage>134</lpage><pub-id pub-id-type="pmid">7967581</pub-id></citation></ref>
<ref id="b21-sensors-11-02611"><label>21.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Yun</surname><given-names>J</given-names></name><name><surname>Lee</surname><given-names>S</given-names></name><name><surname>Woo</surname><given-names>W</given-names></name><name><surname>Ryu</surname><given-names>J</given-names></name></person-group><article-title>User identification system using walking pattern over the UbiFloor</article-title><conf-name>Proceedings of the International Conference on Control, Automation and Systems</conf-name><conf-loc>Gyeongju, Korea</conf-loc><conf-date>22–25 October 2003</conf-date><fpage>1046</fpage><lpage>1050</lpage></citation></ref>
<ref id="b22-sensors-11-02611"><label>22.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Middleton</surname><given-names>L</given-names></name><name><surname>Buss</surname><given-names>AA</given-names></name><name><surname>Bazin</surname><given-names>A</given-names></name><name><surname>Nixon</surname><given-names>MS</given-names></name></person-group><article-title>A floor sensor system for gait recognition</article-title><conf-name>Proceedings of the 4th IEEE Workshop on Automatic Identification Advanced Technologies</conf-name><conf-loc>Buffalo, NY, USA</conf-loc><conf-date>16–18 October 2005</conf-date><fpage>171</fpage><lpage>176</lpage></citation></ref>
<ref id="b23-sensors-11-02611"><label>23.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Qian</surname><given-names>G</given-names></name><name><surname>Zhang</surname><given-names>J</given-names></name><name><surname>Kidané</surname><given-names>A</given-names></name></person-group><article-title>People identification using gait via floor pressure sensing and analysis</article-title><conf-name>Proceedings of the 3rd European Conference on Smart Sensing and Context (EuroSSC)</conf-name><conf-loc>Zurich, Switzerland</conf-loc><conf-date>29–31 October 2008</conf-date><fpage>83</fpage><lpage>98</lpage></citation></ref>
<ref id="b24-sensors-11-02611"><label>24.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Qian</surname><given-names>G</given-names></name><name><surname>Zhang</surname><given-names>J</given-names></name><name><surname>Kidané</surname><given-names>A</given-names></name></person-group><article-title>People identification using floor pressure sensing and analysis</article-title><source>IEEE Sens. J</source><year>2010</year><volume>10</volume><fpage>1447</fpage><lpage>1460</lpage><pub-id pub-id-type="doi">10.1109/JSEN.2010.2045158</pub-id></citation></ref>
<ref id="b25-sensors-11-02611"><label>25.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Holzreiter</surname><given-names>SH</given-names></name><name><surname>Köhle</surname><given-names>ME</given-names></name></person-group><article-title>Assessment of gait patterns using neural networks</article-title><source>J. Biomech</source><year>1993</year><volume>26</volume><fpage>645</fpage><lpage>651</lpage><pub-id pub-id-type="doi">10.1016/0021-9290(93)90028-D</pub-id><pub-id pub-id-type="pmid">8514810</pub-id></citation></ref>
<ref id="b26-sensors-11-02611"><label>26.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Köhle</surname><given-names>M</given-names></name><name><surname>Merkl</surname><given-names>D</given-names></name></person-group><article-title>Identification of gait patterns with self-organizing maps based on ground reaction force</article-title><conf-name>Proceedings of the European Symposium on Artificial Neural Networks</conf-name><conf-loc>Bruges, Belgium</conf-loc><conf-date>24–26 April 1996</conf-date><fpage>73</fpage><lpage>78</lpage></citation></ref>
<ref id="b27-sensors-11-02611"><label>27.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Köhle</surname><given-names>M</given-names></name><name><surname>Merkl</surname><given-names>D</given-names></name><name><surname>Kastner</surname><given-names>J</given-names></name></person-group><article-title>Clinical gait analysis by neural networks: Issues and experiences</article-title><conf-name>Proceedings of the 10th IEEE Symposium on Computer-Based Medical Systems</conf-name><conf-loc>Maribor, Slovenia</conf-loc><conf-date>11–13 June 1997</conf-date><fpage>138</fpage><lpage>143</lpage></citation></ref>
<ref id="b28-sensors-11-02611"><label>28.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Addlesee</surname><given-names>MD</given-names></name><name><surname>Jones</surname><given-names>A</given-names></name><name><surname>Livesey</surname><given-names>F</given-names></name><name><surname>Samaria</surname><given-names>F</given-names></name></person-group><article-title>The ORL active floor</article-title><source>IEEE Personal Commun</source><year>1997</year><volume>4</volume><fpage>35</fpage><lpage>41</lpage><pub-id pub-id-type="doi">10.1109/98.626980</pub-id></citation></ref>
<ref id="b29-sensors-11-02611"><label>29.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Orr</surname><given-names>RJ</given-names></name><name><surname>Abowd</surname><given-names>GD</given-names></name></person-group><article-title>The smart floor: A mechanism for natural user identification and tracking</article-title><conf-name>Proceedings of Extended Abstracts of the ACM Conference on Human Factors in Computing Systems (CHI 2000)</conf-name><conf-loc>Hague, The Netherlands</conf-loc><conf-date>1–6 April 2000</conf-date><fpage>275</fpage><lpage>276</lpage></citation></ref>
<ref id="b30-sensors-11-02611"><label>30.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Suutala</surname><given-names>J</given-names></name><name><surname>Fujinami</surname><given-names>K</given-names></name><name><surname>Röning</surname><given-names>J</given-names></name></person-group><article-title>Gaussian process person identifier based on simple floor sensors</article-title><conf-name>Proceedings of the 3rd European Conference on Smart Sensing and Context (EuroSSC)</conf-name><conf-loc>Zurich, Switzerland</conf-loc><conf-date>29–31 October 2008</conf-date><fpage>55</fpage><lpage>68</lpage></citation></ref>
<ref id="b31-sensors-11-02611"><label>31.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kennedy</surname><given-names>RB</given-names></name></person-group><article-title>Uniqueness of bare feet and its use as a possible means of identification</article-title><source>Forensic Sci. Int</source><year>1996</year><volume>82</volume><fpage>81</fpage><lpage>87</lpage><pub-id pub-id-type="doi">10.1016/0379-0738(96)01969-X</pub-id><pub-id pub-id-type="pmid">8828175</pub-id></citation></ref>
<ref id="b32-sensors-11-02611"><label>32.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nakajima</surname><given-names>K</given-names></name><name><surname>Mizukami</surname><given-names>Y</given-names></name><name><surname>Tanaka</surname><given-names>K</given-names></name><name><surname>Tamura</surname><given-names>T</given-names></name></person-group><article-title>Footprint-based personal recognition</article-title><source>IEEE Trans. Biomed. Eng</source><year>2000</year><volume>47</volume><fpage>1534</fpage><lpage>1537</lpage><pub-id pub-id-type="doi">10.1109/10.880106</pub-id><pub-id pub-id-type="pmid">11077748</pub-id></citation></ref>
<ref id="b33-sensors-11-02611"><label>33.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Jung</surname><given-names>J</given-names></name><name><surname>Bien</surname><given-names>Z</given-names></name><name><surname>Lee</surname><given-names>S</given-names></name><name><surname>Sato</surname><given-names>T</given-names></name></person-group><article-title>Dynamic-footprint based person identification using mat-type pressure sensor</article-title><conf-name>Proceedings of the 25th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS)</conf-name><conf-loc>Cancun, Mexico</conf-loc><conf-date>15–17 September 2003</conf-date><volume>3</volume><fpage>2937</fpage><lpage>2940</lpage></citation></ref>
<ref id="b34-sensors-11-02611"><label>34.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Ailisto</surname><given-names>H</given-names></name><name><surname>Lindholm</surname><given-names>M</given-names></name><name><surname>Mäntyjärvi</surname><given-names>J</given-names></name><name><surname>Vildjiounaite</surname><given-names>E</given-names></name><name><surname>Mäkela</surname><given-names>S</given-names></name></person-group><article-title>Identifying people from gait pattern with accelerometers</article-title><conf-name>Proceedings of SPIE</conf-name><conf-loc>San Diego, CA, USA</conf-loc><conf-date>12–17 February 2005</conf-date><volume>5779</volume><fpage>7</fpage><lpage>14</lpage></citation></ref>
<ref id="b35-sensors-11-02611"><label>35.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gafurov</surname><given-names>D</given-names></name><name><surname>Helkala</surname><given-names>K</given-names></name><name><surname>Søndrol</surname><given-names>T</given-names></name></person-group><article-title>Biometric gait authentication using accelerometer sensor</article-title><source>J. Comput</source><year>2006</year><volume>1</volume><fpage>51</fpage><lpage>59</lpage></citation></ref>
<ref id="b36-sensors-11-02611"><label>36.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Mäntyjärvi</surname><given-names>J</given-names></name><name><surname>Lindholm</surname><given-names>M</given-names></name><name><surname>Vildjiounaite</surname><given-names>E</given-names></name><name><surname>Mäkelä</surname><given-names>S</given-names></name><name><surname>Ailisto</surname><given-names>H</given-names></name></person-group><article-title>Identifying users of portable devices from gait pattern with accelerometers</article-title><conf-name>Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing</conf-name><conf-loc>Philadelphia, PA, USA</conf-loc><conf-date>18–23 March 2005</conf-date><volume>2</volume><fpage>973</fpage><lpage>976</lpage></citation></ref>
<ref id="b37-sensors-11-02611"><label>37.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yun</surname><given-names>J</given-names></name><name><surname>Abowd</surname><given-names>GD</given-names></name><name><surname>Ryu</surname><given-names>J</given-names></name><name><surname>Woo</surname><given-names>W</given-names></name></person-group><article-title>User identification with user’s stepping pattern over the UbiFloorII</article-title><source>Int. J. Pattern Recognit. Arti. I</source><year>2008</year><volume>22</volume><fpage>497</fpage><lpage>514</lpage><pub-id pub-id-type="doi">10.1142/S0218001408006338</pub-id></citation></ref>
<ref id="b38-sensors-11-02611"><label>38.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Yun</surname><given-names>J</given-names></name><name><surname>Woo</surname><given-names>W</given-names></name><name><surname>Ryu</surname><given-names>J</given-names></name></person-group><article-title>User identification using user’s walking pattern over the UbiFloorII</article-title><conf-name>Proceedings of the International Conference on Computational Intelligence and Security</conf-name><conf-loc>Xi’an, China</conf-loc><conf-date>15–19 December 2005</conf-date><fpage>949</fpage><lpage>956</lpage></citation></ref>
<ref id="b39-sensors-11-02611"><label>39.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Haykin</surname><given-names>S</given-names></name></person-group><source>Neural Networks: A Comprehensive Foundation</source><edition>2nd ed</edition><publisher-name>Prentice Hall</publisher-name><publisher-loc>Upper Saddle River, NJ, USA</publisher-loc><year>1998</year></citation></ref>
<ref id="b40-sensors-11-02611"><label>40.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bishop</surname><given-names>CM</given-names></name></person-group><source>Pattern Recognition and Machine Learning</source><publisher-name>Springer</publisher-name><publisher-loc>Berlin, Germany</publisher-loc><year>2007</year></citation></ref>
<ref id="b41-sensors-11-02611"><label>41.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Murase</surname><given-names>H</given-names></name><name><surname>Sakai</surname><given-names>R</given-names></name></person-group><article-title>Moving object recognition in eigenspace representation: Gait analysis and lip reading</article-title><source>Pattern Recognition Lett</source><year>1996</year><volume>17</volume><fpage>155</fpage><lpage>162</lpage><pub-id pub-id-type="doi">10.1016/0167-8655(95)00109-3</pub-id></citation></ref>
<ref id="b42-sensors-11-02611"><label>42.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huang</surname><given-names>PS</given-names></name><name><surname>Harris</surname><given-names>CJ</given-names></name><name><surname>Nixon</surname><given-names>MS</given-names></name></person-group><article-title>Human gait recognition in canonical space using temporal templates</article-title><source>IEE Proc.-Vis. Image Signal Pro</source><year>1999</year><volume>146</volume><fpage>93</fpage><lpage>100</lpage><pub-id pub-id-type="doi">10.1049/ip-vis:19990187</pub-id></citation></ref>
<ref id="b43-sensors-11-02611"><label>43.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname><given-names>L</given-names></name><name><surname>Tan</surname><given-names>T</given-names></name><name><surname>Ning</surname><given-names>H</given-names></name><name><surname>Hu</surname><given-names>W</given-names></name></person-group><article-title>Silhouette analysis-based gait recognition for human identification</article-title><source>IEEE Trans. Patt. Anal. Mach. Int</source><year>2003</year><volume>25</volume><fpage>1508</fpage><lpage>1518</lpage></citation></ref>
<ref id="b44-sensors-11-02611"><label>44.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Suutala</surname><given-names>J</given-names></name><name><surname>Röning</surname><given-names>J</given-names></name></person-group><article-title>Methods for person identification on a pressure-sensitive floor: Experiments with multiple classifiers and reject option</article-title><source>Inform. Fusion</source><year>2008</year><volume>9</volume><fpage>21</fpage><lpage>40</lpage><pub-id pub-id-type="doi">10.1016/j.inffus.2006.11.003</pub-id></citation></ref>
<ref id="b45-sensors-11-02611"><label>45.</label><citation citation-type="web"><source>Weka 3, Data Mining with Open Source Machine Learning Software in Java</source><comment>Available online: <ext-link xlink:href="http://www.cs.waikato.ac.nz/ml/weka/" ext-link-type="uri">http://www.cs.waikato.ac.nz/ml/weka/</ext-link> (accessed on 10 January 2011).</comment></citation></ref>
<ref id="b46-sensors-11-02611"><label>46.</label><citation citation-type="web"><source>Eclipse IDE for Java Developers</source><comment>Available online: <ext-link xlink:href="http://www.eclipse.org/" ext-link-type="uri">http://www.eclipse.org/</ext-link> (accessed on 10 January 2011).</comment></citation></ref>
<ref id="b47-sensors-11-02611"><label>47.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hong</surname><given-names>L</given-names></name><name><surname>Jain</surname><given-names>AK</given-names></name></person-group><article-title>Integrating faces and fingerprints for personal identification</article-title><source>IEEE Trans. Patt. Anal. Mach. Int</source><year>1998</year><volume>20</volume><fpage>1295</fpage><lpage>1307</lpage><pub-id pub-id-type="doi">10.1109/34.735803</pub-id></citation></ref>
<ref id="b48-sensors-11-02611"><label>48.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fox</surname><given-names>NA</given-names></name><name><surname>Gross</surname><given-names>R</given-names></name><name><surname>Cohn</surname><given-names>JF</given-names></name><name><surname>Reilly</surname><given-names>RB</given-names></name></person-group><article-title>Robust biometric person identification using automatic classifier fusion of speech, mouth, and face experts</article-title><source>IEEE Trans. Multimedia</source><year>2007</year><volume>9</volume><fpage>701</fpage><lpage>714</lpage><pub-id pub-id-type="doi">10.1109/TMM.2007.893339</pub-id></citation></ref>
<ref id="b49-sensors-11-02611"><label>49.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ross</surname><given-names>A</given-names></name><name><surname>Jain</surname><given-names>AK</given-names></name></person-group><article-title>Information fusion in biometrics</article-title><source>Pattern Recognition Lett</source><year>2003</year><volume>13</volume><fpage>2115</fpage><lpage>2125</lpage></citation></ref>
<ref id="b50-sensors-11-02611"><label>50.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Pirttikangas</surname><given-names>S</given-names></name><name><surname>Suutala</surname><given-names>J</given-names></name><name><surname>Riekki</surname><given-names>J</given-names></name><name><surname>Röning</surname><given-names>J</given-names></name></person-group><article-title>Footstep identification from pressure signals using hidden Markov models</article-title><conf-name>Proceedings of Finnish Signal Processing Symposium (FINSIG 2003)</conf-name><conf-loc>Tampere, Finland</conf-loc><conf-date>May 2003</conf-date><fpage>124</fpage><lpage>128</lpage></citation></ref>
<ref id="b51-sensors-11-02611"><label>51.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Pirttikangas</surname><given-names>S</given-names></name><name><surname>Suutala</surname><given-names>J</given-names></name><name><surname>Riekki</surname><given-names>J</given-names></name><name><surname>Röning</surname><given-names>J</given-names></name></person-group><article-title>Learning vector quantization in footstep identification</article-title><conf-name>Proceedings of the 3rd IASTED International Conference on Artificial Intelligence and Applications</conf-name><conf-loc>Innsbruck, Austria</conf-loc><conf-date>16–18 February 2003</conf-date><fpage>413</fpage><lpage>417</lpage></citation></ref>
<ref id="b52-sensors-11-02611"><label>52.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Suutala</surname><given-names>J</given-names></name><name><surname>Röning</surname><given-names>J</given-names></name></person-group><article-title>Towards the adaptive identification of walkers automated feature selection of footsteps using distinction-sensitive LVQ</article-title><conf-name>Proceedings of International Workshop on Processing Sensory Information for Proactive Systems</conf-name><conf-loc>Oulu, Finland</conf-loc><conf-date>14–15 June 2004</conf-date><fpage>61</fpage><lpage>67</lpage></citation></ref>
<ref id="b53-sensors-11-02611"><label>53.</label><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Suutala</surname><given-names>J</given-names></name><name><surname>Röning</surname><given-names>J</given-names></name></person-group><article-title>Combining classifiers with different footstep feature sets and multiple samples for person identification</article-title><conf-name>Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2005)</conf-name><conf-loc>Pennsylvania, PL, USA</conf-loc><conf-date>18–23 March 2005</conf-date><fpage>357</fpage><lpage>360</lpage></citation></ref>
<ref id="b54-sensors-11-02611"><label>54.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jung</surname><given-names>J</given-names></name><name><surname>Sato</surname><given-names>T</given-names></name><name><surname>Bien</surname><given-names>Z</given-names></name></person-group><article-title>Dynamic footprint-based person recognition method using a hidden Markov model and a neural network</article-title><source>Int. J. Intell. Syst</source><year>2004</year><volume>19</volume><fpage>1127</fpage><lpage>1141</lpage><pub-id pub-id-type="doi">10.1002/int.20040</pub-id></citation></ref></ref-list>
<sec sec-type="display-objects">
<title>Figures and Tables</title>
<fig id="f1-sensors-11-02611" position="float">
<label>Figure 1.</label>
<caption>
<p>Examples of walking pattern in gait: <bold>(a)</bold> stride length, dynamic range, foot angle <bold>(b)</bold> stance time and swing time.</p></caption>
<graphic xlink:href="sensors-11-02611f1.gif"/></fig>
<fig id="f2-sensors-11-02611" position="float">
<label>Figure 2.</label>
<caption>
<p>An example of stepping pattern in gait: ground reaction force.</p></caption>
<graphic xlink:href="sensors-11-02611f2.gif"/></fig>
<fig id="f3-sensors-11-02611" position="float">
<label>Figure 3.</label>
<caption>
<p>Overall structure of UbiFloorII.</p></caption>
<graphic xlink:href="sensors-11-02611f3.gif"/></fig>
<fig id="f4-sensors-11-02611" position="float">
<label>Figure 4.</label>
<caption>
<p>Reflective photo interrupters (<bold>left</bold>) and electric circuit (<bold>right</bold>).</p></caption>
<graphic xlink:href="sensors-11-02611f4.gif"/></fig>
<fig id="f5-sensors-11-02611" position="float">
<label>Figure 5.</label>
<caption>
<p>A wooden tile composed of 64 photo interrupters (<bold>left</bold>) and UbiFloorII (<bold>right</bold>).</p></caption>
<graphic xlink:href="sensors-11-02611f5.gif"/></fig>
<fig id="f6-sensors-11-02611" position="float">
<label>Figure 6.</label>
<caption>
<p>An example of searching footprints.</p></caption>
<graphic xlink:href="sensors-11-02611f6.gif"/></fig>
<fig id="f7-sensors-11-02611" position="float">
<label>Figure 7.</label>
<caption>
<p>An example of a footprint model.</p></caption>
<graphic xlink:href="sensors-11-02611f7.gif"/></fig>
<fig id="f8-sensors-11-02611" position="float">
<label>Figure 8.</label>
<caption>
<p>Walking feature extraction.</p></caption>
<graphic xlink:href="sensors-11-02611f8.gif"/></fig>
<fig id="f9-sensors-11-02611" position="float">
<label>Figure 9.</label>
<caption>
<p>An array of transitional footprints.</p></caption>
<graphic xlink:href="sensors-11-02611f9.gif"/></fig>
<fig id="f10-sensors-11-02611" position="float">
<label>Figure 10.</label>
<caption>
<p>An array of sampled transitional footprints.</p></caption>
<graphic xlink:href="sensors-11-02611f10.gif"/></fig>
<fig id="f11-sensors-11-02611" position="float">
<label>Figure 11.</label>
<caption>
<p>Structure of the neural network for user identification.</p></caption>
<graphic xlink:href="sensors-11-02611f11.gif"/></fig>
<fig id="f12-sensors-11-02611" position="float">
<label>Figure 12.</label>
<caption>
<p>Results of deciding the number of hidden nodes (<bold>left</bold>) and the epoch and goal (<bold>right</bold>) for walking pattern-based identification.</p></caption>
<graphic xlink:href="sensors-11-02611f12.gif"/></fig>
<fig id="f13-sensors-11-02611" position="float">
<label>Figure 13.</label>
<caption>
<p>Results of deciding the number of hidden nodes (<bold>left</bold>) and the epoch and goal (<bold>right</bold>) for stepping pattern-based identification.</p></caption>
<graphic xlink:href="sensors-11-02611f13.gif"/></fig>
<fig id="f14-sensors-11-02611" position="float">
<label>Figure 14.</label>
<caption>
<p>A flow chart of fusion at the matching score level for gait recognition.</p></caption>
<graphic xlink:href="sensors-11-02611f14.gif"/></fig>
<table-wrap id="t1-sensors-11-02611" position="float">
<label>Table 1.</label>
<caption>
<p>Heights and foot sizes of the subjects.</p></caption>
<table frame="hsides" rules="cols">
<thead>
<tr>
<th align="center" valign="middle"><bold>Subject</bold></th>
<th align="center" valign="middle"><bold>Height (cm)</bold></th>
<th align="center" valign="middle"><bold>Foot size (mm)</bold></th></tr>
<tr>
<th colspan="3" align="center" valign="bottom">
<hr/></th></tr></thead>
<tbody>
<tr>
<td align="center" valign="top">1</td>
<td align="center" valign="top">168</td>
<td align="center" valign="top">255</td></tr>
<tr>
<td align="center" valign="top">2</td>
<td align="center" valign="top">173</td>
<td align="center" valign="top">260</td></tr>
<tr>
<td align="center" valign="top">3</td>
<td align="center" valign="top">165</td>
<td align="center" valign="top">260</td></tr>
<tr>
<td align="center" valign="top">4</td>
<td align="center" valign="top">172</td>
<td align="center" valign="top">275</td></tr>
<tr>
<td align="center" valign="top">5</td>
<td align="center" valign="top">168</td>
<td align="center" valign="top">265</td></tr>
<tr>
<td align="center" valign="top">6</td>
<td align="center" valign="top">180</td>
<td align="center" valign="top">280</td></tr>
<tr>
<td align="center" valign="top">7</td>
<td align="center" valign="top">173</td>
<td align="center" valign="top">255</td></tr>
<tr>
<td align="center" valign="top">8</td>
<td align="center" valign="top">175</td>
<td align="center" valign="top">260</td></tr>
<tr>
<td align="center" valign="top">9</td>
<td align="center" valign="top">180</td>
<td align="center" valign="top">265</td></tr>
<tr>
<td align="center" valign="top">10</td>
<td align="center" valign="top">168</td>
<td align="center" valign="top">260</td></tr></tbody></table></table-wrap>
<table-wrap id="t2-sensors-11-02611" position="float">
<label>Table 2.</label>
<caption>
<p>Classifications of walking feature sets.</p></caption>
<table frame="hsides" rules="cols">
<thead>
<tr>
<th align="center" valign="middle"><bold>Case</bold></th>
<th align="left" valign="middle"><bold>Features sets</bold></th>
<th align="center" valign="middle"><bold>The number of inputs</bold></th></tr>
<tr>
<th colspan="3" align="center" valign="bottom">
<hr/></th></tr></thead>
<tbody>
<tr>
<td align="center" valign="top">1</td>
<td align="left" valign="top"><italic>FX</italic>, <italic>FY</italic></td>
<td align="center" valign="top">10</td></tr>
<tr>
<td align="center" valign="top">2</td>
<td align="left" valign="top"><italic>com_FX</italic>, <italic>com_FY</italic></td>
<td align="center" valign="top">10</td></tr>
<tr>
<td align="center" valign="top">3</td>
<td align="left" valign="top"><italic>com_FX</italic>, <italic>com_FY</italic>, <italic>nSensor</italic></td>
<td align="center" valign="top">15</td></tr>
<tr>
<td align="center" valign="top">4</td>
<td align="left" valign="top"><italic>com_FX</italic>, <italic>com_FY</italic>, <italic>fStart</italic>, <italic>fEnd</italic></td>
<td align="center" valign="top">20</td></tr>
<tr>
<td align="center" valign="top">5</td>
<td align="left" valign="top"><italic>com_FX</italic>, <italic>com_FY</italic>, <italic>fStart</italic>, <italic>fEnd</italic>, <italic>nSensor</italic></td>
<td align="center" valign="top">25</td></tr></tbody></table></table-wrap>
<table-wrap id="t3-sensors-11-02611" position="float">
<label>Table 3.</label>
<caption>
<p>Stepping feature sets in terms of used footsteps.</p></caption>
<table frame="hsides" rules="cols">
<thead>
<tr>
<th align="center" valign="middle"><bold>Case</bold></th>
<th align="left" valign="middle"><bold>Used footsteps</bold></th>
<th align="center" valign="middle"><bold>The number of steps</bold></th></tr>
<tr>
<th colspan="3" align="center" valign="bottom">
<hr/></th></tr></thead>
<tbody>
<tr>
<td align="center" valign="top">1</td>
<td align="left" valign="top">STEP_1, STEP_3</td>
<td align="center" valign="top">2</td></tr>
<tr>
<td align="center" valign="top">2</td>
<td align="left" valign="top">STEP_2, STEP_4</td>
<td align="center" valign="top">2</td></tr>
<tr>
<td align="center" valign="top">3</td>
<td align="left" valign="top">STEP_1, STEP_2</td>
<td align="center" valign="top">2</td></tr>
<tr>
<td align="center" valign="top">4</td>
<td align="left" valign="top">STEP_1, STEP_2, STEP_3, STEP_4</td>
<td align="center" valign="top">4</td></tr></tbody></table></table-wrap>
<table-wrap id="t4-sensors-11-02611" position="float">
<label>Table 4.</label>
<caption>
<p>Various sampling times for transitional footprints.</p></caption>
<table frame="hsides" rules="cols">
<thead>
<tr>
<th align="center" valign="middle"><bold>Sampling time (s)</bold></th>
<th align="center" valign="middle"><bold>The number of elements of the array</bold></th></tr>
<tr>
<th colspan="2" align="center" valign="bottom">
<hr/></th></tr></thead>
<tbody>
<tr>
<td align="center" valign="top">0.04</td>
<td align="center" valign="top">20</td></tr>
<tr>
<td align="center" valign="top">0.05</td>
<td align="center" valign="top">16</td></tr>
<tr>
<td align="center" valign="top">0.06</td>
<td align="center" valign="top">13</td></tr>
<tr>
<td align="center" valign="top">0.08</td>
<td align="center" valign="top">10</td></tr>
<tr>
<td align="center" valign="top">0.10</td>
<td align="center" valign="top">8</td></tr></tbody></table></table-wrap>
<table-wrap id="t5-sensors-11-02611" position="float">
<label>Table 5.</label>
<caption>
<p>Comparison of recognition accuracy of user identification by walking pattern.</p></caption>
<table frame="hsides" rules="cols">
<thead>
<tr>
<th align="center" valign="middle"><bold>Case</bold></th>
<th align="left" valign="middle"><bold>Features sets</bold></th>
<th align="center" valign="middle"><bold>Recognition accuracy (%)</bold></th></tr>
<tr>
<th colspan="3" align="center" valign="bottom">
<hr/></th></tr></thead>
<tbody>
<tr>
<td align="center" valign="top">1</td>
<td align="left" valign="top"><italic>FX, FY</italic></td>
<td align="center" valign="top">80.75</td></tr>
<tr>
<td align="center" valign="top">2</td>
<td align="left" valign="top"><italic>com_FX, com_FY</italic></td>
<td align="center" valign="top">89.05</td></tr>
<tr>
<td align="center" valign="top">3</td>
<td align="left" valign="top"><italic>com_FX, com_FY, nSensor</italic></td>
<td align="center" valign="top">86.85</td></tr>
<tr>
<td align="center" valign="top">4</td>
<td align="left" valign="top"><italic>com_FX, com_FY, fStart, fEnd</italic></td>
<td align="center" valign="top">96.20</td></tr>
<tr>
<td align="center" valign="top">5</td>
<td align="left" valign="top"><italic>com_FX, com_FY, fStart, fEnd, nSensor</italic></td>
<td align="center" valign="top">95.20</td></tr></tbody></table></table-wrap>
<table-wrap id="t6-sensors-11-02611" position="float">
<label>Table 6.</label>
<caption>
<p>Comparison of recognition accuracy (%) of user identification by stepping pattern.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="center" valign="middle"/>
<th align="center" valign="middle"/>
<th colspan="5" align="center" valign="middle"><bold>Sampling time (s)</bold></th></tr>
<tr>
<th colspan="7" align="center" valign="bottom">
<hr/></th></tr>
<tr>
<th align="center" valign="middle"/>
<th align="center" valign="middle">LEFT</th>
<th align="center" valign="middle">0.04</th>
<th align="center" valign="middle">0.05</th>
<th align="center" valign="middle">0.06</th>
<th align="center" valign="middle">0.08</th>
<th align="center" valign="middle">0.10</th></tr></thead>
<tbody>
<tr>
<td align="left" valign="top"><bold>Case 1</bold></td>
<td align="center" valign="top">58.6</td>
<td align="center" valign="top">89.0</td>
<td align="center" valign="top">89.2</td>
<td align="center" valign="top">84.4</td>
<td align="center" valign="top">82.7</td>
<td align="center" valign="top">84.5</td></tr>
<tr>
<td align="left" valign="top"><bold>Case 2</bold></td>
<td align="center" valign="top">60.7</td>
<td align="center" valign="top">89.3</td>
<td align="center" valign="top">82.4</td>
<td align="center" valign="top">80.7</td>
<td align="center" valign="top">73.4</td>
<td align="center" valign="top">80.3</td></tr>
<tr>
<td align="left" valign="top"><bold>Case 3</bold></td>
<td align="center" valign="top">60.0</td>
<td align="center" valign="top">83.9</td>
<td align="center" valign="top">84.9</td>
<td align="center" valign="top">84.8</td>
<td align="center" valign="top">82.5</td>
<td align="center" valign="top">79.0</td></tr>
<tr>
<td align="left" valign="top"><bold>Case 4</bold></td>
<td align="center" valign="top">68.1</td>
<td align="center" valign="top">92.0</td>
<td align="center" valign="top">91.9</td>
<td align="center" valign="top">91.3</td>
<td align="center" valign="top">88.5</td>
<td align="center" valign="top">86.0</td></tr></tbody></table></table-wrap>
<table-wrap id="t7-sensors-11-02611" position="float">
<label>Table 7.</label>
<caption>
<p>Summary of classifier results (mean <italic>±</italic> standard deviation). Comparison of recognition accuracy (%) of user identification by walking pattern.</p></caption>
<table frame="hsides" rules="cols">
<thead>
<tr>
<th align="center" valign="middle"><bold>Classifier</bold></th>
<th align="center" valign="middle"><bold>Recognition accuracy (mean ± std)</bold></th></tr>
<tr>
<th colspan="2" align="center" valign="bottom">
<hr/></th></tr></thead>
<tbody>
<tr>
<td align="center" valign="top">Multilayer Perceptron</td>
<td align="center" valign="top">96.64 ± 0.38</td></tr>
<tr>
<td align="center" valign="top">Instance-based Learning</td>
<td align="center" valign="top">94.08 ± 0.47</td></tr>
<tr>
<td align="center" valign="top">Decision Tree</td>
<td align="center" valign="top">88.30 ± 0.83</td></tr>
<tr>
<td align="center" valign="top">Bayes Net</td>
<td align="center" valign="top">90.86 ± 1.28</td></tr>
<tr>
<td align="center" valign="top">Decision Table</td>
<td align="center" valign="top">73.92 ± 1.36</td></tr>
<tr>
<td align="center" valign="top">Support Vector Machine</td>
<td align="center" valign="top">95.88 ± 0.33</td></tr></tbody></table></table-wrap>
<table-wrap id="t8-sensors-11-02611" position="float">
<label>Table 8.</label>
<caption>
<p>Aggregate confusion matrix for multilayer perceptron based on 10 times 10-fold cross-validation for 10 subjects’ walking pattern.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="center" valign="middle"><bold>User</bold><sub>0</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>1</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>2</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>3</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>4</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>5</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>6</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>7</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>8</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>9</sub></th>
<th align="center" valign="middle"><bold>← Classified as</bold></th></tr></thead>
<tbody>
<tr>
<td align="center" valign="top">445</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">23</td>
<td align="center" valign="top">12</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">User<sub>0</sub></td></tr>
<tr>
<td align="center" valign="top">5</td>
<td align="center" valign="top">478</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">4</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>1</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">485</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">15</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>2</sub></td></tr>
<tr>
<td align="center" valign="top">22</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">463</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">11</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">3</td>
<td align="center" valign="top">User<sub>3</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">500</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>4</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">500</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>5</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">12</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">488</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>6</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">11</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">489</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>7</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">499</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>8</sub></td></tr>
<tr>
<td align="center" valign="top">10</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">5</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">485</td>
<td align="center" valign="top">User<sub>9</sub></td></tr></tbody></table></table-wrap>
<table-wrap id="t9-sensors-11-02611" position="float">
<label>Table 9.</label>
<caption>
<p>Summary of classifier results (mean ± standard deviation). Comparison of recognition accuracy (%) of user identification by stepping pattern.</p></caption>
<table frame="hsides" rules="cols">
<thead>
<tr>
<th align="center" valign="middle"><bold>Classifier</bold></th>
<th align="center" valign="middle"><bold>Recognition accuracy (mean ± std)</bold></th></tr>
<tr>
<th colspan="2" align="center" valign="bottom">
<hr/></th></tr></thead>
<tbody>
<tr>
<td align="center" valign="top">Multilayer Perceptron</td>
<td align="center" valign="top">92.44 ± 0.28</td></tr>
<tr>
<td align="center" valign="top">Instance-based Learning</td>
<td align="center" valign="top">84.32 ± 0.48</td></tr>
<tr>
<td align="center" valign="top">Decision Tree</td>
<td align="center" valign="top">79.16 ± 1.55</td></tr>
<tr>
<td align="center" valign="top">Bayes Net</td>
<td align="center" valign="top">91.62 ± 0.37</td></tr>
<tr>
<td align="center" valign="top">Decision Table</td>
<td align="center" valign="top">57.38 ± 1.61</td></tr>
<tr>
<td align="center" valign="top">Support Vector Machine</td>
<td align="center" valign="top">95.61 ± 0.26</td></tr></tbody></table></table-wrap>
<table-wrap id="t10-sensors-11-02611" position="float">
<label>Table 10.</label>
<caption>
<p>Aggregate confusion matrix for support vector machine based on 10 times 10-fold cross-validation for 10 subjects’ stepping pattern.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="center" valign="middle"><bold>User</bold><sub>0</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>1</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>2</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>3</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>4</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>5</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>6</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>7</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>8</sub></th>
<th align="center" valign="middle"><bold>User</bold><sub>9</sub></th>
<th align="center" valign="middle"><bold>← Classified as</bold></th></tr></thead>
<tbody>
<tr>
<td align="center" valign="top">497</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">3</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>0</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">486</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">14</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>1</sub></td></tr>
<tr>
<td align="center" valign="top">11</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">487</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>2</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">12</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">454</td>
<td align="center" valign="top">18</td>
<td align="center" valign="top">16</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>3</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">466</td>
<td align="center" valign="top">24</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>4</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">52</td>
<td align="center" valign="top">448</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>5</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">4</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">496</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>6</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">15</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">485</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>7</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">11</td>
<td align="center" valign="top">17</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">471</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">User<sub>8</sub></td></tr>
<tr>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">498</td>
<td align="center" valign="top">User<sub>9</sub></td></tr></tbody></table></table-wrap>
<table-wrap id="t11-sensors-11-02611" position="float">
<label>Table 11.</label>
<caption>
<p>Performance comparison of all floor-based systems.</p></caption>
<table frame="hsides" rules="all">
<thead>
<tr>
<th align="left" valign="middle"><bold>Methods</bold></th>
<th align="left" valign="middle"><bold>Sensors</bold></th>
<th align="left" valign="middle"><bold>Features</bold></th>
<th align="center" valign="middle"><bold>Classifiers</bold></th>
<th align="center" valign="middle"><bold>Subjects</bold></th>
<th align="center" valign="middle"><bold>Accuracy</bold></th></tr></thead>
<tbody>
<tr>
<td align="left" valign="top">Kennedy, 1996, [<xref ref-type="bibr" rid="b31-sensors-11-02611">31</xref>]</td>
<td align="left" valign="top">Inked barefoot prints</td>
<td align="left" valign="top">Pressure areas on the soles of the feet</td>
<td align="center" valign="top">Physical matching</td>
<td align="center" valign="top">N/A</td>
<td align="center" valign="top">N/A</td></tr>
<tr>
<td align="left" valign="top">Addlesee, 1997, [<xref ref-type="bibr" rid="b28-sensors-11-02611">28</xref>]</td>
<td align="left" valign="top">Load cells, floor</td>
<td align="left" valign="top">GRF discrete signal over a footstep</td>
<td align="center" valign="top">HMM</td>
<td align="center" valign="top">15</td>
<td align="center" valign="top">91.3</td></tr>
<tr>
<td align="left" valign="top">Orr, 2000, [<xref ref-type="bibr" rid="b29-sensors-11-02611">29</xref>]</td>
<td align="left" valign="top">Load cells, floor</td>
<td align="left" valign="top">GRF profile features over a footstep</td>
<td align="center" valign="top">KNN</td>
<td align="center" valign="top">15</td>
<td align="center" valign="top">93.0</td></tr>
<tr>
<td align="left" valign="top">Nakajima, 2000, [<xref ref-type="bibr" rid="b32-sensors-11-02611">32</xref>]</td>
<td align="left" valign="top">Load cells, mat</td>
<td align="left" valign="top">Direction and position of the footprints</td>
<td align="center" valign="top">Distance function</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">85.0</td></tr>
<tr>
<td align="left" valign="top">Yun, 2003, [<xref ref-type="bibr" rid="b21-sensors-11-02611">21</xref>]</td>
<td align="left" valign="top">Switch sensors, mat</td>
<td align="left" valign="top">Foot centers over 5 consecutive footsteps</td>
<td align="center" valign="top">MLP</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">92.8</td></tr>
<tr>
<td align="left" valign="top">Jung, 2003, [<xref ref-type="bibr" rid="b33-sensors-11-02611">33</xref>]</td>
<td align="left" valign="top">Pressure sensor, mat</td>
<td align="left" valign="top">2D COP trajectories over 2 consecutive footsteps, combine classifiers</td>
<td align="center" valign="top">HMM</td>
<td align="center" valign="top">8</td>
<td align="center" valign="top">64.0</td></tr>
<tr>
<td align="left" valign="top">Pirttikangas, 2003, [<xref ref-type="bibr" rid="b50-sensors-11-02611">50</xref>]</td>
<td align="left" valign="top">ElectroMechanical Film, floor</td>
<td align="left" valign="top">Prototype vector via codebook for profile features</td>
<td align="center" valign="top">HMM</td>
<td align="center" valign="top">3</td>
<td align="center" valign="top">76.8</td></tr>
<tr>
<td align="left" valign="top">Pirttikangas, 2003, [<xref ref-type="bibr" rid="b51-sensors-11-02611">51</xref>]</td>
<td align="left" valign="top">ElectroMechanical Film, floor</td>
<td align="left" valign="top">Prototype vector via codebook for profile features</td>
<td align="center" valign="top">LVQ</td>
<td align="center" valign="top">11</td>
<td align="center" valign="top">78.0</td></tr>
<tr>
<td align="left" valign="top">Jung, 2004, [<xref ref-type="bibr" rid="b54-sensors-11-02611">54</xref>]</td>
<td align="left" valign="top">Pressure sensor, mat</td>
<td align="left" valign="top">2D COP trajectories over 2 consecutive footsteps, combine classifiers</td>
<td align="center" valign="top">HMM, NN</td>
<td align="center" valign="top">11</td>
<td align="center" valign="top">79.6</td></tr>
<tr>
<td align="left" valign="top">Suutala, 2004, [<xref ref-type="bibr" rid="b52-sensors-11-02611">52</xref>]</td>
<td align="left" valign="top">ElectroMechanical Film, floor</td>
<td align="left" valign="top">Features from spatial, frequency domain over a footstep</td>
<td align="center" valign="top">DSLVQ</td>
<td align="center" valign="top">11</td>
<td align="center" valign="top">70.2</td></tr>
<tr>
<td align="left" valign="top">Middleton, 2005, [<xref ref-type="bibr" rid="b22-sensors-11-02611">22</xref>]</td>
<td align="left" valign="top">Force Sensing Resistor, mat</td>
<td align="left" valign="top">Stride length, cadence, heel-to-toe ratio over 4 consecutive footsteps</td>
<td align="center" valign="top">N/A</td>
<td align="center" valign="top">15</td>
<td align="center" valign="top">80.0</td></tr>
<tr>
<td align="left" valign="top">Yun, 2005, [<xref ref-type="bibr" rid="b38-sensors-11-02611">38</xref>]</td>
<td align="left" valign="top">Photo interrupters, floor</td>
<td align="left" valign="top">Foot centers and heel-to-toe time over 5 consecutive footsteps</td>
<td align="center" valign="top">MLP</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">96.2</td></tr>
<tr>
<td align="left" valign="top">Suutala, 2005, [<xref ref-type="bibr" rid="b53-sensors-11-02611">53</xref>]</td>
<td align="left" valign="top">ElectroMechanical Film, floor</td>
<td align="left" valign="top">Features from spatial, frequency domain over a footsteps, combine different feature presentations for a footstep, and then combine on multiple footsteps</td>
<td align="center" valign="top">MLP, 1 footstep<break/>MLP, 5 footsteps</td>
<td align="center" valign="top">11</td>
<td align="center" valign="top">79.2<break/>95.0</td></tr>
<tr>
<td align="left" valign="top">Suutala, 2008, [<xref ref-type="bibr" rid="b30-sensors-11-02611">30</xref>]</td>
<td align="left" valign="top">Switch sensors, floor</td>
<td align="left" valign="top">Spatial, statistical, time-related features over a footsteps, stride length and cadence from multiple consecutive footsteps</td>
<td align="center" valign="top">GP, 1 footstep<break/>GP, 5–7 footsteps</td>
<td align="center" valign="top">9</td>
<td align="center" valign="top">64.2<break/>84.3</td></tr>
<tr>
<td align="left" valign="top">Suutala, 2008, [<xref ref-type="bibr" rid="b44-sensors-11-02611">44</xref>]</td>
<td align="left" valign="top">ElectroMechanical Film, floor</td>
<td align="left" valign="top">Features from spatial, frequency domain over a footsteps, combine different feature presentations for a footstep, and then combine on multiple footsteps</td>
<td align="center" valign="top">MLP, 1 footstep<break/>SVM, 2 footsteps<break/>SVM, 5 footsteps</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">63.3<break/>81.9<break/>91.7</td></tr>
<tr>
<td align="left" valign="top">Yun, 2008, [<xref ref-type="bibr" rid="b37-sensors-11-02611">37</xref>]</td>
<td align="left" valign="top">Photo interrupters, floor</td>
<td align="left" valign="top">Array of sampled transitional footprints over 4 consecutive footsteps</td>
<td align="center" valign="top">MLP</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">92.0</td></tr>
<tr>
<td align="left" valign="top">Qian, 2008, [<xref ref-type="bibr" rid="b23-sensors-11-02611">23</xref>]</td>
<td align="left" valign="top">Force Sensing Resistor, floor</td>
<td align="left" valign="top">1D pressure profile + 2D COP trajectory over a footstep, stride length, cadence, mean pressure of both footsteps</td>
<td align="center" valign="top">FLD</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">94.2</td></tr>
<tr>
<td align="left" valign="top">Qian, 2010, [<xref ref-type="bibr" rid="b24-sensors-11-02611">24</xref>]</td>
<td align="left" valign="top">Force Sensing Resistor, floor</td>
<td align="left" valign="top">1D pressure profile + 2D COP trajectory over a footstep, stride length, mean pressure of both footsteps</td>
<td align="center" valign="top">FLD</td>
<td align="center" valign="top">11</td>
<td align="center" valign="top">92.3</td></tr>
<tr>
<td align="left" valign="top">The Proposed method</td>
<td align="left" valign="top">Photo interrupters, floor</td>
<td align="left" valign="top">Foot centers, heel-to-toe time, array of sampled transitional footprints over 5 consecutive footsteps, combine classifiers</td>
<td align="center" valign="top">MLP</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">99.0</td></tr></tbody></table></table-wrap></sec></back></article>
