Next Article in Journal
A Refined Shape Sensing Method for Skin Antenna Structure Based on Inverse Finite Element Method
Previous Article in Journal
A Linear Brushless Direct Current Motor Design Approach for Seismic Shake Tables
Previous Article in Special Issue
Robust Deep Speaker Recognition: Learning Latent Representation with Joint Angular Margin Loss
Open AccessArticle

Multimodal Few-Shot Learning for Gait Recognition

Department of Computer Engineering and Computer Science, California State University, Long Beach, CA 90840, USA
Department of Computer Science and Engineering, Dankook University, Yongin-si 16890, Gyeonggi-do, Korea
Author to whom correspondence should be addressed.
Appl. Sci. 2020, 10(21), 7619;
Received: 8 October 2020 / Revised: 24 October 2020 / Accepted: 25 October 2020 / Published: 29 October 2020
A person’s gait is a behavioral trait that is uniquely associated with each individual and can be used to recognize the person. As information about the human gait can be captured by wearable devices, a few studies have led to the proposal of methods to process gait information for identification purposes. Despite recent advances in gait recognition, an open set gait recognition problem presents challenges to current approaches. To address the open set gait recognition problem, a system should be able to deal with unseen subjects who have not included in the training dataset. In this paper, we propose a system that learns a mapping from a multimodal time series collected using insole to a latent (embedding vector) space to address the open set gait recognition problem. The distance between two embedding vectors in the latent space corresponds to the similarity between two multimodal time series. Using the characteristics of the human gait pattern, multimodal time series are sliced into unit steps. The system maps unit steps to embedding vectors using an ensemble consisting of a convolutional neural network and a recurrent neural network. To recognize each individual, the system learns a decision function using a one-class support vector machine from a few embedding vectors of the person in the latent space, then the system determines whether an unknown unit step is recognized as belonging to a known individual. Our experiments demonstrate that the proposed framework recognizes individuals with high accuracy regardless they have been registered or not. If we could have an environment in which all people would be wearing the insole, the framework would be used for user verification widely. View Full-Text
Keywords: gait analysis; open set recognition; few-shot learning; multi-modality; wearable sensors gait analysis; open set recognition; few-shot learning; multi-modality; wearable sensors
Show Figures

Figure 1

MDPI and ACS Style

Moon, J.; Le, N.A.; Minaya, N.H.; Choi, S.-I. Multimodal Few-Shot Learning for Gait Recognition. Appl. Sci. 2020, 10, 7619.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Search more from Scilit
Back to TopTop