Next Article in Journal
Influence of Construction Joint and Bridge Geometry on Integral Abutment Bridges
Previous Article in Journal
Modeling Soil Water Content and Reference Evapotranspiration from Climate Data Using Deep Learning Method
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Fall Posture Classification and Recognition Method Based on Wavelet Packet Transform and Support Vector Machine

1
College of Artificial Intelligence, Nankai University, Tianjin 300350, China
2
Department of Electrical Engineering and Automation, Aalto University, 02150 Espoo, Finland
3
Ecole Nationale Supérieure des Arts et Industries Textiles, 59056 Roubaix, France
4
Department of Computer Science, Swiss Distance University of Applied Sciences, CH-3900 Brig, Switzerland
*
Author to whom correspondence should be addressed.
Appl. Sci. 2021, 11(11), 5030; https://doi.org/10.3390/app11115030
Submission received: 29 April 2021 / Revised: 22 May 2021 / Accepted: 26 May 2021 / Published: 29 May 2021
(This article belongs to the Topic Applied Computer Vision and Pattern Recognition)

Abstract

:
An accidental fall seriously threatens the health and safety of the elderly. The injuries caused by a fall have a lot to do with the different postures during the fall. Therefore, recognizing the posture of falling is essential for the rescue and care of the elderly. In this paper, a novel method was proposed to improve the classification and recognition accuracy of fall postures. Firstly, the wavelet packet transform was used to extract multiple features from sample data. Secondly, random forest was used to evaluate the importance of the extracted features and obtain effective features through screening. Finally, the support vector machine classifier based on the linear kernel function was used to realize the falling posture recognition. The experiment results on “Simulated Falls and Daily Living Activities Data Set” show that the proposed method can distinguish different types of fall postures and achieve 99% classification accuracy.

1. Introduction

As the number of elderly people in the world continues to rise and the problem of population aging becomes more and more serious, falls are increasingly threatening the lives and health of the elderly [1,2,3], and an elderly person falls have become an important part of medical care. The physical functions of the elderly over 65 years old are significantly reduced, and at the same time, their reaction ability and balance ability are very weak, and they can easily fall. Once an elderly person falls, the degree of injury of the elderly may be more serious if no one else finds or rescues them, the old person’s injury may be more serious, and they may even fall into a coma, endangering their life. In addition, different fall postures during a fall will cause different impact positions, causing varying degrees of injury to the elderly [4,5]. Therefore, there is a need for an automatic detection method, which cannot only recognize the fall behavior of the elderly in time, but also recognize the fall posture, so that the nursing staff can grasp the specific details such as the impact position and the degree of injury of the elderly, and provide the elderly with more targeted rescue and treatment.
In recent years, artificial intelligence technology is developing rapidly. Its application in fall detection has become more and more extensive. Many experts and scholars carried out research work on fall detection and posture recognition. According to the different fall detection equipment, the current fall detection technology can be divided into video, surrounding environment, and wearable fall detection. The method based on video image collects human motion images by deploying one or more video cameras in the user’s active area and analyzes the real-time collected video images based on the characteristics of the fall motion image extracted offline to determine whether the current user has fallen or recognize the posture of a fall [6,7,8,9,10,11]. The method based on the surrounding environment uses infrared, pressure, and audio sensors arranged in the surrounding environment (walls, floors, ceilings, carpets) to obtain data, analyze, and recognize human behavior [12,13]. The above two methods have the advantages of high accuracy and no need to wear detection equipment, but the whole system is very complicated, incurring high costs and a large amount of data calculation, which easily exposes personal privacy. Moreover, outdoor monitoring cannot be achieved.
With the help of commonly used mobile smart terminals and wearable devices, methods based on wearable devices are widely used to recognize fall postures. Their advantages in terms of accuracy and real-time recognition have made them a research hotspot in the field of healthcare. In this method, a microsensor is worn on the human body to collect data, and a back-end algorithm is used to recognize the falling postures. Most of the studies used acceleration or gyroscope data time series, statistical domain or transform domain features, and used curve similarity comparison or pattern recognition algorithms for fall detection [14,15,16,17,18]. A small set of two or three uniaxial accelerometers mounted on the body were first utilized to distinguish several static and dynamic activities (standing, sitting, lying, walking, ascending stairs, descending stairs, cycling) [19]. He et al. [20] proposed to install an acceleration sensor device on the limbs and crotch and use the support vector machine (SVM) algorithm to judge a variety of typical actions such as jumping, standing still, walking, running, which achieves a detection effect of 92.25% accuracy. Song et al. [21] proposed a method of using a mobile phone as a carrier and embedding a three-dimensional acceleration sensor into it to monitor the body’s daily motion posture, covering running, sitting, rising, falling, and other actions, with an accuracy rate of 97.7%. Thanh et al. [22] proposed developing a real-time, simple and high-accuracy fall detection system for the elderly using 3-DOF accelerometers, for which the fall detection algorithm compares the acceleration with the lower fall threshold and upper fall threshold values to accurately detect a fall event; in addition, a post-fall recognition module was added to the method to enhance the performance and accuracy, and the system achieves 100% sensitivity and accuracy. Nevertheless, our research focused on identifying different fall postures, and the threshold method can easily distinguish falls from daily behaviors, but it cannot effectively identify different fall postures. This fall detection method protects users’ privacy and has small restrictions on the scope of applications, which is an ideal fall detection technology.
Various sensors on wearable devices provide essential data for fall posture detection. However, the high-dimensional nonlinear data collected by multiple sensors is difficult to process and classify. Therefore, the first but most important thing that needs to be done is to extract features from massive sample data. Most researchers’ feature extraction methods mainly include time domain analysis, frequency domain analysis, and time-frequency domain analysis. The time domain and frequency domain analysis methods mainly extract eigenvalues from the signal’s time and frequency domain information. Commonly used eigenvalues mainly include mean, standard deviation, variance, root mean square, and peak-to-peak values. For example, Jian et al. [23] used the root mean square of acceleration and angular velocity for fall detection. Tu et al. [24] extracted feature values such as the mean, variance, maximum, and minimum to train a fall detection model. The above methods had a shorter calculation time and lower space complexity, but it cannot fully express the original signal’s information and cannot handle non-stationary signals well. The most commonly used time-frequency analysis method was the wavelet transform, which was suitable for analyzing non-stationary signals. Wavelet transform only further decomposes the low-frequency part of the signal and does not decompose the high-frequency part. Compared with the wavelet transform, the wavelet packet transform (WPT) can analyze the signal more finely and decompose the signal’s high-frequency part, which is widely used in feature extraction [25,26,27,28]. Therefore, the wavelet packet transform can be applied to fall posture recognition to improve the entire system’s recognition effect.
Moreover, fall postures can be classified using pattern recognition algorithms, which are good at digging out characteristic parameters that can distinguish different behaviors. Traditional classifiers such as artificial neural networks (ANNs), K-nearest neighbor (KNN) all require many samples to achieve good classification results, and their computational cost is high. At the same time, the processor in the wearable device cannot provide enough memory. However, for fall posture recognition cases, the number of fallen samples is limited, making it challenging to achieve a high recognition accuracy. The support vector machine (SVM) algorithm has excellent advantages in solving small sample and local extreme value problems. Even if the number of samples is limited, it can also achieve good classification results. Compared with ANN, SVM has a low computational cost and small memory occupation and is easy to implement in wearable devices. Aziz et al. [29] presents the research and simulation of wearable device-based fall detection approach by addressing the building of wearable device-based fall detection system for elderly care by using mobile devices. The findings suggest that SVM with the polynomial (order 5) method, which achieved 68.91% overall accuracy and produced only 24.46% FPR, is the most precise model for the fall detection system. Shibuya N. et al. [30] presented a custom-designed wireless gait analysis sensor system for real-time fall detection using an SVM classifier, and six features were extracted for fall classification. Finally, the system achieved an overall specificity of 99.5% and overall sensitivity of 97.0%.
This paper proposes a novel method for fall falling posture classification and recognition based on WPT and SVM and has the following contributions:
  • This paper proposes a fall posture classification and recognition method based on time series analysis and uses SVM to distinguish between various fall postures and daily behaviors, achieving 99% classification accuracy, and good real-time performance;
  • WPT was used to extract multiple features from sample data, and random forest was used to evaluate the importance of the extracted features and obtain effective features through screening. Combining the two can ensure a high accuracy rate of fall gesture recognition, high computational efficiency, and a good application value;
  • The “Simulated Falls and Daily Living Activities Data Set” was chosen to verify the effectiveness of the proposed algorithm, which comes from the UCI database, and is a commonly used standard test dataset for machine learning proposed by the University of California Irvine. The experiment and simulation results show that the proposed method has good real-time performance and high accuracy.
The remainder of this paper is organized as follows. In Section 2, we describe the methods of preprocessing, feature extraction, and classification. In Section 3, we introduce the raw data and the hardware platform, and two sets of experiments are presented to verify the effectiveness of the proposed method. Then, we discuss the limitation of our method and future work. We conclude this paper in Section 4.

2. Method

2.1. Data Preprocessing

Since a fall action generally lasts 1–3 s, and the original data collection’s length is about 15 s, the original data must be intercepted to collect valid data information. The sampling frequency is 25 Hz. Thus, a sliding window with a length of 75 is selected. That is, the detection time is 3 s. In order to intercept effective information, the Algorithm 1 is adopted.
Algorithm 1: Signal Window Extraction Algorithm
1: for signal in signals://Each group of data has 21 sensor signals
2:       index = getBiggestChangePoint(signal)
3:       array = arrayAppend(index)
4: index = getMode(array)
5: windowSignal = signals[index-(windowSize/2), index + (windowSize/2)]
Take the x axis acceleration signal as an example, and the signal before and after the window interception ass shown in Figure 1.
As shown in Figure 1, in the original signal with a length of 15 s, only the data within a period of about 5–8 s are valid data. Using our window interception algorithm, effective data were extracted, which is very important for subsequent feature extraction.

2.2. Feature Extraction

Since people’s activities of daily living (ADLs) and falls are a dynamic process, the data collected by sensors on wearable devices are usually non-stationary signals. The wavelet packet decomposition can orthogonalize the collected signals in any independent frequency band without omission. The information components contained in the sensor signal are not the same in different fall postures. After wavelet packet decomposition, different frequency bands’ energy values can be used as feature variables to express a specific fall posture or action. Therefore, the time-domain features and the features obtained by WPT can be combined as feature variables.

2.2.1. Extract Wavelet Packet Transform Features

We used wavelet packet decomposition to divide the signal into different frequency bands and measure the energy of each frequency band as a feature vector. When performing n-layer wave packet transformation, we chose d b 3 wavelet. Each column of data can obtain 2 n groups of different frequency components, and the energy of each frequency component is calculated as follows:
e n , m = i = 1 j x m , i 2
where m   =   0 ,   1 ,   2     2 n     1 ,   i   =   1 ,   2     j , j is the number of discrete sampling points of the signal and x m , i is the amplitude of the discrete points. The decomposition process is shown in the Figure 2.
A certain column of timing signals can be expressed as
E i   =   e n , 0 ,   e n , 1 ,   e n , 2     e n , m
Then, all timing signals can be expressed as
E   =   E 1 ,   E 2     E s

2.2.2. Extract Time Domain Features

Feature extraction based on statistical methods is the most commonly used to extract statistical features from time-series signals as feature vectors. This type of feature is suitable for time series signals with prominent statistical characteristics of signal waveforms. For the window signal after preprocessing, we extract certain features with good discrimination from the perspective of statistical methods, and the extracted features are shown in Table 1:

2.3. Feature Selection

Through feature extraction, hundreds of features can be obtained, but not all features have a positive effect on model classification and recognition. Therefore, it is necessary to reduce the dimensionality of features to eliminate irrelevant features.
Random forest is an algorithm that integrates multiple trees through the idea of ensemble learning. Its basic unit is a decision tree, and its essence belongs to ensemble learning. Random forest combines hundreds of decision trees, trains each decision tree on slightly different observation sets, and considers only a limited number of features in each tree to split nodes. The final prediction of random forest is through averaging the predictions of each tree. The introduction of two random trees makes mitigates the chances of the random forest falling into over-fitting and provides it with good anti-noise ability. It can evaluate each variable’s importance and perform feature selection on high-dimensional data, thereby making the model more robust.
The calculation method of the importance of a certain feature X in a Random Forest is shown as follows:
  • For each decision tree in the Random Forest, we use the corresponding out-of-bag (OOB) data to calculate its error, denoted as e r r o o b 1 ;
  • Randomly add noise interference to the feature X of all samples of OOB data (the value of the sample at feature X can be randomly changed), and calculate its out-of-bag data error again and record it as e r r o o b 2 ;
  • Assuming that there are N trees in the random forest, then the importance of feature is expressed as X = ( e r r o o b 2 e r r o o b 1 ) / N . After a certain feature is randomly added to the noise, the accuracy rate outside the bag is greatly reduced, which means that this feature greatly influences the classification result of the sample.

2.4. Classification

2.4.1. Use SVM to Deal with Two Classification Problems

SVM is a generalized linear classifier that classifies binary or multivariate data according to the supervised learning method, and its decision boundary is the maximum margin hyperplane for solving learning samples. The SVM separates different sample categories by constructing the optimal classification plane to maximize the boundary distance between two or more categories. The simplest SVM model is the maximum interval classifier. It is only suitable for the case where the sample data are linearly separable in the feature space. However, in practice, the training sample set is usually linearly inseparable, so parameter relaxation variables ξ are introduced. If the sample is misclassified during classification, ξ will be greater than 0. The following linear equation can describe any hyperplane:
ω * · x + b * = 0
The classification decision function is defined as
f ( x ) = s i g n ( ω * · x + b * ) = s i g n i = 1 m α i * y i ( x i · x ) + b *
Let i = 1 n ξ i describe the degree of misclassification of training samples. For the classification interface in the case of linear inseparability, it is hoped that the maximum classification interval 2 / ω should be as large as possible, and the degree of misclassification of training samples i = 1 n ξ i should be as small as possible. When errors occur, the degree of punishment for errors needs to be controlled, so the penalty factor C is introduced, which is an adjustable parameter. The larger C is, the heavier the penalty is. Consequently, the objective function can be written as:
min 1 2 ω 2 + C i = 1 n ξ i s . t . y i ( ω T x i + b ) 1 ξ i ,   ξ i 0 , i = 1 , 2 , , n
Rewritten by Lagrangian duality transformation, we have:
max i = 1 m α i 1 2 i , j = 1 m α i α j y i y j ( x i · x j ) s . t . i = 1 m α i y i = 0 , 0 α i C , i = 1 , 2 , , m
Since the training samples are linearly inseparable, the original sample can be transformed into a high-dimensional space by introducing a kernel function method using nonlinear mapping. That is, the linear inseparable problem in the low-dimensional space is transformed into the linearly separable problem in the high-dimensional space. Common kernel functions are shown in Table 2:
Choosing a suitable kernel function, the optimal classification function can be obtained:
f ( X ) = s i g n i = 1 m α i * y i K x i , x + b *

2.4.2. Multi-Classification Method of SVM

The classic SVM only gives a two-class classification algorithm, so extending the support vector machine to a multi-class classification problem and obtaining significant results is still challenging. When using SVM to construct multi-class classifiers, two methods are usually applied. One is to extend to a multi-class classification support vector machine. This method uses a large number of variables and has high computational complexity, which is not applicable in reality. The other is to convert into a two-class classification problem using several two-class classification support vector machines to form a multi-class classifier. Due to the fast calculation speed, this method is widely used. This method has two typical algorithms called the “one-against-all” algorithm and the “one-against-one” algorithm.
The “one-against-all” algorithm sequentially classifies the samples of a specific category into one category and other remaining samples into another category. In this way, the sample of N categories constructs N second-class classifiers. When classifying, the samples to be tested are classified into the category with the largest classification function value. Although this algorithm has the advantages of a small number of classifiers and a fast classification speed, due to the large difference in sample size between the two types, it is easy to cause the problem of dataset skew. At the same time, the “one-against-one” algorithm uses the training samples of any two categories to train a two-class classifier without repetition. For a multi-class classification problem with N categories of training samples, a total of N N 1 / 2 second-class classifiers is required. Although the number of classifiers in this algorithm is large, the training scale of a single second-class classifier of this algorithm is small, and the training data are balanced and easy to expand. In this paper, the “one-against-one” algorithm is applied to construct a multi-class classifier.

3. Results and Discussions

3.1. Experimental Setting

3.1.1. Data Source

The dataset used in this paper comes from the UCI database. The “Simulated Falls and Daily Living Activities Data Set” [31] included in the database in June 2018 was chosen for our experiment. The dataset was completed by 17 volunteers, including ten men and seven women. Each volunteer must complete 36 behaviors, including 20 falling behaviors and 16 daily behaviors, each repeated five times. In this way, there are 3060 sampled data for each part. The original signal is a total of 21-dimensional signals such as three-dimensional acceleration, three-dimensional angular velocity, three-dimensional velocity, three-dimensional geomagnetism, pressure, and more output from the sensor. The sensor’s sampling frequency is 25 Hz, and the average sampling time for each action is 15 s. It has been shown that breasts can achieve better recognition accuracy [32]. In this paper, we select all samples of breasts in this dataset as raw data. Figure 3 shows the change of the sensor value during front-knees and back-lying actions. It can be observed that different sensors produce different signals. Thus, different fall postures can be identified by extracting the change characteristics of different sensors’ signal values.

3.1.2. Data Division

There are 20 fall behaviors in the original data, of which we selected 12 behaviors. In the unused fall data, the four actions numbered 905, 906, 914, and 916 are those the tester would quickly or slowly recover after a fall, which shows that this type of fall does not cause the user to lose control of their body, so it is beyond the scope of our research. The remaining four behaviors numbered 917, 918, 919, and 920 did not indicate the fall’s direction and posture, so these four datasets were discarded. In addition, this paper’s focus is to recognize the posture when falling, and the 16 daily behaviors were classified into one category, and no further subdivision was required. Finally, the selected 12 fall behaviors and 16 daily behaviors were classified into seven different behaviors, which were ADLs, front-lying, front-knees, back-lying, back-sitting, fall to the left, fall to the right.

3.1.3. Experimental Platform

The research on the falling posture recognition and classification algorithm based on machine learning was completed on the Windows10 operating system; we used the PyCharm 2019.2.2 (Community Edition) as software, and the CPU type was Intel Core i5-4200H @2.80 GHz.

3.2. Experimental Results

Based on the “Simulated Falls and Daily Living Activities Data Set”, this paper extracted 12 fall actions and 16 ADLs such as standing, walking, squatting, and a total of 3060 samples to test the proposed fall posture recognition method. It was pointed out that [33] there is no common standard for evaluating the effect of fall posture recognition at this stage, and it is challenging to perform effect testing based on general procedures. In this paper, accuracy, recall, f1 score and precision were used to evaluate the testing effect. There are four basic symbols: true positive (TP): successfully predict positive samples as positive, true negative (TN): successfully predict negative samples as negative; false positive (FP): wrongly predict negative samples as positive; false negative (FN): wrongly predict positive samples as negative. For multi-classification problems, the macro method can be used. The accuracy, precision, recall, and f1 score can be expressed as
A c c u r a c y = T P + T N T P + T N + F P + F N
P r e c i s i o n = T P T P + F P m a c r o P r e c i s i o n = 1 n i = 1 n P r e c i s i o n i
R e c a l l = T P T P + F N m a c r o R e c a l l = 1 n i = 1 n R e c a l l i
F 1 s c o r e = 2 P r e c i s o n R e c a l l P r e c i s o n + R e c a l l m a c r o F 1 s c o r e = 1 n i = 1 n F i

3.2.1. Result 1: Comparison between before and after Feature Extraction of WPT Using Different Classifiers

In order to verify the effectiveness of the proposed wavelet packet decomposition method in feature extraction and the recognition and classification of SVM, comparison between the sample set formed by the time-domain feature vector combined with the feature vector obtained by wavelet packet decomposition with the sample set that only uses the time-domain feature vector were conducted. At the same time, the SVM based on linear kernel function (Linear_SVM), SVM based on radial basis function (Rbf_SVM), Xgboost, LogisticRegression and KNN are used for the recognition and classification of fall posture. The classification of the selected 16 ADLs and 12 fall behaviors are shown in Table 3. In order to better evaluate the prediction performance of the model, the experimental results all adopted a five-fold cross-validation method, and finally, the fall posture recognition results of different classifiers are shown in Table 4. We observed that, regardless of whether we used the time-domain feature or the wavelet packet transform feature combined with the time-domain feature, the accuracy, recall, f1 score, and precision of the SVM with the linear kernel function reached the highest. In addition, we can see that for each classifier, after adding the features obtained by the wavelet packet transform, the accuracy, recall, f1 score, and precision were greatly improved. In order to test the significance of the differences as mentioned above, this paper used the multi-factor analysis of variance to test the significance of the differences in the experimental results using wavelet packet transform and different classifiers, for which the significance level α is set to 0.05; if the p-value was less than the α , it means that there is a statistically significant difference in the above results. The experimental results are shown in Table 5. The results indicate that SVM has significant advantages in solving the problem of small samples and high-dimensional features, and it also confirms the effectiveness of the wavelet packet transform in feature extraction.

3.2.2. Result 2: Comparison before and after Feature Selection

Combining the extracted time-domain features and wavelet packet features as a new sample set can further improve the classifier’s recognition accuracy. However, the feature dimension is too high. Only certain features can help the classifier perform classification and recognition. The remaining features will affect the recognition accuracy and cause a tremendous waste of computing resources and time. Table 6 compares the recognition accuracy, recall, f1 score, precision, training time, and real-time decision time of the algorithm before and after the random forest feature selection. The classifier used is a support vector machine with a linear kernel function. We can observe that after feature selection through the random forest, the algorithm’s accuracy, recall, f1 score and precision are all further improved, and the training time and real-time decision time are also significantly shortened.

3.2.3. Comparisons with Existing Methods

In addition, in order to verify the effectiveness and superiority of the method in this paper, comparisons were made with several existing excellent methods on “Simulated Falls and Daily Living Activities Data Set”. Results are as shown in Table 7. The experimental results show that the accuracy of the method proposed in this paper is better than that of the other three methods.

3.3. Discussions

3.3.1. Discussion of the Limitation

Although the method proposed in this paper can effectively recognize the posture of a fall, it requires the wearing of many sensors. We need to consider the comfort of wearing these sensors for the elderly. In addition, the method proposed in this paper does not perform learning, training, and recognition for some special fall postures, such as from lying down, rolling out of bed, and walking to the floor, falling down from standing, and slowly slipping on a wall. Therefore, these special behaviors may not be effectively recognized.

3.3.2. Discussion on the Future Work

Although the method proposed in this paper has been simulated on a computer and achieved good results, it still needs to be verified in practical applications. Then, we will embed the model trained on the computer into the mobile phone app, use wearable sensors to collect data, and send the data to the mobile phone via Bluetooth. The mobile phone processes the data in real time, determines whether the elderly fell, and recognizes the posture of the fall. Once the elderly has fallen, the mobile phone will immediately send the posture and location information of the fall to family members or medical staff so that the elderly can be rescued in time.

4. Conclusions

This paper proposed a fall posture classification and recognition method based on WPT and SVM. To be specific, the algorithm uses the WPT to extract the original signal features, random forest for feature selection, and SVM for classification. The following conclusions can be drawn:
  • The energy ratio of the frequency band obtained after wavelet packet decomposition can be used as features to show the characteristics of the original signal and improve the classifier’s recognition effect;
  • Using random forest for feature screening and constructing a new feature set can further improve the accuracy of recognition and shorten the algorithm’s training time and real-time decision time;
  • Compared with other classifiers, by using the linear kernel function the SVM can effectively improve the accuracy of classification, and the recognition effect is the best.

Author Contributions

Q.Z. (Qingyun Zhang): methodology, software, writing—original draft, writing—review and editing. J.T.: conceptualization, writing—review and editing. Q.S.: review and editing, supervision. X.Z., M.D., Q.Z. (Quan Zhou): review and editing, supervision. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China (Grant No. 61973172, 61973175, 62003175 and 62003177), the National Key Research and Development Project (Grant No. 2019YFC1510900), the key Technologies Research and Development Program of Tianjin (Grant No. 19JCZDJC32800), this project also funded by China Postdoctoral Science Foundation (Grant No. 2020M670633) and Academy of Finland under No. 315660.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are openly available in UCI Machine Learning Repository.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Pitchai, P.; Dedhia, H.B.; Bhari, N.; Krishnan, D.; D’Souza, N.R.J.; Bellara, J.M. Prevalence, risk factors, circumstances for falls and level of functional independence among geriatric population—A descriptive study. Indian J. Public Health 2019, 63, 21–26. [Google Scholar] [CrossRef]
  2. Baldewijns, G.; Debard, G.; Mertes, G.; Vanrumste, B.; Croonenborghs, T. Bridging the gap between real-life data and simulated data by providing a highly realistic fall dataset for evaluating camera-based fall detection algorithms. Health Technol. Lett. 2016, 3, 6–11. [Google Scholar] [CrossRef] [Green Version]
  3. Griffiths, C.; Rooney, C.; Brock, A. Leading causes of death in England and Wales–how should we group causes? Health Stats Q. 2005, 28, 6. [Google Scholar]
  4. Greenspan, S.L.; Myers, E.R.; Kiel, D.P.; Parker, R.A.; Hayes, W.C.; Resnick, N.M. Fall direction, bone mineral density, and function: Risk factors for hip fracture in frail nursing home elderly. Am. J. Med. 1998, 104, 539–545. [Google Scholar] [CrossRef]
  5. Gratza, S.K.; Chocano-Bedoya, P.O.; Orav, E.J.; Fischbacher, M.; Freystätter, G.; Theiler, R.; Bischoff-Ferrari, H.A. Influence of fall environment and fall direction on risk of injury among pre-frail and frail adults. Osteoporos Int. 2019, 30, 2205–2215. [Google Scholar] [CrossRef] [PubMed]
  6. Mabrouk, A.B.; Zagrouba, E. Abnormal behavior recognition for intelligent video surveillance systems: A review. Expert Syst. Appl. 2018, 91, 480–491. [Google Scholar] [CrossRef]
  7. Alhimale, L. The implementation of an intelligent and video-based fall detection system using a neural network. Appl. Soft Comput. 2014, 18, 59–69. [Google Scholar] [CrossRef]
  8. Fan, Y.X. A deep neural network for real-time detection offalling humans in naturally occurring scenes. Neurocomputing 2017, 260, 43–58. [Google Scholar] [CrossRef]
  9. Wang, S. Human fall detection in surveillance video based on PCANet. Multimed. Tools Appl. 2015, 75, 11603–11613. [Google Scholar] [CrossRef]
  10. Rami, A. Fall detection for elderly from partially observed depth-map video sequences based on view-invariant human activity representation. Appl. Sci. 2017, 7, 316. [Google Scholar] [CrossRef] [Green Version]
  11. Ismail, M.M.B.; Bchir, O. Automatic Fall Detection Using Membership Based Histogram Descriptors. J. Comput. Sci. Technol. 2017, 32, 356–367. [Google Scholar] [CrossRef]
  12. Tao, S. Privacy-Preserved Behavior Analysis and Fall Detection by an Infrared Ceiling Sensor Network. Sensors 2012, 12, 16920–16936. [Google Scholar] [CrossRef] [Green Version]
  13. Yazar, A.; Keskin, F.; Töreyin, B.U.; Çetin, A.E. Fall detection using single-tree complex wavelet transform. Pattern Recogn. Lett. 2013, 34, 1945–1952. [Google Scholar] [CrossRef]
  14. Alarifi, A. Killer heuristic optimized convolution neural network-based fall detection with wearable IoT sensor devices. Measurement 2020, 167, 108258. [Google Scholar] [CrossRef]
  15. Shan, G. A Biomechanical Study for Developing Wearable-Sensor System to Prevent Hip Fractures among Seniors. Appl. Sci. 2017, 7, 771. [Google Scholar] [CrossRef] [Green Version]
  16. Reyes-Ortiz, J.L.; Oneto, L.; Samà, A.; Parra, X.; Anguita, D. Transition-Aware Human Activity Recognition Using Smartphones. Neurocomputingn 2016, 171, 754–767. [Google Scholar] [CrossRef] [Green Version]
  17. Wu, F.; Zhao, H.; Zhao, Y.; Zhong, H. Development of a Wearable-Sensor-Based Fall Detection System. Int. J. Telemed. Appl. 2015, 2015, 1–11. [Google Scholar] [CrossRef] [Green Version]
  18. Lai, C.F.; Chang, S.Y.; Chao, H.C.; Huang, Y.M. Detection of cognitive injured body region using multiple tri-axial accelerometers for elderly falling. IEEE Sens. 2011, 11, 763–770. [Google Scholar] [CrossRef]
  19. Veltink, P.H.; Bussmann, H.J.; De Vries, W.; Martens, W.J.; Van Lummel, R.C. Detection of static and dynamic activities using uniaxial accelerometers. IEEE Trans. Rehabil. Eng. 2002, 4, 375–385. [Google Scholar] [CrossRef] [Green Version]
  20. He, Z.Y.; Jin, L.W. Activity recognition from acceleration data using AR model representation and SVM. In Proceedings of the International Conference on Machine Learning and Cybernetics IEEE, Kunming, China, 12–15 July 2008; pp. 2245–2250. [Google Scholar] [CrossRef]
  21. Song, S.K.; Jang, J.; Park, S. A Phone for Human Activity Recognition Using Triaxial Acceleration Sensor. In Proceedings of the 2008 Digest of Technical Papers-International Conference on Consumer Electronics IEEE, Las Vegas, NV, USA, 9–13 January 2008; pp. 1–2. [Google Scholar] [CrossRef]
  22. Van Thanh, P.; Tran, D.T.; Nguyen, D.C.; Anh, N.D.; Dinh, D.N.; El-Rabaie, S.; Sandrasegaran, K. Development of a Real-Time, Simple and High-Accuracy Fall Detection System for Elderly Using 3-DOF Accelerometers. Arab. J. Sci. Eng. 2019, 44, 3329–3342. [Google Scholar] [CrossRef] [Green Version]
  23. Jian, H.; Chen, H. A Portable Fall Detection and Alerting System Based on k-NN Algorithm and Remote Medicine. China Commun. 2015, 12, 23–31. [Google Scholar] [CrossRef]
  24. Yaqing, T.; Peng, C.; Baoxin, C.; Junping, T.; Yunyong, Z. Intelligent method and application of fall detection based on discrete features. Chin. J. Sci. Instrum. 2017, 38, 629–634. [Google Scholar] [CrossRef]
  25. Shao, H.D.; Cheng, J.S.; Jiang, H.K.; Yang, Y.; Wu, Z.T. Enhanced deep gated recurrent unit and complex wavelet packet energy moment entropy for early fault prognosis of bearing. Knowl. Based Syst. 2019, 105022. [Google Scholar] [CrossRef]
  26. Facchini, G.; Bernardini, L.; Atek, S.; Gaudenzi, P. Use of the wavelet packet transform for pattern recognition in a structural health monitoring application. J. Intell. Mater. Syst. Struct. 2014, 26, 1513–1529. [Google Scholar] [CrossRef]
  27. Pancholi, S.; Joshi, A.M. Improved Classification Scheme using Fused Wavelet Packet Transform based Features for Intelligent Myoelectric Prostheses. IEEE Trans. Ind. Electron. 2019, 99. [Google Scholar] [CrossRef]
  28. Chinara, S. Automatic Classification Methods for Detecting Drowsiness using Wavelet Packet Transform extracted Time-domain features from Single-channel EEG Signal. J. Neuroence Methods 2020, 63. [Google Scholar] [CrossRef]
  29. Abd Aziz, N.S.N.; Daud, S.M.; Sa’at, N.I.M. Wearable Device-based Fall Detection System for Elderly Care Using Support Vector Machine (SVM) classifier. Int. J. Eng. Technol. 2018, 4, 488–491. [Google Scholar] [CrossRef]
  30. Shibuya, N.; Nukala, B.T.; Rodriguez, A.I.; Tsay, J.; Nguyen, T.Q.; Zupancic, S.; Lie, D.Y. A real-time fall detection system using a wearable gait analysis sensor and a Support Vector Machine (SVM) classifier. In Proceedings of the 2015 Eighth International Conference on Mobile Computing and Ubiquitous Networking (ICMU) IEEE, Hakodate, Japan, 20–22 January 2015. [Google Scholar] [CrossRef]
  31. Özdemir, A.T.; Barshan, B. Detecting Falls with Wearable Sensors Using Machine Learning Techniques. Sensors 2014, 14, 10691–10708. [Google Scholar] [CrossRef]
  32. Pannurat, N.; Thiemjarus, S.; Nantajeewarawat, E. Automatic Fall Monitoring: A Review. Sensors 2014, 14, 12900–12936. [Google Scholar] [CrossRef] [Green Version]
  33. Noury, N.; Rumeau, P.; Bourke, A.K.; ÓLaighin, G.; Lundy, J.E. A proposal for the classification and evaluation of fall detectors. IRBM 2008, 29, 1340–1349. [Google Scholar] [CrossRef]
  34. Zhang, T.; Wang, J.; Xu, L.; Liu, P. Fall Detection by Wearable Sensor and One-Class SVM Algorithm. Intell. Comput. Signal Process. Pattern Recognit. 2006. [Google Scholar] [CrossRef]
  35. Zhou, L. Fall Detection Algorithm Based on BP Neural Network. Comput. Sci. 2020, 29, 242–246. [Google Scholar] [CrossRef]
  36. Hou, M.; Wang, H.; Xiao, Z.; Zhang, G. An SVM fall recognition algorithm based on a gravity acceleration sensor. Syst. Sci. Control Eng. 2018, 6, 208–214. [Google Scholar] [CrossRef]
Figure 1. Comparison before and after window interception: (a) original signal; (b) processed signal.
Figure 1. Comparison before and after window interception: (a) original signal; (b) processed signal.
Applsci 11 05030 g001
Figure 2. Wavelet packet decomposition.
Figure 2. Wavelet packet decomposition.
Applsci 11 05030 g002
Figure 3. Examples of sensor signals for a front-knees action and a back-lying action: (a) front-knees, acceleration; (b) back-lying, acceleration; (c) front-knees, gyroscope; (d) back-lying, gyroscope; (e) front-knees, magnet; (f) back-lying, magnet; (g) front-knees, Euler angle; and (h) back-lying, Euler angle.
Figure 3. Examples of sensor signals for a front-knees action and a back-lying action: (a) front-knees, acceleration; (b) back-lying, acceleration; (c) front-knees, gyroscope; (d) back-lying, gyroscope; (e) front-knees, magnet; (f) back-lying, magnet; (g) front-knees, Euler angle; and (h) back-lying, Euler angle.
Applsci 11 05030 g003
Table 1. Several time-domain features extracted.
Table 1. Several time-domain features extracted.
Time-Domain FeaturesExpression
Root mean square (RMS) R M S ( x ) = i = 1 n x i 2 n
Peak-to-peak (pk-pk) p k p k ( x ) = max ( x ) min ( x )
Peak factor (pf) p f ( x ) = max ( x ) / R M S ( x )
Waveform factor (wf) w f ( x ) = R M S ( x ) n i = 1 n x i
Pulse factor (pf) p f ( x ) = max ( x ) n i = 1 n x i
Margin factor (mf) m f ( x ) = max ( x ) n i = 1 n x i 2
Kurtosis (K) K ( x ) = 1 n i = 1 n x i 4 1 n i = 1 n x i 2 2
Table 2. Common kernel functions in SVM.
Table 2. Common kernel functions in SVM.
Kernel FunctionKernel Function ExpressionParameter
Linear kernel K X i · X = X i · X -
Polynomial kernel function K X i · X = s X i · X + c d s , c , d
Radial basis function K X i · X = exp g X X i 2 g
Sigmoid kernel function K X i · X = tanh s X i · X + c s , c
Table 3. Classification of the selected 16 ADLs and 12 fall behaviors.
Table 3. Classification of the selected 16 ADLs and 12 fall behaviors.
NumberBehavior DescriptionType
801walking forwardADLs
802walking backward
803jogging, running
804squatting, then standing up
805bending about 90 degrees
806bending to pick up an object on the floor
807walking with a limp
808stumbling with recovery
809bending while walking and then continuing walking
810coughing or sneezing
811to sitting with a certain acceleration onto a chair (hard surface)
812to sitting with a certain acceleration onto a sofa (soft surface)
813to sitting in the air exploiting the muscles of legs
814to sitting with a certain acceleration onto a bed (soft surface)
815from vertical lying on the bed
816from lying to sitting
901from vertical falling forward to the floorfront-lying
902from vertical falling forward to the floor with arm protection
907from vertical falling down on the floor, ending in right lateral position
908from vertical falling down on the floor, ending in left lateral position
903from vertical falling down on the kneesfront-knees
904from vertical falling down on the knees and then lying on the floor
910from vertical falling on the floor, ending lyingback-lying
911from vertical falling on the floor, ending lying in right lateral position
912from vertical falling on the floor, ending lying in left lateral position
909from vertical falling on the floor, ending sittingback-sitting
915from vertical falling on the floor, ending lyingfall to the left
913from vertical falling on the floor, ending lyingfall to the right
Table 4. Comparison of different methods: accuracy, recall, f1 score and precision on different classifiers with or without WPT.
Table 4. Comparison of different methods: accuracy, recall, f1 score and precision on different classifiers with or without WPT.
Linear_SVMRbf_SVMXgboostLogistic RegressionKNN
Accuracywithout WPT0.9670.9390.9360.9410.934
with WPT0.9870.9740.9780.9730.965
Recallwithout WPT0.9550.9320.9300.9360.902
with WPT0.9730.9380.9520.9400.935
f1 scorewithout WPT0.9540.9510.9390.9400.913
with WPT0.9740.9550.9600.9450.933
Precisionwithout WPT0.9530.9730.9490.9470.927
with WPT0.9770.9750.9670.9520.935
Table 5. Significance test of experimental results.
Table 5. Significance test of experimental results.
p-Value (Use WPT)Significant?p-Value (Use Different Classifiers)Significant?
Accuracy0.000851Yes0.045815Yes
Recall0.036004Yes0.038582Yes
f1 score0.022702Yes0.016202Yes
Precision0.047582Yes0.014486Yes
Table 6. Comparison before and after feature selection based on Linear_SVM.
Table 6. Comparison before and after feature selection based on Linear_SVM.
Before Feature SelectionAfter Feature Selection
Accuracy0.9865040.990553
Recall0.9725770.978491
f1 score0.9744150.979512
Precision0.9765820.981099
Training time264.93 (s)7.59 (s)
Real-time decision time4.29 (s)0.12 (s)
Table 7. Comparison of different methods.
Table 7. Comparison of different methods.
MethodAccuracy
Tong [34] based on one-class SVM0.932
Zhou [35] based on BP neural network0.901
Hou [36] based on SVM0.922
Proposed in this paper0.991
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zhang, Q.; Tao, J.; Sun, Q.; Zeng, X.; Dehmer, M.; Zhou, Q. A Fall Posture Classification and Recognition Method Based on Wavelet Packet Transform and Support Vector Machine. Appl. Sci. 2021, 11, 5030. https://doi.org/10.3390/app11115030

AMA Style

Zhang Q, Tao J, Sun Q, Zeng X, Dehmer M, Zhou Q. A Fall Posture Classification and Recognition Method Based on Wavelet Packet Transform and Support Vector Machine. Applied Sciences. 2021; 11(11):5030. https://doi.org/10.3390/app11115030

Chicago/Turabian Style

Zhang, Qingyun, Jin Tao, Qinglin Sun, Xianyi Zeng, Matthias Dehmer, and Quan Zhou. 2021. "A Fall Posture Classification and Recognition Method Based on Wavelet Packet Transform and Support Vector Machine" Applied Sciences 11, no. 11: 5030. https://doi.org/10.3390/app11115030

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop