Skip to Content
SensorsSensors
  • Article
  • Open Access

20 November 2025

RecovGait: Occluded Parkinson’s Disease Gait Reconstruction Using Unscented Tracking with Gated Initialization Technique

,
,
,
,
and
1
Faculty of Information Science and Technology, Multimedia University Melaka, Melaka 75450, Malaysia
2
Centre for Image and Vision Computing, COE for Artificial Intelligence, Multimedia University, Melaka 75450, Malaysia
3
Centre for Advanced Analytics, COE for Artificial Intelligence, Multimedia University, Melaka 75450, Malaysia
4
Department of Medicine, Faculty of Medicine, Universiti Malaya, Kuala Lumpur 50603, Malaysia

Abstract

Parkinson’s disease is a neurodegenerative disorder disease that worsens over time and involves the deterioration of nerve cells in the brain. Gait analysis has emerged as a promising tool for early detection and monitoring of Parkinson’s disease. However, the accurate classification of Parkinsonian gait is often compromised by missing body keypoints, particularly in critical regions like the hip and legs that are important for motion analysis. In this study, we propose RecovGait, a novel method that combines a gated initialization technique with unscented tracking to recover missing human body keypoints. The gated initialization provides initial estimates, which are subsequently refined through unscented tracking to enhance reconstruction accuracy. Our findings show that missing keypoints in the hips and legs significantly affect the classification result, with accuracy dropping from 0.8043 to 0.5217 in these areas. By using the gated initialization with an unscented tracking method to recover these occluded keypoints, we achieve an MAPE value as low as 0.4082. This study highlights the impact of hip and leg keypoints on Parkinson’s disease gait classification and presents a robust solution for mitigating the challenges posed by occlusions in real-world scenarios.

1. Introduction

Parkinson’s disease (PD) is a progressive neurodegenerative disorder disease that involves the deterioration of nerve cells in the brain. The disease primarily affects the central nervous system, where this neuronal deterioration leads to movement problems such as tremors, rigidity, bradykinesia and postural instability [1,2,3,4]. Despite extensive research, there is currently no cure for PD. The medication can only control and manage the symptoms of the disease.
The diagnosis and monitoring of PD often involve costly clinical assessments and imaging techniques, which can be prohibitive for many patients. PD often impacts motor control, particularly gait, due to its effects on a part of the brain called basalganglia that controls and regulates body movement [5]. Individuals with PD typically take small and shuffling walking steps, and the walking strides are shorter than a healthy individual. A reduction in arm swing and freezing of gait, which is by the sudden inability to move the feet forward, are also common symptoms of PD. These gait disturbances have been extensively studied, and multiple investigations show that gait patterns can be used as reliable biomarkers to distinguish PD patients from healthy individuals accurately [6,7,8].
In previous research, there are two major ways for classification of PD using gait analysis, which are an invasive method and a non-invasive method. Invasive methods involve wearable sensors and pressure sensors that are attached to the patient’s body and foot [9,10,11,12,13]. These methods normally provide high accuracy and detailed motion data, but they often cause discomfort to the patients, can be expensive and are generally impractical for long-term monitoring.
On the other hand, non-invasive methods have been gaining attention in recent years due to their ease of use and potential for remote screening. The methods often use video recordings or vision-based analysis to capture gait patterns [14,15,16,17,18]. The advantage of non-invasive methods lies in their unobtrusiveness and low-cost. This advantage allows for broader accessibility and patient compliance. Furthermore, the advancement of computer vision and deep learning techniques can extract meaningful features from videos, which become increasingly feasible for detecting PD patients gait abnormalities.
In computer vision, occlusion often refers to situations where parts of an object or person are partially or fully blocked by other objects or obscured due to a camera angle (refer Figure 1). Accurate detection of human body joints is critical for gait and posture analysis in PD screening. Models such as AlphaPose or OpenPose rely on the visibility of joint keypoints to extract meaningful motion patterns. However, occlusion often causes missing or incorrect keypoints, which can significantly degrade classification performance. These regions are often occluded because of self-occlusion during walking movements or blocking by other body parts or objects in the scene. In addition, motion blur can further obscure the visibility of joints in these areas. As a result, pose estimation algorithms may fail to accurately detect these keypoints, leading to incomplete skeleton keypoints representation and effect PD classification performance.
The aim of this study is to develop a low-cost method to recover missing keypoints caused by occlusion in full-body movement analysis for PD screening, leveraging computer vision and machine learning technique. While many prior studies focused primarily on gait-related features, this work extends the investigation to examine how occlusion in various body regions affect PD classification. Despite promising results from previous studies on vision-based methods, occlusion remains a major limitation. Environmental factors, such as walking aids or furniture, can temporarily hide body parts, leading to inaccurate PD classification results. Figure 1 shows some examples of real-life occlusions, where the patients are occluded by walking sticks or other objects, like furniture.
To address these challenges, this study proposes a method coined as RecovGait to recover missing keypoints using unscented tracking, enhanced by a gated initialization technique. The initialization step in unscented tracking is crucial and can significantly influence the accuracy of the predictions. It is improved by a lightweight gated initialization on providing robust initial estimate. The proposed method shows a promising result, achieving a MAPE score as low as 0.4082 in reconstructing missing leg keypoints, indicating highly accurate recovery.
Figure 1. Examples of occlusions in real life. (a) The lower body of the subject is occluded by the walking stick and right leg is occluded by the left leg. (b) The lower part of the subject is being occluded by the furniture.

3. Proposed Solution

This section presents the details for the proposed approach for PD classification, with a particular focus on how missing keypoints from different body parts affect the classification accuracy. To capture the temporal dependencies inherent in sequential motion data, a Long Short-Term Memory (LSTM) network is employed as the primary classifier.
The proposed PD classification framework investigates the influence of occlusions by systematically analyses of how the absence of keypoints from different body regions affect the classification accuracy. To address the issue of missing keypoints, we propose an unscented tracking approach with gated initialization, known as RecovGait, for reconstructing occluded joints. Figure 2 illustrates an overview of the proposed method. Human pose estimation is first applied to extract the human skeleton keypoints from the video scene. Occlusion is detected based on structural inconsistencies among the extracted keypoints. Typical indicators of occlusion include unusual shrinking and collapsing toward nearby non-occluded joints. In addition, pose estimation provides a confidence score for each detected joint. Joints with a score below 0.5 are classified as occluded. Details of human pose estimation will be discussed in Section 3.2, occlusion detection will be discussed in Section 3.3 and RecovGait will be discussed in Section 3.4.
Figure 2. Overview of the proposed solution.

3.1. Dataset

The dataset used in this study was self-collected following the Timed Up and Go (TUG) protocol. We contacted the PD patients for their consent to participate in the dataset collection. The data collection received ethical approval from the Multimedia University Research Ethics Committee (Approval Number: EA0422022). The setup of the experiment is presented in Figure 3. TUG test [32] is presented in the data collection process; TUG test is an assessment to determine a person’s mobility and fall risk, participants are required to sit, stand and walk. In the data collection process, participants are required to sit first, then stand and walk on a 3 m path back and forth to a sitting position, and two cameras are used to capture the walking pattern of the patients from the front and side of the patients.
The dataset is divided into two classes: PD and Healthy. The PD class consists of 26 patients while the Healthy class consists of 50 healthy individuals. To increase the dataset size and improve model generalization, data augmentation such as flipping, scaling and translation is further applied. After augmentation, the PD class has 104 samples, and the healthy class contains 200 samples. For training purposes, the dataset is split into 70% for training and 30% for testing.
Figure 3. Data collection setup.

3.2. Human Pose Estimation

The video data is processed using AlphaPose [33] to extract human skeletal keypoints. AlphaPose is a top-down multi-person pose estimator. It is the first open-source system that achieves 70 mAP on COCO dataset. There are two major steps in the pipeline, which are human detection and human pose estimation. It first detects the human bounding boxes using object detectors. Each of the detected bounding boxes are then cropped and resized. A pose estimation network is used to predict keypoints, and a re-identification network is applied to extract features for tracking. Symmetric Integral Regression is employed to localize the keypoints. To refine the results, non-maximum suppression is used to eliminate redundant pose detections. Finally, multi-stage identity matching integrates pose information, re-identification features, and bounding box data to produce a final tracking identity across frames.
In this research, the dataset utilizes the COCO 17 keypoint format, with the alignment keypoints shown in Figure 4. The 17 keypoints are divided into four main parts, where head includes keypoints 0 to keypoints 4, body includes keypoints 5 to keypoints 8, hip includes keypoints 9 to keypoints 12, and lastly, leg includes keypoints 13 to keypoints 16.
For the experiment, only 50 frames per video were extracted using AlphaPose. The extracted human keypoints from each frame are saved in a CSV file, organized sequentially from frame 1 till frame 50, with each frame containing keypoints 0 through 16.
Figure 4. Illustration of human body estimation COCO17 keypoints.

3.3. Occlusion Detection

To detect occluded body keypoints, confidence scores from the pose estimation process are utilized. During human pose estimation, a confidence score is assigned to each keypoints i in every pose detection j . To obtain a robust estimate for each keypoint in the final merged pose, a score–weight merging strategy is employed. Let c l u s t e r _ s c o r e s j , i be the confidence score of keypoints i in pose detection   j , and m a s k e d _ s c o r e s j , i be the same score but masked to zero for detections that are too far from the reference pose. Here, k indexes all redundant poses in the cluster and i indexes the keypoints in the skeleton. The merged confidence score for keypoint i is computed as follows:
m e r g e _ s c o r e i = j ( c l u s t e r _ s c o r e s j , i × m a s k e d _ s c o r e s j , i k m a s k e d _ s c o r e s k , i )
A keypoint i is classified as visible if
m e r g e _ s c o r e i > τ
where τ is a predefined threshold. If the merged score falls below a predefined threshold τ , the corresponding keypoint i is labeled as occluded. This approach is robust to partial occlusion because the confidence scores of occluded joints typically decrease significantly, resulting in a low merged score.

3.4. RecovGait: Unscented Tracking with Gated Initialization

The core idea of the proposed RecovGait technique is to leverage the strength of unscented tracking and gated Recurrent Neural Network to improve the accuracy of missing keypoints recovery while maintaining low computational cost. Figure 5 shows the flowchart of the proposed recovery process. By integrating lightweight recurrent architecture with unscented tracking, the method achieves a balance between deep learning predictive power and unscented tracking computational efficiency. This makes the entire process not only accurate but also highly cost-effective.
Figure 5. Flowchart of missing keypoints recovery using unscented tracking with gated initialization technique.

3.4.1. Initialization

There are several variations of the Kalman Filter [34]. One variant designed to handle non-linear data is the Unscented Kalman Filter (UKF), also referred to as unscented tracking [35]. Unscented tracking is a state estimation technique used for non-linear dynamic systems. Unlike the traditional Kalman Filter, which relies on linear approximations, unscented tracking uses unscented transform to capture the non-linearities in system dynamics. This feature makes it more suitable for estimating missing values in complex motion sequences, such as moving objects. It works by maintaining an estimate of the system state and updating it based on observed measurements. The key steps include a prediction step, sigma point generation, and updating the state.
Initialization is crucial to maintain accuracy of the tracking result. In this study, we propose a lightweight unscented tracking with gated initialization technique. The initial state estimation is defined as x ^ 0 and initial error covariance is defined as P 0 . The initialization step is important as it influences the prediction accuracy, especially in a non-linear dynamics system,, such as human motion. Instead of relying on default values for initial state x ^ 0   and covariance P 0 , the proposed gated initialization learns the patterns of gait from observed keypoints. The gated initialization technique allows the prediction to start from a state that is closer to the true value, particularly in sequences with missing keypoints.
A sliding window mechanism is used. A fixed-length window of five consecutive frames is used to generate input–output pairs. Specifically, each sequence of five frames serves as input to predict the subsequent frame, enabling the model to effectively capture local temporal dependencies. To evaluate the effect of network complexity on reconstruction accuracy, gated initialization networks with 30, 50, and 70 units are tested. The network architecture, as shown in Table 1, consists of a single gated initialization layer with ReLU activation 26 and a dense output layer with a linear activation function, to generate continuous numerical predictions. During training, the model is optimized using Adam optimizer with MSE as the loss function and learning rate is set at 0.001. Missing values are reconstructed iteratively using the trained model.
Table 1. Detailed architecture of initialization.

3.4.2. Tracking

The initial parameters from initialization define the input for the prediction step, which is the state transition function. Once initialized, x ^ 0 and P 0 serve as the starting point of tracking and reconstruction process, then the subsequent tracking and predicting of missing keypoints are performed. State transition function models the temporal evolution of keypoints, allowing the system to reconstruct missing coordinates when visual observation is unavailable due to occlusion. The state transition function is defined as follows:
x k = f x k 1 + w k 1
where x k is the system state vector at time step k , f ( . ) is the non-linear state transition function that is used to calculate predicted mean state x k and applying unscented transform, and w k 1 is the process noise. In the prediction phase of tracking, state transition function is used to figure out the uncertainty in current state; it estimates how it will change over time. The measurement function allows the UKF to compare the actual measurement and predicted measurement; it is used directly after the prediction state, where the equation is given by
z k = h x k + v k
where z k is the measurement vector, h ( . ) is the non-linear measurement function, and v k is the measurement noise.
In sigma point generation, instead of relying on single Gaussian distribution, unscented tracking generates a set of sigma points to capture the mean and covariance of the prior state distribution. Equation (5) is the first sigma point, the mean of the distribution, and the best estimate of current state. Equation (6) is the next n sigma point, each created by adding a scaled portion of variance and mean. Equation (7) is the remaining n sigma point, created by subtracting the same vectors. Given a state vector x k 1 R n and its covariance P k 1 , the sigma points X ( i ) are computed as follows:
X ( 0 ) = x k 1
X ( i ) = x k 1 + ( ( n + λ ) P k 1 ) i ,       i = 1 , , n
X ( i + n ) = x k 1 ( ( n + λ ) P k 1 ) i ,       i = 1 , , n
where P k 1 is the state covariance matrix is from the previous step, n is the dimension of state vector, and λ is a scaling parameter that controls the spread of sigma points.
After a set of sigma points are generated, they will propagate through the non-linear state transition function f ( . ) as shown in Equation (8). In this step, the state is predicted based on previous observations from the data using a non-linear motion model. Then, a new set of predicted sigma points will represent the possible position of the keypoints.
X k | k 1 ( i ) = f X k 1 i
From these propagated sigma points, the predicted state mean and covariance are calculated by taking weighted averages over those points as follows:
x ^ k | k 1 = i = 0 2 n W i ( m ) X k | k 1 ( i )
P k | k 1 = i = 0 2 n W i x ( X k | k 1 i x ^ k | k 1 ) ( X k | k 1 i x ^ k | k 1 ) T + Q
where W i ( m ) are the weights for the mean and W i x are the weights for the covariance.
Sigma points are mapped through the measurement function as shown in Equation (11); each predicted sigma points pass through measurement function h ( . ) . The current set of sigma points now in the measurement space representing the predicted observations.
z k ( i ) = h ( X k | k 1 i )
The predicted observation mean is obtained as
k = i = 0 2 n W i ( m ) X k ( i )
Next, the innovation covariance and cross-covariance are computed as
S k = i = 0 2 n W i ( c ) ( z k ( i ) k ) ( z k i k ) T + R
The cross-covariance between state and measurement sigma points are computed as
P x z = i = 0 2 n W i ( c ) ( X k | k 1 ( i ) x ^ k | k 1 ) ( z k i k ) T
Using these, the Kalman gain is derived as
K k = P x z S k 1
Finally, the state and covariance are updated with incoming measures.
x ^ = x ^ k | k 1 + K k ( z k k )
P k = P k | k 1 K k S k K k T
where K k is the Kalman Gain, x ^ k is the updated state estimate after incorporating measurement and P k is the updated error covariance.

4. Experimental Result

4.1. Experiment Setup

The experiments were conducted on a laptop equipped with an Intel i5-9300H CPU 2.4 GHz and GPU NVDIA GeForce GTX 1650 Ti with Max-Q Design (Santa Clara, CA, USA). To investigate the impact of missing different body parts on PD detection, a lightweight gated initialization network was implemented. The detailed architecture of PD–Healthy Classification is shown in Table 2; it was structured as follows: an initial layer consisting of 128 units, followed by a dropout layer with a rate of 0.2 to prevent overfitting. A second layer with 64 units was then applied, followed by a dense layer with 32 units and another dropout layer at 0.2. The final output layer consists of a single neuron with a sigmoid activation function.
Table 2. Detailed architecture of PD and Healthy Classification.
The model was compiled using the Adam optimizer with a learning rate between 0.00005 and 0.001 in different missing frames and different body parts, and binary cross-entropy as the loss function. An early stopping mechanism was applied to monitor the validation loss, with a patience value of 5 epochs to avoid overfitting and ensure efficient training. The model was trained for up to 50 epochs with a batch size of 32, using a training–validation split for evaluation. The model was saved at the best epoch that achieved the best validation performance.

4.2. Occlusion Simulation

Occlusion in human pose estimation often arises due to unfavorable camera angles or the presence of obstructing objects, which results in incomplete capture of the human body. To replicate such real-world conditions, an extended version of the original dataset was constructed by artificially removing selected body keypoints within a defined range of video frames, specifically between frame 10 and frame 40.
The extended dataset is stored in a CSV format, where each record corresponds to a single video consisting of 50 frames. For every frame, 34 keypoint values were extracted using AlphaPose, representing the x- and y-coordinates of 17 human body keypoints. Consequently, each record contained a total of 1700 data values (34 keypoints × 50 frames), representing the complete sequence of extracted coordinates for one subject.
To further emulate real-world occlusions where specific body regions are blocked, the keypoints were grouped based on body parts: the head, upper body, hips, and legs. These groups of keypoints were selectively removed to simulate localized occlusion effects. Figure 6a illustrates the full-body keypoints of a patient, with each keypoint making up from the x- and y-coordinates. In the head region shown in Figure 6b, the occluded keypoints include the nose, left eye, right eye, left ear, and right ear. Each occluded keypoint was replaced with (x, y) = (0, 0) in the dataset. The occluded keypoints for the upper body shown in Figure 6c include the left shoulder, right shoulder, left elbow and right elbow. For the hip region shown in Figure 6d, the occluded keypoints include the left wrist, right wrist, left hip and right hip. Wrists were grouped under the hip region, since during walking, the hands (and wrists) typically align horizontally with the hips. The leg region shown in Figure 6e includes keypoints of the left and right knees, as well as the left and right ankles.
Figure 6. Illustration of missing keypoints in different body parts. (a) Illustration of full human body keypoints. (b) Illustration of missing head keypoints. (c) Illustration of missing body keypoints. (d) Illustration of missing hips keypoints. (e) Illustration of missing leg keypoints.
Figure 7 illustrates the dataset preprocessing pipeline designed to simulate occlusion for testing modules, while the training modules utilize the complete dataset without missing values. The rationale for applying different preprocessing strategies to training and testing data is to assess how effectively the proposed technique can recover missing keypoints.
To simulate missing data caused by occlusions or sensor errors, specific keypoints are manually removed from the complete dataset. The processed dataset is then divided into five subsets: one with no missing values serving as the ground truth and four subsets with progressively missing frames, where the last 10, 20, 30, and 40 frames are removed, respectively. The removed values are replaced with zeros. This backward frame removal was used to simulate realistic challenges, as tracking methods usually rely on past frames to make predictions for the future state.
In addition, occlusions were simulated at the body-part level by independently removing grouped keypoints (head, upper body, hips, and legs). This enables analysis of which body region contributes most significantly to Parkinson’s disease classification. Once preprocessed as described, the dataset is ready for the next stage of experimentation.
Figure 7. Flowchart of occlusion simulation in testing dataset.

4.3. Evaluation Metrics

To evaluate model performance, Accuracy was used as the primary metric, followed by Precision, Recall and F1-score, where the formula is as follows:
A c c u r a c y = T r u e   P o s i t i v e + T r u e   N e g a t i v e T r u e   P o s i t i v e + T r u e   N e g a t i v e + F a l s e   P o s i t i v e + F a l s e   N e g a t i v e
P r e c i s i o n = T r u e   P o s i t i v e T r u e   P o s i t i v e + F a l s e   P o s i t i v e
R e c a l l = T r u e   P o s i t i v e T r u e   P o s i t i v e + F a l s e   N e g a t i v e
F 1 S c o r e = 2 × P r e c i s i o n × R e c a l l P r e c i s i o n + R e c a l l
A confusion matrix is used to provide a detailed overview of model’s classification performance by comparing predicted labels with the actual labels. Figure 8 shows a confusion matrix; each element in the matrix represents the number of samples belonging to a prediction–actual combination. In PD classification, the term true positive is defined as when the model correctly classifies PD, true negative is defined as when the model correctly classifies as healthy, false positive is defined as when the model incorrectly classifies healthy as PD, and false negative is defined as incorrectly classification of PD as healthy.
Figure 8. Confusion matrix.
Several performance metrics are applied to assess the effectiveness of the proposed approach. The performance metrics used include Mean Absolute Error (MAE) [36], Mean Squared Error (MSE) [37], and Mean Absolute Percentage Error (MAPE) [38]. The formula for MAE, MSE, and MAPE are presented as follows:
M A E = 1 n i = 1 n y i y ^ i
M S E = 1 n i = 1 n y i y ^ i 2
M A P E = 100 % n i = 1 n y i y ^ i y i

4.4. Evaluation of PD Classification with Occluded Parts

Table 3 presents the results of PD classification using LSTM under different occlusion scenarios. The complete dataset without any missing body parts or missing frames achieved the highest accuracy at 0.8913 and an F1-Score at 0.8387. From the overall comparison, leg and hip keypoints emerge as the most critical for accurate classification. In contrast, missing head and body keypoints still allow for moderate classification performance, which suggests that these regions are less sensitive to data loss.
Table 3. PD classification using LSTM.
The results also show that the effect of missing keypoints varies across different body regions. As shown in Table 3, an increasing number of missing frames consistently reduces classification accuracy across all groups. In the head region, the accuracy decreases from 0.8587 (10 missing frames) to 0.7609 (40 missing frames). The body region shows a decline from 0.8370 to 0.5870, while the hips region drops from 0.8478 to 0.5870. The leg region shows the most significant decline, from 0.8043 to 0.5217, as the number of missing frames increases from 10 to 40.
This downward trend, moving from head to legs, highlights the increasing importance of lower-body keypoints in PD classification. Since PD is strongly linked to gait and movement abnormalities, missing information in the leg region significantly undermines the model’s ability to distinguish PD patients from healthy controls. Thus, ensuring reliable recovery of leg and hip keypoints is essential for maintaining classification performance.

4.5. Missing Keypoints Recovery Ability

Table 4 shows the performance of the proposed method on an incomplete dataset with 40 missing frames and 70 LSTM hidden units across different body parts. The results show that the method remains effective even when a large portion of the data is unavailable. Among all body regions, the head exhibits the highest error rate, while the legs have the lowest error rate, indicating stronger recovery ability in the lower body.
Table 4. Missing keypoints recovery using the proposed method evaluation on body parts.
Table 5 shows the PD classification performance of the proposed method on an incomplete dataset with 40 missing frames and 70 LSTM hidden units across different body parts, and Figure 9 shows the loss curves and accuracy curves of PD classification. The results show that the proposed method is able to recover the classification performance after using the proposed method. The body, hips, and leg regions are able to recover a classification performance that is the same as the classification performance without occlusion.
Table 5. PD classification using LSTM on missing keypoints recovery using proposed method evaluation on body parts.
Figure 9. Loss curves and accuracy curves of PD Classification Training. (a) Head loss curves and accuracy curves. (b) Body loss curves and accuracy curves. (c) Hips loss curves and accuracy curves. (d) Leg loss curves and accuracy curves.
Table 6 further evaluates the method under varying numbers of missing frames, ranging from 10, 20, 30 and 40 for each body part. The error increases progressively as the number of missing frames grows. The head region shows the most significant performance drop, highlighting its vulnerability to missing information. On the contrary, the legs and hips maintain relatively low errors even with 40 missing frames, demonstrating greater resilience to missing data.
Table 6. Missing keypoints recovery using the proposed method evaluation on number of missing frames.
Table 7 investigates the impact of different LSTM hidden unit sizes (30, 50, and 70) on recovery performance. Interestingly, the results reveal that the optimal performance does not always align with the largest LSTM size. For example, the legs achieve their lowest errors with 50 hidden units, while the hips perform best with 30 units. Across all configurations, the legs and hips consistently exhibit the highest predictability, whereas the head and body show greater sensitivity to model architecture. Collectively, these findings suggest that the proposed method effectively recovers missing keypoints, particularly in the hips and legs, which are the most crucial for PD-related movement analysis.
Table 7. Missing keypoints recovery using the proposed method evaluation on hidden units.
Table 8 shows the performance of the proposed method on an incomplete dataset with 40 missing frames and 50 LSTM hidden units under different levels of occlusion across different body parts. A performance decline was observed when more body parts were being occluded. When all the body keypoints are occluded, this represents the worst-case scenario of the occlusion.
Table 8. Different levels of occlusion from different body parts.

4.6. Comparison with Other Methods

Table 9 presents a comparison of four baseline models, namely Convolutional Neural Network (CNN), Gated Recurrent Unit (GRU), Recurrent Neural Network (RNN), Temporal Convolutional Network (TCN), Fusion of 2D Keypoint and GEI, and Spatio-Temporal Graph Convolutional Networks (STGCNs) against the proposed RecovGait framework in classifying PD, and Figure 10 shows the confusion matrix of all the methods. These models were selected because they capture key temporal and spatial dependencies in gait data and have been widely applied in recent studies on human activity recognition and PD detection. Unlike RecovGait, these baseline models rely solely on the classification stage and do not incorporate initialization or movement tracking features, making their performance more vulnerable to degradation when the input data contain missing keypoints. In contrast, RecovGait integrates gated initialization and unscented tracking, enabling a more stable performance under incomplete data conditions. All models were trained using the complete dataset and subsequently evaluated on datasets with missing keypoints.
Table 9. PD Classification using RecovGait compared with other methods.
The results clearly demonstrate that RecovGait achieves a significantly higher accuracy of 0.8804, whereas the best-performing baseline model attains only 0.6957 accuracy. This substantial performance gap highlights the effectiveness of RecovGait in overcoming the negative impact of missing data on classification accuracy. Overall, the comparison outlines the importance of integrating recovery mechanisms into the model pipeline, showing that RecovGait not only improves robustness but also provides a more reliable solution for real-world PD classification tasks where missing data is inevitable.
Figure 10. Confusion matrix of PD classification using RecovGait compared with other methods. (a) Confusion matrix of CNN. (b) Confusion matrix of GRU. (c) Confusion matrix of RNN. (d) Confusion matrix of TCN. (e) Confusion matrix of fusion of 2D Keypoint and GEI. (f) Confusion matrix of STGCN. (g) Confusion matrix of RecovGait.

4.7. Visualization of the Proposed Method

Figure 11 illustrates the visualization of the recovered missing keypoints using RecovGait. The first row shows the past five complete frames, with the subsequent five complete frames shown on the right side. The second row demonstrates recovery performance when five consecutive head keypoints are missing, and similar visualization applies for the other missing body parts using RecovGait.
From Figure 11, it can be observed that the leg region achieves the highest similarity to the original skeleton frames, consistent with the quantitative results in Table 4, where the legs recorded the lowest error values. The recovery accuracy follows a descending order: legs → hips → body → head. This visualization confirms the model’s ability to restore missing keypoints with high fidelity, particularly in the lower body, which is critical for gait-related tasks such as PD classification.

4.8. Ablation Study

To understand the contribution of each component in the proposed method, an ablation study is conducted as summarized in Table 10 and Table 11. The experiments were evaluated under four configurations: (i) without any recovery techniques, (ii) using only the unscented tracking method, (iii) using only the gated initialization model, and (iv) the proposed method combining unscented tracking with gated initialization. The evaluation was performed on sequences with the last 40 frames missing for each body part. For both the gated initialization model and the proposed method, a lightweight gated initialization model with 50 hidden units was employed to ensure fair comparison.
Table 10. Ablation study in error metrics of missing keypoints recovery.
Table 11. Ablation study in PD classification.
As shown in Table 10, the proposed method consistently outperforms the other configurations across all error metrics (MAE, MSE and MAPE). This demonstrates that the integration of unscented tracking with gated initialization enables the model to achieve accuracy levels comparable to more complex, higher-capacity architectures, while maintaining computational efficiency.
It is also observed that legs and hips exhibit lower recovery errors compared to head and body. The improvements for leg keypoints are particularly significant and visually more noticeable. This is likely due to the dynamic and periodic nature of leg movements in gait, which makes them inherently more predictable and well-suited for sequential modeling.
Figure 11. Visualization of missing keypoints recovery using RecovGait.
As shown in Table 11, the missing body parts keypoints severely degrade PD classification performance. The application of any technique resolves this issue, bringing the classification performance back to a robust level. This indicates that all methods are sufficiently recovering keypoints to enable correct high-level classification.

5. Discussion

The experiments conducted on LSTM-based PD classification and RecovGait for missing keypoint recovery provide several important insights:
  • Several irregular performances can be observed in Table 3, particularly in head and body regions, where recall and F1-score increased despite a higher number of missing frames. These fluctuations were most frequent in head region, followed by body, hips and legs. This could indicate that head keypoints are less reliable and are the least uniquely informative for classifying PD and Healthy, so removing redundant head data could help the classifier. Legs carry stronger and more informative gait signals, so removing them is more likely to hurt the performance.
  • Increasing the hidden units of gated initialization from 50 to 70 yields only marginal improvements across most body regions. This suggests that a lightweight module with 50 units is already sufficient to capture the underlying motion dynamics to enable lightweight yet effective recovery of missing keypoints.
  • Both in classification and recovery experiments, missing keypoints from the legs and hips consistently lead to significant performance degradation. This shows the diagnostic importance of lower-body gait patterns in Parkinson’s disease, where motor impairments are often most evident in these regions.
  • The results of PD classification in Table 11 can be observed to be unaffected by the recovery technique. This indicates that, to classify PD, a less precise keypoints recovery method was good enough. However, Table 10 shows that the proposed method was able to improve the overall data quality, and that higher-fidelity keypoints often lead to more reliable and noise-free feature vectors.
Although RecovGait was primarily developed to recover occluded gait keypoints in Parkinson’s disease analysis, the proposed framework demonstrates promising robustness and generalization characteristics. The gated initialization mechanism dynamically adjusts to varying occlusion patterns and confidence levels that enables reliable performance across different viewing conditions and keypoint detectors.
The framework is designed to be model-agnostic. It can integrate with any pose estimation model (e.g., OpenPose, BlazePose, MediaPipe) as it operates purely at the keypoint coordinate level. Future work will extend this analysis through cross-dataset validation and real-world video capture to further confirm generalization capability across diverse populations and camera environments.

6. Conclusions

In this study, we proposed a robust framework, RecovGait, which integrates unscented tracking with gated initialization mechanisms to recover missing human keypoints and enhance Parkinson’s disease (PD) classification from gait data. By simulating missing frames across different body regions, we evaluated both the impact of incomplete data on classification accuracy and the effectiveness of the recovery techniques. RecovGait exhibits particularly strong robustness under high missing-data conditions, most notably from the legs, which play a critical role in gait analysis for PD. The hybrid approach also proves to be highly computationally efficient, as it achieves a strong performance even with lightweight configurations. This makes RecovGait especially well-suited for deployment in resource-constrained environments where training and inference efficiency are essential. Moving forward, while this work relied on simulated missing data derived from benchmark datasets, an important avenue for future research is to validate RecovGait using real patient data captured from live camera systems in clinical or real-world settings. Such validation would better reflect practical challenges such as occlusions, motion blur, and hardware limitations, ultimately strengthening the clinical relevance and applicability of the proposed method.
While this study focuses on binary classification between Parkinson’s disease and healthy controls, the proposed RecovGait framework serves as a foundational step toward more complex tasks such as PD stage progression analysis. The accurate reconstruction of occluded lower limb keypoints ensures reliable gait features, which are important for distinguishing subtle motor variations across disease stages. Future work will extend RecovGait to multi-stage PD classification using clinically annotated datasets to enhance its clinical applicability and diagnostic value.

Author Contributions

Conceptualization, C.W.Y. and T.C.; methodology, C.W.Y.; software, C.W.Y.; validation, T.C., T.S.O., A.A.-K. and M.F.; formal analysis, C.W.Y.; investigation, C.W.Y.; resources, N.I.S.; data curation, C.W.Y.; writing—original draft preparation, C.W.Y.; writing—review and editing, T.C., N.I.S., T.S.O., A.A.-K. and M.F.; visualization, C.W.Y.; supervision, T.C.; project administration, C.W.Y. and T.C.; funding acquisition, T.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research is supported by Multimedia University—Al-Zaytoonah University of Jordan Matching Grant (Project ID: MMUI/240092).

Institutional Review Board Statement

This study is approved by the Research Ethics Committee, Multimedia University (Approval Number: EA0422022, Approval Date: 28 June 2022).

Data Availability Statement

The dataset used in this study is available at https://www.kaggle.com/datasets/teeconnie/mmu-visual-based-parkinsons-disease-dataset (accessed on 1 November 2025).

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Saini, N.; Singh, N.; Kaur, N.; Garg, S.; Kaur, M.; Kumar, A.; Verma, M.; Singh, K.; Sohal, H.S. Motor and Non-Motor Symptoms, Drugs, and Their Mode of Action in Parkinson’s Disease (PD): A Review. Med. Chem. Res. 2024, 33, 580–599. [Google Scholar] [CrossRef] [Scilit]
  2. Antonini, A.; Reichmann, H.; Gentile, G.; Garon, M.; Tedesco, C.; Frank, A.; Falkenburger, B.; Konitsiotis, S.; Tsamis, K.; Rigas, G.; et al. Toward Objective Monitoring of Parkinson’s Disease Motor Symptoms Using a Wearable Device: Wearability and Performance Evaluation of PDMonitor®. Front. Neurol. 2023, 14, 1080752. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  3. AlZu’bi, S.; Elbes, M.; Mughaid, A.; Bdair, N.; Abualigah, L.; Forestiero, A.; Zitar, R.A. Diabetes Monitoring System in Smart Health Cities Based on Big Data Intelligence. Future Internet 2023, 15, 85. [Google Scholar] [CrossRef] [Scilit]
  4. Shehadeh, H.; Jebril, I.; Jaradat, G.; Ibrahim, D.; Sihwail, R.; AlHamad, H.; Chu, S.-C.; Alia, M. Intelligent Diagnostic Prediction and Classification System for Parkinson’s Disease by Incorporating Sperm Swarm Optimization (SSO) and Density-Based Feature Selection Methods. Int. J. Adv. Soft Comput. Its Appl. 2023, 15, 2074–8523. [Google Scholar]
  5. Zanardi, A.P.J.; da Silva, E.S.; Costa, R.R.; Passos-Monteiro, E.; dos Santos, I.O.; Kruel, L.F.M.; Peyré-Tartaruga, L.A. Gait Parameters of Parkinson’s Disease Compared with Healthy Controls: A Systematic Review and Meta-Analysis. Sci. Rep. 2021, 11, 752. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  6. Ferreira, M.I.A.S.N.; Barbieri, F.A.; Moreno, V.C.; Penedo, T.; Tavares, J.M.R.S. Machine Learning Models for Parkinson’s Disease Detection and Stage Classification Based on Spatial-Temporal Gait Parameters. Gait Posture 2022, 98, 49–55. [Google Scholar] [CrossRef] [Scilit]
  7. Wang, Q.; Zeng, W.; Dai, X. Gait Classification for Early Detection and Severity Rating of Parkinson’s Disease Based on Hybrid Signal Processing and Machine Learning Methods. Cogn. Neurodynamics 2024, 18, 109–132. [Google Scholar] [CrossRef] [Scilit]
  8. Smith, M.D.; Brazier, D.E.; Henderson, E.J. Current Perspectives on the Assessment and Management of Gait Disorders in Parkinson’s Disease. Neuropsychiatr. Dis. Treat. 2021, 17, 2965–2985. [Google Scholar] [CrossRef] [Scilit]
  9. Sun, H.J.; Zhang, Z.G. Transformer-Based Severity Detection of Parkinson’s Symptoms from Gait. In Proceedings of the 2022 15th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2022, Beijing, China, 5–7 November 2022; Institute of Electrical and Electronics Engineers Inc.: New York, NY, USA, 2022. [Google Scholar]
  10. Castelli Gattinara Di Zubiena, F.; Menna, G.; Mileti, I.; Zampogna, A.; Asci, F.; Paoloni, M.; Suppa, A.; Del Prete, Z.; Palermo, E. Machine Learning and Wearable Sensors for the Early Detection of Balance Disorders in Parkinson’s Disease. Sensors 2022, 22, 9903. [Google Scholar] [CrossRef] [Scilit]
  11. Shcherbak, A.; Kovalenko, E.; Somov, A. Detection and Classification of Early Stages of Parkinson’s Disease Through Wearable Sensors and Machine Learning. IEEE Trans. Instrum. Meas. 2023, 72, 4007909. [Google Scholar] [CrossRef] [Scilit]
  12. Ren, K.; Chen, Z.; Ling, Y.; Zhao, J. Recognition of Freezing of Gait in Parkinson’s Disease Based on Combined Wearable Sensors. BMC Neurol. 2022, 22, 229. [Google Scholar] [CrossRef] [Scilit]
  13. Sotirakis, C.; Su, Z.; Brzezicki, M.A.; Conway, N.; Tarassenko, L.; FitzGerald, J.J.; Antoniades, C.A. Identification of Motor Progression in Parkinson’s Disease Using Wearable Sensors and Machine Learning. Npj Park. Dis. 2023, 9, 142. [Google Scholar] [CrossRef] [Scilit]
  14. Shalin, G.; Pardoel, S.; Lemaire, E.D.; Nantel, J.; Kofman, J. Prediction and Detection of Freezing of Gait in Parkinson’s Disease from Plantar Pressure Data Using Long Short-Term Memory Neural-Networks. J. Neuroeng. Rehabil. 2021, 18, 167. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  15. Naimi, S.; Bouachir, W.; Bilodeau, G.-A. HCT: Hybrid Convnet-Transformer for Parkinson’s Disease Detection and Severity Prediction from Gait. In Proceedings of the 2023 International Conference on Machine Learning and Applications (ICMLA), Jacksonville, FL, USA, 15–17 December 2023. [Google Scholar]
  16. Guayacán, L.C.; Martínez, F. Visualising and Quantifying Relevant Parkinsonian Gait Patterns Using 3D Convolutional Network. J. Biomed. Inf. Inform. 2021, 123, 103935. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  17. Zeng, Q.; Liu, P.; Yu, N.; Wu, J.; Huo, W.; Han, J. Video-Based Quantification of Gait Impairments in Parkinson’s Disease Using Skeleton-Silhouette Fusion Convolution Network. IEEE Trans. Neural Syst. Rehabil. Eng. 2023, 31, 2912–2922. [Google Scholar] [CrossRef] [Scilit]
  18. Kaur, R.; Motl, R.W.; Sowers, R.; Hernandez, M.E. A Vision-Based Framework for Predicting Multiple Sclerosis and Parkinson’s Disease Gait Dysfunctions—A Deep Learning Approach. IEEE J. Biomed. Health Inf. Inform. 2023, 27, 190–201. [Google Scholar] [CrossRef] [Scilit]
  19. Shin, J.H.; Woo, K.A.; Lee, C.Y.; Jeon, S.H.; Kim, H.-J.; Jeon, B. Automatic Measurement of Postural Abnormalities with a Pose Estimation Algorithm in Parkinson’s Disease. J. Mov. Disord. 2022, 15, 140–145. [Google Scholar] [CrossRef] [Scilit]
  20. Yin, Z.; Geraedts, V.J.; Wang, Z.; Contarino, M.F.; DIbeklioglu, H.; Van Gemert, J. Assessment of Parkinson’s Disease Severity from Videos Using Deep Architectures. IEEE J. Biomed. Health Inf. Inform. 2022, 26, 1164–1176. [Google Scholar] [CrossRef] [Scilit]
  21. Yunus, A.P.; Shirai, N.C.; Morita, K.; Wakabayashi, T. Comparison of RNN-LSTM and Kalman Filter Based Time Series Human Motion Prediction. J. Phys. Conf. Ser. 2022, 2319, 012034. [Google Scholar] [CrossRef] [Scilit]
  22. Yang, H.; Li, X.; Li, X. Research on Human Motion Data Filtering Based on Unscented Kalman Filter Algorithm. In Proceedings of the 33rd Chinese Control and Decision Conference, CCDC 2021, Kunming, China, 22–24 May 2021; Institute of Electrical and Electronics Engineers Inc.: New York, NY, USA, 2021; pp. 3269–3274. [Google Scholar]
  23. Bharathi, A.; Sanku, R.; Sridevi, M.; Manusubramanian, S.; Chandar, S.K. Real-Time Human Action Prediction Using Pose Estimation with Attention-Based LSTM Network. Signal Image Video Process. 2024, 18, 3255–3264. [Google Scholar] [CrossRef] [Scilit]
  24. Guo, W.; Du, Y.; Shen, X.; Lepetit, V.; Alameda-Pineda, X.; Moreno-Noguer, F. Back to MLP: A Simple Baseline for Human Motion Prediction. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Tucson, AZ, USA, 26 February–6 March 2025. [Google Scholar]
  25. Katircioglu, I.; Georgantas, C.; Salzmann, M.; Fua, P. Dyadic Human Motion Prediction. arXiv 2021, arXiv:2112.00396. [Google Scholar]
  26. Gupta, A.; Semwal, V.B. Occluded Gait Reconstruction in Multi Person Gait Environment Using Different Numerical Methods. Multimed. Tools Appl. 2022, 81, 23421–23448. [Google Scholar] [CrossRef] [Scilit]
  27. Hasan, K.; Uddin, M.Z.; Ray, A.; Hasan, M.; Alnajjar, F.; Ahad, M.A.R. Improving Gait Recognition through Occlusion Detection and Silhouette Sequence Reconstruction. IEEE Access 2024, 12, 158597–158610. [Google Scholar] [CrossRef] [Scilit]
  28. Vernikos, I.; Spyrou, E. Skeleton Reconstruction Using Generative Adversarial Networks for Human Activity Recognition Under Occlusion. Sensors 2025, 25, 1567. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  29. Kumar, S.S.; Singh, B.; Chattopadhyay, P.; Halder, A.; Wang, L. BGaitR-Net: An Effective Neural Model for Occlusion Reconstruction in Gait Sequences by Exploiting the Key Pose Information. Expert Syst. Appl. 2024, 246, 123181. [Google Scholar] [CrossRef] [Scilit]
  30. Jain, M.; Chattopadhyay, P.; Paul, A.; Jain, J. Fusion of Forward and Backward LSTMs for Effective Occlusion Reconstruction in Gait Sequences. SN Comput. Sci. 2025, 6, 207. [Google Scholar] [CrossRef] [Scilit]
  31. Singh, J.P.; Jain, S.; Singh, U.P.; Arora, S. Hybrid Neural Network Model for Reconstruction of Occluded Regions in Multi-Gait Scenario. Multimed. Tools Appl. 2022, 81, 9607–9629. [Google Scholar] [CrossRef] [Scilit]
  32. Podsiadlo, D.; Richardson, S. The Timed “Up & Go”: A Test of Basic Functional Mobility for frail Elderly Persons. J. Am. Geriatr. Soc. 1991, 39, 142–148. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  33. Fang, H.-S.; Li, J.; Tang, H.; Xu, C.; Zhu, H.; Xiu, Y.; Li, Y.-L.; Lu, C. AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time. IEEE Trans. Pattern Anal. Mach. Intell. 2022, 45, 7157–7173. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  34. Kalman, R.E. A New Approach to Linear Filtering and Prediction Problems. J. Basic Eng. 1960, 82, 35–45. [Google Scholar] [CrossRef] [Scilit]
  35. Julier, S.J.; Uhlmann, J.K. New Extension of the Kalman Filter to Nonlinear Systems. In Signal Processing, Sensor Fusion, and Target Recognition VI; Kadar, I., Ed.; SPIE: Bellingham, WA, USA, 1997; Volume 3068, pp. 182–193. [Google Scholar]
  36. Sammut, C.; Webb, G.I. (Eds.) Mean Absolute Error. In Encyclopedia of Machine Learning; Springer: Boston, MA, USA, 2010; p. 652. ISBN 978-0-387-30164-8. [Google Scholar]
  37. Dodge, Y. (Ed.) Mean Squared Error. In The Concise Encyclopedia of Statistics; Springer: New York, NY, USA, 2008; pp. 337–339. ISBN 978-0-387-32833-1. [Google Scholar]
  38. Montaño, J.; Palmer, A.; Sesé, A.; Cajal, B. Using the R-MAPE Index as a Resistant Measure of Forecast Accuracy. Psicothema 2013, 25, 500–506. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  39. Carvajal-Castaño, H.A.; Pérez-Toro, P.A.; Orozco-Arroyave, J.R. Classification of Parkinson’s Disease Patients—A Deep Learning Strategy. Electronics 2022, 11, 2684. [Google Scholar] [CrossRef] [Scilit]
  40. Jun, K.; Lee, D.W.; Lee, K.; Lee, S.; Kim, M.S. Feature Extraction Using an RNN Autoencoder for Skeleton-Based Abnormal Gait Recognition. IEEE Access 2020, 8, 19196–19207. [Google Scholar] [CrossRef] [Scilit]
  41. Ding, A.; Nedzved, A.; Jia, H.; Guo, J. Intelligent Diagnosis of Gait Disorders Using Video-Based 3D Motion Analysis; Belarusian State University of Informatics and Radio-Electronics: Minsk, Belarus, 2025. [Google Scholar]
  42. Wu, J.; Su, N.; Li, X.; Yao, C.; Zhang, J.; Zhang, X.; Sun, W. Insights into Gait Performance in Parkinson’s Disease via Latent Features of Deep Graph Neural Networks. Front. Neurol. 2025, 16, 1567344. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.