Next Article in Journal
SnacktivityTM, Giant Games and Immersive Virtual Reality Exercises: A Rapid Narrative Review of These New Physical Activity Practices among Older People Living in Nursing Homes and Long-Term Care Facilities
Next Article in Special Issue
Age-Stratified Analysis of COVID-19 Outcome Using Machine Learning Predictive Models
Previous Article in Journal
Buffering Effect of Perseverance and Meditation on Depression among Medical Students Experiencing Negative Family Climate
Previous Article in Special Issue
Classification Algorithms Used in Predicting Glaucoma Progression
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Intelligent Monitoring Model for Fall Risks of Hospitalized Elderly Patients

by
Amal H. Alharbi
and
Hanan A. Hosni Mahmoud
*
Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
*
Author to whom correspondence should be addressed.
Healthcare 2022, 10(10), 1896; https://doi.org/10.3390/healthcare10101896
Submission received: 29 August 2022 / Revised: 20 September 2022 / Accepted: 23 September 2022 / Published: 28 September 2022
(This article belongs to the Special Issue Artificial Intelligence Applications in Medicine)

Abstract

:
Early detection of high fall risk is an important process of fall prevention in hospitalized elderly patients. Hospitalized elderly patients can face several falling risks. Monitoring systems can be utilized to protect health and lives, and monitoring models can be less effective if the alarm is not invoked in real time. Therefore, in this paper we propose a monitoring prediction system that incorporates artificial intelligence. The proposed system utilizes a scalable clustering technique, namely the Catboost method, for binary classification. These techniques are executed on the Snowflake platform to rapidly predict safe and risky incidence for hospitalized elderly patients. A later stage employs a deep learning model (DNN) that is based on a convolutional neural network (CNN). Risky incidences are further classified into various monitoring alert types (falls, falls with broken bones, falls that lead to death). At this phase, the model employs adaptive sampling techniques to elucidate the unbalanced overfitting in the datasets. A performance study utilizes the benchmarks datasets, namely SERV-112 and SV-S2017 of the image sequences for assessing accuracy. The simulation depicts that the system has higher true positive counts in case of all health-related risk incidences. The proposed system depicts real-time classification speed with lower training time. The performance of the proposed multi-risk prediction is high at 87.4% in the SERV-112 dataset and 98.71% in the SV-S2017 dataset.

1. Introduction

Falls are indicators of feebleness, immovability, and severe chronic injury in elderly people. Fall risks reduce normal tasks by producing injury and movement limitations. Most injuries in the elderly are caused by falls that can produce hip fractures and forearm injuries [1,2,3].
The prediction of fall risks must consider the range of ages and fitness status within the elderly patients and report the variety of reasons for falls. Fall risk factors are listed in controlled studies, which agree to the detection of patients at risk. Older people with several health deficiencies are at the highest risk [4,5,6].
A fall is defined as an unintentional occasion that leads the patient to rest on a ground level. Falls are designated in three stages, as follows [7]:
  • An introducing event that relocates the patient’s center of mass away from its base of support which can be caused by environmental hazards or unstable joint weakness.
  • The second stage of a fall is the inability of the patient to sustain an upright posture to perceive this movement in time to evade a fall due to loss of sensory function.
  • The third stage is the effect of the patient’s body on solid surfaces, which yields to the conduction of forces to the patients’ organs. The prospective for damage is a function of the magnitude and direction of the fall forces.
Research is moving towards automation, deep learning (DL), and artificial intelligence. Dynamic monitoring networks speed up the stream of health-related risk information [1,2,3]. These developments convey convenience to high-risk situations and reveal concealed dangers to hospitalized elderly patients. Thus, protecting people’s lives from violation or violence incidents is a life-risking challenge and is a needed research track for monitoring research. There are numerous health-related risks to personal lives and hospitals everywhere. In [2], the authors studied three metallic materials, and their applications in metal-on-metal bearing for hip implants in terms of contact pressure. The authors employed finite element simulation for predicting contact pressure under normal walking conditions. Recently, both the health-related risk techniques and the count of monitoring health-related risks have grown radically. This carries random risks to the safety and stable process of many premises such as hospitals and hospices. Thus, effective tools to identify various monitoring risks and to combat these risks are immediately required. An automated monitoring system (ASS) can identify health-related risk incidences and prevent them.
Many researchers have utilized deep learning models for the monotonous prediction of unusual monitoring movements for hospitalized elderly patients [1]. Many monitoring systems employ deep learning models, especially in the image recognition paradigm [2,3], and motion analysis [3,4,5]. Machine learning techniques usually have high prediction performance, such as DNN recurrent neural network (RNN) and Catboost [6]. However, the prediction accuracy has room for improvement. Deep learning techniques are performed by using neurons to extract hidden monitoring features. However, techniques such as deep learning [5,6,7,8,9] take a long time to train the system. Thus, a single deep learning technique will not encounter the real-time requirements of the monitoring systems in the new generation.
There are several hybrid monitoring prediction models that unite several deep learning techniques such as support vector deeps (SVM) and C-means [10,11,12,13], SVM based on naive Bayes, LDBoost [11,12], and support vector deep with recurrent C-means clustering [3]. Also, there are mixtures of several deep learning techniques such as Vinaya-kumar and its equivalents [12,13,14]. The authors in [15] utilized RNN and SVM models to extract spatial and temporal features. The authors in [16] presented a recurrent DNN system to detect the semantic features of monitoring settings. Other unions of deep learning techniques and neural techniques. For instance, the authors in [17] presented a deep learning model with a hidden belief technique to extract features and RNN for classification. The authors in [18] utilized a stacked encoder-decoder model for feature selection and then utilized random forests for classification. The authors in [19] presented a deep learning fusion classification model.
Distributed intelligent learning techniques and deep techniques are presented by many researchers [19,20,21,22]. Such systems train high-dimensionality input rapidly and effectively so they can be utilized to train the enormous size of data in the training phase of the two phase prediction monitoring systems. Multi-risk prediction phase of monitoring systems, deep neural techniques can extract hidden features and extract unpreceded health-related risks with high performance. An investigation of monitoring prediction is proposed in [19]. The authors in [19] presented a flow model which performed the first phase by using Snowflake Python as the deep learning framework and the RNN architecture. The complexity is enlarged if the data is altered on several hardware models. Such methods predict only safe and risky incidences without further classifying risky incidences. These hybrid models are doing well on previously defined datasets, but with new health-related risk types, more development is necessary. Guaranteeing the real-time requirements of monitoring prediction without degrading the performance is an imperative problem that has to be deliberated for next-era monitoring systems. Based on previous research, this paper proposes an improvement for an automated health monitoring system such that various risky incidences can be classified in real-time, thus constructing a more reliable system. Different fall risk prediction models are depicted in Figure 1.
Therefore, in this paper, we introduce a monitoring intelligent prediction system. The proposed system incorporates a scalable clustering method using the Catboost binary classification. These techniques are executed on the Snowflake platform (https://www.snowflake.com/en/) accessed on 23 June 2022, for real-time prediction of risk. Snowflake’s Data Cloud is powered by an advanced data platform provided as Software-as-a-Service (SaaS). Snowflake enables data storage, processing, and analytic solutions that are faster, easier to use, and far more flexible than traditional offerings [22] We then employ a deep learning neural network to classify various monitoring alert types (fall, fall with broken bones, and falls that lead to death).
This paper proposes a multi-stage monitoring prediction model using a distributed method that can be utilized for a considerably sized dataset. The proposed model utilizes intelligent techniques to extract hidden features to prevent an overfitting problem. A comparison of the performance of the true positive rate on the SERV-112 and SV-S2017 datasets depicts a higher true positive rate for health-related risk incidences and a higher true positive rate for multi-risk prediction. Both datasets are composed of an image sequence of 120 frames for each incident.
The organization of this paper is depicted as follows. Section 2 outlines the materials and methods of the proposed research. The experimental settings and the classification results are elucidated in Section 3. Conclusions from the proposed research are perceived in Section 4.

2. Materials and Methods

The proposed monitoring/prediction system comprises three phases. The first phase of the monitoring prediction involves the analysis of the class attributes with data processing and the removal of unrelated data. In addition, normalization is performed to obtain the processed data. Phase 2 predicts safe and unsafe incidences based on the scalable clustering algorithm. In the final phase, the hidden features are extracted using DL techniques. As depicted in Figure 2, Snowflake is the core of the presented system. Before prediction, the conforming libraries of Snowflake have to be imported. Snowflake for the experiment settings of this research. The training dataset in the last phase is deducted from the sampling by SMOTE [20] after eliminating safe incidences in the first phase. The testing subsets of the last phase are deducted from the rest of the results from the testing datasets.

2.1. Distributed C-Means Phase (DC)

The main stages of the C-means technique are to choose cluster centroids, compute the displacements between incidence points and the cluster centroids, then allocate each incidence to the correct centroid. Stages will be reiterated to check that the state is attained. The DC technique computes the displacement between the cluster centroid and the incidence by computing the Euclidean displacement, which is defined as the matrices of the squared distances between points [21]. The formula is calculated as follows:
d i s ( P 1 , P 2 ) = ( P 11 P 21 ) 2 + ( P 12 P 22 ) 2 + + ( P 1 m P 2 m ) 2  
where P 1   and   P 2 represent two incidences with m fields and d i s ( P 1 , P 2 ) = represents the Euclidean displacement between points P 1 = ( P 11 , P 12 , , P 1 m ) and P 2 = ( P 21 , P 22 , , P 2 m ) . The experiments are performed in Snowflake. The data is portioned into several subsets which relate to various distributed sets (DSets). Each DSet saves multiple subsets. The C-means algorithm groups the subsets in each DSet and computes the concluding results. Snowflake will perform several threads to calculate the subsets in the servers. The preliminary cluster centroid is 9, so the concluding result is 9.

2.2. Distributed Catboost Technique

The Catboost technique is a unified deep learning technique that constructs forest trees using node splitting and reselection. The ultimate prediction outcome is nominated from the results of several trees [23]. Following the C-means phase, safe incidences and unsafe incidences will be classified by Catboost, and these unsafe incidences will be further partitioned. Catboost performs training on a group of forests disjointedly, so the learning process can be performed on Snowflake. The forests are used to construe DSets. The essential part is fixing the count of the forests rationally. The count of forests is 500 with the longest one being 30 levels. The clustering forest technique of the Catboost technique is designated in the following equation:
R ( P ) = a r g m a x P ( k = 0 n P r o b   ( r i ( P ) = A )
where, P and A denotes a particular prediction incidence and object, where r i ( P ) denotes a prediction result, P r o b   ( r i ( P ) = A ) is the probability computation, and R ( P ) denotes the prediction of the Catboost technique.

2.3. Deep Learning Techniques for Multi-Risk Prediction

In the final phase, the deep learning technique (DNN) is utilized to accomplish multi-risk classification. DNN usually comprises an input, deep learning, pooling, and fully connected layers (FC). They are feedforward neurons that employ the convolution operation. The convolution operation selects hidden features, and the kernels achieve convolution computation with the initial data to select those key features. DNN is partitioned into several parallel CNNs, with each CNN extracting a single feature from a subset of the input. Feature integration is performed to output the required feature matrix as depicted in Figure 3. In this article, health-related risk incidences can be classified into safe incidences and unsafe incidences.
The deep learning technique (DL) is utilized to accomplish multi-risk irregularity classification. DL usually comprises an input, deep learning, pooling, and fully connected layers (FC). They are feedforward neurons that employ the convolution operation. The convolution operation selects hidden features, and the kernels achieve convolution computation with the initial data to select those key features. DL is partitioned into DL-1D, DL-2D, and DL-3D using the input. Several dimension layers have various scenarios. DL-1D is utilized in serialization systems. In this article, health-related risk incidences can be classified into safe incidences and unsafe incidences. Thus, DL-1D can be utilized as the monitoring prediction system. The forward network of the DL convolution can be computed as depicted below:
i l = R e L U   ( i l + 1 × ω l + O l )
R e L U   ( i ) = { i ,   i > 0 0 ,   i < 0  
where R e L U is the rectified linear operation unit. The computation is depicted in Equation (4), where i l + 1 and i l denote the input and the output of the neural operation. ω l denotes the l t h layer weight vector, and O l denotes the offset of the l t h layer.
DL is intended to tackle the gradient fading problem of the RNNs. The proposed DL model has a direct link between earlier and late stages of the monitoring prediction incidence; this research uses the time series system. A standard deep learning unit is composed of an input cell 9 that has an image I n ( x , y ) , an output cell (has an output image O u t ( x , y ) , and an ignore cell (with an image I g ( x , y ) ). As depicted below:
I n ( x , y ) = p i x ( j , k ) p i x m i n p i x a v g p i x m i n
p i x ( x , y ) = 1 r r     X = x r / 2 x + r / 2 Y = y = r / 2 y + r / 2 p i x ( x , y ) )
I n ( x , y ) = ξ ( x , y ) ξ m i n ξ m a x ξ m i n
ξ ( x , y ) = a b s ( p i x ( x , y ) p i x ( x , y ) ,   I g ( x , y ) = 1 ψ ( x , y )
Since p i x ( x , y ) is a local optimum and ξ ( x , y ) is the absolute difference between p i x ( x , y ) and p i x ( x , y ) . p i x ( x , y ) represents the pixel value at points x and y.
The entropy of the energy is computed for the positive set, ignore set, and negative set as depicted below. Where p r o b depicts the probability for an incidence Z.
E n t r o p y   ( P o s i t i v e ) = Z = min { P o s i t i v e } max { P o s i t i v e } p r o b ( Z ) ln ( p r o b ( Z ) )
E n t r o p y   ( I g n o r e ) = Z = min { I g n o r e } max { I g n o r e } p r o b ( Z ) ln ( p r o b ( Z ) )
E n t r o p y   ( N e g a t i v e ) = Z = min { N e g a t i v e } max { N e g a t i v e } p r o b ( Z ) ln ( p r o b ( Z ) )
T o t a l   ( E n t r o p y ) = E n t r o p y   ( P o s i t i v e ) + E n t r o p y   ( I g n o r e ) + E n t r o p y   ( N e g a t i v e )

2.4. Dataset Description

The benchmark datasets [24,25] are composed of files of extracted features from labelled video sequences captured by cameras in the patients’ hospital rooms. These videos undergo splitting into frames which are fed to the deep learning model. The key point is the extracted feature map and the frame labels. These maps are utilized as training data and fed to the fall monitoring deep network. The output model then classifies the fall of the testing frames for new incidences. The SERV-112 [24] and the SV-S2017 [25] datasets are utilized to validate the efficiency of the system presented in this research. The SERV-112 dataset is preprocessed, prearranged and labelled. SV-S2017 was produced in 2019 [22,23,24,25,26] by the Hospitalized Monitoring and European health monitoring. The SERV-112 dataset has labeled image sequences of 30 different features. The extracted features in the training phase of the monitoring prediction system are the entropy functions and the probability functions of different classes. The SV-S2017 dataset utilized in this research has continuous-valued features such as optical flow features. Examples of fall images from the dataset SV-S2017 are shown in Figure 4.
Description of the datasets according to labelled fall cases (safe, fall, fall with broken bones, fall that leads to death) are depicted in Table 1 and Table 2. The distribution of both data sets for the training, validation, and testing datasets is depicted in Table 3.

2.4.1. Feature Extraction

Health issue group, risk, and red flags define the categorical reported attributes in SERV-112. The attributes are transformed into values. For instance, the feature of the health issue type includes severely paralyzed, moderately paralyzed, and non-paralyzed, which is transformed into ordinal values from one to three. In this situation, the health issue type feature is transformed to ordinal values [1, 60].

2.4.2. Data Normalization

Data normalization is the computation to convert the multi-dimensional feature into a one-dimensional value. Preprocessing confines the values to definite ranges to reduce the effects done by the difference in variance values. In this article, all representative values are normalized to [0, 1], where f m , n denotes the n t h feature of the m t h incidence.
f m , n = f m , n M i n M a x M i n
where M a x is the greatest value of the n t h feature, and M i n is the smallest value of the n t h feature.

2.4.3. Label Binarization

The incidence labels of the SERV-112 and SV-S2017 are numeric values, and binarization labeling of is utilized to define categories into vectors of bits. In the SERV-112 dataset, we have eight categories representing the severity of immobility. In the SV-S2017 dataset, we have the same eight categories, in addition to two categories of health-related risks, namely previous injuries and previous falls. This research performs label binarization for the immobility features and the health-related risks categories.

2.5. Bi-Classification Using Distributed Deep Learning

The second phase is for rapid prediction of health-related risk incidences while guaranteeing the performance of health-related risk incidences. If a high number of health-related risk incidences are misclassified, the monitoring system’s false negative count will rise, and the monitoring systems will not be operative. Thus, the objective of this phase is to isolate the health-related risks promptly. The enhancement of the monitoring system’s performance is governed by the legitimacy of the input. The data composed by the monitoring systems are diverse collected from patients’ behavior and aptitude. This multiplicity that we employ can produce the operative processing of monitoring incidences. These data of multi-dimensional monitoring systems need to predict the risky incidence before classifying health-related risk classes. The health-related risk is clarified by removing safe incidence, which decreases the effort and time complexity of the in-depth analysis of health-related risks in the final phase. The prediction at this phase is depicted in Figure 5.
The binary monitoring prediction system integrates the DC technique and the Catboost technique using Snowflake. The DC technique is utilized to group monitoring prediction incidences, and Catboost is utilized to categorize the clusters. The input is separated into several subsets according to the structure of the Snowflake system and the data size. All different data subsets subsist as DSet in Snowflake. Each transmutes and action function in the technique will be incidences and will be applied to all DSets. Thus, the incidence sets in Figure 5 are partitioned into several subsets. In the procedure, the C-means technique is utilized to cluster the input to form clusters. At that juncture, the DSet aggregation operation is utilized to combine the clusters into the results sets. For R e s u l t 1 , R e s u l t 2 , and R e s u l t 3 , until the last cluster, several schemes are employed using different points. Clusters with less than thirty points are either classified as unsafe or the Catboost technique is utilized to predict the results.

2.6. Multi-Risk Health Related Risk Incidences Classification Using Deep Learning Technique

In the last phase, the incidences classified as safe by the Catboost technique in the previous phase will leave the system directly. Many health-related risk incidences are positively separated, and the incidences classified as unsafe will enter the last phase. Using these schemes, unsafe incidences and safe incidences can be extracted. The model platform of the DC and the Catboost techniques are depicted in Figure 5. The point limit in Figure 5 is 30 as depicted.

Monitoring Prediction Deep Learning System Framework with Long Short-Term Memory (LS)

In this phase, three architectures are used, namely: “DNN”, “LS”, and “DNN + LS”, and are utilized to validate the accuracy of the system. Each system structure comprises from one to three hidden layers. ReLU classification is used, and the final phase is fully connected (FC). The classification is performed using Softmax. These structures are utilized to discover the most appropriate multiple risk health-related incidence prediction method. All health-related risk incidences are classified using Softmax. The whole configuration of this phase is depicted. In the last preprocessing stage, SERV-112 has 120 attributes and SV-S2017 has 80 attributes. The last layer has six dense layers for the SERV-112 dataset and eight in the SV-S2017 dataset, as depicted in Figure 6.

3. Results and Discussion

The deep learning model is depicted in Table 4. We generated a Snowflake framework and ran Snowflake processes; this is also an essential experimental setting for the final phase. The nodes are configured with a TMS 34010, Intel, New York, NY, USA, graphic processor (https://www.ti.com/lit/pdf/spvu015 accessed on 23 June 2022), which utilizes Tensor as the prime platform of Keras. This permits us to decrease the training time of the DNN system. After the binary prediction by the DNN model on the Snowflake framework, the safe and unsafe incidences are directly computed by the distributed model to the master side. In the final phase, the monitoring prediction data saved on the master side can be utilized for prediction straight away as depicted in Table 4.

3.1. Evaluation

Evaluation methods for prediction results of unsafe incidences are used. Precision and true positive rate and true negative rate are mostly measured. The ratio of incidences in the test subset diverges, and the classification outcomes may be inclined to incidences with higher occurrence data. Thus, the precision is not enough. The classification outcomes produced by the monitoring system can be partitioned into several groups.
The accuracy is the percentage of correctly classified incidences to the total incidences count. Accuracy is employed for all safe incidences and unsafe incidences in the test dataset. The true positive rate is the percentage of incidences defined as health-related risks, which are properly classified as health-related risks in the datasets for all items defined as health-related risks as depicted in the equations below.
Accuracy   = T P + T N T P + F P + F N + T N
True   positive   rate = T P T P + F N
True   negative   rate = T N F P + T N
where, true positive (TP) is defined as the correctly classified health-related risk incidences, and TN denotes the properly classifies safe incidences. FP depicts the mistakenly classified positive incidences and a false negative is defined as the incorrectly classified negative incidences.

3.2. Binary Prediction Experiments

The prediction by the deep DNN prediction system, the results are depicted in Table 5 and Table 6. The prediction rate in SERV-112 is 91.80%, and the prediction results in the SV-S2017 are 99.67%, specifying health-related risk incidences can be predicted accurately. The false positive rate of health-related risk incidences is very little. This indicates that the accuracy of the prediction system is high. Prediction accuracy and the positive ratio for the SERV-112 set can encounter further prediction of health-related risk incidences in the final phase.

3.3. The Experimental Results of the Multi-Risk Health Related Incidences Prediction

The multi-risk health-related incidences prediction employs several deep learning frameworks: DNN, long short-term memory, and DNN + long short-term memory. The factors of the training system affect the prediction experimental ratios. After several epochs, the deep layers of the DNN system are made equal to 2056, the FC size is made equal to 6, and the pooling layers are made equal to 4. The factors for the long short-term memory system are set to 520. The parameter of the DNN + long short-term memory system is computed using the previous systems. The preliminary learning rate is equal to 0.02.
The precision rate of the loss rate of the training systems of eight convolutions is depicted. The three deep learning systems can accomplish high accuracy and low loss rates. It is observed that the count of epochs needed to predict only health-related risk incidences is 100 epochs, which is considerably low compared to the 500 epochs needed by the model in [27] to predict safe incidences and the five types of health-related risk incidences. The early splitting of safe incidences avoids pointless training time for the multi-risk unsafe prediction phase based on the training deep learning CNN techniques [28,29,30]. Therefore, the learning curve can be considerably abridged [31].
In [32,33] the study assessed Tresca stress in CoCrMo-onCoCrMo hip implants using patient body mass index. The authors presented a 2D computational model to attain this objective.
Results depicted in Figure 7 show the correlation between the real ratio of risk incidence in elderly patients from a physician’s judgment from patients’ charts, and the ratio of the risk incidence detected from the proposed system.
The Bland-Altman plot of the real ratio of the risk incidence in elderly patients from a medical personal prognosis in comparison to the calculated ratio of risk incidence of the proposed system is depicted in Figure 8.
The true positive rates of health-related risk incidences used for the three used models are depicted in Table 5 and Table 6. In the SERV-112 dataset, the monitoring prediction method predicted by the DNN is comparatively balanced. The True positive rate in the DNN system with four hidden layers is above 80%, and the health-related risk incidences have a moderate recall rate. Compared with the system presented, long short-term memory is considerably enhanced in the proposed research, with a true positive rate as high as 92.8%. The other groups of health-related risk incidences have a reasonably balanced true positive rate (namely; fall, fall with broken bones, and fall that leads to death). Table 7 shows that other common health-related risk types have the highest true positive rate in the presented methods in the SV-S2017 dataset, except for falls that lead to death risk. In precise, the True positive rate of Fall, Fall with broken bones accomplish up to 98.7%. This means that fall and fall with broken bones can be classified with high precision, as depicted in Table 7 and Table 8.
The computational load is challenging due to the fact that these systems were realized on various platforms. Thus, the computational load can be depicted by simulation models. The final phase of the system is grounded on the statistic that testing datasets are partitioned into unsafe related risk incidences and safe incidences from the second phase. The incidences predicted as unsafe-related risks from the second phase were gathered on the server. The DNN prediction system of the final phase is predicted from the server, and testing will be converted frequently on various platforms. Snowflakes’ distributed hardware finalizes the data of the training input in the final phase and will save training time in this phase. The prediction system utilizes Azure Machine, which utilizes the speedup technique for faster training, so the computational load of the final phase can be enhanced. Figure 9 depicts the correctly classified versus incorrectly-classified instances. Table 9 and Table 10 depict the comparison of the prediction time in seconds.

3.4. Comparison and Discussion

Comparison between the proposed model (DNN + LS) model and other fall prediction models is displayed in Table 11.

Computational CPU Time

In deep learning neural networks, training time is one of the metrics for defining the model performance. In addition, classification CPU time is very crucial, especially for real time applications. The fall monitoring system is one of the real time applications where classification has to be done in real time from video captured by the camera. In the following table we display the CPU time comparisons for both training time and classification time.
As we can see from Table 12, the proposed model maintains an average time that is lower than the other models in training time. This is due to two factors: The first factor is the Snowflake’s distributed hardware where the system is designed and implemented to be distributed system. The second factor is the application of the C-Means from the beginning to cluster the fall incidence from the No-Fall incidences before the deep learning training phase. The same two factors contribute significantly to less classification time for alarms to notify health personnel about a future fall incident, as depicted in Table 13.

4. Conclusions

This article presented a cascading monitoring prediction technique based on distributed C-means, Catboost, and deep learning. We presented a methodology to solve monitoring systems problems that are computationally time-consuming and that have low prediction accuracy. The distributed methodology is utilized to accomplish the time-efficient processing of the monitoring prediction dataset. The unsafe related risk incidences and safe incidences were alienated by incorporating the distributed C-means and the Catboost technique. The isolated unsafe related risk incidences are fed to deep learning systems that extract hidden features of multi-risk incidences. The final phase performs the prediction of various related risk incidences promptly. The prediction system presented in this paper is evaluated using the SERV-112 and SV-S2017 datasets. The experimental results depict that the presented method can efficiently recognize the prediction of health-related risk incidences. The performance of safe incidences and the other three types of unsafe related risk incidences is 87.24% in the SERV-112 dataset, while the accuracy of unsafe incidences is 98.9% in the SV-S2017 dataset. We also compared the proposed model (DNN + LS) with the separate deep learning monitoring prediction systems (DNN and LS)), and the system presented in this paper achieved a higher true positive rate for most risk incidences irrespective of the incidence number of these related risk incidences, which determined that more elderly related risks could be precisely predicted. The proposed model maintains average time that is lower than the other models in training time. This is due to two factors. The first factor is the Snowflakes’ distributed hardware where the proposed system is designed and implemented to the distributed system. The second factor is the application of the C-Means from the beginning to cluster the fall incidence from the No-Fall incidences before the deep learning training phase. The same two factors contribute significantly to less classification time for alarms to notify health personnel about a future fall incident.
The limitation of this study is the lack of posture information in the learning stage, as it might help in the classification process, but it might take require more classification CPU time.

Author Contributions

Conceptualization, H.A.H.M. and A.H.A.; methodology, H.A.H.M.; software, H.A.H.M.; validation, H.A.H.M. and A.H.A.; formal analysis, H.A.H.M.; investigation, H.A.H.M.; resources, H.A.H.M.; data curation, H.A.H.M.; writing—original draft preparation, H.A.H.M.; writing—review and editing, H.A.H.M.; visualization, H.A.H.M.; supervision, H.A.H.M.; project administration, H.A.H.M.; funding acquisition, A.H.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2022R113), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Conflicts of Interest

The authors declare that they have no conflicts of interest to report regarding the present study.

References

  1. Zhao, Z.; Zhang, L.; Shang, H. A Lightweight Subgraph-Based Deep Learning Approach for Fall Recognition. Sensors 2022, 22, 5482. [Google Scholar] [CrossRef] [PubMed]
  2. Jamari, J.; Ammarullah, M.I.; Santoso, G.; Sugiharto, S.; Supriyono, T.; van der Heide, E. In Silico Contact Pressure of Metal-on-Metal Total Hip Implant with Different Materials Subjected to Gait Loading. Metals 2022, 12, 1241. [Google Scholar] [CrossRef]
  3. Guerreiro, M.T.; Guerreiro, E.M.A.; Barchi, T.; MBiluca, J.; Alves, T.A.; de Souza Tadano, Y.; Trojan, F.; Siqueira, H.V. Anomaly Detection in Automotive Industry Using Clustering Methods—A Case Study. Appl. Sci. 2021, 11, 9868. [Google Scholar] [CrossRef]
  4. Martins, L.M.; Ribeiro, N.F.; Soares, F.; Santos, C.P. Inertial Data-Based AI Approaches for ADL and Fall Recognition. Sensors 2022, 22, 4028. [Google Scholar] [CrossRef]
  5. Wang, S.; Miranda, F.; Wang, Y.; Rasheed, R.; Bhatt, T. Near-Fall Detection in Unexpected Slips during Over-Ground Locomotion with Body-Worn Sensors among Older Adults. Sensors 2022, 22, 3334. [Google Scholar] [CrossRef] [PubMed]
  6. Bari, A.S.M.H.; Gavrilova, M.L. KinectGaitNet: Kinect-Based Gait Recognition Using Deep Convolutional Neural Network. Sensors 2022, 22, 2631. [Google Scholar] [CrossRef]
  7. Li, C.; Zhong, Q.; Xie, D.; Pu, S. Co-occurrence feature learning from skeleton data for action recognition and detection with hierarchical aggregation. arXiv 2018, arXiv:1804.06055. [Google Scholar]
  8. Yan, S.; Xiong, Y.; Lin, D. Spatial-temporal graph convolutional networks for skeleton-based action recognition. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA, 2–7 February 2018. [Google Scholar]
  9. Cheng, K.; Zhang, Y.; He, X.; Chen, W.; Cheng, J.; Lu, H. Skeleton-based action recognition with shift graph convolutional network. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Virtual, 14–19 June 2020; pp. 183–192. [Google Scholar]
  10. Liu, Z.; Zhang, H.; Chen, Z.; Wang, Z.; Ouyang, W. Disentangling and unifying graph convolutions for skeleton-based action recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Virtual, 14–19 June 2020; pp. 143–152. [Google Scholar]
  11. Zhang, P.; Lan, C.; Zeng, W.; Xing, J.; Xue, J.; Zheng, N. Semantics-guided neural networks for efficient skeleton-based human action recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Virtual, 14–19 June 2020; pp. 1112–1121. [Google Scholar]
  12. Thakkar, K.; Narayanan, P.J. Part-based graph convolutional network for action recognition. arXiv 2018, arXiv:1809.04983. [Google Scholar]
  13. Huang, L.; Huang, Y.; Ouyang, W.; Wang, L. Part-level graph convolutional network for skeleton-based action recognition. In Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA, 7–12 February 2020; Volume 34, pp. 11045–11052. [Google Scholar]
  14. Shi, L.; Zhang, Y.; Cheng, J.; Lu, H. Skeleton-based action recognition with directed graph neural networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 16–20 June 2019; pp. 7912–7921. [Google Scholar]
  15. Núñez-Marcos, A.; Azkune, G. Arganda-Carreras I. Vision-based fall detection with convolutional neural networks. Wirel. Commun. Mob. Comput. 2017, 2017, 9474806. [Google Scholar] [CrossRef]
  16. Feng, Q.; Gao, C.; Wang, L.; Zhao, Y.; Song, T.; Li, Q. Spatio-temporal fall event detection in complex scenes using attention guided LSTM. Pattern Recognit. Lett. 2020, 130, 242–249. [Google Scholar] [CrossRef]
  17. Espinosa, R.; Ponce, H.; Gutiérrez, S.; Martínez-Villaseñor, L.; Brieva, J.; Moya-Albor, E. A vision-based approach for fall detection using multiple cameras and convolutional neural networks: A case study using the UP-Fall detection dataset. Comput. Biol. Med. 2019, 115, 103520. [Google Scholar] [CrossRef] [PubMed]
  18. Christiansen, T.L.; Lipsitz, S.; Scanlan, M.; Yu, S.P.; Lindros, M.E.; Leung, W.Y.; Adelman, J.; Bates, D.W.; Dykes, P.C. Patient activation related to fall prevention: A multisite study. Jt. Comm. J. Qual. Patient Saf. 2020, 46, 129–135. [Google Scholar] [CrossRef] [PubMed]
  19. Alam, E.; Sufian, A.; Dutta, P.; Leo, M. Vision-based human fall detection systems using deep learning: A review. Comput. Biol. Med. 2022, 146, 105626. [Google Scholar] [CrossRef] [PubMed]
  20. Cao, Z.; Simon, T.; Wei, S.E.; Sheikh, Y. Realtime multi-person 2d pose estimation using part affinity fields. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 7291–7299. [Google Scholar]
  21. Shahroudy, A.; Liu, J.; Ng, T.T.; Wang, G. Ntu rgb+ d: A large scale dataset for 3d human activity analysis. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 July 2016; pp. 1010–1019. [Google Scholar]
  22. Kwolek, B.; Kepski, M. Human fall detection on the embedded platform using depth maps and wireless accelerometer. Comput. Methods Programs Biomed. 2014, 117, 489–501. [Google Scholar] [CrossRef]
  23. Martínez-Villaseñor, L.; Ponce, H.; Brieva, J.; Moya-Albor, E.; Núñez-Martínez, J.; Peñafort-Asturiano, C. UP-fall detection dataset: A multimodal approach. Sensors 2019, 19, 1988. [Google Scholar] [CrossRef]
  24. Zhao, R.; Ali, H.; Van der Smagt, P. Two-stream RNN/CNN for action recognition in 3D videos. In Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada, 24–28 September 2017; pp. 4260–4267. [Google Scholar]
  25. Li, W.; Wen, L.; Chang, M.C.; Nam Lim, S.; Lyu, S. Adaptive RNN tree for large-scale human action recognition. In Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 22–29 October 2017; pp. 1444–1452. [Google Scholar]
  26. Liu, J.; Wang, G.; Hu, P.; Duan, L.Y.; Kot, A.C. Global context-aware attention lstm networks for 3d action recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 1647–1656. [Google Scholar]
  27. Lee, I.; Kim, D.; Kang, S.; Lee, S. Ensemble deep learning for skeleton-based action recognition using temporal sliding lstm networks. In Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 22–29 October 2017; pp. 1012–1020. [Google Scholar]
  28. Lev, G.; Sadeh, G.; Klein, B.; Wolf, L. Rnn fisher vectors for action recognition and image annotation. In Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands, 8–16 October 2016; Springer: Cham, Switzerland, 2016; pp. 833–850. [Google Scholar]
  29. Chen, Y.; Du, R.; Luo, K.; Xiao, Y. Fall detection system based on real-time pose estimation and SVM. In Proceedings of the 2021 IEEE 2nd International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE), Nanchang, China, 26–28 March 2021; pp. 990–993. [Google Scholar] [CrossRef]
  30. Jamari, J.; Ammarullah, M.I.; Santoso, G.; Sugiharto, S.; Supriyono, T.; Prakoso, A.T.; Basri, H.; van der Heide, E. Computational Contact Pressure Prediction of CoCrMo, SS 316L and Ti6Al4V Femoral Head against UHMWPE Acetabular Cup under Gait Cycle. J. Funct. Biomater. 2022, 13, 64. [Google Scholar] [CrossRef]
  31. Dokmanic, I.; Parhizkar, R.; Ranieri, J.; Vetterli, M. Euclidean Distance Matrices: Essential theory, algorithms, and applications. IEEE Signal Process. Mag. 2015, 32, 12–30. [Google Scholar] [CrossRef]
  32. Ammarullah, M.I.; Santoso, G.; Sugiharto, S.; Supriyono, T.; Kurdi, O.; Tauviqirrahman, M.; Winarni, T.I.; Jamari, J. Tresca Stress Study of CoCrMo-on-CoCrMo Bearings Based on Body Mass Index Using 2D Computational Model. J. Tribol. 2022, 33, 31–38. [Google Scholar]
  33. Kalmatskiy, A.; Zhukova, N.A.; Kulikov, I.A. Snowflake—An Internet Protocol from Scratch. In Proceedings of the 2020 XXIII International Conference on Soft Computing and Measurements (SCM), St. Petersburg, Russia, 27–29 May 2020; pp. 73–75. [Google Scholar] [CrossRef]
Figure 1. Fall risk prediction models can consist of wearable devices, room sensors or image and video analysis.
Figure 1. Fall risk prediction models can consist of wearable devices, room sensors or image and video analysis.
Healthcare 10 01896 g001
Figure 2. The three phases of the monitoring and prediction framework. The first phase of the monitoring prediction comprises the analysis of the class attributes with data processing and the removal of unrelated data. Furthermore, normalization is performed to obtain the processed data. The second phase predicts safe and unsafe incidences based on the scalable clustering algorithm. In the final phase, the hidden features are extracted using DL techniques.
Figure 2. The three phases of the monitoring and prediction framework. The first phase of the monitoring prediction comprises the analysis of the class attributes with data processing and the removal of unrelated data. Furthermore, normalization is performed to obtain the processed data. The second phase predicts safe and unsafe incidences based on the scalable clustering algorithm. In the final phase, the hidden features are extracted using DL techniques.
Healthcare 10 01896 g002
Figure 3. Architecture of the proposed DNN (inputs are fed in parallel to the convolutional neural networks where features are extracted and then integrated through the feature integration phase to produce the feature matrix).
Figure 3. Architecture of the proposed DNN (inputs are fed in parallel to the convolutional neural networks where features are extracted and then integrated through the feature integration phase to produce the feature matrix).
Healthcare 10 01896 g003
Figure 4. Example of fall images in the datasets SV-S2017.
Figure 4. Example of fall images in the datasets SV-S2017.
Healthcare 10 01896 g004
Figure 5. The distributed binary monitoring prediction system. Health risk incidences are inputted to the distributed training system and the results are computed and gathered in the first phase. The gathered clusters are fed to the Catboost classifiers in the second phase and collected and sent to the server.
Figure 5. The distributed binary monitoring prediction system. Health risk incidences are inputted to the distributed training system and the results are computed and gathered in the first phase. The gathered clusters are fed to the Catboost classifiers in the second phase and collected and sent to the server.
Healthcare 10 01896 g005
Figure 6. The model platform of the C-means and the Catboost techniques. The model depicts the training and testing set to produce the different safe and fall classes.
Figure 6. The model platform of the C-means and the Catboost techniques. The model depicts the training and testing set to produce the different safe and fall classes.
Healthcare 10 01896 g006
Figure 7. The correlation of the real ratio of health risk incidence in cases from a medical diagnosis versus the prediction of risk incidence from the proposed monitoring system.
Figure 7. The correlation of the real ratio of health risk incidence in cases from a medical diagnosis versus the prediction of risk incidence from the proposed monitoring system.
Healthcare 10 01896 g007
Figure 8. The Bland-Altman Plot that denotes the difference of the predicted values versus the average of actual diagnoses.
Figure 8. The Bland-Altman Plot that denotes the difference of the predicted values versus the average of actual diagnoses.
Healthcare 10 01896 g008
Figure 9. Correctly classified versus incorrectly-classified instances.
Figure 9. Correctly classified versus incorrectly-classified instances.
Healthcare 10 01896 g009
Table 1. Description of the datasets according to safe, fall, falls with broken bones, fall that leads to death cases in the SERV-112 dataset.
Table 1. Description of the datasets according to safe, fall, falls with broken bones, fall that leads to death cases in the SERV-112 dataset.
LabelNumber of ImagesPercentage %
Safe201021.60
Fall256527.57
Falls with broken bones217023.32
Fall that leads to death (no movement for the whole sequence) 256027.51
Total9305
Table 2. Description of the datasets according to safe, fall, falls with broken bones, falls that lead to death cases in the SV-S2017 dataset.
Table 2. Description of the datasets according to safe, fall, falls with broken bones, falls that lead to death cases in the SV-S2017 dataset.
LabelNumber of ImagesPercentage %
Safe230023.69
Fall261126.90
Falls with broken bones233724.07
Fall that lead to death246025.34
Total9708
Table 3. The distribution of both data sets for the training, validation, and testing datasets where 70% of both datasets is used for training, 15% for validation and 15% for testing.
Table 3. The distribution of both data sets for the training, validation, and testing datasets where 70% of both datasets is used for training, 15% for validation and 15% for testing.
SERV-112 DatasetSV-S2017 DatasetPercentage
Training6515679670%
Validation1395145615%
Testing1395145615%
Total93059708
Table 4. Experiments Configuration of the neural network with the structure of the CNN layers.
Table 4. Experiments Configuration of the neural network with the structure of the CNN layers.
Layer Layer TypeStructure
1Input Layer1024 × 1024 × 3
2Convolution512 × 32 × 1
3Pooling Max pooling
4Convolution256 (8 × 8 × 3)
5Second PoolingAverage
6Convolution64 (3 × 3 × 3)
7Fully Connected (FC)2020 neurons
8ClassifierSoftmax
Table 5. The confusion matrix denotes the accuracy of the model using the SV-S2017 set.
Table 5. The confusion matrix denotes the accuracy of the model using the SV-S2017 set.
Predicted Cases
PositiveNegative
Actual casesPositive101012
Negative8772
Table 6. The confusion matrix denotes the accuracy of the model using the SERV-112 set.
Table 6. The confusion matrix denotes the accuracy of the model using the SERV-112 set.
Predicted Cases
PositiveNegative
Actual casesPositive90082
Negative30920
Table 7. Comparison of performance results with different numbers of clusters from the C-Means (N) for the SV-S2017 set.
Table 7. Comparison of performance results with different numbers of clusters from the C-Means (N) for the SV-S2017 set.
DNNLSDNN + LS
NPrecisionTPTNPrecisionTPTNPrecisionTPTN
30.820.840.800.910.900.900.930.930.92
40.820.890.820.910.920.920.9250.930.91
50.840.840.840.950.920.900.9250.9350.93
60.860.860.860.920.920.920.930.9250.945
20.830.830.830.920.910.950.930.9330.936
80.890.800.890.910.920.910.930.930.937
Table 8. Comparison of performance results with different numbers of clusters from the C-Means (N) for the SV-S2017 set.
Table 8. Comparison of performance results with different numbers of clusters from the C-Means (N) for the SV-S2017 set.
DNNLSDNN + LS
NPrecisionTPTNPrecisionTPTNPrecisionTPTN
30.920.940.900.930.900.960.980.990.98
40.920.990.920.910.920.930.970.980.99
50.940.940.940.950.940.960.970.960.99
60.960.960.960.920.940.920.980.970.98
20.930.930.930.940.960.950.980.990.98
80.990.900.990.910.920.910.980.980.98
Table 9. Statistics for using DNN model and C-Means with a long short memory for multi-risk prediction.
Table 9. Statistics for using DNN model and C-Means with a long short memory for multi-risk prediction.
Fall That Leads to DeathFallFall with Broken Bones
TP 0.8410.9120.96
FP 0.1590.0880.04
Inter-Qualitative Reliability0.1870.2010.314
Absolute Square Error0.8410.5210.311
Table 10. Comparison of the prediction time in seconds.
Table 10. Comparison of the prediction time in seconds.
MethodExecution Time (s)
Binary ClassificationDNN 14.42   ±   0.115
LS 19.25   ±   0.429
DNN + LS 4.42   ±   0.329
Multi ClassificationDNN 9.32   ±   0.223
LS 8.29   ±   0.929
DNN + LS 7.42   ±   1.029
Table 11. Precision comparison averaged on both datasets.
Table 11. Precision comparison averaged on both datasets.
Method ClassificationAverage Accuracy %Average Sensitivity % Average Specificity %
The proposed DNN model and C-Means with a Long short memory for multi-risk predictionMulti classes97.6%98.1%97.9%
A Lightweight Subgraph-Based Deep Learning Approach for Fall Recognition [2]Binary classification (Fall, No-Fall)97%98%96%
Human Fall Detection Based on Pose Estimation [30]Three classes (Fall, No-Fall, Unknown)93.4%94.6%92.1%
Table 12. Training CPU time of training of all methods.
Table 12. Training CPU time of training of all methods.
Method (Average Minutes)Standard Deviation
The proposed DNN model and C-Means with a long short memory for multi-risk prediction152±9.9
A lightweight subgraph-based deep learning approach for fall recognition [2]560±9.6
Human fall detection based on pose estimation [30]509±10.9
Table 13. Classification CPU time of training of all methods.
Table 13. Classification CPU time of training of all methods.
Method (Average Seconds)Standard Deviation
The proposed DNN model and C-means with a long short memory for multi-risk prediction0.67±0.12
A lightweight subgraph-based deep learning approach for fall recognition [2]5.6±0.6
Human fall detection based on pose estimation [30]9.5±0.9
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Alharbi, A.H.; Hosni Mahmoud, H.A. Intelligent Monitoring Model for Fall Risks of Hospitalized Elderly Patients. Healthcare 2022, 10, 1896. https://doi.org/10.3390/healthcare10101896

AMA Style

Alharbi AH, Hosni Mahmoud HA. Intelligent Monitoring Model for Fall Risks of Hospitalized Elderly Patients. Healthcare. 2022; 10(10):1896. https://doi.org/10.3390/healthcare10101896

Chicago/Turabian Style

Alharbi, Amal H., and Hanan A. Hosni Mahmoud. 2022. "Intelligent Monitoring Model for Fall Risks of Hospitalized Elderly Patients" Healthcare 10, no. 10: 1896. https://doi.org/10.3390/healthcare10101896

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop