Next Article in Journal
A Hybrid Sparse Representation Model for Image Restoration
Next Article in Special Issue
Postsurgical Analysis of Gait, Radiological, and Functional Outcomes in Children with Developmental Dysplasia of the Hip
Previous Article in Journal
Simultaneous Classification of Both Mental Workload and Stress Level Suitable for an Online Passive Brain–Computer Interface
Previous Article in Special Issue
Validation of Zulu Watch against Polysomnography and Actigraphy for On-Wrist Sleep-Wake Determination and Sleep-Depth Estimation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Soft Transducer for Patient’s Vitals Telemonitoring with Deep Learning-Based Personalized Anomaly Detection

1
Interdepartmental Research Center in Health Management and Innovation in Healthcare (CIRMIS), University of Naples Federico II, 80125 Naples, Italy
2
Department of Information Technology and Electrical Engineering (DIETI), University of Naples Federico II, 80125 Naples, Italy
3
Department of Public Health, University of Naples Federico II, 80125 Naples, Italy
4
Department of Electronics and Telecommunications, Polytechnic University of Turin, 10129 Turin, Italy
5
NexusTLC SRLS, 80010 Quarto, Italy
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(2), 536; https://doi.org/10.3390/s22020536
Submission received: 18 December 2021 / Revised: 5 January 2022 / Accepted: 7 January 2022 / Published: 11 January 2022

Abstract

:
This work addresses the design, development and implementation of a 4.0-based wearable soft transducer for patient-centered vitals telemonitoring. In particular, first, the soft transducer measures hypertension-related vitals (heart rate, oxygen saturation and systolic/diastolic pressure) and sends the data to a remote database (which can be easily consulted both by the patient and the physician). In addition to this, a dedicated deep learning algorithm, based on a Long-Short-Term-Memory Autoencoder, was designed, implemented and tested for providing an alert when the patient’s vitals exceed certain thresholds, which are automatically personalized for the specific patient. Furthermore, a mobile application (EcO2u) was developed to manage the entire data flow and facilitate the data fruition; this application also implements an innovative face-detection algorithm that ensures the identity of the patient. The robustness of the proposed soft transducer was validated experimentally on five individuals, who used the system for 30 days. The experimental results demonstrated an accuracy in anomaly detection greater than 93%, with a true positive rate of more than 94%.

1. Introduction

The recent COVID-19 pandemic and the associated transition of patient care outside the hospital have boosted the development of systems for the remote monitoring of patient vitals signs [1,2,3], a task that has also been favored by the advancement of wearable technologies [4,5,6,7,8,9] and the Internet of Things (IoT). These two technologies have contributed to the widespread adoption of smart healthcare solutions (soft transducer), deployed either at hospitals or at home [10,11]. In fact, on the one hand, the integration of IoT with wearable devices enables the doctor to remotely monitor the patients’ health. On the other hand, it also allows patients to gain awareness of their health status, which is particularly important when affected by chronic diseases. This approach facilitates an engaging and responsive patient experience, thus improving the patient’s journey.
Among chronic diseases, one of the most widespread is certainly hypertension. In fact, the World Health Organization states that one in three adults in the world suffer from hypertension, and this proportion increases with age. Hypertension is frequently referred to as the silent killer because it often does not involve disturbing symptoms but still can degenerate suddenly and seriously. Even a moderate increase in blood pressure is associated with reduced life expectancy. In this regard, monitoring patient vitals represents an important aspect of patient care because these signs usually give early information about abnormal physiology. In practice, this can be accomplished by employing soft transducers, which are wearable devices able to acquire and process a large amount of data in real time [12,13]. Indeed, it is crucial for physicians to be able not only to monitor hypertensive patients regularly but also to predict the evolution of this condition.
In the last few years, the processing of data related to patient vitals has been facilitated by the adoption of artificial intelligence (AI), which is one of the most promising enabling technologies of the 4.0 paradigm [14]. In fact, AI represents a strategic tool for supporting clinical decisions and improving disease management [15], thus promoting the correct management, interpretation and use of multiple data collected from the individual patient [16]. The incorporation of AI, and in particular Machine Learning (ML) and Deep Learning (DL), has the potential to improve personalized, patient-centered care medicine, thus strengthening the effectiveness of therapies [17,18,19]. AI can be defined as a technology aimed to provide algorithms that learn from data without being programmed [20,21,22]. ML and DL are a sub-category of AI and refer to data processing oriented to (i) identify and design their relevant characteristics and (ii) perform predictions on the output generated [23]. In Healthcare, the adoption of ML and DL can be considered the best practice in designing decision support systems aimed at predicting patients’ health [24].
Starting from these considerations, this work presents the development of a DL-based soft transducer for the telemonitoring of patient vitals. In addition to the wearable sensors platform for remote monitoring of the vital signs, a DL algorithm based on the Long-Short-Term-Memory (LSTM) Autoencoder was implemented. This choice is driven by the potential of the DL to be able to automatically identify complex features even without having any prior knowledge of the domain. As detailed in the following, the implemented network allows anticipating possible onset or worsening of the disease. The most notable aspect is that, different from the state of the art (see Section 2), the proposed algorithm is trained to identify patient-specific alert thresholds. In fact, the definition of personalized threshold values reduces the occurrence of false positives during normal operating conditions. Finally, to manage data flow and to facilitate data fruition, a dedicated mobile application was developed that also provides an alert to patients and physicians in the case of aggravating conditions. The application also includes a face-recognition feature that allows verifying the patient’s identity. It is important to point out that, while the proposed system was developed and validated in a case study related to healthcare, the obtained results have broader generality and may be declined for other application contexts.
The paper is organized as follows. In Section 2, several approaches similar with the one proposed in this work are discussed, showing strong and weak points. Then, in Section 3, a conceptual description of the proposed soft transducer is provided, and the design of the proposed soft transducer is presented. Section 4 addresses its implementation of the soft transducer, while in Section 5, the experimental results are reported and discussed. Finally, in Section 6, conclusions are drawn and future work is outlined.

2. Related Work

As mentioned in the Introduction, AI has been widely used as a solution for predicting patients’ health [24]. For example, in [25], 21 different ML algorithms were applied and compared in the field of hypertension. In [26], a prediction system characterized by the use of an artificial neural network was described to evaluate the risk of hypertension in rural residents over the age of 35 years in a Chinese area. In [27], the authors proposed a hybrid machine learning algorithm of k-Nearest Neighbor (k-NN) and Least-Square Support Vector Machine (LS-SVM) for predicting future values of monitored vital signs using wearable technologies.In [28], it was found that (i) predictive observation and real-time analysis of values of biomedical signals and (ii) automatic detection of epileptic seizures before onset are beneficial for the development of warning systems for patients as they, once informed that an epilepsy seizure is about to start, can take safety measures in useful time. In [29], a system based on an LSTM network was used in order to monitor vital parameters and ensure an intelligent rehabilitation process. In [30], a novel DL-based anomaly detection approach, called DeepAnT, was presented for time series data. It consists of both a time series prediction module and an anomaly detection module. The time series prediction module uses a deep convolution neural network (CNN) to predict the next timestamp on the defined horizon. The expected value is then passed to the anomaly detector module, which is responsible for marking the corresponding timestamp as normal or abnormal. In [31], DL was applied to provide early prediction of type-2 diabetes and hypertension. To perform this analysis, the Isolation Forest algorithm was used to detect abnormal data from the data set, while SMOTETomek was used to balance the unbalanced data set. Finally, in [32], a forecasting system capable of predicting systolic blood pressure in real time by means of a Bidirectional Short-Term Memory (BI-LSTM) algorithm was described.
All these aforementioned works have been demonstrated as a suitable solution to improve real-time patients’ health monitoring. However, a training phase of the algorithms was always required on generalized sets of data. Hence, the resulting alert values are not personalized for the specific patient. As a result, the development of a processing strategy to identify patient-specific features can represent an interesting solution to enhance the patient’s vitals monitoring and the accuracy of the alert provided in case of worsening of health status.

3. Design and Overall Architecture

This section addresses the conceptual description of the proposed soft transducer. In particular, the overall architecture and the development of the mobile application are described. Essentially, the proposed soft transducer works as follows.
  • The patient uses wearable sensors to measure the vitals.
  • The measured data are sent to a cloud database and are made available through a mobile application for the patient and the remote physician.
  • The data on the cloud are processed by means of a DL algorithm, which is trained on the basis of preliminary measurements of the patient vitals.
  • If the patient’s vitals exceed a certain threshold, an alert is sent to the physician and to the patient.
The overall architecture of the proposed soft transducer is shown in Figure 1. One or more Wearable Sensors are used to measure a set of the patient’s vitals. Then, the measurement results are sent to a Cloud Database. The obtained data are saved in the database and processed by an AI Processing algorithm. The system returns a Score, which is sent to the user Mobile App along with all the information regarding the data acquired; if the vitals exceed a pre-established threshold, evaluated after training with preliminary measurements of the patient, an alert is sent both to the physician and the patient.
The mobile application was developed considering the essential requirements of the healthcare context, including the description of the services offered by the system, the sensor connection, the vital parameter reading, the parameter processing and the activation of emergency alarms. Overall, the application was designed with a six-level structure dedicated to:
  • Patient registration;
  • Vitals measurements;
  • Management of the patient’s Medical History;
  • Remote Vitals visualization;
  • AI processing;
  • Delivery of the Score results to the patient and the physician.
The design of the user interface was carried out taking into account the principles of good system design, as reported in [33]: guaranteeing a minimalist design to prevent cognitive overload, using large and readable icons to facilitate user interaction and, finally, using a clear, concise and intuitive language to help users identify their clinical status.

4. Implementation

4.1. Wearable Sensing Platform

Figure 2 shows the schematization of the wearable sensing platform as implemented in this work.
Heart rate (HR), oxygen saturation (SpO2) and systolic and diastolic pressure (SP, DP) were considered as vitals-to-be-monitored. To this aim, for the monitoring task, the MAX30100, a low-cost SpO2 and HR monitor sensor, was used [34].
In order to retrieve the diastolic and sistolic pressure values, the patient is also required to measure their blood pressure through a sphygmomanometer. As detailed in the following section, it is used only once for calibrating the sensor for the successive automated evaluation of the blood pressure starting from HR values.
The wearable sensing platform also includes a low-cost microcontroller with integrated Wi-Fi and dual-mode Bluetooth, namely the ESP32 [35], allowing the wireless transmission of the measured patient data.
The patient’s vitals are transmitted via Wi-Fi to the database through the MQTT protocol. This database was created and managed in Node-RED and works on the AWS (Amazon Web Services) cloud platform.
The vital monitoring and real-time anomaly detection is carried out by means of the developed AI-based algorithm. First, a Multivariate Linear Regression (MLR) algorithm is used to estimate the value of SP and DP, starting from the HR and SpO2 values coming from the MAX30100 and taking into account the age and the presence of diabetes for each patient. The MLR was chosen since it is one of the most consolidated approaches adopted at the state of the art [36,37,38]. However, other algorithms based on Support Vector Machine, Support Vector Regression [39] and Regression Tree [40] can also be suitably used to estimate systolic and diastolic pressure values. Then, an LSTM Autoencoder is implemented to process the entire set of obtained data (HR, SpO2, SP, DP).
Once the measured data are classified, the result is sent in real-time to the mobile application (available to the user and to the physician). In the case of hypertension risk, an alert is also sent to the physician to allow their prompt intervention. As shown in Figure 3, the interactions between the mobile application and Node-RED are managed as HTTP calls.

4.2. Mobile Application

The mobile application (which was called Eco2u) was developed in Java, and it is compatible with Android (from version 4.4 onward). As previously mentioned, the application is structured in six levels, as shown in Figure 3.
  • Patient registration: Figure 4 shows the window for registration and/or log in. During registration, the patient inserts their tax code (which is automatically verified), and the patient is associated to the reference physician. The user also enters additional personal information (such as name, surnames, date of birth). The association to the wearable measurement devices is carried out by scanning a QR code generated specifically for a single device. These sensitive data are treated in full compliance with anonymity requirements. In fact, only when an anomaly is detected, the doctor is warned and is able to trace the patient’s identity. Figure 4b shows the window that summarizes the user’s data before they are sent to the cloud database, which checks the data and sends a feedback on the correct registration. Once the registration phase is completed, the patient is brought back to the log-in window to make the first log in. Furthermore, at this stage, there is a check with the database to verify that the password and tax code entered are correct.
  • Vitals measurement: To allow the successive automated estimation of the systolic and diastolic pressure, a preliminary calibration procedure has to be carried out. In particular, the patient uses a sphygmomanometer to measure the systolic and diastolic pressure values, while the wearable sensing platform sensor is measuring HR and SpO2. Then, the patient manually enters these data in the application (Figure 4c). This phase, which has to be carried out only once, is necessary to identify the parameters that will subsequently allow the soft transducer to estimate the pressure. After the calibration, the patient can start using the soft transducer.
    The mobile application was also endowed with an important identification feature that allows associating (and later verify) the patient’s identity acquired through the smartphone camera, as shown in Figure 5a. Finally, the monitored vitals are displayed to the patient, as shown in Figure 5b.
  • Management of the patient’s Medical History: The management of the patient’s medical history is conducted by: (a) showing the daily progress by a graph of the measurements made, (b) reporting the symptoms during the day and (c) indicating any symptoms not present to study a certain correspondence. The cloud database is updated in real-time after each measurement session.
  • Remote Vitals Visualization: The physician can access the EcO2u mobile application with the master credentials to view their patient list; after selecting the specific patient, the physician can display the most recent medical parameters, the graph of past trends and the list of notes, which can be also entered by the patient, in order to see if there is an onset of new symptoms that require a change in therapy (see Figure 5b).
  • AI processing: The AI-based processing of the acquired vitals provides a diagnostic tool to detect anomalies in real-time. In particular, as detailed in the following section, a multivariate linear regression is used to estimate the value of SP and DP, starting from the HR and SpO2 values coming from the MAX30100 and taking into account the age and the presence of diabetes for each patient, while a DL algorithm, based on an LSTM Autoencoder, is used to process the entire set of obtained data (HR, SpO2, SP, DP).
  • Delivery of the Score result: The Score result is a synthetic quantity that indicates if an anomaly is detected based on the patient’s history and current data. In that case, the physician and the patient are immediately warned about the patient’s condition.

4.3. Deep Learning Algorithm for Anomaly Detection

The approach used in this work is semi-supervised learning; in fact, most of the originally available data imported from [41] were not labeled but described the patients normal health conditions. However, with such data, it was possible to train a robust model and evaluate its performance in the validation and test phase using a small amount of labeled data, including normal and abnormal data.
The operating steps of the procedure were the following.
  • Data Set Creation: First, the reference data set for the anomaly detection was imported from [41]. The 50 subjects included are 80% men (40) and 20% women (10), with an age range ranging from 26 to 35 years old. Oxygen saturation, heart rate and identification are indicated for each user.
  • Model Identification and Training: The second phase consisted of the construction of a normal behavior model using 80% of the imported data set as training data. The identification of this model is necessary to allow the subsequent classification of anomalies when they occur. The model chosen was the LSTM Autoencoder. This structure is characterized by an Encoder, which learns to generate an internal, compressed representation of input data, and a Decoder, which tries to reconstruct the original input on the basis of this internal representation. The Autoencoder was developed with an LSTM neural network. This choice was dictated by the fact that LSTM is the most suitable approach to process data when effects from past events need to be taken into account, differently from CNN, which does not depend on any previous information for prediction since it only uses the current window [42]. The LSTM requires pre-processing the data based on a three-dimensional array that contains the number of observations, the time window and the relevant information. To determine the LSTM architecture, it was considered that the number of layers and the corresponding number of neurons should be high enough to avoid underfitting but, at the same time, should be as low as possible to avoid both overfitting and high computational complexity. Therefore, an input level with 16 nodes, 2 hidden layers with 4 nodes each, and an output level with 16 nodes was chosen. The number of epochs was set to 100 and the batch size to 10. The model was trained by minimizing the reconstruction error, defined as the average absolute difference between the original input and the rebuilt output produced by the decoder.
  • Alarm Value Identification: The third phase consisted of the identification of threshold values in order to mark the data as standard or anomalous. These thresholds were determined by the reconstruction errors that the Autoencoder performs in the training phase. An anomaly occurs if the obtained reconstruction error exceeds that threshold; in that case, the corresponding data are marked as anomalous.
  • Test Validation: The fourth phase allowed the validation of the threshold identified in the previous step. At this stage, the Autoencoder was provided with labeled data containing two anomalies to be identified. These test data are made up of the remaining 20% of the imported data set. The identification of an anomaly can be seen as a binary classification problem that provides a prediction score as output. The score indicates the certainty of the system that a given observation belongs to the standard class or that there is an anomaly.
    To this aim, the assessment of the obtained model was carried out using three figures of merit: the Area Under Curve-Receiving Operating Characteristic (AUC-ROC) curve; the F1 score; and the Binary Accuracy.
    • The ROC curve is plotted following two metrics: True Positive Rate (also known as Sensivity) and False Positive Rate. The True Positive Rate is defined as the number of true positive results divided by the number of all samples that should have been identified as positive. On the other hand, the False Positive Rate is defined as the ratio between the number of negative results wrongly categorized as positive (false positives) and the total number of actual negative results. The ROC curve shows the relationship between the True Positive Rate and the False Positive Rate. The closer Area Under Curve (AUC) is to 1, the more accurate is the model.
    • The F 1 score is calculated based on two metrics: Precision and Recall (also known as Sensivity or True Positive Rate and already defined in the previous item). The Precision is defined as the number of true positive results divided by the number of all positive results, including those not identified correctly. The F 1 score is obtained as the harmonic mean of the Precision and Recall, and it is a indication of the test’s accuracy.
    • The Binary Accuracy represents how well a classification test correctly identifies or excludes a condition. Then, it is defined as the proportion of correct predictions among the total number of cases examined.
  • Readjustment: Once the model is validated, it is readjusted after 30 days with further measurements provided by the user. The readjustment aims to identify customized threshold values for the personalized patient care.

5. Experimental Results and Discussion

In this Section, the obtained experimental results are presented and discussed. More specifically, a metrological characterization of the soft transducer in terms of validation of (i) the telemonitoring system and (ii) the DL algorithm performance was conducted.

5.1. Experimental Validation of the Telemonitoring System

The telemonitoring application EcO2U was tested on five volunteers. Firstly, functional testing was carried out to ensure each block worked properly. In particular, during this phase, it was possible to verify (1) the correctness of the Wearable Sensing Platform/Subject association within the database and (2) the calls inserted into the database application to correctly use the information.
Then, the correct estimation of systolic and diastolic pressure, obtained by means of the multivariate linear regression algorithm, was verified after inserting the parameters required during the calibration phase. Throughout the measurement, the mobile phone focused on the user and on the sensor in order to validate the procedure. Automatically, the data are sent to the database and made visible to the user. If the measurement result, after appropriate processing, indicates a risk for the patient, then the application itself will manage this alarm by informing the doctor and the patient himself.
For each subject, 30 HR and SP/DP values were recorded. Two different sessions were conducted. Table 1 summarizes the obtained results in terms of mean value and related 1- σ repeatability. The results confirmed the proper functioning of the telemonitoring section of the soft transducer.

5.2. Experimental Validation of the Developed DL Algorithm

As mentioned in Section 4.3, the training of the LSTM Autoencoder was carried out for 100 epochs and allowed the identification of the appropriate threshold value. Figure 6 shows the behavior of the Autoencoder on the complete dataset, including the data used for training and testing. These data were indexed day by day. As shown, during the observation period, the score of the reconstruction error occasionally exceeded the threshold value, indicating an anomaly in the measured data.
Table 2 summarizes the results of the binary classification (anomalous/standard data) on the test set in terms of True Positive Rate, False Positive Rate and Precision.
Starting from these metrics, the three figures of merit (AUC, F1 score and Binary Accuracy) were evaluated. In particular, the AUC was equal to 0.81, the F 1 score was equal to 0.96 and the binary accuracy was equal to 0.93. Figure 7 shows the resulting AUC. The obtained results confirmed the capability of the system to successfully identify the anomalies that can occur during the monitoring phase.

Patient-Specific Customization and Validation of The Soft Transducer

The patient-specific customization of the proposed soft transducer (Readjustment) was carried out on the five volunteers. The operative steps, conducted separately for each volunteer, were the following:
  • The user employed the soft transducer for 30 days. The acquisition of their vitals (twice a day) also included abnormal values, which were emulated by placing him/her under stress conditions (e.g., a short run).
  • The obtained data set (60 samples) was split into 80% training (48 samples) and 20% test (12 samples). Therefore, the LSTM Autoencoder was re-trained in order to identify the patient specific threshold value
During the test phase, it was observed that the algorithm successfully identified all the labeled anomalies.
After this 30-day phase, further tests were conducted in order to determine the optimal number of days to wait to update the model to maintain adequate performance. The results showed that 15 days is the optimal calibration interval necessary to personalize and update the model. In fact, this choice allowed obtaining a value of AUC equal to 0.831 in the test phase, while after 30 days, this value slightly increased to 0.836.

6. Conclusions

In this work, a soft-transducer for remote monitoring of a patient’s health was designed, implemented and experimentally validated. The soft transducer measures the patient’s heart rate, oxygen saturation and systolic/diastolic pressure in real-time and sends the data to a remote database, which can be easily consulted both by the patient and the physician. To endow the soft transducers with predictive features, a DL algorithm (based on LSTM Autoencoder) was developed and implemented: the algorithm provides an alert when the vitals exceed certain thresholds, which are personalized for the specific patient. Furthermore, a dedicated application (named EcO2u) was developed (i) to manage the remote collection of the patient vitals and the communication with the physician and (ii) to automatically detect anomalies by means of a patient-personalized, DL-based processing. After validating a public data set, the obtained experimental results on five volunteers showed an accuracy in anomaly detection greater than 93% with a True Positive Rate higher than 94%, thus confirming the robustness of the proposed strategy.
In practical applications, the proposed soft transducer can facilitate the monitoring of patients outside clinical facilities by providing advantages to the hospital in terms of resource management. Moreover, the proposed system manages to improve the quality of the patient’s life by allowing them to stay in their own family environment in contact with family and friends. This benefit is particularly important for children or elderly patients, for whom hospitalization may have severe emotional impact. Finally, it is worth mentioning that, although in this work a healthcare-related case study was considered, the obtained results have broader generality and may be declined for other application scenarios.
Future work will focus on integrating the developed soft transducer into an augmented reality-based interface, which has been proven effective in the medical field [43,44,45,46], in order to further improve patient’s engagement and their journey.

Author Contributions

Conceptualization, P.A.; methodology, E.D.B., G.I. and F.S.; software, F.C. and F.S.; validation, F.C.; formal analysis, F.C., E.D.B., L.D. and G.I.; investigation, F.C.; resources, P.A.; data curation, F.C.; writing—original draft preparation, F.C.; writing—review and editing, E.D.B. and L.D.; visualization, F.C. and L.D.; supervision, E.D.B.; project administration, P.A. All authors have read and agreed to the published version of the manuscript.

Funding

This work was carried out as part of the “ICT for Health” project, which was financially supported by the Italian Ministry of Education, University and Research (MIUR), under the initiative “Departments of Excellence” (Italian Law no. 232/2016) through an excellence grant awarded to the Department of Information Technology and Electrical Engineering of the University of Naples Federico II, Naples, Italy.

Institutional Review Board Statement

Not applicabile.

Informed Consent Statement

Patient consent was waived due to the fact that no information is disclosed in the paper that could lead to the identification of the subjects.

Data Availability Statement

Not applicabile.

Acknowledgments

The authors wish to thank Emilio Salomone, Gennaro Miccoli and Vincenzo Canfora Nexus TLC SRL for their technical support.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Veenis, J.F.; Radhoe, S.P.; Hooijmans, P.; Brugts, J.J. Remote Monitoring in Chronic Heart Failure Patients: Is Non-Invasive Remote Monitoring the Way to Go? Sensors 2021, 21, 887. [Google Scholar] [CrossRef]
  2. Silva, A.F.; Tavakoli, M. Domiciliary Hospitalization through Wearable Biomonitoring Patches: Recent Advances, Technical Challenges, and the Relation to Covid-19. Sensors 2020, 20, 6835. [Google Scholar] [CrossRef] [PubMed]
  3. Khan, F.; Ghaffar, A.; Khan, N.; Cho, S.H. An Overview of Signal Processing Techniques for Remote Health Monitoring Using Impulse Radio UWB Transceiver. Sensors 2020, 20, 2479. [Google Scholar] [CrossRef] [PubMed]
  4. Schiavoni, R.; Monti, G.; Piuzzi, E.; Tarricone, L.; Tedesco, A.; De Benedetto, E.; Cataldo, A. Feasibility of a wearable reflectometric system for sensing skin hydration. Sensors 2020, 20, 2833. [Google Scholar] [CrossRef] [PubMed]
  5. Arquilla, K.; Webb, A.K.; Anderson, A.P. Textile electrocardiogram (ECG) electrodes for wearable health monitoring. Sensors 2020, 20, 1013. [Google Scholar] [CrossRef] [Green Version]
  6. Zhang, H.; Li, C.; Liu, W.; Wang, J.; Zhou, J.; Wang, S. A Multi-Sensor Wearable System for the Quantitative Assessment of Parkinson’s Disease. Sensors 2020, 20, 6146. [Google Scholar] [CrossRef]
  7. Kumar, S.; Buckley, J.L.; Barton, J.; Pigeon, M.; Newberry, R.; Rodencal, M.; Hajzeraj, A.; Hannon, T.; Rogers, K.; Casey, D.; et al. A wristwatch-based wireless sensor platform for IoT health monitoring applications. Sensors 2020, 20, 1675. [Google Scholar] [CrossRef] [Green Version]
  8. Corchia, L.; Monti, G.; De Benedetto, E.; Cataldo, A.; Angrisani, L.; Arpaia, P.; Tarricone, L. Fully-textile, wearable chipless tags for identification and tracking applications. Sensors 2020, 20, 429. [Google Scholar] [CrossRef] [Green Version]
  9. Schiavoni, R.; Monti, G.; Tedesco, A.; Tarricone, L.; Piuzzi, E.; De Benedetto, E.; Masciullo, A.; Cataldo, A. Microwave Wearable System for Sensing Skin Hydration. In Proceedings of the Conference Record—IEEE Instrumentation and Measurement Technology Conference, Glasgow, UK, 17–20 May 2021; Volume 2021. [Google Scholar] [CrossRef]
  10. Harb, H.; Mansour, A.; Nasser, A.; Cruz, E.M.; de la Torre Díez, I. A Sensor-Based Data Analytics for Patient Monitoring in Connected Healthcare Applications. IEEE Sens. J. 2021, 21, 974–984. [Google Scholar] [CrossRef]
  11. Yeh, K. A Secure IoT-Based Healthcare System With Body Sensor Networks. IEEE Access 2016, 4, 10288–10299. [Google Scholar] [CrossRef]
  12. Donati, M.; Celli, A.; Ruiu, A.; Saponara, S.; Fanucci, L. A telemedicine service platform exploiting BT/BLE wearable sensors for remote monitoring of chronic patients. In Proceedings of the 2018 7th International Conference on Modern Circuits and Systems Technologies (MOCAST), Thessaloniki, Greece, 7–9 May 2018; pp. 1–4. [Google Scholar]
  13. Rohmetra, H.; Raghunath, N.; Narang, P.; Chamola, V.; Guizani, M.; Lakkaniga, N.R. AI-enabled remote monitoring of vital signs for COVID-19: Methods, prospects and challenges. Computing 2021, 1–27. [Google Scholar] [CrossRef]
  14. Kumar, A.; Krishnamurthi, R.; Nayyar, A.; Sharma, K.; Grover, V.; Hossain, E. A Novel Smart Healthcare Design, Simulation, and Implementation Using Healthcare 4.0 Processes. IEEE Access 2020, 8, 118433–118471. [Google Scholar] [CrossRef]
  15. Rodrigues, J.J.P.C.; De Rezende Segundo, D.B.; Junqueira, H.A.; Sabino, M.H.; Prince, R.M.; Al-Muhtadi, J.; De Albuquerque, V.H.C. Enabling Technologies for the Internet of Health Things. IEEE Access 2018, 6, 13129–13141. [Google Scholar] [CrossRef]
  16. Omboni, S.; Panzeri, E.; Campolo, L. E-health in hypertension management: An insight into the current and future role of blood pressure telemonitoring. Curr. Hypertens. Rep. 2020, 22, 1–13. [Google Scholar] [CrossRef]
  17. Koshimizu, H.; Kojima, R.; Kario, K.; Okuno, Y. Prediction of blood pressure variability using deep neural networks. Int. J. Med. Inform. 2020, 136, 104067. [Google Scholar] [CrossRef]
  18. Lee, S.; Chang, J.H. Deep learning ensemble with asymptotic techniques for oscillometric blood pressure estimation. Comput. Methods Prog. Biomed. 2017, 151, 1–13. [Google Scholar] [CrossRef]
  19. Koren, G.; Nordon, G.; Radinsky, K.; Shalev, V. Machine learning of big data in gaining insight into successful treatment of hypertension. Pharmacol. Res. Perspect. 2018, 6, e00396. [Google Scholar] [CrossRef] [Green Version]
  20. Tzafestas, S.G. Synergy of IoT and AI in modern society: The robotics and automation case. Robot. Autom. Eng. J. 2018, 31, 1–15. [Google Scholar] [CrossRef]
  21. Knickerbocker, J.U.; Budd, R.; Dang, B.; Chen, Q.; Colgan, E.; Hung, L.; Kumar, S.; Lee, K.; Lu, M.; Nah, J.; et al. Heterogeneous integration technology demonstrations for future healthcare, IoT, and AI computing solutions. In Proceedings of the 2018 IEEE 68th Electronic Components and Technology Conference (ECTC), San Diego, CA, USA, 29 May–1 June 2018; pp. 1519–1528. [Google Scholar]
  22. Johnson, K.W.; Torres Soto, J.; Glicksberg, B.S.; Shameer, K.; Miotto, R.; Ali, M.; Ashley, E.; Dudley, J.T. Artificial intelligence in cardiology. J. Am. Coll. Cardiol. 2018, 71, 2668–2679. [Google Scholar] [CrossRef]
  23. Rajkomar, A.; Dean, J.; Kohane, I. Machine learning in medicine. N. Engl. J. Med. 2019, 380, 1347–1358. [Google Scholar] [CrossRef]
  24. Hijazi, S.; Page, A.; Kantarci, B.; Soyata, T. Machine learning in cardiac health monitoring and decision support. Computer 2016, 49, 38–48. [Google Scholar] [CrossRef]
  25. Arefa, I.; Alam, M.; Siddiquee, I.; Siddique, N. Performance Analysis of Machine Learning Algorithms for Hypertension Decision Support System. In Proceedings of the 2019 IEEE International Conference on Robotics, Automation, Artificial-intelligence and Internet-of-Things (RAAICON), Automation, Dhaka, Bangladesh, 29 November–1 December 2019; pp. 15–20. [Google Scholar]
  26. Huang, S.; Xu, Y.; Yue, L.; Wei, S.; Liu, L.; Gan, X.; Zhou, S.; Nie, S. Evaluating the risk of hypertension using an artificial neural network method in rural residents over the age of 35 years in a Chinese area. Hypertens. Res. 2010, 33, 722–726. [Google Scholar] [CrossRef]
  27. Youssef Ali Amer, A.; Wouters, F.; Vranken, J.; de Korte-de Boer, D.; Smit-Fun, V.; Duflot, P.; Beaupain, M.H.; Vandervoort, P.; Luca, S.; Aerts, J.M.; et al. Vital Signs Prediction and Early Warning Score Calculation Based on Continuous Monitoring of Hospitalised Patients Using Wearable Technology. Sensors 2020, 20, 6593. [Google Scholar] [CrossRef]
  28. Aileni, R.M.; Pasca, S.; Florescu, A. EEG-Brain Activity Monitoring and Predictive Analysis of Signals Using Artificial Neural Networks. Sensors 2020, 20, 3346. [Google Scholar] [CrossRef]
  29. Uddin, M.Z.; Hassan, M.M.; Alsanad, A.; Savaglio, C. A body sensor data fusion and deep recurrent neural network-based behavior recognition approach for robust healthcare. Inf. Fusion 2020, 55, 105–115. [Google Scholar] [CrossRef]
  30. Munir, M.; Siddiqui, S.A.; Dengel, A.; Ahmed, S. DeepAnT: A deep learning approach for unsupervised anomaly detection in time series. IEEE Access 2018, 7, 1991–2005. [Google Scholar] [CrossRef]
  31. Fitriyani, N.L.; Syafrudin, M.; Alfian, G.; Rhee, J. Development of disease prediction model based on ensemble learning approach for diabetes and hypertension. IEEE Access 2019, 7, 144777–144789. [Google Scholar] [CrossRef]
  32. Saleh, H.; Younis, E.M.; Sahal, R.; Ali, A.A. Predicting Systolic Blood Pressure in Real-Time Using Streaming Data and Deep Learning. Mob. Netw. Appl. 2020, 26, 326–335. [Google Scholar] [CrossRef]
  33. Hazari, S. Usability Factors to Consider When Developing Apps for Senior Citizen Population. Available online: http://appsusability.com/2012/06/20/elder/ (accessed on 12 November 2021).
  34. MAX30100 Technical Specification. Available online: https://www.maximintegrated.com/en/products/sensors/MAX30100.html?utm_source=google&utm_campaign=corp-sensors&s_kwcid=AL!8732!3!517495051369!b!!g!!&gclid=CjwKCAjwzt6LBhBeEiwAbPGOgU6XlnaLwAiRQZfmrDWlxDbKuBd9_edSl_jfpszGaTb4nB7qWRj94RoCXpIQAvD_BwE (accessed on 12 November 2021).
  35. ESP32 Technical Specification. Available online: https://www.espressif.com/en/products/socs/esp32 (accessed on 12 November 2021).
  36. Lazazzera, R.; Belhaj, Y.; Carrault, G. A new wearable device for blood pressure estimation using photoplethysmogram. Sensors 2019, 19, 2557. [Google Scholar] [CrossRef] [Green Version]
  37. Hsieh, Y.Y.; Wu, C.D.; Lu, S.S.; Tsao, Y. A linear regression model with dynamic pulse transit time features for noninvasive blood pressure prediction. In Proceedings of the 2016 IEEE Biomedical Circuits and Systems Conference (BioCAS), Shanghai, China, 17–19 October 2016; pp. 604–607. [Google Scholar] [CrossRef]
  38. Haddad, S.; Boukhayma, A.; Caizzone, A. Continuous PPG-Based Blood Pressure Monitoring Using Multi-Linear Regression. IEEE J. Biomed. Health Inform. 2021. aheadofprint. [Google Scholar] [CrossRef]
  39. Khalid, S.G.; Zhang, J.; Chen, F.; Zheng, D. Blood pressure estimation using photoplethysmography only: Comparison between different machine learning approaches. J. Healthc. Eng. 2018, 2018, 1548647. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Zhang, B.; Ren, H.; Huang, G.; Cheng, Y.; Hu, C. Predicting blood pressure from physiological index data using the SVR algorithm. BMC Bioinform. 2019, 20, 1–15. [Google Scholar] [CrossRef] [PubMed]
  41. Kaggle. Available online: https://www.kaggle.com/datasets (accessed on 13 June 2021).
  42. Selvin, S.; Vinayakumar, R.; Gopalakrishnan, E.A.; Menon, V.K.; Soman, K.P. Stock price prediction using LSTM, RNN and CNN-sliding window model. In Proceedings of the 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Udupi, India, 13–16 September 2017; pp. 1643–1647. [Google Scholar] [CrossRef]
  43. Arpaia, P.; De Benedetto, E.; Duraccio, L. Design, implementation, and metrological characterization of a wearable, integrated AR-BCI hands-free system for health 4.0 monitoring. Measurement 2021, 177, 109280. [Google Scholar] [CrossRef]
  44. Cattari, N.; Condino, S.; Cutolo, F.; Ferrari, M.; Ferrari, V. In situ visualization for 3d ultrasound-guided interventions with augmented reality headset. Bioengineering 2021, 8, 131. [Google Scholar] [CrossRef]
  45. Condino, S.; Montemurro, N.; Cattari, N.; D’Amato, R.; Thomale, U.; Ferrari, V.; Cutolo, F. Evaluation of a Wearable AR Platform for Guiding Complex Craniotomies in Neurosurgery. Ann. Biomed. Eng. 2021, 49, 2590–2605. [Google Scholar] [CrossRef]
  46. Viglialoro, R.; Condino, S.; Turini, G.; Carbone, M.; Ferrari, V.; Gesi, M. Augmented reality, mixed reality, and hybrid approach in healthcare simulation: A systematic review. Appl. Sci. 2021, 11, 2338. [Google Scholar] [CrossRef]
Figure 1. General architecture of the proposed soft transducer.
Figure 1. General architecture of the proposed soft transducer.
Sensors 22 00536 g001
Figure 2. Implementation of the proposed telemonitoring system.
Figure 2. Implementation of the proposed telemonitoring system.
Sensors 22 00536 g002
Figure 3. Application level of the proposed telemonitoring system.
Figure 3. Application level of the proposed telemonitoring system.
Sensors 22 00536 g003
Figure 4. Window of the EcO2u mobile application: Main menu of the application (a); Patient registration (sensitive data are hidden) (b); Data calibration (c).
Figure 4. Window of the EcO2u mobile application: Main menu of the application (a); Patient registration (sensitive data are hidden) (b); Data calibration (c).
Sensors 22 00536 g004
Figure 5. Vitals monitoring with face recognization (a); Visualization of vitals after completing the measurement (b).
Figure 5. Vitals monitoring with face recognization (a); Visualization of vitals after completing the measurement (b).
Sensors 22 00536 g005
Figure 6. Reconstruction error (blue line) as a function of the training and test data. The identified threshold for the anomaly detection is shown in red.
Figure 6. Reconstruction error (blue line) as a function of the training and test data. The identified threshold for the anomaly detection is shown in red.
Sensors 22 00536 g006
Figure 7. Area under the curve.
Figure 7. Area under the curve.
Sensors 22 00536 g007
Table 1. Average values of vitals acquired in two sessions with related 1- σ repeatability.
Table 1. Average values of vitals acquired in two sessions with related 1- σ repeatability.
SubjectHR (Bpm)
1st Session
HR (Bpm)
2nd Session
SP/DP (mmHg)
1st Session
SP/DP (mmHg)
2nd Session
#185 ± 382 ± 2112/80 ± 2112/79 ± 2
#271 ± 268 ± 2130/82 ±1128/82 ± 2
#388 ± 485 ± 4125/85 ± 2124/84 ± 1
#475 ± 173 ± 2126/84 ± 2125/84 ± 1
#570 ± 267 ± 1136/82 ± 1134/82 ± 2
Table 2. Results of data classification.
Table 2. Results of data classification.
MetricResult
True Positive68
False Positive1
False Negative4
True Negative2
True Positive Rate0.94
False Positive Rate0.33
Precision0.99
Area Under Curve0.81
F1 Score0.96
Binary Accuracy0.93
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Arpaia, P.; Crauso, F.; De Benedetto, E.; Duraccio, L.; Improta, G.; Serino, F. Soft Transducer for Patient’s Vitals Telemonitoring with Deep Learning-Based Personalized Anomaly Detection. Sensors 2022, 22, 536. https://doi.org/10.3390/s22020536

AMA Style

Arpaia P, Crauso F, De Benedetto E, Duraccio L, Improta G, Serino F. Soft Transducer for Patient’s Vitals Telemonitoring with Deep Learning-Based Personalized Anomaly Detection. Sensors. 2022; 22(2):536. https://doi.org/10.3390/s22020536

Chicago/Turabian Style

Arpaia, Pasquale, Federica Crauso, Egidio De Benedetto, Luigi Duraccio, Giovanni Improta, and Francesco Serino. 2022. "Soft Transducer for Patient’s Vitals Telemonitoring with Deep Learning-Based Personalized Anomaly Detection" Sensors 22, no. 2: 536. https://doi.org/10.3390/s22020536

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop