Search Results (124)

Reliable analysis of remote photoplethysmography (rPPG) signals depends on identifying physiologically plausible pulses. Traditional approaches rely on clustering self-similar pulses, which can discard valid variability. Automating pulse quality assessment could capture the true underlying morphology while preserving physiological variability. In this manuscript, individual rPPG pulses were manually labelled as plausible, borderline and implausible and used to train multilayer perceptron classifiers. Two independent datasets were used to ensure strict separation between training and test data: the Vision-MD dataset (4036 facial videos from 1270 participants) and a clinical laboratory dataset (235 videos from 58 participants). Vision-MD data were used for model development with an 80/20 training–validation split and 5-fold cross-validation, while the clinical dataset served exclusively as an independent test set. A three-class model was evaluated achieving $F_1$-scores of 0.92, 0.24 and 0.79 respectively. Recall was highest for plausible and implausible pulses but lower for borderline pulses. To test separability, three pairwise binary classifiers were trained, with ROC-AUC > 0.89 for all three category pairs. When combining borderline and implausible pulses into a single class, the binary classifier achieved an $F_1$-score of 0.93 for the plausible category. Finally, usability analysis showed that automated labelling identified more usable pulses per signal than the previously used agglomerative clustering method, while preserving physiological variability. Full article

Cardiovascular diseases (CVDs) remain the leading cause of global mortality, with ischemic heart disease (IHD) being the most prevalent and deadly subtype. The growing burden of IHD underscores the urgent need for effective early detection methods that are scalable and non-invasive. Heart Rate Variability (HRV), a non-invasive physiological marker influenced by the autonomic nervous system (ANS), has shown clinical relevance in predicting adverse cardiac events. This study presents a photoplethysmography (PPG)-based Zhurek IoT device, a custom-developed Internet of Things (IoT) device for non-invasive HRV monitoring. The platform’s effectiveness was evaluated using HRV metrics from electrocardiography (ECG) and PPG signals, with machine learning (ML) models applied to the task of early IHD risk detection. ML classifiers were trained on HRV features, and the Random Forest (RF) model achieved the highest classification accuracy of 90.82%, precision of 92.11%, and recall of 91.00% when tested on real data. The model demonstrated excellent discriminative ability with an area under the ROC curve (AUC) of 0.98, reaching a sensitivity of 88% and specificity of 100% at its optimal threshold. The preliminary results suggest that data collected with the “Zhurek” IoT devices are promising for the further development of ML models for IHD risk detection. This study aimed to address the limitations of previous work, such as small datasets and a lack of validation, by utilizing real and synthetically augmented data (conditional tabular GAN (CTGAN)), as well as multi-sensor input (ECG and PPG). The findings of this pilot study can serve as a starting point for developing scalable, remote, and cost-effective screening systems. The further integration of wearable devices and intelligent algorithms is a promising direction for improving routine monitoring and advancing preventative cardiology. Full article

This paper presents a real-time smart mirror system combining multiple AI modules for multimodal health monitoring. The proposed platform integrates three core components: facial expression analysis, remote photoplethysmography (rPPG), and conversational AI. A key innovation lies in transforming the Moving Average rPPG (MA-rPPG) model—originally developed for offline batch processing—into a real-time, continuously streaming setup, enabling seamless heart rate and peripheral oxygen saturation (SpO₂) monitoring using standard webcams. The system also incorporates the DeepFace facial analysis library for live emotion, age detection, and a Generative Pre-trained Transformer 4o (GPT-4o)-based mental health chatbot with bilingual (English/Korean) support and voice synthesis. Embedded into a touchscreen mirror with Graphical User Interface (GUI), this solution delivers ambient, low-interruption interaction and real-time user feedback. By unifying these AI modules within an interactive smart mirror, our findings demonstrate the feasibility of integrating multimodal sensing (rPPG, affect detection) and conversational AI into a real-time smart mirror platform. This system is presented as a feasibility-stage prototype to promote real-time health awareness and empathetic feedback. The physiological validation was limited to a single subject, and the user evaluation constituted only a small formative assessment; therefore, results should be interpreted strictly as preliminary feasibility evidence. The system is not intended to provide clinical diagnosis or generalizable accuracy at this stage. Full article

This study investigates the effects of heart rate and arm tremor on performance in elite archery, using non-contact physiological monitoring from real Olympic competition footage. A total of 50 video segments were extracted from publicly available international broadcasts, comprising athletes of various backgrounds. From these, heart rate signals were estimated via remote photoplethysmography (rPPG) from facial regions, and micro-movements were quantified from right and left arm regions using feature point tracking. Ordinal logistic regression was employed to evaluate the relationship between biometric variables and archery scores (10, 9, ≤8 points). Results showed that elevated heart rate ($\beta$ = −0.1166; $p<$ 0.001) and greater right-arm movement ($\beta$ = −6.1747; p = 0.008) were significantly associated with lower scores. Athletes scoring 10 points exhibited significantly lower heart rate ($p<$ 0.001) and reduced right-arm tremor (p = 0.010) compared to others. These findings support the hypothesis that physiological arousal and biomechanical instability impair performance, and they further demonstrate the feasibility of contactless monitoring in real competition environments. The proposed method enables objective, in-game performance evaluation and supports the development of personalized training systems for precision sports. Full article

Remote photoplethysmography (rPPG) offers a promising solution for non-contact driver monitoring by detecting subtle blood flow-induced facial color changes from video. However, motion artifacts in dynamic driving environments remain key challenges. This study presents an rPPG framework that combines signal processing techniques before and after applying Eulerian Video Magnification (EVM) for pulse rate (PR) estimation in driving simulators. While not novel, the approach offers insights into the efficiency of the EVM method and its time complexity. We compare results of the proposed rPPG approach against reference Empatica E4 data and also compare it with existing achievements from the literature. Additionally, the possible bias of the Empatica E4 is further assessed using an independent dataset with both the Empatica E4 and the Faros 360 measurements. EVM slightly improves PR estimation, reducing the mean absolute error (MAE) from 6.48 bpm to 5.04 bpm (the lowest MAE (~2 bpm) was achieved under strict conditions) with an additional time required for EVM of about 20 s for 30 s sequence. Furthermore, statistically significant differences are identified between younger and older drivers in both reference and rPPG data. Our findings demonstrate the feasibility of using rPPG-based PR monitoring, encouraging further research in driving simulations. Full article

For an intuitive understanding of traditional remote photoplethysmography (rPPG), this study categorizes existing algorithms into two main types: spatial vector projection and spatial angle projection in RGB color space. The RGB variation induced by noise (RGB_noise) is visualized in color space and approximated by the raw RGB signal. We propose APON (Adaptive Projection plane Orthogonal to Noise) to suppress artifacts. Two rPPG methods, APON_Vector and APON_Angle, are then developed from this adaptive plane. Comparative experiments on the public databases show that APON_Vector is comparable to state-of-the-art methods like CHROM and POS (achieving an Accuracy of 87.35%), while APON_Angle outperforms other angle projection methods (reducing MAE to 0.78 bpm). The results show that the simple yet effective APON contains significant pulse variation and holds potential for more pulse detection methods. Full article

This study evaluates the accuracy of a low-cost wearable system for the continuous monitoring of vital signs, including heart rate, blood oxygen saturation (Sp${\mathrm{O}}_2$), blood pressure trend (BPT), and body temperature. The prototype was built using the nRF52840 microcontroller, which integrates photoplethysmography and infrared sensors. The heart rate and Sp${\mathrm{O}}_2$ data were collected under three body positions (Rest, Sitting, and Standing), while all measurements were performed using both anatomical configurations: BPT-Finger and BPT-Earlobe. Results were compared against validated commercial devices: UT-100 for heart rate and Sp${\mathrm{O}}_2$, G-TECH LA800 for blood pressure, and G-TECH THGTSC3 for body temperature. Ten participants were monitored over a ten-day period. Bland–Altman analysis revealed clinically acceptable agreement thresholds of ±5 mmHg for blood pressure, ±5–10 bpm for heart rate, ±4% for Sp${\mathrm{O}}_2$, and ±0.5 °C for temperature. Both wearable configurations demonstrated clinically acceptable agreement across all vital signs. The BPT-Earlobe configuration exhibited superior stability and lower variability in the Rest and Sitting positions, likely due to reduced motion artifacts. Conversely, the BPT-Finger configuration showed higher Sp${\mathrm{O}}_2$ accuracy in the Standing position, with narrower limits of agreement. These findings highlight the importance of sensor placement in maintaining measurement consistency across physiological conditions. With an estimated cost of only ~USD 130—compared to ~USD 590 for the commercial alternatives—the proposed system presents a cost-effective, scalable, and accessible solution for decentralized health monitoring, particularly in underserved or remote environments. Full article

Remote photoplethysmography (rPPG) enables non-contact physiological measurement for emotion recognition, yet the temporally sparse nature of emotional cardiovascular responses, intrinsic measurement noise, weak session-level labels, and subtle correlates of valence pose critical challenges. To address these issues, we propose a physiologically inspired deep learning framework comprising a Multi-scale Temporal Dynamics Encoder (MTDE) to capture autonomic nervous system dynamics across multiple timescales, an adaptive sparse α-Entmax attention mechanism to identify salient emotional segments amidst noisy signals, Gated Temporal Pooling for the robust aggregation of emotional features, and a structured three-phase curriculum learning strategy to systematically handle temporal sparsity, weak labels, and noise. Evaluated on the MAHNOB-HCI dataset (27 subjects and 527 sessions with a subject-mixed split), our temporal-only model achieved competitive performance in arousal recognition (66.04% accuracy; 61.97% weighted F1-score), surpassing prior CNN-LSTM baselines. However, lower performance in valence (62.26% accuracy) revealed inherent physiological limitations regarding a unimodal temporal cardiovascular analysis. These findings establish clear benchmarks for temporal-only rPPG emotion recognition and underscore the necessity of incorporating spatial or multimodal information to effectively capture nuanced emotional dimensions such as valence, guiding future research directions in affective computing. Full article

Using multimodal wearable devices to diagnose cardiovascular diseases early is essential for providing timely medical assistance, particularly in remote areas. This approach helps prevent risks and reduce mortality rates. However, prolonged use of medical devices can lead to measurement inaccuracies, necessitating calibration to maintain precision. Unfortunately, wearable devices often lack affordable calibrators that are suitable for personal use. This study introduces a low-cost simulation system for phonocardiography (PCG) and photoplethysmography (PPG) signals designed for a multimodal smart stethoscope calibration. The proposed system was developed using a multicore microprocessor (MCU), two digital-to-analog converters (DACs), an LED light, and a speaker. It synchronizes dual signals by assigning tasks based on a multitasking function. A designed time adjustment algorithm controls the pulse transit time (PTT) to simulate various cardiovascular conditions. The simulation signals are generated from preprocessed PCG and PPG signals collected during in vivo experiments. A prototype device was manufactured to evaluate performance by measuring the generated signal using an oscilloscope and a multimodal smart stethoscope. The preprocessed signals, generated signals, and measurements by the smart stethoscope were compared and evaluated through correlation analysis. The experimental results confirm that the proposed system accurately generates the features of the physiological signals and remains in phase with the original signals. Full article

Recently, technologies monitoring users’ physiological signals in consumer electronics such as smartphones or kiosks with cameras and displays are gaining attention for their potential role in diverse services. While many of these technologies focus on photoplethysmography for the measurement of blood flow changes, respiratory measurement is also essential for assessing an individual’s health status. Previous studies have proposed thermal camera-based and body movement-based respiratory measurement methods. In this paper, we adopt an approach to extract respiratory signals from RGB face videos using photoplethysmography. Prior research shows that photoplethysmography can measure respiratory signals, due to its correlation with cardiac activity, by setting arterial vessel regions as areas of interest for respiratory measurement. However, this correlation does not directly reflect real-time respiratory components in photoplethysmography. Our new approach measures the respiratory rate by capturing changes in skin brightness from motion artifacts. We utilize these brightness factors, including facial movement, for respiratory signal measurement. We applied the wavelet transform and smoothing filters to remove other unrelated motion artifacts. In order to validate our method, we built a dataset of respiratory rate measurements from 20 individuals using an RGB camera in a facial movement-aware environment. Our approach demonstrated a similar performance level to the reference signal obtained with a contact-based respiratory belt, with a correlation above 0.9 and an MAE within 1 bpm. Moreover, our approach offers advantages for real-time measurements, excluding complex computational processes for measuring optical flow caused by the movement of the chest due to respiration. Full article

The Monit4Healthy system is an IoT-enabled health monitoring solution designed to address critical challenges in real-time biomedical signal processing, energy efficiency, and data transmission. The system’s modular design merges wireless communication components alongside a number of physiological sensors, including galvanic skin response, electromyography, photoplethysmography, and EKG, to allow for the remote gathering and evaluation of health information. In order to decrease network load and enable the quick identification of abnormalities, edge computing is used for real-time signal filtering and feature extraction. Flexible data transmission based on context and available bandwidth is provided through a hybrid communication approach that includes Bluetooth Low Energy and Wi-Fi. Under typical monitoring scenarios, laboratory testing shows reliable wireless connectivity and ongoing battery-powered operation. The Monit4Healthy system is appropriate for scalable deployment in connected health ecosystems and portable health monitoring due to its responsive power management approaches and structured data transmission, which improve the resiliency of the system. The system ensures the reliability of signals whilst lowering latency and data volume in comparison to conventional cloud-only systems. Limitations include the requirement for energy profiling, distinctive hardware miniaturizing, and sustained real-world validation. By integrating context-aware processing, flexible design, and effective communication, the Monit4Healthy system complements existing IoT health solutions and promotes better integration in clinical and smart city healthcare environments. Full article

Remote vital sensing in veterinary medicine is a relatively new area of practice, which involves the acquisition of data without invasion of the body cavities of live animals. This paper aims to review several technologies in remote vital sensing: infrared thermography, remote photoplethysmography (rPPG), radar, wearable sensors, and computer vision and machine learning. In each of these technologies, we outline its concepts, uses, strengths, and limitations in multiple animal species, and its potential to reshape health surveillance, welfare evaluation, and clinical medicine in animals. The review also provides information about the problems associated with applying these technologies, including species differences, external conditions, and the question of the reliability and classification of these technologies. Additional topics discussed in this review include future developments such as the use of artificial intelligence, combining different sensing methods, and creating monitoring solutions tailored to specific animal species. This contribution gives a clear understanding of the status and future possibilities of remote vital sensing in veterinary applications and stresses the importance of that technology for the development of the veterinary field in terms of animal health and science. Full article

We provide new insights into the performance of camera-based heart and respiration rate extraction and evaluate its usability for replacing spot checks conducted in the general ward. A study was performed comprising of 36 ICU patients recorded for a total time of 699 h. The 5 beats/minute agreement between camera and ECG-based heart rate measurements was 81.5%, with a coverage of 81.9%, where the largest gap between measurements was 239 min. The challenges encountered in heart rate monitoring were limited visibility of the patient’s face and irregular heart rates, which led to poor agreement between camera- and ECG-based heart rate measurements. To prevent non-breathing motion from causing error in respiration rate extraction, we developed a metric which was used to detect non-breathing motion. The 3 breaths/minute agreement between the camera- and contact-based respiration rate measurements was 91.1%, with a coverage of 59.1%, where the largest gap between measurements was 114 min. Encountered challenges were the morphology of the respiration signal and irregular breathing. While a few challenges need to be overcome, the results show promise for the usability of camera-based heart and respiration rate monitoring as a replacement for spot checks of these vital parameters conducted in the general ward. Full article

Advancements in camera technology over the past two decades have made image-based monitoring increasingly accessible for healthcare applications. Imaging photoplethysmography (iPPG) and remote photoplethysmography (rPPG) are non-invasive methods for measuring vital signs, such as heart rate, respiratory rate, oxygen saturation, and blood pressure, without physical contact. rPPG utilizes basic cameras to detect physiological changes, while rPPG enables remote monitoring by capturing subtle skin colour variations linked to blood flow. Various rPPG techniques, including colour-based, motion-based, multispectral, and depth-based approaches, enhance accuracy and resilience. These technologies are beneficial not only for healthcare but also for fitness tracking, stress management, and security systems, offering a promising future for contactless physiological monitoring. In this article, there is an overview of these methods and their uniqueness for use in remote photoplethysmography. Full article

Remote photoplethysmography is a technology that estimates heart rate by detecting changes in blood volume induced by heartbeats and the resulting changes in skin color through imaging. This technique is fundamental for the noncontact acquisition of physiological signals from the human body. Despite the notable progress in remote-photoplethysmography algorithms for estimating heart rate from facial videos, challenges remain in accurately assessing heart rate during cardiovascular exercises such as treadmill or elliptical workouts. To address these issues, research has been conducted in various fields. For example, an understanding of optics can help solve these issues. Careful design of video production is also crucial. Approaches in computer vision and deep learning with neural networks can also be applied. We focused on developing a practical approach to improve heart rate estimation algorithms under constrained conditions. To address the limitations of motion blur during high-motion activities, we introduced a novel motion-based algorithm. While existing methods like CHROM, LGI, OMIT, and POS incorporate correction processes, they have shown limited success in environments with significant motion. By analyzing treadmill data, we identified a relationship between motion changes and heart rate. With an initial heart rate provided, our algorithm achieved over a 15 bpm improvement in mean absolute error and root mean squared error compared to existing methods, along with more than double the Pearson correlation. We hope this research contributes to advancements in healthcare and monitoring. Full article