Search Results (60)

Non-contact physiological monitoring based on remote PPG (rPPG) offers a viable alternative for the care of pediatric populations, particularly for children with cerebral palsy (CP) who present unique communication and mobility challenges. This paper presents a review of the literature on the use of rPPG for the estimation of vital signs and its application in emotional monitoring. Following the PRISMA 2020 guidelines as a methodological framework for searching and filtering, an exhaustive search was conducted in the IEEE Xplore and Scopus databases covering the period from 2017 to 2024. A total of 35 studies were selected for analysis. The review examines the evolution of rPPG algorithms—from classical mathematical approaches to recent deep-learning-based architectures—identifying critical technical challenges such as motion artifacts caused by spasticity and variations in lighting conditions. The results reveal that while rPPG has reached technical maturity for monitoring core physiological parameters such as heart rate, its application to robust emotion detection in children with CP remains limited. The main limitation identified across the surveyed literature is the critical scarcity of public or clinical datasets featuring pediatric CP cohorts. Finally, the potential of multimodal integration—combining rPPG with eye-tracking and wearable sensors—is discussed as a promising pathway toward objective emotional monitoring. Such an approach could enhance communication, support rehabilitation processes, and ultimately improve the quality of life of children with cerebral palsy and their caregivers. Full article

Remote Photoplethysmography (rPPG) provides a non-contact alternative to traditional heart rate monitoring. Estimating physiological signals from facial videos has recently attracted significant research interest. However, rPPG performance is sensitive to illumination variation and environmental interference, which can distort the extracted physiological signal. Since the background and face are affected by similar conditions, the effect of these conditions can be extracted from the background and isolated from the result. This paper proposes the Triple-Head Spatio-Temporal Transformer (TH-STT). TH-STT is a multi-task architecture designed to separate rPPG signals from environmental interference. In addition to facial tokens, a background anchor token is used as an environmental reference. Facial tokens and background anchor are processed using a shared transformer backbone. The proposed architecture has two auxiliary tasks to help purify the resulting rPPG. The Reaction-Driven Gating (RDG) mechanism was introduced, which tracks facial muscular activity. Furthermore, a Dynamic Anchor Locking (DAL) strategy is proposed to cancel environmental illumination interference. Experimental results on three benchmark datasets demonstrate improved and stable performance, with the TH-STT achieving a Mean Absolute Error (MAE) of 0.42 bpm on UBFC-rPPG and 1.08 on COHFACE. Full article

Remote photoplethysmography (rPPG) estimates heart rate by analyzing subtle blood-flow-induced color variations from camera videos; however, its performance is highly sensitive to illumination changes caused by variations in light intensity, position, and environmental conditions. To address this limitation, this study proposes a lightweight, training-free brightness normalization method that suppresses illumination-induced luminance fluctuations while preserving physiologically relevant color variations associated with blood perfusion. The proposed approach separates luminance and chrominance components from the frame-mean RGB vector and applies normalization only to the brightness component, thereby maintaining the intrinsic color direction essential for rPPG signal extraction and stabilizing temporal brightness without distorting chrominance relationships. Experimental evaluations show that channel-wise mean values vary only within $\pm 6$–$12\%$ with negligible changes in standard deviation, while dynamic range and temporal stability are significantly improved. Furthermore, when combined with an SNR-based signal selection strategy, the proposed method reduces the mean absolute error (MAE) of the CHROM algorithm on the DLCN dataset from approximately 18–19 BPM to 4.87 BPM under complex illumination scenarios, with consistent improvements also observed on the MR-NIRP dataset. These results suggest that the proposed preprocessing method helps preserve blood-flow-induced temporal color variations and improves the robustness of rPPG measurement under diverse illumination conditions. Full article

Accurate, non-contact vital-sign monitoring promises a scalable alternative to conventional sensors, yet low signal quality and long recording times have limited real-life adoption. We present a dual-modality system that combines Eulerian video magnified remote photoplethysmography (rPPG) from facial videos with optical flow-based shoulder tracking to estimate heart rate (HR) and respiratory rate (RR) from ultra-short 15 s recordings. With 200 participants, each providing 2 videos, 387 videos passed strict usability criteria, excluding flicker, blur, occlusion, and low illumination. For 15 s recordings, the HR estimates reached 98.5% accuracy within a ±10 beats per minute tolerance (MAE = 3.25, RMSE = 4.88, r = 0.93; p < 0.05) and the RR estimates achieved 98.4% accuracy within a ±5 respirations per minute tolerance (MAE = 0.69, RMSE = 0.87, r = 0.90; p < 0.05), exceeding prior studies that required 30 to 60 s recording lengths. Computational analysis on a standard home computer confirmed feasibility, with near real-time performance achievable on optimized hardware. By integrating complementary modalities and rigorous video quality control, the system overcomes low-SNR challenges, delivering high-fidelity, clinically validated vital signs monitoring. These results establish a robust, scalable, and precise framework for clinical and home care, demonstrating that accurate, contact-free HR and RR monitoring can now be achieved in seconds, making rapid, real-life vital signs assessment practical and accessible. Full article

Remote photoplethysmography (rPPG) enables contactless estimation of cardiovascular signals from video, but most existing studies assume a fixed, stationary camera. This study investigates the feasibility of performing real-time moving-average rPPG (MA-rPPG) using a drone-mounted camera, where platform motion, vibration, and viewing distance introduce additional challenges. Building on our previously validated real-time MA-rPPG smart mirror platform, we reuse the smart mirror interface as a unified frontend for visualization, synchronization, and logging while adapting the MA-rPPG pipeline to operate on live video streamed from an off-the-shelf DJI Tello micro-drone. Feasibility experiments were conducted with 10 participants under controlled indoor lighting and constrained flight conditions, where the drone maintained a stable hover in front of a standing subject and facial video was processed in real time to estimate heart rate from a forehead region of interest. To avoid cross-modality bias and clarify the effect of the aerial imaging platform, drone-derived MA-rPPG outputs were compared against a fixed desktop-camera MA-rPPG reference using the same trained model, enabling a controlled, like-for-like evaluation. The results indicate that continuous heart-rate estimation from a drone camera is feasible in our controlled hover-only setup, while agreement tended to vary with hover stability and effective facial resolution. This work is presented strictly as a feasibility-stage investigation and does not claim clinical validity. The findings provide an experimental baseline and operating-envelope insight for future motion-robust rPPG on mobile and aerial health-sensing platforms. Full article

Remote photoplethysmography (rPPG) enables noncontact estimation of vital signs, particularly heart rate, by analyzing subtle periodic skin color variations in facial videos. While deep learning has advanced rPPG signal extraction, existing methods rely on carefully designed task-specific architectures that are costly to develop and generalize poorly. In this work, we demonstrate that the general video foundation model VideoMAE v2 can be effectively adapted to the rPPG signal regression task by introducing only a lightweight adapter, without modifying its pretrained backbone. We freeze the entire VideoMAE v2 encoder and introduce a Temporal Difference Convolutional Adapter to capture the subtle interframe intensity differences. To address the mismatch between VideoMAE v2′s short input window (16 frames) and the long temporal context typically required for robust rPPG extraction (e.g., 160 frames), we adopt an overlapping sliding window strategy for segmented inference and reconstruct the full signal through weighted temporal aggregation. On the COHFACE and UBFC-rPPG datasets, our method achieves mean absolute errors (MAEs) of 0.90 and 1.55, reducing the error by more than 55% and 42%, respectively, compared to PhysFormer (2.00 and 2.70). Furthermore, on challenging real-world datasets such as BUAA-MIHR, which features strong illumination variations, and VIPL-HR, which involves significant head movements, our approach achieves MAEs of 6.68 and 8.23, respectively, despite incorporating no task-specific robustness modules. These results demonstrate stable rPPG signal recovery and validate the feasibility of leveraging general video foundation models for physiological signal perception. Full article

Remote photoplethysmography (rPPG) enables non-contact acquisition of human physiological parameters using ordinary cameras, and has been widely applied in medical monitoring, human–computer interaction, and health management. However, most existing studies focus on estimating specific physiological metrics, such as heart rate and heart rate variability, while paying insufficient attention to reconstructing the underlying rPPG waveform. In addition, publicly available datasets typically record facial videos accompanied by fingertip PPG signals as reference labels. Since fingertip PPG waveforms differ substantially from the true photoplethysmography (PPG) signals obtained from the face, deep learning models trained on such datasets often struggle to recover high-quality rPPG waveforms. To address this issue, we collected a new dataset consisting of palm-region videos paired with wrist-based PPG signals as reference labels, and experimentally validated its effectiveness for training neural network models aimed at rPPG waveform reconstruction. Furthermore, we propose a generative adversarial network (GAN)-based pulse-wave synthesis framework that produces high-quality rPPG waveforms by denoising the mean green-channel signal. By incorporating time-domain peak-aware loss, frequency-domain loss, and adversarial loss, our method achieves promising performance, with an RMSE (Root Mean Square Error) of 0.102, an MAPE (Mean Absolute Percentage Error) of 0.028, a Pearson correlation of 0.987, and a cosine similarity of 0.989. These results demonstrate the capability of the proposed approach to reconstruct high-fidelity rPPG waveforms with improved morphological accuracy compared to noisy raw rPPG signals, rather than directly validating health monitoring performance. This study presents a high-quality rPPG waveform reconstruction approach from both data and model perspectives, providing a reliable foundation for subsequent physiological signal analysis, waveform-based studies, and potential health-related applications. Full article

This work presents a unified benchmarking framework for evaluating classical machine-learning–based heart-rate estimation from remote photoplethysmography (rPPG) across both RGB and near-infrared (NIR) modalities. Despite extensive research on algorithmic rPPG methods, their relative robustness across datasets, illumination conditions, and sensor types remains inconsistently reported. To address this gap, we standardize ROI extraction, signal preprocessing, rPPG computation, handcrafted feature generation, and label formation across four publicly available datasets: UBFC-rPPG Part 1, UBFC-rPPG Part 2, VicarPPG-2, and IMVIA-NIR. We benchmark five rPPG extraction methods (Green, POS, CHROM, PBV, PCA/ICA) combined with four classical regressors using MAE, RMSE, and $R^2$, complemented by permutation feature importance for interpretability. Results show that CHROM is consistently the most reliable algorithm across all RGB datasets, providing the lowest error and highest stability, particularly when paired with tree-based models. For NIR recordings, PCA with spatial patch decomposition substantially outperforms ICA, highlighting the importance of spatial redundancy when color cues are absent. While handcrafted features and classical regressors offer interpretable baselines, their generalization is limited by small-sample datasets and the absence of temporal modeling. The proposed pipeline establishes robust cross-dataset baselines and offers a standardized foundation for future deep-learning architectures, hybrid algorithmic–learned models, and multimodal sensor-fusion approaches in remote physiological monitoring. Full article

Infrared thermal cameras can noninvasively measure the surface temperatures of objects and are widely used as fever-screening systems for infectious diseases. However, body temperature measurements alone are often insufficient for identifying people with infections. To address the inherent limitations of fever-based screening, this study aimed to develop analytical methods that enable multi-vital sensing alongside body temperature measurement using a single mid-wave infrared (MWIR) camera. Respiratory parameters were assessed by visualizing exhaled airflow based on MWIR absorption by carbon dioxide, whereas the heart rate was estimated from subtle temperature fluctuations captured using high thermal resolution. The experimental results validated the proposed method, showing that the developed system achieved good agreement with reference measurements; the respiratory rate, heart rate, and body temperature showed strong correlations (r = 0.864–0.987) and acceptable limits of agreement in Bland–Altman analyses. The exhalation volume was quantified from the visualized airflow and was found to align with the expected physiological ranges. These results demonstrate that noncontact multi-vital sensing can be achieved using a single MWIR camera, without the need for complex instrumentation. The proposed method holds promise for high-precision infection screening, remote health monitoring, and in-home physiological assessment. Full article

Remote photoplethysmography (rPPG) enables non-contact heart rate estimation but remains highly sensitive to illumination variation and dataset-dependent factors. This study proposes CHROM-Y, a robust 2D feature representation that combines chrominance (Ω, Φ) with luminance (Y) to improve physiological signal extraction under varying lighting conditions. The proposed features were evaluated using U-Net, ResNet-18, and VGG16 for heart rate estimation and waveform reconstruction on the UBFC-rPPG and BhRPPG datasets. On UBFC-rPPG, U-Net with CHROM-Y achieved the best performance with a Peak MAE of 3.62 bpm and RMSE of 6.67 bpm, while ablation experiments confirmed the importance of the Y-channel, showing degradation of up to 41.14% in MAE when removed. Although waveform reconstruction demonstrated low Pearson correlation, dominant frequency preservation enabled reliable frequency-based HR estimation. Cross-dataset evaluation revealed reduced generalization (MAE up to 13.33 bpm and RMSE up to 22.80 bpm), highlighting sensitivity to domain shifts. However, fine-tuning U-Net on BhRPPG produced consistent improvements across low, medium, and high illumination levels, with performance gains of 11.18–29.47% in MAE and 12.48–27.94% in RMSE, indicating improved adaptability to illumination variations. Full article

Remote photoplethysmography (rPPG) is a non-contact technology that estimates physiological signals, such as Heart Rate (HR), by capturing subtle skin color changes caused by periodic blood volume variations using only a standard RGB camera. While cost-effective and convenient, it suffers from a fundamental limitation: performance degrades severely in dynamic environments due to susceptibility to noise, such as abrupt illumination changes or motion blur. This study presents a deep learning framework that combines two structural modifications to ensure robustness in dynamic environments, specifically modeling movement noise and illumination change noise. The proposed framework structurally cancels global disturbances, such as illumination changes or global motion, through a dual-branch pipeline that encodes the face and background in parallel after Video Color Magnification (VCM) and then performs differencing. Subsequently, it utilizes a structure that injects a Temporal Shift Module (TSM) into the Spatio-Temporal Feature Extraction (SSFE) block to preserve long- and short-term temporal correlations and smooth noise, even amidst short and irregular movements. We measured MAE, RMSE, and correlation on the standard dataset UBFC-rPPG under four noise conditions: clean, illumination change noise, Movement Noise, Both Noise and the real-world in-vehicle dataset MR-NIRP (Stationary and Driving). Experimental results showed that the proposed method achieved consistent error reduction and correlation improvement compared to the VS-Net baseline in the illumination change noise-only and combined noise environments (UBFC-rPPG) and in the high-noise driving scenario (MR-NIRP). It maintained competitive performance in motion-only noise. Conversely, a modest performance disadvantage was observed under clean conditions (UBFC) and quasi-clean stationary conditions (MR-NIRP), interpreted as a design trade-off focused on global noise cancellation and temporal smoothing. Ablation studies demonstrated that the dual-branch pipeline is the primary contributor under illumination change noise, while TSM is the key contributor under movement noise, and that the combination of both elements achieves optimal robustness in the most complex scenarios. Full article

Artificial intelligence (AI) is transforming cardiac electrophysiology across the entire care pathway, from arrhythmia detection on 12-lead electrocardiograms (ECGs) and wearables to the guidance of catheter ablation procedures, through to outcome prediction and therapeutic personalization. End-to-end deep learning (DL) models have achieved cardiologist-level performance in rhythm classification and prognostic estimation on standard ECGs, with a reported arrhythmia classification accuracy of ≥95% and an atrial fibrillation detection sensitivity/specificity of ≥96%. The application of AI to wearable devices enables population-scale screening and digital triage pathways. In the electrophysiology (EP) laboratory, AI standardizes the interpretation of intracardiac electrograms (EGMs) and supports target selection, and machine learning (ML)-guided strategies have improved ablation outcomes. In patients with cardiac implantable electronic devices (CIEDs), remote monitoring feeds multiparametric models capable of anticipating heart-failure decompensation and arrhythmic risk. This review outlines the principal modeling paradigms of supervised learning (regression models, support vector machines, neural networks, and random forests) and unsupervised learning (clustering, dimensionality reduction, association rule learning) and examines emerging technologies in electrophysiology (digital twins, physics-informed neural networks, DL for imaging, graph neural networks, and on-device AI). However, major challenges remain for clinical translation, including an external validation rate below 30% and workflow integration below 20%, which represent core obstacles to real-world adoption. A joint clinical engineering roadmap is essential to translate prototypes into reliable, bedside tools. Full article

This study investigates the effects of heart rate and arm tremor on performance in elite archery, using non-contact physiological monitoring from real Olympic competition footage. A total of 50 video segments were extracted from publicly available international broadcasts, comprising athletes of various backgrounds. From these, heart rate signals were estimated via remote photoplethysmography (rPPG) from facial regions, and micro-movements were quantified from right and left arm regions using feature point tracking. Ordinal logistic regression was employed to evaluate the relationship between biometric variables and archery scores (10, 9, ≤8 points). Results showed that elevated heart rate ($\beta$ = −0.1166; $p<$ 0.001) and greater right-arm movement ($\beta$ = −6.1747; p = 0.008) were significantly associated with lower scores. Athletes scoring 10 points exhibited significantly lower heart rate ($p<$ 0.001) and reduced right-arm tremor (p = 0.010) compared to others. These findings support the hypothesis that physiological arousal and biomechanical instability impair performance, and they further demonstrate the feasibility of contactless monitoring in real competition environments. The proposed method enables objective, in-game performance evaluation and supports the development of personalized training systems for precision sports. Full article

Background: Artificial intelligence (AI) and machine learning (ML) have been reshaping maternal, fetal, neonatal, and reproductive healthcare by enhancing risk prediction, diagnostic accuracy, and operational efficiency across the perinatal continuum. However, no comprehensive synthesis has yet been published. Objective: To conduct a scoping review of reviews of AI/ML applications spanning reproductive, prenatal, postpartum, neonatal, and early child-development care. Methods: We searched PubMed, Embase, the Cochrane Library, Web of Science, and Scopus through April 2025. Two reviewers independently screened records, extracted data, and assessed methodological quality using AMSTAR 2 for systematic reviews, ROBIS for bias assessment, SANRA for narrative reviews, and JBI guidance for scoping reviews. Results: Thirty-nine reviews met our inclusion criteria. In preconception and fertility treatment, convolutional neural network-based platforms can identify viable embryos and key sperm parameters with over 90 percent accuracy, and machine-learning models can personalize follicle-stimulating hormone regimens to boost mature oocyte yield while reducing overall medication use. Digital sexual-health chatbots have enhanced patient education, pre-exposure prophylaxis adherence, and safer sexual behaviors, although data-privacy safeguards and bias mitigation remain priorities. During pregnancy, advanced deep-learning models can segment fetal anatomy on ultrasound images with more than 90 percent overlap compared to expert annotations and can detect anomalies with sensitivity exceeding 93 percent. Predictive biometric tools can estimate gestational age within one week with accuracy and fetal weight within approximately 190 g. In the postpartum period, AI-driven decision-support systems and conversational agents can facilitate early screening for depression and can guide follow-up care. Wearable sensors enable remote monitoring of maternal blood pressure and heart rate to support timely clinical intervention. Within neonatal care, the Heart Rate Observation (HeRO) system has reduced mortality among very low-birth-weight infants by roughly 20 percent, and additional AI models can predict neonatal sepsis, retinopathy of prematurity, and necrotizing enterocolitis with area-under-the-curve values above 0.80. From an operational standpoint, automated ultrasound workflows deliver biometric measurements at about 14 milliseconds per frame, and dynamic scheduling in IVF laboratories lowers staff workload and per-cycle costs. Home-monitoring platforms for pregnant women are associated with 7–11 percent reductions in maternal mortality and preeclampsia incidence. Despite these advances, most evidence derives from retrospective, single-center studies with limited external validation. Low-resource settings, especially in Sub-Saharan Africa, remain under-represented, and few AI solutions are fully embedded in electronic health records. Conclusions: AI holds transformative promise for perinatal care but will require prospective multicenter validation, equity-centered design, robust governance, transparent fairness audits, and seamless electronic health record integration to translate these innovations into routine practice and improve maternal and neonatal outcomes. Full article

This study evaluates the accuracy of a low-cost wearable system for the continuous monitoring of vital signs, including heart rate, blood oxygen saturation (Sp${\mathrm{O}}_2$), blood pressure trend (BPT), and body temperature. The prototype was built using the nRF52840 microcontroller, which integrates photoplethysmography and infrared sensors. The heart rate and Sp${\mathrm{O}}_2$ data were collected under three body positions (Rest, Sitting, and Standing), while all measurements were performed using both anatomical configurations: BPT-Finger and BPT-Earlobe. Results were compared against validated commercial devices: UT-100 for heart rate and Sp${\mathrm{O}}_2$, G-TECH LA800 for blood pressure, and G-TECH THGTSC3 for body temperature. Ten participants were monitored over a ten-day period. Bland–Altman analysis revealed clinically acceptable agreement thresholds of ±5 mmHg for blood pressure, ±5–10 bpm for heart rate, ±4% for Sp${\mathrm{O}}_2$, and ±0.5 °C for temperature. Both wearable configurations demonstrated clinically acceptable agreement across all vital signs. The BPT-Earlobe configuration exhibited superior stability and lower variability in the Rest and Sitting positions, likely due to reduced motion artifacts. Conversely, the BPT-Finger configuration showed higher Sp${\mathrm{O}}_2$ accuracy in the Standing position, with narrower limits of agreement. These findings highlight the importance of sensor placement in maintaining measurement consistency across physiological conditions. With an estimated cost of only ~USD 130—compared to ~USD 590 for the commercial alternatives—the proposed system presents a cost-effective, scalable, and accessible solution for decentralized health monitoring, particularly in underserved or remote environments. Full article