Designing Reproducible Test Environments for rPPG: A System for Camera Sensor Response Validation
Abstract
1. Introduction
2. Materials and Methods
2.1. Camera Control
2.2. Experimental Setup
2.3. Camera Sensor Characterisation
2.4. Measurement Protocol
2.5. Signal Processing and Evaluation Metrics
2.5.1. Time Domain Morphology Comparison
2.5.2. Frequency Response
3. Results
3.1. Baseline Measurements
3.1.1. Threshold Setting
3.1.2. Reproducibility Testing
3.2. Characterisation and Comparison of Other Devices
4. Discussion
4.1. Implications for rPPG Work
4.2. Limitations
4.3. Future Work
5. Conclusions
6. Patents
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| BP | Blood Pressure |
| DUT | Device Under Test |
| FS | Fitness Score |
| ISP | Image Signal Processing |
| LEDs | Light Emitting Diodes |
| PPG | Photoplethysmography |
| PR | Pulse Rate |
| rPPG | Remote Photoplethysmography |
| RD | Reference Device |
| RMSE | Root Mean Square Error |
| SD | Standard Deviation |
References
- Allen, J. Photoplethysmography and its application in clinical physiological measurement. Physiol. Meas. 2007, 28, R1–R39. [Google Scholar] [CrossRef] [PubMed]
- Charlton, P.H.; Kyriacou, P.A.; Mant, J.; Marozas, V.; Chowienczyk, P.; Alastruey, J. Wearable photoplethysmography for cardiovascular monitoring. Proc. IEEE 2022, 110, 355–381. [Google Scholar] [CrossRef]
- Tamura, T.; Maeda, Y.; Sekine, M.; Yoshida, M. Wearable photoplethysmographic sensors—past and present. Electronics 2014, 3, 282–302. [Google Scholar] [CrossRef]
- Verkruysse, W.; Svaasand, L.O.; Nelson, J.S. Remote plethysmographic imaging using ambient light. Opt. Express 2008, 16, 21434–21445. [Google Scholar] [CrossRef] [PubMed]
- Kim, B.S.; Yoo, S.K. Motion artifact reduction in photoplethysmography using independent component analysis. IEEE Trans. Biomed. Eng. 2006, 53, 566–568. [Google Scholar] [CrossRef]
- Yao, J.; Warren, S. A short study to assess the potential of independent component analysis for motion artifact separation in wearable pulse oximeter signals. In Proceedings of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference; IEEE: New York, NY, USA, 2006; pp. 3585–3588. [Google Scholar]
- Shahmirzadi, D.; Rahmani, A.M.; Wang, W.F. Hybrid approach to heart rate estimation: Comparing Green, CHROM and POS methods in rPPG analysis. In Proceedings of the International Workshop on Advanced Imaging Technology (IWAIT) 2025; SPIE: Bellingham, WA, USA, 2025; Volume 13510, pp. 77–81. [Google Scholar]
- Khaleel Sallam Ma’aitah, M.; Helwan, A. 3D DenseNet with temporal transition layer for heart rate estimation from real-life RGB videos. Technol. Health Care 2025, 33, 419–430. [Google Scholar] [CrossRef]
- Haugg, F.; Elgendi, M.; Menon, C. Effectiveness of remote PPG construction methods: A preliminary analysis. Bioengineering 2022, 9, 485. [Google Scholar] [CrossRef]
- Yu, Z.; Li, X.; Zhao, G. Facial-video-based physiological signal measurement: Recent advances and affective applications. IEEE Signal Process. Mag. 2021, 38, 50–58. [Google Scholar] [CrossRef]
- Lu, Y.; Wang, C.; Meng, M.Q.H. Video-based Contactless Blood Pressure Estimation: A Review. In Proceedings of the 2020 IEEE International Conference on Real-Time Computing and Robotics (RCAR), Asahikawa, Japan, 28–29 September 2020; pp. 62–67. [Google Scholar] [CrossRef]
- Mironenko, Y.; Kalinin, K.; Kopeliovich, M.; Petrushan, M. Remote photoplethysmography: Rarely considered factors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA, 14–19 June 2020; pp. 296–297. [Google Scholar]
- Pointer, M.R.; Attridge, G.G.; Jacobson, R.E. Practical camera characterization for colour measurement. Imaging Sci. J. 2001, 49, 63–80. [Google Scholar] [CrossRef]
- Mullikin, J.C.; van Vliet, L.J.; Netten, H.; Boddeke, F.R.; Van der Feltz, G.; Young, I.T. Methods for CCD camera characterization. In Proceedings of the Image Acquisition and Scientific Imaging Systems; SPIE: Bellingham, WA, USA, 1994; Volume 2173, pp. 73–84. [Google Scholar]
- van Putten, L.D.; Bamford, K.E.; Veleslavov, I.; Wegerif, S. From video to vital signs: Using personal device cameras to measure pulse rate and predict blood pressure using explainable AI. Discov. Appl. Sci. 2024, 6, 184. [Google Scholar] [CrossRef]
- Xuan, Y.; Barry, C.; Antipa, N.; Wang, E.J. A calibration method for smartphone camera photophlethysmography. Front. Digit. Health 2023, 5, 1301019. [Google Scholar] [CrossRef] [PubMed]
- Nosko, S.; Musil, M.; Zemcik, P.; Juranek, R. Color HDR video processing architecture for smart camera: How to capture the HDR video in real-time. J. Real-Time Image Process. 2020, 17, 555–566. [Google Scholar] [CrossRef]
- Wang, J.; Shan, C.; Liu, Z.; Zhou, S.; Shu, M. Physiological Information Preserving Video Compression for rPPG. IEEE J. Biomed. Health Inform. 2025, 29, 3563–3575. [Google Scholar] [CrossRef] [PubMed]
- Procka, P.; Borik, S. System for contactless monitoring of tissue perfusion. In Proceedings of the 2022 ELEKTRO (ELEKTRO); IEEE: New York, NY, USA, 2022; pp. 1–5. [Google Scholar]
- Karras, T.; Laine, S.; Aittala, M.; Hellsten, J.; Lehtinen, J.; Aila, T. Analyzing and Improving the Image Quality of StyleGAN. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 14–19 June 2020. [Google Scholar]
- Wiffen, L.; Brown, T.; Maczka, A.B.; Kapoor, M.; Pearce, L.; Chauhan, M.; Chauhan, A.J.; Saxena, M.; Lifelight Trials Group. Measurement of vital signs by lifelight software in comparison to standard of care multisite development (VISION-MD): Protocol for an observational study. JMIR Res. Protoc. 2023, 12, e41533. [Google Scholar] [CrossRef]
- van Putten, L.D.; Ahmed, A.; Wegerif, S. Remote photoplethysmography for contactless pulse rate monitoring: Algorithm development and accuracy assessment. Physiol. Meas. 2025, 46, 115004. [Google Scholar] [CrossRef]
- Lennart, L. System Identification: Theory for the User; PTR Prentice Hall: Upper Saddle River, NJ, USA, 1999; Volume 28, p. 540. [Google Scholar]
- Zahedi, E.; Sohani, V.; Ali, M.M.; Chellappan, K.; Beng, G.K. Experimental feasibility study of estimation of the normalized central blood pressure waveform from radial photoplethysmogram. J. Healthc. Eng. 2015, 6, 121–144. [Google Scholar] [CrossRef]
- Takazawa, K. Clinical usefulness of the second derivative of a plethysmogram (acceleration plethysmogram). J. Cardiol. 1993, 23, 207–217. [Google Scholar]
- Imanaga, I.; Hara, H.; Koyanagi, S.; Tanaka, K. Correlation between wave components of the second derivative of plethysmogram and arterial distensibility. Jpn. Heart J. 1998, 39, 775–784. [Google Scholar] [CrossRef]
- Kurylyak, Y.; Lamonaca, F.; Grimaldi, D. A Neural Network-based method for continuous blood pressure estimation from a PPG signal. In Proceedings of the 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Minneapolis, MN, USA, 6–9 May 2013; pp. 280–283. [Google Scholar] [CrossRef]
- Tigges, T.; Pielmuş, A.; Klum, M.; Feldheiser, A.; Hunsicker, O.; Orglmeister, R. Model selection for the Pulse Decomposition Analysis of fingertip photoplethysmograms. In Proceedings of the 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Jeju, Republic of Korea, 11–15 July 2017; pp. 4014–4017. [Google Scholar] [CrossRef]
- de Haan, G.; van Leest, A. Improved motion robustness of remote-PPG by using the blood volume pulse signature. Physiol. Meas. 2014, 35, 1913. [Google Scholar] [CrossRef]
- Moco, A.V.; Stuijk, S.; de Haan, G. New insights into the origin of remote PPG signals in visible light and infrared. Sci. Rep. 2018, 8, 8501. [Google Scholar] [CrossRef] [PubMed]
- Nowara, E.M.; McDuff, D.J.; Veeraraghavan, A. A Meta-Analysis of the Impact of Skin Type and Gender on Non-contact Photoplethysmography Measurements. In Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA, 13–19 June 2020; pp. 1148–1155. [Google Scholar]
- Lifelight. Validated Devices|Lifelight. 2026. Available online: https://lifelight.ai/validated-devices (accessed on 10 March 2026).









| Pulse Rate (bpm) | Pulse Wave Shape 1 | Pulse Wave Shape 2 |
|---|---|---|
| 60 | 0.81 | 0.82 |
| 90 | 0.71 | 0.72 |
| 120 | 0.61 | 0.62 |
| Pulse Rate (bpm) | Pulse Shape: FS Threshold | Samsung A33 (Mean ± SD) | iPhone XR (Mean ± SD) | Pixel 10 (Mean ± SD) |
|---|---|---|---|---|
| 60 | 1: >0.81 | 0.94 ± 0.01 | 0.88 ± 0.05 | 0.89 ± 0.04 |
| 90 | 1: >0.71 | 0.84 ± 0.01 | 0.86 ± 0.05 | 0.85 ± 0.06 |
| 120 | 1: >0.61 | 0.86 ± 0.02 | 0.84 ± 0.03 | 0.84 ± 0.06 |
| 60 | 2: >0.82 | 0.88 ± 0.03 | 0.86 ± 0.05 | 0.88 ± 0.04 |
| 90 | 2: >0.72 | 0.91 ± 0.01 | 0.85 ± 0.04 | 0.84 ± 0.06 |
| 120 | 2: > 0.62 | 0.79 ± 0.01 | 0.74 ± 0.05 | 0.79 ± 0.06 |
| Device | Mean RMSE | SD RMSE | Max RMSE | Mean Correlation (r) |
|---|---|---|---|---|
| iPad 8 (Reference device) | 0.0197 | 0.0128 | 0.0535 | – |
| Samsung A33 | 0.0170 | 0.0112 | 0.0360 | 0.99 |
| iPhone XR | 0.0483 | 0.0111 | 0.0638 | 0.98 |
| Pixel 10 | 0.0718 | 0.0221 | 0.1019 | 0.96 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
van Putten, L.D.; Veleslavov, I.; Ahmed, A.; Mathieu, A.; Wegerif, S. Designing Reproducible Test Environments for rPPG: A System for Camera Sensor Response Validation. Lights 2026, 2, 3. https://doi.org/10.3390/lights2020003
van Putten LD, Veleslavov I, Ahmed A, Mathieu A, Wegerif S. Designing Reproducible Test Environments for rPPG: A System for Camera Sensor Response Validation. Lights. 2026; 2(2):3. https://doi.org/10.3390/lights2020003
Chicago/Turabian Stylevan Putten, Lieke Dorine, Ivan Veleslavov, Ayman Ahmed, Aristide Mathieu, and Simon Wegerif. 2026. "Designing Reproducible Test Environments for rPPG: A System for Camera Sensor Response Validation" Lights 2, no. 2: 3. https://doi.org/10.3390/lights2020003
APA Stylevan Putten, L. D., Veleslavov, I., Ahmed, A., Mathieu, A., & Wegerif, S. (2026). Designing Reproducible Test Environments for rPPG: A System for Camera Sensor Response Validation. Lights, 2(2), 3. https://doi.org/10.3390/lights2020003

