Evaluating the Feasibility of Low-Cost, Contactless Consumer Sleep-Tracking Devices as Measurement Tools for Preliminary Sleep Research
Highlights
- For all sleep metrics except sleep stages, the iSleep S200G and Sleep Dot B501 showed no significant differences compared to PSG.
- The iSleep S200G and Sleep Dot B501 demonstrate comparable or even superior reliability levels to Actiwatch Spectrum in sleep/wake measurements and EBE agreement.
- This study offers a potential solution for conducting long-term, large-scale preliminary sleep research with low precision requirements under budget constraints.
- The performance validation results provide data references for researchers adopting iteratively upgraded CCSTDs.
Abstract
1. Introduction
2. Materials and Methods
2.1. Participants
2.2. Sleep Monitors
2.2.1. Contactless Consumer Sleep-Tracking Devices
2.2.2. PSG and Actigraphy
2.3. Procedures
2.4. Statistical Analyses
2.5. Missing Data Procedures
3. Results
3.1. Sleep Summary Outcomes
3.2. EBE Analysis Outcomes
4. Discussion
4.1. Principal Results
4.2. Comparison with Prior Work
4.3. Limitations
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| PSG | Polysomnography |
| CCSTDs | Contactless consumer sleep-tracking devices |
| TIB | Total time in bed |
| TST | Total sleep time |
| TWT | Total wake time |
| SE | Sleep efficiency |
| SOL | Sleep onset latency |
| WASO | Wake after sleep onset |
| N1 | Light sleep |
| N2 | Moderate sleep |
| N3 | Deep sleep |
| REM | Rapid eye movement |
| EBE | Epoch-by-epoch |
| ICC | Intraclass correlation coefficient |
| LOA | Lower and upper limits of agreement |
| PPV | Positive predictive value |
| NPV | Negative predictive value |
References
- Zhai, H.; Yan, Y.; He, S.; Zhao, P.; Zhang, B. Evaluation of the Accuracy of Contactless Consumer Sleep-Tracking Devices Application in Human Experiment: A Systematic Review and Meta-Analysis. Sensors 2023, 23, 4842. [Google Scholar] [CrossRef]
- Haghayegh, S.; Khoshnevis, S.; Smolensky, M.H.; Diller, K.R.; Castriotta, R.J. Accuracy of Wristband Fitbit Models in Assessing Sleep: Systematic Review and Meta-Analysis. J. Med. Internet Res. 2019, 21, e16273. [Google Scholar] [CrossRef]
- Scott, H. Sleep and circadian wearable technologies: Considerations toward device validation and application. Sleep 2020, 43, zsaa163. [Google Scholar] [CrossRef]
- Menghini, L.; Cellini, N.; Goldstone, A.; Baker, F.C.; de Zambotti, M. A standardized framework for testing the performance of sleep-tracking technology: Step-by-step guidelines and open-source code. Sleep 2021, 44, zsaa170. [Google Scholar] [CrossRef]
- de Zambotti, M.; Menghini, L.; Grandner, M.A.; Redline, S.; Zhang, Y.; Wallace, M.L.; Buxton, O.M. Rigorous performance evaluation (previously, ?validation?) for informed use of new technologies for sleep health measurement. Sleep Health 2022, 8, 263–269. [Google Scholar] [CrossRef]
- Lee, X.K.; Chee, N.; Ong, J.L.; Teo, T.B.; van Rijn, E.; Lo, J.C.; Chee, M.W.L. Validation of a Consumer Sleep Wearable Device With Actigraphy and Polysomnography in Adolescents Across Sleep Opportunity Manipulations. J. Clin. Sleep Med. 2019, 15, 1337–1346. [Google Scholar] [CrossRef]
- Kahawage, P.; Jumabhoy, R.; Hamill, K.; de Zambotti, M.; Drummond, S.P.A. Validity, potential clinical utility, and comparison of consumer and research-grade activity trackers in Insomnia Disorder I: In-lab validation against polysomnography. J. Sleep Res. 2020, 29, e12931. [Google Scholar] [CrossRef]
- Chinoy, E.D.; Cuellar, J.A.; Huwa, K.E.; Jameson, J.T.; Watson, C.H.; Bessman, S.C.; Hirsch, D.A.; Cooper, A.D.; Drummond, S.P.A.; Markwald, R.R. Performance of seven consumer sleep-tracking devices compared with polysomnography. Sleep 2021, 44, zsaa291. [Google Scholar] [CrossRef] [PubMed]
- Chinoy, E.D.; Cuellar, J.A.; Jameson, J.T.; Markwald, R.R. Performance of Four Commercial Wearable Sleep-Tracking Devices Tested Under Unrestricted Conditions at Home in Healthy Young Adults. Nat. Sci. Sleep 2022, 14, 493–516. [Google Scholar] [CrossRef] [PubMed]
- Grandner, M.A.; Bromberg, Z.; Hadley, A.; Morrell, Z.; Graf, A.; Hutchison, S.; Freckleton, D. Performance of a multisensor smart ring to evaluate sleep: In-lab and home-based evaluation of generalized and personalized algorithms. Sleep 2023, 46, zsac152. [Google Scholar] [CrossRef]
- Zhang, Z.; Henzmann, S.; Hugli, G.; Qi, M.; Chen, W.; Lu, C.; Khatami, R. Validation of wearable sleep monitoring device based on cardiopulmonary coupling and accelerometer with comparison to polysomnography in adults. Proc. Eur. J. Neurol. 2018, 25, 385. [Google Scholar]
- Edouard, P.; Campo, D.; Bartet, P.; Yang, R.Y.; Bruyneel, M.; Roisman, G.; Escourrou, P. Validation of the Withings Sleep Analyzer, an under-the-mattress device for the detection of moderate-severe sleep apnea syndrome. J. Clin. Sleep Med. 2021, 17, 1217–1227. [Google Scholar] [CrossRef] [PubMed]
- O’Hare, E.; Flanagan, D.; Penzel, T.; Garcia, C.; Frohberg, D.; Heneghan, C. A comparison of radio-frequency biomotion sensors and actigraphy versus polysomnography for the assessment of sleep in normal subjects. Sleep Breath. 2014, 19, 91–98. [Google Scholar] [CrossRef]
- Hou, D.; Lin, C.; Lin, Y. Diurnal Circadian Lighting Accumulation Model: A Predictor of the Human Circadian Phase Shift Phenotype. Phenomics 2022, 2, 50–63. [Google Scholar] [CrossRef] [PubMed]
- Aries, M.B.C.; Fischl, G.; Lowden, A.; Beute, F. The relationship of light exposure to sleep outcomes among office workers. Part 1: Working in the office versus at home before and during the COVID-pandemic. Light. Res. Technol. 2022, 56, 113–125. [Google Scholar] [CrossRef]
- Scott, H.; Lechat, B.; Guyett, A.; Reynolds, A.C.; Lovato, N.; Naik, G.; Appleton, S.; Adams, R.; Escourrou, P.; Catcheside, P.; et al. Sleep Irregularity Is Associated With Hypertension: Findings From Over 2 Million Nights With a Large Global Population Sample. Hypertension 2023, 80, 1117–1126. [Google Scholar] [CrossRef]
- Hirata, T.; Kogure, M.; Tsuchiya, N.; Miyagawa, K.; Narita, A.; Nochioka, K.; Uruno, A.; Obara, T.; Nakamura, T.; Nakaya, N.; et al. Impacts of the urinary sodium-to-potassium ratio, sleep efficiency, and conventional risk factors on home hypertension in a general Japanese population. Hypertens. Res. 2021, 44, 858–865. [Google Scholar] [CrossRef]
- Driller, M.W.; Dunican, I.C.; Omond, S.E.T.; Boukhris, O.; Stevenson, S.; Lambing, K.; Bender, A.M. Pyjamas, Polysomnography and Professional Athletes: The Role of Sleep Tracking Technology in Sport. Sports 2023, 11, 14. [Google Scholar] [CrossRef]
- Edinborough, L.; Hill, J.; Jarvis, M.; Bruce-Low, S.; Pedlar, C.R. A bespoke sleep monitoring and sleep hygiene intervention improves sleep in an U18 professional football player: A case study. J. Sports Sci. 2023, 41, 350–357. [Google Scholar] [CrossRef]
- Power, C.J.; Fox, J.L.; Teramoto, M.; Scanlan, A.T. Sleep Patterns Fluctuate Following Training and Games across the Season in a Semi-Professional, Female Basketball Team. Brain Sci. 2023, 13, 238. [Google Scholar] [CrossRef]
- Depner, C.M.; Cheng, P.C.; Devine, J.K.; Khosla, S.; de Zambotti, M.; Robillard, R.; Vakulin, A.; Drummond, S.P.A. Wearable technologies for developing sleep and circadian biomarkers: A summary of workshop discussions. Sleep 2020, 43, zsz254. [Google Scholar] [CrossRef]
- Stone, J.D.; Rentz, L.E.; Forsey, J.; Ramadan, J.; Markwald, R.R.; Finomore, V.S., Jr.; Galster, S.M.; Rezai, A.; Hagen, J.A. Evaluations of Commercial Sleep Technologies for Objective Monitoring During Routine Sleeping Conditions. Nat. Sci. Sleep 2020, 12, 821–842. [Google Scholar] [CrossRef]
- Heglum, H.S.A.; Kallestad, H.; Vethe, D.; Langsrud, K.; Sand, T.; Engstrøm, M. Distinguishing sleep from wake with a radar sensor: A contact-free real-time sleep monitor. Sleep 2021, 44, zsab060. [Google Scholar] [CrossRef]
- Hendriks, M.M.S.; van Lotringen, J.H.; Vos-van der Hulst, M.; Keijsers, N.L.W. Bed Sensor Technology for Objective Sleep Monitoring Within the Clinical Rehabilitation Setting: Observational Feasibility Study. JMIR mHealth uHealth 2021, 9, e24339. [Google Scholar] [CrossRef]
- Nagatomo, K.; Masuyama, T.; Iizuka, Y.; Makino, J.; Shiotsuka, J.; Sanui, M. Validity of an under-mattress sensor for objective sleep measurement in critically ill patients: A prospective observational study. J. Intensive Care 2020, 8, 16. [Google Scholar] [CrossRef]
- Zhang, Z.; Liu, X. Effect of the sleep nursing intervention on sleep status and gross motor development of infants. Chin. J. Behav. Med. Brain Sci. 2019, 28, 881–886. [Google Scholar]
- Liang, S. The Contactless Sleep Monitor iSleep Achieved its Crowdfunding Goal in Just One Hour. Available online: https://tech.huanqiu.com/article/9CaKrnJFMWd (accessed on 22 October 2025).
- Isleep Non Contact Sleep Monitor. Available online: https://www.made-in-china.com/showroom/manshu0608/product-detailWvwxiducrPkD/China-Isleep-Non-Contact-Sleep-Monitor.html (accessed on 20 October 2025).
- Sleepace. Available online: http://webapi.test.sleepace.net/cn/mall.html (accessed on 20 October 2025).
- Dou, Y.; Xu, X.; Bo, H.; Xu, L. Application of Radio Frequency Micro-Power Radar in Intelligent Sleep Management. China Med. Devices 2016, 31, 16–20. [Google Scholar]
- Hedges, L.V. Distribution Theory for Glass’s Estimator of Effect Size and Related Estimators. J. Educ. Stat. 1981, 6, 107–128. [Google Scholar] [CrossRef]
- Tomczak, M.; Tomczak-Łukaszewska, E. The need to report effect size estimates revisited. An overview of some recommended measures of effect size. Trends Sport Sci. 2014, 21, 19–25. [Google Scholar]
- Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [PubMed]
- Toften, S.; Pallesen, S.; Hrozanova, M.; Moen, F.; Grønli, J. Validation of sleep stage classification using non-contact radar technology and machine learning (Somnofy®). Sleep Med. 2020, 75, 54–61. [Google Scholar] [CrossRef]
- Tuominen, J.; Peltola, K.; Saaresranta, T.; Valli, K. Sleep parameter assessment accuracy of a consumer home sleep monitoring ballistocardiograph beddit sleep tracker: A validation study. J. Clin. Sleep Med. 2019, 15, 483–487. [Google Scholar] [CrossRef]
- Pallin, M.; O’Hare, E.; Zaffaroni, A.; Boyle, P.; Fagan, C.; Kent, B.; Heneghan, C.; de Chazal, P.; McNicholas, W.T. Comparison of a novel non-contact biomotion sensor with wrist actigraphy in estimating sleep quality in patients with obstructive sleep apnoea. J. Sleep Res. 2014, 23, 475–484. [Google Scholar] [CrossRef] [PubMed]
- Chase, J.D.; Busa, M.A.; Staudenmayer, J.W.; Sirard, J.R. Sleep Measurement Using Wrist-Worn Accelerometer Data Compared with Polysomnography. Sensors 2022, 22, 5041. [Google Scholar] [CrossRef]
- Bonnar, D.; Lee, S.; Roane, B.M.; Blum, D.J.; Kahn, M.; Jang, E.; Dunican, I.C.; Gradisar, M.; Suh, S. Evaluation of a Brief Sleep Intervention Designed to Improve the Sleep, Mood, and Cognitive Performance of Esports Athletes. Int. J. Environ. Res. Public Health 2022, 19, 4146. [Google Scholar] [CrossRef] [PubMed]
- Fritz, H.; Kinney, K.A.; Wu, C.Y.; Schnyer, D.M.; Nagy, Z. Data fusion of mobile and environmental sensing devices to understand the effect of the indoor environment on measured and self-reported sleep quality. Build. Environ. 2022, 214, 108835. [Google Scholar] [CrossRef]
- Dergaa, I.; Ammar, A.; Souissi, A.; Fessi, M.S.; Trabelsi, K.; Glenn, J.M.; Ghram, A.; Taheri, M.; Irandoust, K.; Chtourou, H.; et al. COVID-19 lockdown: Impairments of objective measurements of selected physical activity, cardiorespiratory and sleep parameters in trained fitness coaches. EXCLI J. 2022, 21, 1084–1098. [Google Scholar] [CrossRef]
- Mac Carthaigh, S.; Perry, J.; Griffin, C. Do objective data support the claim that problematic smartphone use has a clinically meaningful impact upon adolescent sleep duration? Behav. Inf. Technol. 2022, 42, 2626–2638. [Google Scholar] [CrossRef]
- Ameen, M.S.; Cheung, L.M.; Hauser, T.; Hahn, M.A.; Schabus, M. About the Accuracy and Problems of Consumer Devices in the Assessment of Sleep. Sensors 2019, 19, 4160. [Google Scholar] [CrossRef]
- Miller, D.J.; Lastella, M.; Scanlan, A.T.; Bellenger, C.; Halson, S.L.; Roach, G.D.; Sargent, C. A validation study of the WHOOP strap against polysomnography to assess sleep. J. Sports Sci. 2020, 38, 2631–2636. [Google Scholar] [CrossRef]
- El-Amrawy, F.; Nounou, M.I. Are Currently Available Wearable Devices for Activity Tracking and Heart Rate Monitoring Accurate, Precise, and Medically Beneficial? Healthc. Inform. Res. 2015, 21, 315–320. [Google Scholar] [CrossRef] [PubMed]
- Lechat, B.; Naik, G.; Reynolds, A.; Aishah, A.; Scott, H.; Loffler, K.A.; Vakulin, A.; Escourrou, P.; McEvoy, R.D.; Adams, R.J.; et al. Multinight Prevalence, Variability, and Diagnostic Misclassification of Obstructive Sleep Apnea. Am. J. Respir. Crit. Care Med. 2022, 205, 563–569. [Google Scholar] [CrossRef] [PubMed]
- Goldstein, C. Current and Future Roles of Consumer Sleep Technologies in Sleep Medicine. Sleep Med. Clin. 2020, 15, 391–408. [Google Scholar] [CrossRef] [PubMed]
- Baumert, M.; Cowie, M.R.; Redline, S.; Mehra, R.; Arzt, M.; Pepin, J.L.; Linz, D. Sleep characterization with smart wearable devices: A call for standardization and consensus recommendations. Sleep 2022, 45, zsac183. [Google Scholar] [CrossRef]




| Outcomes | n | PSG Mean ± SD/ Med (IQR) | Device Mean ± SD/ Med (IQR) | Bias a | LOA b | t/w (p) c | Effect Size | ICC e [95%CI] p |
|---|---|---|---|---|---|---|---|---|
| TST (min) | ||||||||
| iSleep f | 16 | 438.66 ± 65.90 | 420.94 ± 60.93 | −17.72 | −96.20, 60.76 | 1.77 (0.10) | 0.28 | 0.78 [0.48–0.92] < 0.001 |
| Sleep Dot g | 19 | 400.42 ± 98.20 | 391.45 ± 98.16 | −8.97 | −98.93, 80.99 | 0.85 (0.41) | 0.09 | 0.89 [0.75–0.96] < 0.001 |
| Actiwatch h | 16 | 399.25 ± 101.30 | 401.47 ± 70.60 | 2.22 | −115.54, 119.98 | −0.15 (0.88) | −0.03 | 0.77 [0.46–0.92] < 0.001 |
| SE (%) | ||||||||
| iSleep | 16 | 87.37% (75.65%, 92.78%) | 85.14% ± 4.26% | 1.36% | −15.36%, 17.96% | −0.16 (0.88) d | −0.17 | 0.48 [−0.02–0.78] 0.03 |
| Sleep Dot | 19 | 84.40% (62.88%, 89.90%) | 82.48% (71.15%, 89.23%) | 1.92% | −18.80%, 22.64% | −0.44 (0.66) d | −0.14 | 0.71 [0.40–0.88] < 0.001 |
| Actiwatch | 16 | 76.31% ± 15.24% | 82.11% ± 8.66% | 5.80% | −20.58%, 32.18% | −1.72 (0.11) | −0.47 | 0.38 [−0.07–0.72] 0.051 |
| SOL (min) | ||||||||
| Sleep Dot | 19 | 30.20 (20.10, 66.70) | 49.00 (25.00, 66.00) | 5.46 | −57.91, 68.83 | −0.78 (0.44) d | −0.11 | 0.81 [0.57–0.92] < 0.001 |
| Actiwatch | 16 | 37.75 (19.80, 109.65) | 60.66 ± 41.65 | −4.71 | −83.07, 73.65 | −0.36 (0.72) d | 0.09 | 0.72 [0.36–0.89] 0.001 |
| WASO (min) | ||||||||
| Sleep Dot | 19 | 32.00 (18.10, 76.90) | 28.52 (16.00, 53.64) | −3.96 | −74.15, 66.23 | 0 (p > 0.99) d | 0.10 | 0.64 [0.27–0.84] 0.002 |
| Actiwatch | 16 | 33.70 (24.54, 70.13) | 25.00 (14.25, 28.50) | −18.75 | −78.92, 41.42 | −2.07 (0.04) d | 0.53 | 0.56 [0.11–0.82] 0.004 |
| Light Sleep (min) | ||||||||
| iSleep | 16 | 255.44 ± 59.94 | 236.00 ± 25.57 | −19.44 | −129.57, 90.69 | 1.38 (0.19) | 0.42 | 0.25 [−0.23–0.64] 0.16 |
| Sleep Dot | 19 | 224.18 ± 66.69 | 277.96 ± 75.38 | 53.78 | −71.35, 178.91 | −3.67 (0.002) | −0.76 | 0.47 [−0.01–0.77] 0.003 |
| Deep Sleep (min) | ||||||||
| iSleep | 16 | 41.09 ± 29.28 | 187.50 ± 50.75 | 146.41 | 44.65, 248.17 | −11.28 (<0.001) | −3.53 | 0.03 [−0.04–0.18] 0.20 |
| Sleep Dot | 19 | 39.32 ± 27.27 | 112.49 ± 44.31 | 73.17 | −15.83, 162.17 | −7.02 (<0.001) | −1.99 | 0.08 [−0.09–0.35] 0.156 |
| Device | Accuracy | Sensitivity | Specificity | PPV | NPV |
|---|---|---|---|---|---|
| Actiwatch Spectrum | 0.83 | 0.92 | 0.58 | 0.88 | 0.57 |
| iSleep S200G | 0.85 | 0.91 | 0.65 | 0.92 | 0.49 |
| Sleep Dot B501 | 0.88 | 0.94 | 0.68 | 0.91 | 0.74 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Zhai, H.; Yan, Y.; Gao, L.; He, S.; Dong, X.; Cheng, X.; Hu, T. Evaluating the Feasibility of Low-Cost, Contactless Consumer Sleep-Tracking Devices as Measurement Tools for Preliminary Sleep Research. Sensors 2026, 26, 2371. https://doi.org/10.3390/s26082371
Zhai H, Yan Y, Gao L, He S, Dong X, Cheng X, Hu T. Evaluating the Feasibility of Low-Cost, Contactless Consumer Sleep-Tracking Devices as Measurement Tools for Preliminary Sleep Research. Sensors. 2026; 26(8):2371. https://doi.org/10.3390/s26082371
Chicago/Turabian StyleZhai, Huifang, Yonghong Yan, Litao Gao, Siqi He, Xiaowan Dong, Xiang Cheng, and Tao Hu. 2026. "Evaluating the Feasibility of Low-Cost, Contactless Consumer Sleep-Tracking Devices as Measurement Tools for Preliminary Sleep Research" Sensors 26, no. 8: 2371. https://doi.org/10.3390/s26082371
APA StyleZhai, H., Yan, Y., Gao, L., He, S., Dong, X., Cheng, X., & Hu, T. (2026). Evaluating the Feasibility of Low-Cost, Contactless Consumer Sleep-Tracking Devices as Measurement Tools for Preliminary Sleep Research. Sensors, 26(8), 2371. https://doi.org/10.3390/s26082371

