A Comprehensive Review of Unobtrusive Biosensing in Intelligent Vehicles: Sensors, Algorithms, and Integration Challenges
Abstract
1. Introduction
2. Integrating Biosensors in Automotive Environments
Sensor Location | Article | Modality | Methodology and Results | Limitations |
---|---|---|---|---|
Steering Wheel | K. Futatsuyama et al. (2014) [37] |
|
|
|
B.G. Lee., et al. (2016) [38] |
|
| The ECG could only be acquired when both hands are on the steering wheel.
| |
Y.-J Choi et al. (2018) [39] |
|
|
| |
J.K. Park (2019) [40] |
|
|
| |
B. Babusiak et al. (2021) [53] |
|
|
| |
J.M. Warnecke, et al. (2022) [54] |
|
|
| |
Car seat | R. Fu & H. Wang (2014) [43] |
|
|
|
E. Schires, et al. (2018) [44] |
|
|
| |
L. Leicht, et al. (2018) [45] |
|
|
| |
D.U. Uguz, et al. (2020) [46] |
|
|
| |
C. Loss, et al. (2021) [49] |
|
|
| |
Seat belt | H. J. Baek, et al.(2009) [47] |
|
|
|
X. Ji, et al.(2022) [48] |
|
|
| |
Dashboard and Instrument Panel | Q. I. Zhang, et al. (2018) [51] |
|
|
|
F. Wang, et al. (2022) [50] |
|
|
|
2.1. Biopotential Sensors
2.1.1. Electrocardiogram (ECG)
2.1.2. Electromyography (EMG)
2.2. Optical Sensors
2.2.1. Photoplethysmography (PPG)
2.2.2. Pulse Oximetry
2.3. Electrical Sensors
2.3.1. Electrodermal Activity (EDA)
2.3.2. Electrical Bioimpedance (EBI)
2.4. Mechanical Sensors
2.4.1. Accelerometers
2.4.2. Strain and Piezoelectric Sensors
2.4.3. Ballistocardiography (BCG)
2.5. Non-Contact Sensors
2.5.1. Cameras
2.5.2. Radar
2.6. Emerging Biosensing Technologies
2.6.1. Electroencephalography (EEG)
2.6.2. Electrooculography (EOG)
2.6.3. Magnetic Impedance Monitoring (MIM)
2.6.4. Functional Near-Infrared Spectroscopy (fNIRS)
2.6.5. Chemical Sensors
2.6.6. Acoustic Sensors
2.6.7. Blood Pressure Sensors
3. Vehicle-Based Biosensing Applications
3.1. Detection of Heart Attack
3.2. Detection of Fatigue and Drowsiness
3.3. Detection of Stress and Emotional Driving
3.4. Detection of Dangerous Driving
3.5. Detection of Driver Distraction
3.6. Detection of Impaired Driving
4. Overview of Key Algorithms
4.1. Preprocessing
4.2. Feature Extraction
4.3. Classification and Prediction
4.4. Real-Time Monitoring
4.5. Multimodal Sensing and Contextual Data Integration with AI
5. Industrial Prototypes
5.1. Safety Enhancement Systems
5.2. Comfort and Wellness Optimization
5.3. Semi-Autonomous and Autonomous Driving Support
5.4. Future Insights
6. Discussion
6.1. Advancements in Wearable and In-Vehicle Health Monitoring Technologies
6.2. Autonomous Driving Integration
6.3. Vehicle Vibration and Driver Movement Cancellation
6.4. Enhanced Data Analysis Through AI
6.4.1. Federated Learning and Privacy
6.4.2. Enhanced Learning Approaches
6.4.3. Innovative Model Architectures
6.4.4. Adaptive Learning and Minimal Data Requirements
6.5. Privacy Concerns and Ethical Considerations
6.6. Risks of Misclassification and Engineering Responsibility
6.7. Database and Data Quality Concerns
7. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Miner, P.; Smith, B.M.; Jani, A.; McNeill, G.; Gathorne-Hardy, A. Car harm: A global review of automobility’s harm to people and the environment. J. Transp. Geogr. 2024, 115, 103817. [Google Scholar] [CrossRef]
- U.S. Department of Transportation. Distracted Driving in Fatal Crashes, 2017; Traffic Safety Facts Research Note. Report No. DOT HS 700; U.S. Department of Transportation: Washington, DC, USA, 2019; Volume 812.
- Pickrell, T.M.; Li, H.R. Traffic Safety Facts. 2016. Available online: https://www.nhtsa.gov/risky-driving/distracted-driving (accessed on 6 June 2024).
- WHO. World Health Statistics 2023: Monitoring Health for the SDGs, Sustainable Development Goals; World Health Organization: Geneva, Switzerland, 2023. [Google Scholar]
- WHO. Global Health Estimates 2015: Deaths by Cause, Age, Sex, by Country and by Region, 2000–2015; World Health Organization: Geneva, Switzerland, 2016. [Google Scholar]
- Singh, S. Critical Reasons for Crashes Investigated in the National Motor Vehicle Crash Causation Survey; Technical Report; National Center for Statistics and Analysis: Washington, DC, USA, 2015.
- Qu, Y.; Hu, H.; Liu, J.; Zhang, Z.; Li, Y.; Ge, X. Driver state monitoring technology for conditionally automated vehicles: Review and future prospects. IEEE Trans. Instrum. Meas. 2023, 72, 3000920. [Google Scholar] [CrossRef]
- Detjen, H.; Faltaous, S.; Pfleging, B.; Geisler, S.; Schneegass, S. How to increase automated vehicles’ acceptance through in-vehicle interaction design: A review. Int. J. Hum. Comput. Interact. 2021, 37, 308–330. [Google Scholar] [CrossRef]
- Meteier, Q.; Capallera, M.; Ruffieux, S.; Angelini, L.; Abou Khaled, O.; Mugellini, E.; Widmer, M.; Sonderegger, A. Classification of drivers’ workload using physiological signals in conditional automation. Front. Psychol. 2021, 12, 596038. [Google Scholar] [CrossRef]
- Puertas-Ramirez, D.; Serrano-Mamolar, A.; Martin Gomez, D.; Boticario, J.G. Should Conditional Self-Driving Cars Consider the State of the Human Inside the Vehicle? In Proceedings of the Adjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization, Utrecht, The Netherlands, 21–25 June 2021; pp. 137–141. [Google Scholar]
- Schmidt, E.A.; Schrauf, M.; Simon, M.; Fritzsche, M.; Buchner, A.; Kincses, W.E. Drivers’ misjudgement of vigilance state during prolonged monotonous daytime driving. Accid. Anal. Prev. 2009, 41, 1087–1093. [Google Scholar] [CrossRef]
- Healey, J.A.; Picard, R.W. Detecting stress during real-world driving tasks using physiological sensors. IEEE Trans. Intell. Transp. Syst. 2005, 6, 156–166. [Google Scholar] [CrossRef]
- Muñoz-Organero, M.; Corcoba-Magaña, V. Predicting upcoming values of stress while driving. IEEE Trans. Intell. Transp. Syst. 2016, 18, 1802–1811. [Google Scholar] [CrossRef]
- Choi, M.; Koo, G.; Seo, M.; Kim, S.W. Wearable device-based system to monitor a driver’s stress, fatigue, and drowsiness. IEEE Trans. Instrum. Meas. 2017, 67, 634–645. [Google Scholar] [CrossRef]
- Larue, G.S.; Rakotonirainy, A.; Pettitt, A.N. Predicting reduced driver alertness on monotonous highways. IEEE Pervasive Comput. 2015, 14, 78–85. [Google Scholar] [CrossRef]
- Chen, L.l.; Zhang, A.; Lou, X.G. Cross-subject driver status detection from physiological signals based on hybrid feature selection and transfer learning. Expert Syst. Appl. 2019, 137, 266–280. [Google Scholar] [CrossRef]
- Dehzangi, O.; Rajendra, V.; Taherisadr, M. Wearable driver distraction identification on-the-road via continuous decomposition of galvanic skin responses. Sensors 2018, 18, 503. [Google Scholar] [CrossRef] [PubMed]
- Yin, J.L.; Chen, B.H.; Lai, K.H.R.; Li, Y. Automatic dangerous driving intensity analysis for advanced driver assistance systems from multimodal driving signals. IEEE Sens. J. 2017, 18, 4785–4794. [Google Scholar] [CrossRef]
- Dong, Y.; Hu, Z.; Uchimura, K.; Murayama, N. Driver inattention monitoring system for intelligent vehicles: A review. IEEE Trans. Intell. Transp. Syst. 2010, 12, 596–614. [Google Scholar] [CrossRef]
- Takahashi, I.; Takaishi, T.; Yokoyama, K. Overcoming drowsiness by inducing cardiorespiratory phase synchronization. IEEE Trans. Intell. Transp. Syst. 2013, 15, 982–991. [Google Scholar] [CrossRef]
- Lin, C.T.; Wu, R.C.; Liang, S.F.; Chao, W.H.; Chen, Y.J.; Jung, T.P. EEG-based drowsiness estimation for safety driving using independent component analysis. IEEE Trans. Circuits Syst. I Regul. Pap. 2005, 52, 2726–2738. [Google Scholar]
- Mühlbacher-Karrer, S.; Mosa, A.H.; Faller, L.M.; Ali, M.; Hamid, R.; Zangl, H.; Kyamakya, K. A driver state detection system—Combining a capacitive hand detection sensor with physiological sensors. IEEE Trans. Instrum. Meas. 2017, 66, 624–636. [Google Scholar] [CrossRef]
- Gong, P.; Wang, P.; Zhou, Y.; Wen, X.; Zhang, D. TFAC-Net: A Temporal-Frequential Attentional Convolutional Network for Driver Drowsiness Recognition With Single-Channel EEG. IEEE Trans. Intell. Transp. Syst. 2024, 25, 1–13. [Google Scholar] [CrossRef]
- De Rosario, H.; Solaz, J.S.; Rodr íguez, N.; Bergasa, L.M. Controlled inducement and measurement of drowsiness in a driving simulator. IET Intell. Transp. Syst. 2010, 4, 280–288. [Google Scholar] [CrossRef]
- Hostens, I.; Ramon, H. Assessment of muscle fatigue in low level monotonous task performance during car driving. J. Electromyogr. Kinesiol. 2005, 15, 266–274. [Google Scholar] [CrossRef]
- Elgendi, M.; Menon, C. Machine Learning Ranks ECG as an Optimal Wearable Biosignal for Assessing Driving Stress. IEEE Access 2020, 8, 34362–34374. [Google Scholar] [CrossRef]
- Lee, H.; Lee, J.; Shin, M. Using wearable ECG/PPG sensors for driver drowsiness detection based on distinguishable pattern of recurrence plots. Electronics 2019, 8, 192. [Google Scholar] [CrossRef]
- Walter, M.; Eilebrecht, B.; Wartzek, T.; Leonhardt, S. The smart car seat: Personalized monitoring of vital signs in automotive applications. Pers. Ubiquitous Comput. 2011, 15, 707–715. [Google Scholar] [CrossRef]
- Amidei, A.; Rapa, P.M.; Tagliavini, G.; Rabbeni, R.; Benini, L.; Pavan, P.; Benatti, S. Unobtrusive Multimodal Monitoring of Physiological Signals for Driver State Analysis. IEEE Sens. J. 2024, 25, 7809–7818. [Google Scholar] [CrossRef]
- Giusti, A.; Zocchi, C.; Rovetta, A. A noninvasive system for evaluating driver vigilance level examining both physiological and mechanical data. IEEE Trans. Intell. Transp. Syst. 2009, 10, 127–134. [Google Scholar] [CrossRef]
- Panula, T.; Sirkiä, J.P.; Wong, D.; Kaisti, M. Advances in Non-Invasive Blood Pressure Measurement Techniques. IEEE Rev. Biomed. Eng. 2023, 16, 424–438. [Google Scholar] [CrossRef]
- Lanatà, A.; Valenza, G.; Greco, A.; Gentili, C.; Bartolozzi, R.; Bucchi, F.; Frendo, F.; Scilingo, E.P. How the autonomic nervous system and driving style change with incremental stressing conditions during simulated driving. IEEE Trans. Intell. Transp. Syst. 2014, 16, 1505–1517. [Google Scholar] [CrossRef]
- Leonhardt, S.; Leicht, L.; Teichmann, D. Unobtrusive vital sign monitoring in automotive environments—A review. Sensors 2018, 18, 3080. [Google Scholar] [CrossRef]
- Brüser, C.; Antink, C.H.; Wartzek, T.; Walter, M.; Leonhardt, S. Ambient and unobtrusive cardiorespiratory monitoring techniques. IEEE Rev. Biomed. Eng. 2015, 8, 30–43. [Google Scholar] [CrossRef]
- Naziyok, T.P.; Zeleke, A.A.; Röhrig, R. Contactless patient monitoring for general wards: A systematic technology review. In Exploring Complexity in Health: An Interdisciplinary Systems Approach; IOS Press: Amsterdam, The Netherlands, 2016; pp. 707–711. [Google Scholar]
- Zaunseder, S.; Henning, A.; Wedekind, D.; Trumpp, A.; Malberg, H. Unobtrusive Acquisition of Cardiorespiratory Signals: Available Techniques and Perspectives for Sleep Medicine 2017. Available online: https://opus.bibliothek.uni-augsburg.de/opus4/files/99853/99853.pdf (accessed on 6 June 2024).
- Futatsuyama, K.; Kawachi, T.; Nakagawa, T. Cuffless blood pressure monitoring using steering wheel sensor system. Biomed. Eng. 2014, 52, OS-67–OS-68. [Google Scholar]
- Lee, B.G.; Chung, W.Y. Driver alertness monitoring using fusion of facial features and bio-signals. IEEE Sens. J. 2012, 12, 2416–2422. [Google Scholar] [CrossRef]
- Choi, Y.J.; Lee, J.Y.; Kong, S.H. Driver ECG measuring system with a conductive fabric-based dry electrode. IEEE Access 2017, 6, 415–427. [Google Scholar] [CrossRef]
- Park, J.K.; Hong, Y.; Lee, H.; Jang, C.; Yun, G.H.; Lee, H.J.; Yook, J.G. Noncontact RF vital sign sensor for continuous monitoring of driver status. IEEE Trans. Biomed. Circuits Syst. 2019, 13, 493–502. [Google Scholar] [CrossRef] [PubMed]
- Jung, S.J.; Shin, H.S.; Chung, W.Y. Driver fatigue and drowsiness monitoring system with embedded electrocardiogram sensor on steering wheel. IET Intell. Transp. Syst. 2014, 8, 43–50. [Google Scholar] [CrossRef]
- Lee, B.G.; Park, J.H.; Pu, C.C.; Chung, W.Y. Smartwatch-based driver vigilance indicator with kernel-fuzzy-C-means-wavelet method. IEEE Sens. J. 2015, 16, 242–253. [Google Scholar] [CrossRef]
- Fu, R.; Wang, H. Detection of driving fatigue by using noncontact EMG and ECG signals measurement system. Int. J. Neural Syst. 2014, 24, 1450006. [Google Scholar] [CrossRef]
- Schires, E.; Georgiou, P.; Lande, T.S. Vital sign monitoring through the back using an UWB impulse radar with body coupled antennas. IEEE Trans. Biomed. Circuits Syst. 2018, 12, 292–302. [Google Scholar] [CrossRef]
- Leicht, L.; Skobel, E.; Knackstedt, C.; Mathissen, M.; Sitter, A.; Wartzek, T.; Möhler, W.; Reith, S.; Leonhardt, S.; Teichmann, D. Capacitive ECG monitoring in cardiac patients during simulated driving. IEEE Trans. Biomed. Eng. 2018, 66, 749–758. [Google Scholar] [CrossRef]
- Uguz, D.U.; Dettori, R.; Napp, A.; Walter, M.; Marx, N.; Leonhardt, S.; Hoog Antink, C. Car seats with capacitive ECG electrodes can detect cardiac pacemaker spikes. Sensors 2020, 20, 6288. [Google Scholar] [CrossRef]
- Baek, H.J.; Lee, H.B.; Kim, J.S.; Choi, J.M.; Kim, K.K.; Park, K.S. Nonintrusive biological signal monitoring in a car to evaluate a driver’s stress and health state. Telemed. E-Health 2009, 15, 182–189. [Google Scholar] [CrossRef]
- Ji, X.; Rao, Z.; Zhang, W.; Liu, C.; Wang, Z.; Zhang, S.; Zhang, B.; Hu, M.; Servati, P.; Xiao, X. Airline Point-of-Care System on Seat Belt for Hybrid Physiological Signal Monitoring. Micromachines 2022, 13, 1880. [Google Scholar] [CrossRef]
- Loss, C.; Gouveia, C.; Salvado, R.; Pinho, P.; Vieira, J. Textile antenna for bio-radar embedded in a car seat. Materials 2021, 14, 213. [Google Scholar] [CrossRef] [PubMed]
- Wang, F.; Zeng, X.; Wu, C.; Wang, B.; Liu, K.R. Driver vital signs monitoring using millimeter wave radio. IEEE Internet Things J. 2021, 9, 11283–11298. [Google Scholar] [CrossRef]
- Zhang, Q.; Zhou, Y.; Song, S.; Liang, G.; Ni, H. Heart rate extraction based on near-infrared camera: Towards driver state monitoring. IEEE Access 2018, 6, 33076–33087. [Google Scholar] [CrossRef]
- Sun, Y.; Yu, X. An innovative nonintrusive driver assistance system for vital signal monitoring. IEEE J. Biomed. Health Inform. 2014, 18, 1932–1939. [Google Scholar] [CrossRef] [PubMed]
- Babusiak, B.; Hajducik, A.; Medvecky, S.; Lukac, M.; Klarak, J. Design of smart steering wheel for unobtrusive health and drowsiness monitoring. Sensors 2021, 21, 5285. [Google Scholar] [CrossRef] [PubMed]
- Warnecke, J.M.; Ganapathy, N.; Koch, E.; Dietzel, A.; Flormann, M.; Henze, R.; Deserno, T.M. Printed and flexible ECG electrodes attached to the steering wheel for continuous health monitoring during driving. Sensors 2022, 22, 4198. [Google Scholar] [CrossRef]
- Hasan, K.; Ebrahim, M.P.; Xu, H.; Yuce, M.R. Analysis of Spectral Estimation Algorithms for Accurate Heart Rate and Respiration Rate Estimation Using an Ultra-Wideband Radar Sensor. IEEE Rev. Biomed. Eng. 2024, 17, 297–309. [Google Scholar] [CrossRef]
- Sörnmo, L.; Bailón, R.; Laguna, P. Spectral Analysis of Heart Rate Variability in Time-Varying Conditions and in the Presence of Confounding Factors. IEEE Rev. Biomed. Eng. 2024, 17, 322–341. [Google Scholar] [CrossRef]
- Lee, C.H.; Kim, S.H. ECG Measurement System for Vehicle Implementation and Heart Disease Classification Using Machine Learning. IEEE Access 2023, 11, 17968–17982. [Google Scholar] [CrossRef]
- Xiong, H.; Yan, Y.; Sun, L.; Liu, J.; Han, Y.; Xu, Y. Detection of driver drowsiness level using a hybrid learning model based on ECG signals. Biomed. Eng./Biomed. Tech. 2024, 69, 151–165. [Google Scholar] [CrossRef]
- Zander, T.O.; Lehne, M.; Ihme, K.; Jatzev, S.; Correia, J.; Kothe, C.; Picht, B.; Nijboer, F. A dry EEG-system for scientific research and brain–computer interfaces. Front. Neurosci. 2011, 5, 53. [Google Scholar] [CrossRef] [PubMed]
- Chi, Y.M.; Jung, T.P.; Cauwenberghs, G. Dry-contact and noncontact biopotential electrodes: Methodological review. IEEE Rev. Biomed. Eng. 2010, 3, 106–119. [Google Scholar] [CrossRef] [PubMed]
- Meziane, N.; Webster, J.; Attari, M.; Nimunkar, A. Dry electrodes for electrocardiography. Physiol. Meas. 2013, 34, R47. [Google Scholar] [CrossRef] [PubMed]
- Sukumar, N.; Sivashankar, B.; Sumathi, P.; Maurya, O.P. Physiological and Physical Sensors for Stress Level, Drowsiness Detection, and Behaviour Analysis. IEEE Trans. Consum. Electron. 2024, 70, 656–668. [Google Scholar] [CrossRef]
- Choi, Y.; Han, S.I.; Kong, S.H.; Ko, H. Driver status monitoring systems for smart vehicles using physiological sensors: A safety enhancement system from automobile manufacturers. IEEE Signal Process. Mag. 2016, 33, 22–34. [Google Scholar] [CrossRef]
- Lu, L.; Zhu, T.; Morelli, D.; Creagh, A.; Liu, Z.; Yang, J.; Liu, F.; Zhang, Y.T.; Clifton, D.A. Uncertainties in the Analysis of Heart Rate Variability: A Systematic Review. IEEE Rev. Biomed. Eng. 2023, 17, 180–196. [Google Scholar] [CrossRef]
- Yin, L.; Zhang, Z.; Wu, M.; Wang, Z.; Ma, C.; Zhou, S.; Yang, J. Adaptive parallel filter method for active cancellation of road noise inside vehicles. Mech. Syst. Signal Process. 2023, 193, 110274. [Google Scholar] [CrossRef]
- Nacpil, E.J.C.; Wang, Z.; Nakano, K. Application of physiological sensors for personalization in semi-autonomous driving: A review. IEEE Sens. J. 2021, 21, 19662–19674. [Google Scholar] [CrossRef]
- Nacpil, E.J.C.; Nakano, K. Surface electromyography-controlled automobile steering assistance. Sensors 2020, 20, 809. [Google Scholar] [CrossRef]
- Zheng, R.; Yamabe, S.; Nakano, K.; Suda, Y. Biosignal analysis to assess mental stress in automatic driving of trucks: Palmar perspiration and masseter electromyography. Sensors 2015, 15, 5136–5150. [Google Scholar] [CrossRef]
- Zhenhai, G. The driver’s steering feel assessment using EEG and EMG signals. NeuroQuantology 2018, 16, 6–13. [Google Scholar] [CrossRef]
- Lee, J.; Matsumura, K.; Yamakoshi, K.i.; Rolfe, P.; Tanaka, S.; Yamakoshi, T. Comparison between red, green and blue light reflection photoplethysmography for heart rate monitoring during motion. In Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan, 3–7 July 2013. [Google Scholar] [CrossRef]
- Dobbins, C.; Fairclough, S. Signal processing of multimodal mobile lifelogging data towards detecting stress in real-world driving. IEEE Trans. Mob. Comput. 2018, 18, 632–644. [Google Scholar] [CrossRef]
- Chan, E.D.; Chan, M.M.; Chan, M.M. Pulse oximetry: Understanding its basic principles facilitates appreciation of its limitations. Respir. Med. 2013, 107, 789–799. [Google Scholar] [CrossRef] [PubMed]
- Chen, L.l.; Zhao, Y.; Ye, P.F.; Zhang, J.; Zou, J.Z. Detecting driving stress in physiological signals based on multimodal feature analysis and kernel classifiers. Expert Syst. Appl. 2017, 85, 279–291. [Google Scholar] [CrossRef]
- Cheng, C.Y.; Shu, W.; Tsen, H.P. Exploring cognitive distraction of galvanic skin response while driving: An artificial intelligence modeling. J. Adv. Inf. Technol. 2020, 11, 35–39. [Google Scholar] [CrossRef]
- Zontone, P.; Affanni, A.; Bernardini, R.; Piras, A.; Rinaldo, R.; Formaggia, F.; Minen, D.; Minen, M.; Savorgnan, C. Car driver’s sympathetic reaction detection through electrodermal activity and electrocardiogram measurements. IEEE Trans. Biomed. Eng. 2020, 67, 3413–3424. [Google Scholar] [CrossRef]
- Macías, R.M.; González, M.Á.G.; Castro, J.R.; Bardia, R.B.; Chimeno, M.F. Contactless Electrical Bioimpedance System for Monitoring Ventilation-A Biodevice for Vehicle Environment. In Proceedings of the International Conference on Biomedical Electronics and Devices, Barcelona, Spain, 11–14 February 2013; Volume 2, pp. 14–20. [Google Scholar]
- Hosseini, M.; de Zambotti, M.; Baker, F.C.; Forouzanfar, M. Multistream lstm for artifact detection in impedance cardiography. IEEE Sens. Lett. 2025, 9, 6005404. [Google Scholar] [CrossRef]
- Wang, J.; Warnecke, J.M.; Deserno, T.M. In-Vehicle Respiratory Rate Estimation Using Accelerometers. In Proceedings of the pHealth, Genoa, Italy, 10–12 June 2019; pp. 97–102. [Google Scholar]
- Arakawa, T. A review of heartbeat detection systems for automotive applications. Sensors 2021, 21, 6112. [Google Scholar] [CrossRef]
- Romano, C.; Schena, E.; Formica, D.; Massaroni, C. Comparison between chest-worn accelerometer and gyroscope performance for heart rate and respiratory rate monitoring. Biosensors 2022, 12, 834. [Google Scholar] [CrossRef]
- Yadav, S.; Saha, S.K.; Kar, R.; Mandal, D. Optimized adaptive noise canceller for denoising cardiovascular signal using SOS algorithm. Biomed. Signal Process. Control. 2021, 69, 102830. [Google Scholar] [CrossRef]
- Castro, I.D.; Mercuri, M.; Patel, A.; Puers, R.; Van Hoof, C.; Torfs, T. Physiological driver monitoring using capacitively coupled and radar sensors. Appl. Sci. 2019, 9, 3994. [Google Scholar] [CrossRef]
- Allataifeh, A.; Al Ahmad, M. Simultaneous piezoelectric noninvasive detection of multiple vital signs. Sci. Rep. 2020, 10, 416. [Google Scholar] [CrossRef] [PubMed]
- Mizuno, N.; Manh, H.N. An Adaptive Filtering Technique for Driver’s Heart Rate Monitoring through Vibration Signal by Seat-Embedded Piezoelectric Sensors. In Proceedings of the International Workshop on Adaptation and Learning in Control and Signal Processing, Caen, France, 3–5 July 2013. [Google Scholar]
- Cacioppo, J.T.; Tassinary, L.G.; Berntson, G. Handbook of Psychophysiology; Cambridge University Press: Cambridge, UK, 2007. [Google Scholar]
- Okamoto, Y.; Nguyen, T.V.; Takahashi, H.; Takei, Y.; Okada, H.; Ichiki, M. Highly sensitive low-frequency-detectable acoustic sensor using a piezoresistive cantilever for health monitoring applications. Sci. Rep. 2023, 13, 6503. [Google Scholar] [CrossRef] [PubMed]
- Meteier, Q.; Kindt, M.; Angelini, L.; Abou Khaled, O.; Mugellini, E. Non-intrusive contact respiratory sensor for vehicles. Sensors 2022, 22, 880. [Google Scholar] [CrossRef]
- Sidikova, M.; Martinek, R.; Kawala-Sterniuk, A.; Ladrova, M.; Jaros, R.; Danys, L.; Simonik, P. Vital sign monitoring in car seats based on electrocardiography, ballistocardiography and seismocardiography: A review. Sensors 2020, 20, 5699. [Google Scholar] [CrossRef]
- Wusk, G.; Gabler, H. Non-invasive detection of respiration and heart rate with a vehicle seat sensor. Sensors 2018, 18, 1463. [Google Scholar] [CrossRef]
- Nowara, E.M.; Marks, T.K.; Mansour, H.; Veeraraghavan, A. Near-infrared imaging photoplethysmography during driving. IEEE Trans. Intell. Transp. Syst. 2020, 23, 3589–3600. [Google Scholar] [CrossRef]
- Xu, M.; Zeng, G.; Song, Y.; Cao, Y.; Liu, Z.; He, X. Ivrr-PPG: An Illumination Variation Robust Remote-PPG Algorithm for Monitoring Heart Rate of Drivers. IEEE Trans. Instrum. Meas. 2023, 72, 3515510. [Google Scholar] [CrossRef]
- Huang, P.W.; Wu, B.J.; Wu, B.F. A Heart Rate Monitoring Framework for Real-World Drivers Using Remote Photoplethysmography. IEEE J. Biomed. Health Inform. 2021, 25, 1397–1408. [Google Scholar] [CrossRef]
- Gong, Z.; Yang, X.; Song, R.; Han, X.; Ren, C.; Shi, H.; Niu, J.; Li, W. Heart Rate Estimation in Driver Monitoring System Using Quality-Guided Spectrum Peak Screening. IEEE Trans. Instrum. Meas. 2024, 73, 5008214. [Google Scholar] [CrossRef]
- Gücüyener, İ. A novel design of heartbeat monitoring system for the motor vehicle. Int. J. Inj. Control Saf. Promot. 2016, 23, 395–399. [Google Scholar] [CrossRef] [PubMed]
- Kim, D.; Park, H.; Kim, T.; Kim, W.; Paik, J. Real-time driver monitoring system with facial landmark-based eye closure detection and head pose recognition. Sci. Rep. 2023, 13, 18264. [Google Scholar] [CrossRef] [PubMed]
- Guo, K.; Zhai, T.; Purushothama, M.H.; Dobre, A.; Meah, S.; Pashollari, E.; Vaish, A.; DeWilde, C.; Islam, M.N. Contactless Vital Sign Monitoring System for In-Vehicle Driver Monitoring Using a Near-Infrared Time-of-Flight Camera. Appl. Sci. 2022, 12, 4416. [Google Scholar] [CrossRef]
- Kajiwara, S. Driver-Condition Detection Using a Thermal Imaging Camera and Neural Networks. Int. J. Automot. Technol. 2021, 22, 1505–1515. [Google Scholar] [CrossRef]
- Le, A.S.; Xuan, N.H.; Aoki, H. Assessment of senior drivers’ internal state in the event of simulated unexpected vehicle motion based on near-infrared spectroscopy. Traffic Inj. Prev. 2022, 23, 221–225. [Google Scholar] [CrossRef]
- Shi, D.; Tang, H. Research on Safe Driving Evaluation Method Based on Machine Vision and Long Short-Term Memory Network. J. Electr. Comput. Eng. 2021, 2021, 9955079. [Google Scholar] [CrossRef]
- Zhang, Y.; Li, T.; Li, C.; Zhou, X. A Novel Driver Distraction Behavior Detection Method Based on Self-Supervised Learning With Masked Image Modeling. IEEE Internet Things J. 2024, 11, 6056–6071. [Google Scholar] [CrossRef]
- Guo, Z.; Liu, Q.; Zhang, L.; Li, Z.; Li, G. L-TLA: A Lightweight Driver Distraction Detection Method Based on Three-Level Attention Mechanisms. IEEE Trans. Reliab. 2024, 73, 1731–1742. [Google Scholar] [CrossRef]
- Duan, C.; Gong, Y.; Liao, J.; Zhang, M.; Cao, L. FRNet: DCNN for Real-Time Distracted Driving Detection Toward Embedded Deployment. IEEE Trans. Intell. Transp. Syst. 2023, 24, 9835–9848. [Google Scholar] [CrossRef]
- Hasan, M.Z.; Chen, J.; Wang, J.; Rahman, M.S.; Joshi, A.; Velipasalar, S.; Hegde, C.; Sharma, A.; Sarkar, S. Vision-Language Models Can Identify Distracted Driver Behavior From Naturalistic Videos. IEEE Trans. Intell. Transp. Syst. 2024, 25, 11602–11616. [Google Scholar] [CrossRef]
- Zhou, Z.; Fang, Z.; Wang, J.; Chen, J.; Li, H.; Han, L.; Zhang, Z. Driver vigilance detection based on deep learning with fused thermal image information for public transportation. Eng. Appl. Artif. Intell. 2023, 124, 106604. [Google Scholar] [CrossRef]
- Forouzanfar, M.; Mabrouk, M.; Rajan, S.; Bolic, M.; Dajani, H.R.; Groza, V.Z. Event recognition for contactless activity monitoring using phase-modulated continuous wave radar. IEEE Trans. Biomed. Eng. 2016, 64, 479–491. [Google Scholar] [CrossRef] [PubMed]
- Mabrouk, M.; Rajan, S.; Bolic, M.; Forouzanfar, M.; Dajani, H.R.; Batkin, I. Human breathing rate estimation from radar returns using harmonically related filters. J. Sens. 2016, 2016, 9891852. [Google Scholar] [CrossRef]
- Yang, X.; Ding, Y.; Zhang, X.; Zhang, L. Spatial-temporal-circulated GLCM and physiological features for in-vehicle people sensing based on IR-UWB radar. IEEE Trans. Instrum. Meas. 2022, 71, 1–13. [Google Scholar] [CrossRef]
- Beltrán, E.T.M.; Pérez, M.Q.; Bernal, S.L.; Pérez, G.M.; Celdrán, A.H. SAFECAR: A Brain–Computer Interface and intelligent framework to detect drivers’ distractions. Expert Syst. Appl. 2022, 203, 117402. [Google Scholar] [CrossRef]
- Papadelis, C.; Chen, Z.; Kourtidou-Papadeli, C.; Bamidis, P.D.; Chouvarda, I.; Bekiaris, E.; Maglaveras, N. Monitoring sleepiness with on-board electrophysiological recordings for preventing sleep-deprived traffic accidents. Clin. Neurophysiol. 2007, 118, 1906–1922. [Google Scholar] [CrossRef]
- Lee, B.G.; Lee, B.L.; Chung, W.Y. Mobile healthcare for automatic driving sleep-onset detection using wavelet-based EEG and respiration signals. Sensors 2014, 14, 17915–17936. [Google Scholar] [CrossRef]
- Krigolson, O.E.; Williams, C.C.; Norton, A.; Hassall, C.D.; Colino, F.L. Choosing MUSE: Validation of a Low-Cost, Portable EEG System for ERP Research. Front. Neurosci. 2017, 11, 109. [Google Scholar] [CrossRef]
- Knierim, M.T.; Berger, C.; Reali, P. Open-source concealed EEG data collection for Brain-computer-interfaces - neural observation through OpenBCI amplifiers with around-the-ear cEEGrid electrodes. Brain-Comput. Interfaces 2021, 8, 161–179. [Google Scholar] [CrossRef]
- This Car Headrest Monitors Your Brain Waves to Stop You Falling Asleep at the Wheel. Available online: https://www.wired.com/story/brainwaves-stop-car-driver-tired/ (accessed on 6 June 2024).
- Santos, R.; Santos, N.; Jorge, P.M.; Abrantes, A. Eye gaze as a human-computer interface. Procedia Technol. 2014, 17, 376–383. [Google Scholar] [CrossRef]
- Zhu, X.; Zheng, W.L.; Lu, B.L.; Chen, X.; Chen, S.; Wang, C. EOG-based drowsiness detection using convolutional neural networks. In Proceedings of the 2014 International Joint Conference on Neural Networks (IJCNN), Beijing, China, 6–11 July 2014; pp. 128–134. [Google Scholar]
- Yang, B.; Zheng, R.; Yin, Y.; Yamabe, S.; Nakano, K. Analysis of influence on driver behaviour while using in-vehicle traffic lights with application of head-up display. IET Intell. Transp. Syst. 2016, 10, 347–353. [Google Scholar] [CrossRef]
- Morris, T.; Miller, J.C. Electrooculographic and performance indices of fatigue during simulated flight. Biol. Psychol. 1996, 42, 343–360. [Google Scholar] [CrossRef] [PubMed]
- Linschmann, O.; Uguz, D.U.; Romanski, B.; Baarlink, I.; Gunaratne, P.; Leonhardt, S.; Walter, M.; Lueken, M. A portable multi-modal cushion for continuous monitoring of a driver’s vital signs. Sensors 2023, 23, 4002. [Google Scholar] [CrossRef] [PubMed]
- Zeng, L.; Zhou, K.; Han, Q.; Wang, Y.; Guo, G.; Ye, L. An fNIRS labeling image feature-based customized driving fatigue detection method. J. Ambient Intell. Humaniz. Comput. 2022, 14, 12493–12509. [Google Scholar] [CrossRef]
- Perello-March, J.; Burns, C.G.; Woodman, R.; Birrell, S.; Elliott, M.T. How Do Drivers Perceive Risks During Automated Driving Scenarios? An fNIRS Neuroimaging Study. Hum. Factors J. Hum. Factors Ergon. Soc. 2023, 66, 2244–2263. [Google Scholar] [CrossRef]
- Balters, S.; Baker, J.M.; Geeseman, J.W.; Reiss, A.L. A methodological review of fNIRS in driving research: Relevance to the future of autonomous vehicles. Front. Hum. Neurosci. 2021, 15, 637589. [Google Scholar] [CrossRef]
- Ren, Z.; Guo, F.; Li, M.; Lyu, W.; Duffy, V.G. The effect of in-vehicle agent embodiment on drivers’ perceived usability and cognitive workload: Evidence from subjective reporting, ECG, and fNIRS. Hum. Factors Ergon. Manuf. Serv. Ind. 2024, 34, 325–337. [Google Scholar] [CrossRef]
- Wang, H.; Zhang, X.; Li, J.; Li, B.; Gao, X.; Hao, Z.; Fu, J.; Zhou, Z.; Atia, M. Driving risk cognition of passengers in highly automated driving based on the prefrontal cortex activity via fNIRS. Sci. Rep. 2023, 13, 15839. [Google Scholar] [CrossRef]
- Flanagan, K.; Saikia, M.J. Consumer-Grade Electroencephalogram and Functional Near-Infrared Spectroscopy Neurofeedback Technologies for Mental Health and Wellbeing. Sensors 2023, 23, 8482. [Google Scholar] [CrossRef]
- Dotoli, M.; Rocca, R.; Giuliano, M.; Nicol, G.; Parussa, F.; Baricco, M.; Ferrari, A.M.; Nervi, C.; Sgroi, M.F. A review of mechanical and chemical sensors for automotive Li-ion battery systems. Sensors 2022, 22, 1763. [Google Scholar] [CrossRef]
- Zosel, J.; De_Blauwe, F.; Guth, U. Chemical sensors for automotive application. Adv. Eng. Mater. 2001, 3, 797–801. [Google Scholar] [CrossRef]
- Schulman, C.I.; Killawala, C.; Bakali, U.; Baum, J.; Dikici, E.; Miller, K.; Withum, K.; Deo, S.; Bachas, L.; Daunert, S. Efficacy and feasibility of a breath sensor for detecting driver fatigue and drowsiness. Traffic Inj. Prev. 2024, 25, S257–S267. [Google Scholar] [CrossRef]
- Melders, L.; Smigins, R.; Birkavs, A. Recent Advances in Vehicle Driver Health Monitoring Systems. Sensors 2025, 25, 1812. [Google Scholar] [CrossRef] [PubMed]
- Gao, X.; Ma, K.; Yang, H.; Wang, K.; Fu, B.; Zhu, Y.; She, X.; Cui, B. A rapid, non-invasive method for fatigue detection based on voice information. Front. Cell Dev. Biol. 2022, 10, 994001. [Google Scholar] [CrossRef] [PubMed]
- Farzam, R.; Azad, M.H.; Moghaddam, H.A.; Forouzanfar, M. Beat-to-beat oscillometric blood pressure estimation: A bayesian approach with system identification. IEEE Trans. Biomed. Eng. 2024, 72, 619–629. [Google Scholar] [CrossRef]
- Shaikh, M.R.; Forouzanfar, M. Dual-stream CNN-LSTM architecture for cuffless blood pressure estimation from PPG and ECG signals: A PulseDB study. IEEE Sens. J. 2024, 25, 4006–4014. [Google Scholar] [CrossRef]
- Meusel, M.; Wegerich, P.; Bode, B.; Stawschenko, E.; Kusche-Vihrog, K.; Hellbrück, H.; Gehring, H. Measurement of blood pressure by ultrasound—The applicability of devices, algorithms and a view in local hemodynamics. Diagnostics 2021, 11, 2255. [Google Scholar] [CrossRef]
- Chowdhury, M.E.; Alzoubi, K.; Khandakar, A.; Khallifa, R.; Abouhasera, R.; Koubaa, S.; Ahmed, R.; Hasan, A. Wearable real-time heart attack detection and warning system to reduce road accidents. Sensors 2019, 19, 2780. [Google Scholar] [CrossRef]
- Wang, F.; Yao, W.; Lu, B.; Fu, R. ECG-Based Real-Time Drivers’ Fatigue Detection Using A Novel Elastic Dry Electrode. IEEE Trans. Instrum. Meas. 2023, 73, 1–16. [Google Scholar] [CrossRef]
- Gwak, J.; Hirao, A.; Shino, M. An investigation of early detection of driver drowsiness using ensemble machine learning based on hybrid sensing. Appl. Sci. 2020, 10, 2890. [Google Scholar] [CrossRef]
- Lee, D.S.; Chong, T.W.; Lee, B.G. Stress events detection of driver by wearable glove system. IEEE Sens. J. 2016, 17, 194–204. [Google Scholar] [CrossRef]
- Halim, Z.; Rehan, M. On identification of driving-induced stress using electroencephalogram signals: A framework based on wearable safety-critical scheme and machine learning. Inf. Fusion 2020, 53, 66–79. [Google Scholar] [CrossRef]
- Yan, F.; Liu, M.; Ding, C.; Wang, Y.; Yan, L. Driving style recognition based on electroencephalography data from a simulated driving experiment. Front. Psychol. 2019, 10, 1254. [Google Scholar] [CrossRef] [PubMed]
- Wu, C.K.; Tsang, K.F.; Chi, H.R.; Hung, F.H. A precise drunk driving detection using weighted kernel based on electrocardiogram. Sensors 2016, 16, 659. [Google Scholar] [CrossRef]
- Wiles, R.; Kinmonth, A.L. Patients’ understandings of heart attack: Implications for prevention of recurrence. Patient Educ. Couns. 2001, 44, 161–169. [Google Scholar] [CrossRef]
- Abu-Faraj, Z.O.; Al Chamaa, W.; Al Hadchiti, A.; Sraj, Y.; Tannous, J. Design and development of a heart-attack detection steering wheel. In Proceedings of the 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Beijing, China, 13–15 October 2018; pp. 1–6. [Google Scholar]
- Ali, S.; Ghazal, M. Real-time heart attack mobile detection service (RHAMDS): An IoT use case for software defined networks. In Proceedings of the 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE), Windsor, ON, Canada, 30 April–3 May 2017; pp. 1–6. [Google Scholar]
- May, J.F.; Baldwin, C.L. Driver fatigue: The importance of identifying causal factors of fatigue when considering detection and countermeasure technologies. Transp. Res. Part Traffic Psychol. Behav. 2009, 12, 218–224. [Google Scholar] [CrossRef]
- Doudou, M.; Bouabdallah, A.; Berge-Cherfaoui, V. Driver drowsiness measurement technologies: Current research, market solutions, and challenges. Int. J. Intell. Transp. Syst. Res. 2020, 18, 297–319. [Google Scholar] [CrossRef]
- Sikander, G.; Anwar, S. Driver fatigue detection systems: A review. IEEE Trans. Intell. Transp. Syst. 2018, 20, 2339–2352. [Google Scholar] [CrossRef]
- Subasi, A.; Saikia, A.; Bagedo, K.; Singh, A.; Hazarika, A. EEG-based driver fatigue detection using FAWT and multiboosting approaches. IEEE Trans. Ind. Inform. 2022, 18, 6602–6609. [Google Scholar] [CrossRef]
- Li, Z.; Li, S.E.; Li, R.; Cheng, B.; Shi, J. Online detection of driver fatigue using steering wheel angles for real driving conditions. Sensors 2017, 17, 495. [Google Scholar] [CrossRef]
- Gedam, S.; Paul, S. A review on mental stress detection using wearable sensors and machine learning techniques. IEEE Access 2021, 9, 84045–84066. [Google Scholar] [CrossRef]
- Memar, M.; Mokaribolhassan, A. Stress level classification using statistical analysis of skin conductance signal while driving. SN Appl. Sci. 2021, 3, 64. [Google Scholar] [CrossRef]
- Hu, J.; Zhang, X.; Maybank, S. Abnormal Driving Detection With Normalized Driving Behavior Data: A Deep Learning Approach. IEEE Trans. Veh. Technol. 2020, 69, 6943–6951. [Google Scholar] [CrossRef]
- Koh, D.W.; Lee, S.G. An evaluation method of safe driving for senior adults using ECG signals. Sensors 2019, 19, 2828. [Google Scholar] [CrossRef]
- Heine, T.; Lenis, G.; Reichensperger, P.; Beran, T.; Doessel, O.; Deml, B. Electrocardiographic features for the measurement of drivers’ mental workload. Appl. Ergon. 2017, 61, 31–43. [Google Scholar] [CrossRef]
- Eraqi, H.M.; Abouelnaga, Y.; Saad, M.H.; Moustafa, M.N. Driver distraction identification with an ensemble of convolutional neural networks. J. Adv. Transp. 2019, 2019, 4125865. [Google Scholar] [CrossRef]
- Almahasneh, H.; Chooi, W.T.; Kamel, N.; Malik, A.S. Deep in thought while driving: An EEG study on drivers’ cognitive distraction. Transp. Res. Part F Traffic Psychol. Behav. 2014, 26, 218–226. [Google Scholar] [CrossRef]
- Li, G.; Yuan, Y.; Ouyang, D.; Zhang, L.; Yuan, B.; Chang, X.; Guo, Z.; Guo, G. Driver Distraction from the EEG Perspective: A Review. IEEE Sens. J. 2023, 24, 2329–2349. [Google Scholar] [CrossRef]
- Cafasso, A.; Karlsson, S. Automatic Detection of Saccadic Eye Movements Using EOG for Analysing Effects of Cognitive Distraction During Driving. Master’s Thesis, Chalmers University of Technology, Gothenburg, Sweden, 2017. [Google Scholar]
- Misra, A.; Samuel, S.; Cao, S.; Shariatmadari, K. Detection of Driver Cognitive Distraction Using Machine Learning Methods. IEEE Access 2023, 11, 18000–18012. [Google Scholar] [CrossRef]
- Shariff, W.; Dilmaghani, M.S.; Kielty, P.; Lemley, J.; Farooq, M.A.; Khan, F.; Corcoran, P. Neuromorphic Driver Monitoring Systems: A Computationally Efficient Proof-of-Concept for Driver Distraction Detection. IEEE Open J. Veh. Technol. 2023, 4, 836–848. [Google Scholar] [CrossRef]
- Çetinkaya, M.; Acarman, T. Driver impairment detection using decision tree based feature selection and classification. Results Eng. 2023, 18, 101025. [Google Scholar] [CrossRef]
- Hayley, A.C.; Shiferaw, B.; Aitken, B.; Vinckenbosch, F.; Brown, T.L.; Downey, L.A. Driver monitoring systems (DMS): The future of impaired driving management? Traffic Inj. Prev. 2021, 22, 313–317. [Google Scholar] [CrossRef] [PubMed]
- Singh, G.; Chen, T.A.; Robucci, R.; Patel, C.; Banerjee, N. distratto: Impaired driving detection using textile sensors. IEEE Sens. J. 2015, 16, 2666–2673. [Google Scholar] [CrossRef]
- Du, N.; Zhou, F.; Pulver, E.M.; Tilbury, D.M.; Robert, L.P.; Pradhan, A.K.; Yang, X.J. Predicting driver takeover performance in conditionally automated driving. Accid. Anal. Prev. 2020, 148, 105748. [Google Scholar] [CrossRef] [PubMed]
- Peivandi, M.; Ardabili, S.Z.; Sheykhivand, S.; Danishvar, S. Deep learning for detecting multi-level driver fatigue using physiological signals: A comprehensive approach. Sensors 2023, 23, 8171. [Google Scholar] [CrossRef]
- Mou, L.; Chang, J.; Zhou, C.; Zhao, Y.; Ma, N.; Yin, B.; Jain, R.; Gao, W. Multimodal driver distraction detection using dual-channel network of CNN and Transformer. Expert Syst. Appl. 2023, 234, 121066. [Google Scholar] [CrossRef]
- Zhou, D.; Cheng, Y.; Wen, L.; Luo, H.; Liu, Y. Drivers’ Comprehensive Emotion Recognition Based on HAM. Sensors 2023, 23, 8293. [Google Scholar] [CrossRef]
- Huang, Y.; Deng, Y. A hybrid model utilizing principal component analysis and artificial neural networks for driving drowsiness detection. Appl. Sci. 2022, 12, 6007. [Google Scholar] [CrossRef]
- Choi, G.H.; Lim, K.; Pan, S.B. Driver identification system using normalized electrocardiogram based on adaptive threshold filter for intelligent vehicles. Sensors 2020, 21, 202. [Google Scholar] [CrossRef]
- Zhang, Q.; Wu, Q.; Zhou, Y.; Wu, X.; Ou, Y.; Zhou, H. Webcam-based, non-contact, real-time measurement for the physiological parameters of drivers. Measurement 2017, 100, 311–321. [Google Scholar] [CrossRef]
- Arif, S.; Munawar, S.; Ali, H. Driving drowsiness detection using spectral signatures of EEG-based neurophysiology. Front. Physiol. 2023, 14, 1153268. [Google Scholar] [CrossRef] [PubMed]
- Ma, Y.; Chen, B.; Li, R.; Wang, C.; Wang, J.; She, Q.; Luo, Z.; Zhang, Y. Driving fatigue detection from EEG using a modified PCANet method. Comput. Intell. Neurosci. 2019, 2019, 4721863. [Google Scholar] [CrossRef] [PubMed]
- Zhang, T.; Chen, J.; He, E.; Wang, H. Sample-entropy-based method for real driving fatigue detection with multichannel electroencephalogram. Appl. Sci. 2021, 11, 10279. [Google Scholar] [CrossRef]
- Siam, A.I.; Gamel, S.A.; Talaat, F.M. Automatic stress detection in car drivers based on non-invasive physiological signals using machine learning techniques. Neural Comput. Appl. 2023, 35, 12891–12904. [Google Scholar] [CrossRef]
- Nezamabadi, K.; Sardaripour, N.; Haghi, B.; Forouzanfar, M. Unsupervised ECG analysis: A review. IEEE Rev. Biomed. Eng. 2022, 16, 208–224. [Google Scholar] [CrossRef]
- Zhao, Z.; Zhou, N.; Zhang, L.; Yan, H.; Xu, Y.; Zhang, Z. Driver fatigue detection based on convolutional neural networks using EM-CNN. Comput. Intell. Neurosci. 2020, 2020, 7251280. [Google Scholar] [CrossRef]
- Huang, J.; Liu, Y.; Peng, X. Recognition of driver’s mental workload based on physiological signals, a comparative study. Biomed. Signal Process. Control. 2022, 71, 103094. [Google Scholar] [CrossRef]
- Jiao, Y.; Deng, Y.; Luo, Y.; Lu, B.L. Driver sleepiness detection from EEG and EOG signals using GAN and LSTM networks. Neurocomputing 2020, 408, 100–111. [Google Scholar] [CrossRef]
- Rahman, A.; Hriday, M.B.H.; Khan, R. Computer vision-based approach to detect fatigue driving and face mask for edge computing device. Heliyon 2022, 8, e11204. [Google Scholar] [CrossRef]
- Zeng, H.; Li, X.; Borghini, G.; Zhao, Y.; Aricò, P.; Di Flumeri, G.; Sciaraffa, N.; Zakaria, W.; Kong, W.; Babiloni, F. An EEG-based transfer learning method for cross-subject fatigue mental state prediction. Sensors 2021, 21, 2369. [Google Scholar] [CrossRef]
- Yang, G.; Ridgeway, C.; Miller, A.; Sarkar, A. Comprehensive assessment of artificial intelligence tools for driver monitoring and analyzing safety critical events in vehicles. Sensors 2024, 24, 2478. [Google Scholar] [CrossRef] [PubMed]
- Luo, Y.; Yang, Y.; Ma, Y.; Huang, R.; Qi, A.; Ma, M.; Qi, Y. Enhancing Road Safety: Fast and Accurate Noncontact Driver HRV Detection Based on Huber–Kalman and Autocorrelation Algorithms. Biomimetics 2024, 9, 481. [Google Scholar] [CrossRef] [PubMed]
- Wang, S.; Li, Y.; Zhang, T.; Li, K. TAGformer: A multimodal physiological signals fusion network for pilot stress recognition. IEEE Sens. J. 2024, 24, 20842–20854. [Google Scholar] [CrossRef]
- Mohammadi, H.; Karwowski, W. Graph Neural Networks in Brain Connectivity Studies: Methods, Challenges, and Future Directions. Brain Sci. 2024, 15, 17. [Google Scholar] [CrossRef]
- Cao, S.; Feng, P.; Kang, W.; Chen, Z.; Wang, B. Optimized driver fatigue detection method using multimodal neural networks. Sci. Rep. 2025, 15, 12240. [Google Scholar] [CrossRef]
- Craye, C.; Rashwan, A.; Kamel, M.S.; Karray, F. A multi-modal driver fatigue and distraction assessment system. Int. J. Intell. Transp. Syst. Res. 2016, 14, 173–194. [Google Scholar] [CrossRef]
- Warnecke, J.M.; Boeker, N.; Spicher, N.; Wang, J.; Flormann, M.; Deserno, T.M. Sensor fusion for robust heartbeat detection during driving. In Proceedings of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Online, 1–5 November 2021; pp. 447–450. [Google Scholar]
- Yoshida, Y.; Kowata, K.; Abe, R.; Yuda, E. Evaluation of Fatigue in Older Drivers Using a Multimodal Medical Sensor and Driving Simulator. Electronics 2024, 13, 1126. [Google Scholar] [CrossRef]
- Němcová, A.; Svozilová, V.; Bucsuházy, K.; Smíšek, R.; Mézl, M.; Hesko, B.; Belák, M.; Bilík, M.; Maxera, P.; Seitl, M.; et al. Multimodal features for detection of driver stress and fatigue. IEEE Trans. Intell. Transp. Syst. 2020, 22, 3214–3233. [Google Scholar] [CrossRef]
- Wu, Y.; Wei, H.; Chen, X.; Xu, J.; Rahul, S. Adaptive authority allocation of human-automation shared control for autonomous vehicle. Int. J. Automot. Technol. 2020, 21, 541–553. [Google Scholar] [CrossRef]
- Caterpillar Safety Services—Driver Safety System. Available online: http://s7d2.scene7.com/is/content/Caterpillar/CM20170405-57228-26405 (accessed on 6 June 2024).
- SMARTCAP. Available online: https://ramjacktech.com/our-technologies/smartcap/ (accessed on 6 June 2024).
- Seeingmachines Guardian. Available online: https://seeingmachines.com/wp-content/uploads/2023/11/SM-Guardian-Brochure-2023_WEB.pdf (accessed on 6 June 2024).
- OPTALERT EAGLE. Available online: https://www.optalert.com/introducing-the-eagle-light/ (accessed on 6 June 2024).
- Driver Drowsiness Detection. 2024. Available online: https://www.bosch-mobility.com/en/solutions/assistance-systems/driver-drowsiness-detection (accessed on 25 February 2024).
- Denso Driver Status Monitoring. Available online: https://www.denso.com/global/en/business/products-and-services/mobility/pick-up/dsm/ (accessed on 6 June 2024).
- Taylor, M. No doze: Mercedes e-class alerts drowsy drivers. Autoweek Daily Drive, 23 December 2008. [Google Scholar]
- Safer Fleets and Safer Roads for All. Available online: https://www.nauto.com/ (accessed on 6 June 2024).
- Tesla’s Newest Safety Feature Will Monitor Driver for Drowsiness, Even When Autopilot Is OffTesla’s Newest Safety Feature Will Monitor Driver for Drowsiness, Even When Autopilot Is Off. 2023. Available online: https://www.notateslaapp.com/software-updates/upcoming-features/id/1661/tesla-to-introduce-new-safety-feature-that-monitors-driver-s-drowsiness (accessed on 6 June 2024).
- Driver Alertness Detection System. 2017. Available online: https://www.media.volvocars.com/global/en-gb/media/pressreleases/250015/volvo-cars-to-deploy-in-car-cameras-and-intervention-against-intoxication-distraction (accessed on 6 June 2024).
- Making Roads Safer by Detecting Driver Heart Anomalies. Available online: https://pressroom.toyota.com/making-roads-safer-by-detecting-driver-heart-anomalies/ (accessed on 30 September 2010).
- Strickland, E. 3 Ways Ford Cars Could Monitor Your Health. IEEE Spectrum, 19 May 2017. Available online: https://spectrum.ieee.org/3-ways-ford-cars-could-monitor-your-health (accessed on 6 June 2024).
- BMW Develops Health-Check Steering Wheel to Monitor Physical and Emotional Duress. 2011. Available online: https://www.massdevice.com/bmw-develops-health-check-steering-wheel-monitor-physical-and-emotional-duress-massdevicecom-ca/ (accessed on 25 February 2024).
- What is Mercedes-Benz Energizing Comfort Control Technology? 2017. Available online: https://www.mbscottsdale.com/blog/what-is-mercedes-benz-energizing-comfort-control-technology/#:~:text=The%20goal%20of%20Energizing%20Comfort,Joy%2C%20Comfort%2C%20and%20Training (accessed on 6 June 2024).
- Audi AI Traffice Jam Pilot. 2017. Available online: https://magazine.audi.com.au/article/audi-ai-traffic-jam-pilot (accessed on 25 February 2024).
- Forouzanfar, M.; Baker, F.C.; de Zambotti, M.; Claudatos, S.; Chai, B.B.; Bergen, J.; Lubin, J. Physiological synchrony: A new approach toward identifying unknown presentation attacks on biometric systems. IEEE Trans. Instrum. Meas. 2021, 70, 1–9. [Google Scholar] [CrossRef]
- Gu, C.; Wang, G.; Li, Y.; Inoue, T.; Li, C. A hybrid radar-camera sensing system with phase compensation for random body movement cancellation in Doppler vital sign detection. IEEE Trans. Microw. Theory Tech. 2013, 61, 4678–4688. [Google Scholar] [CrossRef]
- Maleki Varnosfaderani, S.; Forouzanfar, M. The role of AI in hospitals and clinics: Transforming healthcare in the 21st century. Bioengineering 2024, 11, 337. [Google Scholar] [CrossRef] [PubMed]
- Mohammad Amini, M.; Jesus, M.; Fanaei Sheikholeslami, D.; Alves, P.; Hassanzadeh Benam, A.; Hariri, F. Artificial Intelligence Ethics and Challenges in Healthcare Applications: A Comprehensive Review in the Context of the European GDPR Mandate. Mach. Learn. Knowl. Extr. 2023, 5, 1023–1035. [Google Scholar] [CrossRef]
- Jin, W.; Duan, Y.; Liu, J.; Huang, S.; Xiong, Z.; Peng, X. BROOK dataset: A playground for exploiting data-driven techniques in human-vehicle interactive designs. arXiv 2022, arXiv:2202.06494. [Google Scholar]
- Schneegass, S.; Pfleging, B.; Broy, N.; Heinrich, F.; Schmidt, A. A data set of real world driving to assess driver workload. In Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Eindhoven, The Netherlands, 28–30 October 2013; pp. 150–157. [Google Scholar]
- StateFarmDistractedDriverDataset. Available online: https://www.kaggle.com/datasets/alpha46663/distracted-driver-dataset (accessed on 6 June 2024).
- Jain, A.; Koppula, H.S.; Soh, S.; Raghavan, B.; Singh, A.; Saxena, A. Brain4cars: Car that knows before you do via sensory-fusion deep learning architecture. arXiv 2016, arXiv:1601.00740. [Google Scholar]
- Haouij, N.E.; Poggi, J.M.; Sevestre-Ghalila, S.; Ghozi, R.; Jaïdane, M. AffectiveROAD system and database to assess driver’s attention. In Proceedings of the 33rd Annual ACM Symposium on Applied Computing, Pau, France, 9–13 April 2018; pp. 800–803. [Google Scholar]
- Hanna, R. The contribution of medical conditions to passenger vehicle crashes. Ann. Emerg. Med. 2010, 55, 563–564. [Google Scholar]
Application | Notable Studies | Methodology | Results |
---|---|---|---|
Detection of Heart Attack | M.E.H. Chowdhury et al. (2019) [133] | Developed an SVM classifier for ECG classification using data from 28 individuals from the MIT-BIH ST Change Database. | The classifier demonstrated a 97.4% accuracy rate in identifying ST-elevation myocardial infarctions and a 96.3% accuracy rate for non-ST-elevation myocardial infarctions. |
Detection of Fatigue and Drowsiness | F. Wang et al. (2023) [134] | Utilized elastic dry electrodes for ECG signal acquisition from the palm, introducing a periodic man–machine interaction mode (PMIM) to evaluate and mitigate driver fatigue. Sixteen healthy subjects underwent a simulated driving experiment on a monotonous highway in two modes: normal and PMIM, to induce driving fatigue. | Demonstrated effective fatigue reduction with fatigue recognition accuracies ranging between 94% and 99% in various experimental conditions. |
J. Gwak et al. (2020) [135] | Utilized EEG, ECG, and behavioral indices to classify driver states using a random forest. The method was tested in a study involving 16 participants in a monotonous driving simulation aimed at inducing drowsiness. | Achieved 82.4% accuracy in distinguishing between alert and slightly drowsy states and 95.4% accuracy between alert and moderately drowsy states. | |
Detection of Stress and Emotional Diriving | D.S. Lee et al. (2016) [136] | Utilized a wearable glove with fingertip PPG sensing to monitor stress and emotional states in real time. Twenty-eight subjects were requested to perform three different driving sessions with random scenarios generated while performing various driving maneuvers to assess the dynamics of mental workloads. | Achieved 95% accuracy in identifying stressful driving conditions. |
Z. Halim & M. Rehan. (2020) [137] | EEG sensors were utilized to capture brain activity, focusing on stress detection. The SVM algorithm was used to analyze the collected data collected from a group of 50 drivers. | Achieved 97.95% accuracy, showcasing superior performance over alternative classifiers. | |
Detection of Dangerous Driving | F. Yan et al. (2019) [138] | EEG and driving data were analyzed using K-means clustering and SVM modeling to classify driving styles. Experiments were performed on 23 participants under 75 driving tasks. | Achieved 80% accuracy with SVM, distinguishing conservative and aggressive driving styles by their unique EEG patterns. |
Detection of DriverDistraction | O. Dehzangi et al. (2018) [17]) | Engaged 10 driver subjects in real driving experiments, measuring phasic EDA via a wristband wearable. Applied continuous decomposition analysis for signal processing and SVM with recursive feature elimination for feature selection and classification. | Achieved a cross-validation accuracy of 94.81% with all features and 93.01% with a reduced feature set, demonstrating effective distraction identification. |
Detection of Impaired Driving | C. K. Wu et al. (2016) [139] | Designed an ECG-based Drunk Driving Detection (DDD) system using a classifier with weighted kernel functions. The DDD system was evaluated on 50 volunteers in a stationary car under normal and intoxicated conditions. | Achieved an accuracy of 87.52%, outperforming conventional methods by 11%. |
Algorithm Category | Description and Examples | Requirements, Assumptions, and Applications | Examples of Applications |
---|---|---|---|
Statistical Machine Learning | Involves models that infer relationships from statistical analysis. Examples: SVM, k-nearest neighbor (KNN), Bayesian networks. | Assumes certain data distributions; requires extensive data preprocessing and feature engineering; ideal for unimodal biosensing with custom features, especially when minimizing overfitting is crucial. | M. Choi et al. (2020) introduced a fuzzy SVM for personalized fatigue, drowsiness, and stress monitoring, analyzing PPG, GSR, temperature, and motion data. It achieved 92% accuracy and outperformed traditional SVM. |
Ensemble Methods | Techniques that combine predictions from multiple models to improve accuracy. Examples: random forest, gradient boosting. | Assume that combining multiple models increases accuracy; ideal for biosensing applications with user-defined features, improving accuracy and reducing overfitting via diverse models. | N. Du et al. (2022) [162] designed a random forest to predict drivers’ takeover performance in conditionally automated driving by analyzing heart rate, EDA, eye-tracking metrics, and driving conditions. Tested on two indidivuals and achieved an accuracy of 84.3% using a 3-s prediction window. |
Neural Networks | Comprises algorithms modeled on the human brain’s architecture, suitable for capturing complex and nonlinear patterns. Examples: multi-layer perceptron (MLP), RNN (LSTM, Gated recurrent unit—GRU), CNN. | There is no specific assumption; require large amounts of data and high processing power; suitable for processing and learning from large, intricate, and unprocessed datasets. | M Peivandi et al. (2023) [163] introduced a novel approach for multi-level driver fatigue detection from ECG, EEG, EMG, and respiratory signal utilizing CNNs. Tested on 20 students and achieved accuracies ranging from 89% to 96%. |
Advanced Deep Learning Models | Focuses on state-of-the-art neural network architectures for complex pattern recognition and generation. Examples: Transformers (for sequence modeling tasks), GAN (for generating new data instances). | Assume complex relationships in data; require substantial computational resources and diverse datasets; effective for data generation (GANs) and recognizing long-term patterns in physiological data (Transformers), delivering unparalleled performance. | L. Mou et al. (2023) [164] implemented a dual-channel model combining CNN and Transformer for driver distraction detection on a multimodal dataset. Tested on 68 individuals and achieved a high accuracy of 99%. |
Hybrid Methods | Integrates various machine learning techniques to exploit their combined strengths. Example: Combining CNN with RNN for complex tasks. | Integrates diverse neural architectures; demands innovative design and substantial data; efficient in analyzing multimodal and complex physiological data. | D. Zhou et al. (2023) [165] developed a multimodal fusion framework combining the driver’s voice, facial image, and video sequence data to recognize a range of emotions using a hybrid CNN + Bi-LSTM + attention model. Tested on 123 individuals and achieved a recognition rate of 85.5%. |
Feature Selection Methods | Identifies the most relevant features for the model to improve performance and reduce overfitting. Examples: Recursive Feature Elimination (RFE), Principal Component Analysis (PCA). | Assumes specific relationships among features; simplifies data by reducing dimensions; suitable for improving model efficiency and interpretability of complex biosensing data. | Y. Huang et al. (2022) [166] combined PCA and MLP to identify driving drowsiness using PPG, EDA, and respiration data. Tested on nine individuals and achieved 97% accuracy. |
Prototype | Description | Sensors | |
---|---|---|---|
Fatigue | Caterpillar Driver Safety System (DSS) [189] | It uses in-cab cameras and sensors to monitor drivers for fatigue and distraction, providing real-time alerts and data to a central system. The system employs facial recognition cameras, seat sensors, steering wheel sensors, and GPS to analyze driver behavior and alertness levels. | In-cab cameras, facial recognition cameras, seat sensors, steering wheel sensors, GPS |
SmartCap [190] | The SmartCap is a wearable cap with EEG sensors that monitor brain activity and detect fatigue levels. It provides real-time alerts and integrates with fleet management systems to improve driver safety and productivity. | EEG sensors | |
Guardian by Seeing Machines [191] | Guardian uses a dash-mounted camera and sensors to track drivers’ head and eye movements. It detects signs of fatigue and distraction, providing real-time alerts and detailed data analysis for proactive safety measures. | Dash-mounted camera, infrared sensors, head and eye tracking sensors | |
Optalert’s Eagle [192] | Eagle consists of glasses equipped with an infrared sensor and IR LED that continuously monitor eyelid movements and blink patterns. It provides real-time feedback via the Johns Drowsiness Score and integrates with fleet management systems to enhance driver alertness and safety. | Infrared sensor and IR LED | |
Drowsiness | Bosch Driver Drowsiness Detection System [193] | Bosch’s system uses steering angle sensors and vehicle speed data to assess driver drowsiness. It alerts the driver with audio and visual signals, helping to prevent accidents caused by reduced alertness. | Steering angle sensors, vehicle speed sensors |
Denso’s Driver Status Monitor [194] | Denso’s system uses a camera and infrared sensors to monitor the driver’s face for signs of drowsiness and inattention. It integrates with other vehicle safety systems to provide timely alerts and ensure driver attentiveness. | Camera, infrared sensors | |
Mercedes-Benz ATTENTION ASSIST [195] | ATTENTION ASSIST monitors steering movements and driving behavior to detect signs of driver drowsiness. It alerts the driver with visual and acoustic signals, promoting safer driving habits and reducing fatigue-related accidents. | Steering movement sensors, vehicle behavior sensors, GPS | |
Distraction | Nauto Driver Safety System [196] | Nauto combines AI-powered cameras and sensors to monitor driver behavior, including distractions and drowsiness. It delivers real-time alerts and comprehensive fleet management reports for proactive safety measures. | AI-powered cameras, infrared sensors, GPS |
Tesla Driver Engagement Monitoring [197] | Tesla’s system uses in-cabin cameras and AI-powered sensors to monitor driver attention and engagement. It ensures drivers remain focused on the road and alert to interact with semi-autonomous driving features effectively. | In-cabin cameras, AI-powered sensors, GPS | |
Volvo Intoxication and Distraction System [198] | Volvo’s system uses in-car cameras and sensors to monitor signs of driver intoxication and distraction. It automatically intervenes if necessary to prevent accidents and ensure safe driving conditions. | In-car cameras, alcohol sensors, GPS | |
Health Metrics | Toyota’s Steering Wheel with Heart Rate Sensors [199] | Toyota integrates heart rate sensors into the steering wheel to monitor the driver’s physical condition. It detects signs of stress or health issues and provides alerts to maintain driver well-being and safety. | Steering wheel heart rate sensors |
Ford’s Health-Focused Technologies [200] | Ford’s system includes wearable device integration and in-car sensors to monitor the driver’s health metrics such as heart rate and glucose levels. It provides alerts and feedback to enhance driver well-being and safety during journeys. | Wearable device integration, in-car sensors (heart rate sensors, glucose sensors), GPS | |
BMW and Wearable Device Interface [201] | BMW integrates wearable devices with vehicle systems to monitor driver health metrics such as heart rate and stress levels. It provides real-time feedback and adjusts car settings for safety and comfort during driving. | Wearable devices (smartwatches, fitness trackers), vehicle system integration (CAN bus), GPS | |
Other | Mercedes-Benz Energizing Comfort [202] | Mercedes-Benz uses in-car climate control, ambient lighting, and music to improve driver well-being and reduce fatigue during long journeys. The system adjusts environmental factors to enhance driver comfort and alertness. | In-car climate control sensors, ambient lighting sensors, audio sensors, GPS |
Audi TrafficJam Pilot [203] | Audi’s system utilizes a combination of cameras, sensors, and AI to monitor driver attention during traffic jams. It ensures the driver is ready to take over when necessary, enhancing safety and convenience in congested traffic conditions. | Cameras, radar sensors, ultrasonic sensors, AI |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Maleki Varnosfaderani, S.; Shaikh, M.R.; Forouzanfar, M. A Comprehensive Review of Unobtrusive Biosensing in Intelligent Vehicles: Sensors, Algorithms, and Integration Challenges. Bioengineering 2025, 12, 669. https://doi.org/10.3390/bioengineering12060669
Maleki Varnosfaderani S, Shaikh MR, Forouzanfar M. A Comprehensive Review of Unobtrusive Biosensing in Intelligent Vehicles: Sensors, Algorithms, and Integration Challenges. Bioengineering. 2025; 12(6):669. https://doi.org/10.3390/bioengineering12060669
Chicago/Turabian StyleMaleki Varnosfaderani, Shiva, Mohd. Rizwan Shaikh, and Mohamad Forouzanfar. 2025. "A Comprehensive Review of Unobtrusive Biosensing in Intelligent Vehicles: Sensors, Algorithms, and Integration Challenges" Bioengineering 12, no. 6: 669. https://doi.org/10.3390/bioengineering12060669
APA StyleMaleki Varnosfaderani, S., Shaikh, M. R., & Forouzanfar, M. (2025). A Comprehensive Review of Unobtrusive Biosensing in Intelligent Vehicles: Sensors, Algorithms, and Integration Challenges. Bioengineering, 12(6), 669. https://doi.org/10.3390/bioengineering12060669