Search Results (148)

Due to the increasing number of vehicles and the aging population, the vulnerability to sudden medical emergencies among drivers is a growing problem. Events such as heart attack, stroke, and loss of consciousness can occur without warning and endanger everyone on the road. Modern vehicles, equipped with electronic systems, can support real-time driver’s health monitoring through early detection technologies. The existing Driver Monitoring Systems (DMS) in our cars assess behavioral states such as drowsiness and distraction. In the future, DMS will include biometric sensors to monitor vital signs such as heart rate and respiration. By finding predictors of sudden illnesses (SI), such a system will provide valuable time for the driver to react before the strike of a medical event. In this paper, we present our vision for DMS operation with physiological monitoring capabilities. A brief overview of sensor’s types and their locations in the vehicle interior used in the research studies for monitoring the corresponding physiological parameters is presented. A comparative analysis of the advantages and disadvantages of the sensing methods used for physiological monitoring of the driver in real driving scenarios is made. Full article

Driver drowsiness is a major contributor to road accidents, often resulting from delayed reaction times and impaired cognitive performance. This study introduces EffRes-DrowsyNet, a hybrid deep learning model that integrates the architectural efficiencies of EfficientNetB0 with the deep representational capabilities of ResNet50. The model is designed to detect early signs of driver fatigue through advanced video-based analytics by leveraging both computational scalability and deep feature learning. Extensive experiments were conducted on three benchmark datasets—SUST-DDD, YawDD, and NTHU-DDD—to validate the model’s performance across a range of environmental and demographic variations. EffRes-DrowsyNet achieved 97.71% accuracy, 98.07% precision, and 97.33% recall on the SUST-DDD dataset. On the YawDD dataset, it sustained a high accuracy of 92.73%, while on the NTHU-DDD dataset, it reached 95.14% accuracy, 94.09% precision, and 95.39% recall. These results affirm the model’s superior generalization and classification performance in both controlled and real-world-like settings. The findings underscore the effectiveness of hybrid deep learning models in real-time, safety-critical applications, particularly for automotive driver monitoring systems. Furthermore, EffRes-DrowsyNet’s architecture provides a scalable and adaptable solution that could extend to other attention-critical domains such as industrial machinery operation, aviation, and public safety systems. Full article

Driver fatigue is a key factor in road accidents worldwide, requiring effective real-time detection mechanisms. Traditional deep neural network (DNN)-based solutions have shown promising results in detecting drowsiness; however, they are often less suitable for real-time applications due to their high computational complexity, risk of overfitting, and reliance on large datasets. Hence, this paper introduces an innovative approach that integrates fast neighbourhood component analysis (FNCA) with a deep neural network (DNN) to enhance the detection of driver drowsiness using electroencephalogram (EEG) data. FNCA is employed to optimize feature representation, effectively highlighting critical features for drowsiness detection, which are then analysed using a DNN to achieve high accuracy in recognizing signs of driver fatigue. Our model has been evaluated on the SEED-VIG dataset and achieves state-of-the-art accuracy: 94.29% when trained on 12 subjects and 90.386% with 21 subjects, surpassing existing methods such as TSception, ConvNeXt LMDA-Net, and CNN + LSTM. Full article

We developed a multi-feature drowsiness detection model employing eye aspect ratio (EAR), mouth aspect ratio (MAR), head pose angles (yaw, pitch, and roll), and a Raspberry Pi 4 for real-time applications. The model was trained on the NTHU-DDD dataset and optimized using long short-term memory (LSTM) deep learning algorithms implemented using TensorFlow version 2.14.0. The model enabled robust drowsiness detection at a rate of 10 frames per second (FPS). The system embedded with the model was constructed for live image capture. The camera placement was adjusted for optimal positioning in the system. Various features were determined under diverse conditions (day, night, and with and without glasses). After training, the model showed an accuracy of 95.23%, while the accuracy ranged from 91.81 to 95.82% in validation. In stationary and moving vehicles, the detection accuracy ranged between 51.85 and 85.71%. Single-feature configurations exhibited an accuracy of 51.85 to 72.22%, while in dual features, the accuracy ranged from 66.67 to 75%. An accuracy of 80.95 to 85.71% was attained with the integration of all features. Challenges in the drowsiness included diminished accuracy with MAR alone and delayed prediction during transitions from non-drowsy to drowsy status. These findings underscore the model’s applicability in detecting drowsiness while highlighting the necessity for refinement. Through algorithm optimization, dataset expansion, and the integration of additional features and feedback mechanisms, the model can be improved in terms of performance and reliability. Full article

Drowsiness while driving poses a significant risk in terms of road safety, making effective drowsiness detection systems essential for the prevention of accidents. Facial signal-based detection methods have proven to be an effective approach to drowsiness detection. However, they bring challenges arising from inter-individual differences among drivers. Variations in facial structure necessitate personalized feature extraction thresholds, yet existing methods apply a uniform threshold, leading to inaccurate feature extraction. Furthermore, many current methods focus on only one or two facial regions, overlooking the possibility that drowsiness may manifest differently across different facial areas among different drivers. To address these issues, we propose a drowsiness detection method that combines an ensemble model with hybrid facial features. This approach enables the accurate extraction of features from four key facial regions—the eye region, mouth contour, head pose, and gaze direction—through adaptive threshold correction to ensure comprehensive coverage. An ensemble model, combining Random Forest, XGBoost, and Multilayer Perceptron with a soft voting criterion, is then employed to classify the drivers’ drowsiness state. Additionally, we use the SHAP method to ensure model explainability and analyze the correlations between features from various facial regions. Trained and tested on the UTA-RLDD dataset, our method achieves a video accuracy (VA) of 86.52%, outperforming similar techniques introduced in recent years. The interpretability analysis demonstrates the value of our approach, offering a valuable reference for future research and contributing significantly to road safety. Full article

Drowsiness while driving is a common problem for many drivers and a significant problem in contemporary society. This study presents a method for detecting drowsiness while driving. The key finding is that six channels of EEG data are closely associated with drowsiness detection; this finding will contribute significantly to the development of new drowsiness detection systems. To process EEG data with high frequencies and large datasets, an in-depth Inception model suitable for time-series data was employed, incorporating a self-attention mechanism. This model effectively extracts the time–frequency representation of EEG data using a short-time Fourier transform and selectively learns important features by applying the self-attention mechanism within the Inception block structure. Additionally, channel-wise convolution is utilized to reduce the dimensionality of input data, and modified Inception blocks are stacked to enable more profound data representation. The model manages its complexity by adding partial sequential convolution filters and self-attention to the Inception blocks while performing complementary roles. Our method achieved high-performance drowsiness detection with an accuracy of 79.02% using only six EEG channels. The method contributes to ensuring accurate detection by minimizing information loss through the introduction of a self-attention mechanism. Full article

Driver drowsiness remains a critical factor in road safety, necessitating the development of robust detection methodologies. This study presents a dual-framework approach that integrates a convolutional neural network (CNN) and a facial landmark analysis model to enhance drowsiness detection. The CNN model classifies driver states into “Awake” and “Drowsy”, achieving a classification accuracy of 92.5%. In parallel, a deep learning-based facial landmark analysis model analyzes a driver’s physiological state by extracting and analyzing facial features. The model’s accuracy was significantly enhanced through advanced image preprocessing techniques, including image normalization, illumination correction, and face hallucination, reaching a 97.33% classification accuracy. The proposed dual-model architecture leverages imagery analysis to detect key drowsiness indicators, such as eye closure dynamics, yawning patterns, and head movement trajectories. By integrating CNN-based classification with precise facial landmark analysis, this study not only improves detection robustness but also ensures greater resilience under challenging conditions, such as low-light environments. The findings underscore the efficacy of multi-model approaches in drowsiness detection and their potential for real-world implementation to enhance road safety and mitigate drowsiness-related vehicular accidents. Full article

Drowsy driving significantly impairs drivers’ attention and reaction times, increasing the risk of accidents. Developing effective prevention technologies is therefore a critical task. Previous studies have highlighted several limitations: (1) Most drowsiness-detection methods rely solely on facial features such as eye blinking or yawning, limiting their ability to detect different drowsiness levels. (2) Sensor-based methods utilizing wearable devices may interfere with driving activities. (3) Binary classification of drowsiness levels is insufficient for accident prevention, as it fails to detect early signs of drowsiness. This study proposes a novel drowsiness-detection method that classifies drowsiness into three levels (alert, low vigilant, drowsy) using a non-contact, camera-based approach that integrates physiological signals and visible facial features. Conducted as a feasibility study, it evaluates the potential applicability of this method in driving situations. To evaluate generalizability, experiments were conducted with seen-subject and unseen-subject conditions, achieving accuracies of 96.7% and 75.7%, respectively. This approach provides a more comprehensive and practical solution to drowsiness detection, contributing to safer driving environments. Full article

Drowsy driving poses a significant challenge to road safety worldwide, contributing to thousands of accidents and fatalities annually. Despite advancements in driver drowsiness detection (DDD) systems, many existing methods face limitations such as intrusiveness and delayed reaction times. This research addresses these gaps by leveraging facial analysis and state-of-the-art machine learning techniques to develop a real-time, non-intrusive DDD system. A distinctive aspect of this research is its systematic assessment of various machine and deep learning algorithms across three pivotal public datasets, the NTHUDDD, YawDD, and UTA-RLDD, known for their widespread use in drowsiness detection studies. Our evaluation covered techniques including the K-Nearest Neighbors (KNNs), support vector machines (SVMs), convolutional neural networks (CNNs), and advanced computer vision (CV) models such as YOLOv5, YOLOv8, and Faster R-CNN. Notably, the KNNs classifier reported the highest accuracy of 98.89%, a precision of 99.27%, and an F1 score of 98.86% on the UTA-RLDD. Among the CV methods, YOLOv5 and YOLOv8 demonstrated exceptional performance, achieving 100% precision and recall with mAP@0.5 values of 99.5% on the UTA-RLDD. In contrast, Faster R-CNN showed an accuracy of 81.0% and a precision of 63.4% on the same dataset. These results demonstrate the potential of our system to significantly enhance road safety by providing proactive alerts in real time. Full article

The significant number of road traffic accidents caused by fatigued drivers presents substantial risks to the public’s overall safety. In recent years, there has been a notable convergence of intelligent cameras and artificial intelligence (AI), leading to significant advancements in identifying driver drowsiness. Advances in computer vision technology allow for the identification of driver drowsiness by monitoring facial expressions such as yawning, eye movements, and head movements. These physical indications, together with assessments of the driver’s physiological condition and behavior, aid in assessing fatigue and lowering the likelihood of drowsy driving-related incidents. This study presents an extensive variety of meticulously designed algorithms that were thoroughly analyzed to assess their effectiveness in detecting drowsiness. At the core of this attempt lay the essential concept of feature extraction, an efficient technique for isolating facial and ocular regions from a particular set of input images. Following this, various deep learning models, such as a traditional CNN, VGG16, and MobileNet, facilitated detecting drowsiness. Among these approaches, the MobileNet model was a valuable choice for drowsiness detection in drivers due to its real-time processing capability and suitability for deployment in resource-constrained environments, with the highest achieved accuracy of 92.75%. Full article

In recent years, the growing number of vehicles on the road have exacerbated issues related to safety and traffic congestion. However, the advent of the Internet of Vehicles (IoV) holds the potential to transform mobility, enhance traffic management and safety, and create smarter, more interconnected road networks. This paper addresses key road safety concerns, focusing on driver condition detection, vehicle monitoring, and traffic and road management. Specifically, various models proposed in the literature for monitoring the driver’s health and detecting anomalies, drowsiness, and impairment due to alcohol consumption are illustrated. The paper describes vehicle condition monitoring architectures, including diagnostic solutions for identifying anomalies, malfunctions, and instability while driving on slippery or wet roads. It also covers systems for classifying driving style, as well as tire and emissions monitoring. Moreover, the paper provides a detailed overview of the proposed traffic monitoring and management solutions, along with systems for monitoring road and environmental conditions, including the sensors used and the Machine Learning (ML) algorithms implemented. Finally, this review also presents an overview of innovative commercial solutions, illustrating advanced devices for driver monitoring, vehicle condition assessment, and traffic and road management. Full article

This research explores the design of a system for monitoring driver drowsiness and supervising seat belt usage in interprovincial buses. In Peru, road accidents involving long-distance bus transportation amounted to 5449 in 2022, and the human factor plays a significant role. It is essential to understand how the use of non-invasive sensors for monitoring and supervising passengers and drivers can enhance safety in interprovincial transportation. The objective of this research is to develop a system using a Raspberry Pi 4 and Arduino Nano that allows for the storage of monitoring data. To achieve this, a conventional camera and MediaPipe were used for driver drowsiness detection, while passenger supervision was carried out using a combination of commercially available sensors as well as custom-built sensors. RS485 communication was utilized to store data related to both the driver and passengers. The simulations conducted demonstrate a high level of reliability in detecting driver drowsiness under specific conditions and the correct operation of the sensors for passenger supervision. Therefore, the proposed system is feasible and can be implemented for real-world testing. The implications of this research suggest that the system’s cost is not a barrier to its implementation, thus contributing to improved safety in interprovincial transportation. Full article

Drowsy driving contributes to over 6000 fatal incidents annually in the US, underscoring the need for effective, non-intrusive drowsiness detection. This study seeks to address detection challenges, particularly in non-standard head positions. Our innovative approach leverages computer vision by combining facial feature detection using Dlib, head pose estimation with the HOPEnet model, and analyses of the percentage of eyelid closure over time (PERCLOS) and the percentage of mouth opening over time (POM). These are integrated with traditional machine learning models, such as Support Vector Machines, Random Forests, and XGBoost. These models were chosen for their ability to process detailed information from facial landmarks, head poses, PERCLOS, and POM. They achieved a high overall accuracy of 86.848% in detecting drowsiness, with a small overall model size of 5.05 MB and increased computational efficiency. The models were trained on the National Tsing Hua University Driver Drowsiness Detection Dataset, making them highly suitable for devices with a limited computational capacity. Compared to the baseline model from the literature, which achieved an accuracy of 84.82% and a larger overall model size of 37.82 MB, the method proposed in this research shows a notable improvement in the efficiency of the model with relatively similar accuracy. These findings provide a framework for future studies, potentially improving sleepiness detection systems and ultimately saving lives by enhancing road safety. Full article

Drowsiness has been recognized as a leading factor in road accidents worldwide. Despite considerable research in this area, this paper aims to improve the precision of drowsiness detection specifically for long-haul travel by employing the Dlib-based facial feature detection algorithm. This study proposes two algorithms: a static and adaptive frame threshold. Both approaches utilize eye closure ratio (ECR) and mouth aperture ratio (MAR) parameters to determine the driver’s level of drowsiness. The static threshold method issues a warning when the ECR and/or MAR values reach specific thresholds. In this method, the ECR threshold is established at 0.15 and the MAR threshold at 0.4. The static threshold method demonstrated an accuracy of 89.4% and a sensitivity of 96.5% using 1000 images. The adaptive frame threshold algorithm uses a counter to monitor the number of consecutive frames that meet the drowsiness criteria before triggering a warning. Additionally, the number of consecutive frames required is adjusted dynamically over time to enhance detection accuracy and more accurately indicate a state of drowsiness. The adaptive frame threshold algorithm was tested using four 30 min videos, from a publicly available dataset achieving a maximum accuracy of 98.2% and a sensitivity of 64.3% with 500 images. Full article

Drowsy driving is a leading cause of commercial vehicle traffic crashes. The trend is to train fatigue detection models using deep neural networks on driver video data, but challenges remain in coarse and incomplete high-level feature extraction and network architecture optimization. This paper pioneers the use of the CLIP (Contrastive Language-Image Pre-training) model for fatigue detection. And by harnessing the power of a Transformer architecture, sophisticated and long-term temporal features are adeptly extracted from video sequences, paving the way for more nuanced and accurate fatigue analysis. The proposed CT-Net (CLIP-Transformer Network) achieves an AUC (Area Under the Curve) of 0.892, a 36% accuracy improvement over the prevalent CNN-LSTM (Convolutional Neural Network-Long Short-Term Memory) end-to-end model, reaching state-of-the-art performance. Experiments show that the CLIP pre-trained model more accurately extracts facial and behavioral features from driver video frames, improving the model’s AUC by 7% over the ImageNet-based pre-trained model. Moreover, compared with LSTM, the Transformer more flexibly captures long-term dependencies among temporal features, further enhancing the model’s AUC by 4%. Full article