Next Article in Journal
Robust Magnetized Graphene Oxide Platform for In Situ Peptide Synthesis and FRET-Based Protease Detection
Next Article in Special Issue
A Low-Cost Automatic Vehicle Identification Sensor for Traffic Networks Analysis
Previous Article in Journal
Fault Detection and Isolation Methods in Subsea Observation Networks
Previous Article in Special Issue
Assessment of the Speed Management Impact on Road Traffic Safety on the Sections of Motorways and Expressways Using Simulation Methods
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Effects of the Driver’s Mental State and Passenger Compartment Conditions on Driving Performance and Driving Stress

by
Víctor Corcoba Magaña
1,*,
Wilhelm Daniel Scherz
2,
Ralf Seepold
2,3,
Natividad Martínez Madrid
3,4,
Xabiel García Pañeda
1 and
Roberto Garcia
1
1
Department of Computer Science, University of Oviedo, 33003 Oviedo, Spain
2
Ubiquitous Computing Lab, Department of Computer Science, University of Technology, Business and Design Konstanz, 78462 Konstanz, Germany
3
Institute of Digital Medicine, I.M. Sechenov First Moscow State Medical University, 119435 Moscow, Russia
4
IoT Lab, School of Informatics, Reutlingen University, 72762 Reutlingen, Germany
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(18), 5274; https://doi.org/10.3390/s20185274
Submission received: 30 July 2020 / Revised: 1 September 2020 / Accepted: 11 September 2020 / Published: 15 September 2020
(This article belongs to the Special Issue Intelligent Transportation Related Complex Systems and Sensors)

Abstract

:
Globalization has increased the number of road trips and vehicles. The result has been an intensification of traffic accidents, which are becoming one of the most important causes of death worldwide. Traffic accidents are often due to human error, the probability of which increases when the cognitive ability of the driver decreases. Cognitive capacity is closely related to the driver’s mental state, as well as other external factors such as the CO2 concentration inside the vehicle. The objective of this work is to analyze how these elements affect driving. We have conducted an experiment with 50 drivers who have driven for 25 min using a driving simulator. These drivers completed a survey at the start and end of the experiment to obtain information about their mental state. In addition, during the test, their stress level was monitored using biometric sensors and the state of the environment (temperature, humidity and CO2 level) was recorded. The results of the experiment show that the initial level of stress and tiredness of the driver can have a strong impact on stress, driving behavior and fatigue produced by the driving test. Other elements such as sadness and the conditions of the interior of the vehicle also cause impaired driving and affect compliance with traffic regulations.

1. Introduction

In 2018, there were 102,299 traffic accidents with victims in Spain, with 1806 people losing their lives [1]. Most of these accidents happened in cities. Distractions were the main cause of fatal accidents at 32%, speed was at 22% and alcohol or drug consumption was at 21%. Most accidents are due to human error [2,3]. Other factors such as the environment or the vehicle involve less hazard [4].
In the literature, we find many works that evaluate driving performance and the drivers’ physiological and cognitive states [5,6]. For example, in [5], the authors proposed a method to determine a driver’s relative stress level based on analyzing physiological data and artificial intelligence. Twenty-four drivers participated in the experiment. The authors monitored the participants in real driving for at least 50 min. The results showed that the conductivity of the skin and the pulse metrics are those that most correlate with the level of stress. In [6], the changes in the muscles of the shoulder and the neck were analyzed while the participant drove in a driving simulator. Professional and non-professional drivers participated in the study. The conclusions were that, in both cases, the drivers suffered from fatigue after driving for 15 min. Many researchers have found a strong relationship between emotions and traffic accidents. Researchers in [7] conducted a cluster analysis on responses to a survey by more than 1500 college students about potentially annoying driving-related situations. The authors noted that men were more angered by the police presence and slow driving. On the other hand, women were more angered by illegal behavior and obstructions. Finally, they concluded that knowing the driver’s anger could be of great help in reducing traffic accidents. Negative emotions, such as fear, anger, disgust or sadness, increase the probability of manifesting dangerous behaviors while driving. In [8], the authors analyzed the influence of mood on risk perception and attitude. The authors conducted an experiment where they induced different emotions in the driver by watching videos. The results showed that negative emotions significantly increase the perception of risk by the driver, but also cause an inappropriate attitude. In [9], the authors focused on studying how sadness affects driving performance. Sixteen drivers participated in the experiment. They used a driving simulator. The results showed that drivers with sadness make more driving mistakes than neutral drivers. Furthermore, the driving times is also longer. In [10], the authors explore the use of affective interfaces in vehicles. The researchers conducted an online survey on emotional situations on the road. The results showed that drivers who experienced negative situations require better information management and a high degree of automation. In contrast, drivers with positive emotions prefer a more genuine driving mode.
The state of the interior of the vehicle is another factor to consider. Other aspects such as the number of occupants in the vehicle or adequate ventilation should also be taken into account. It has been shown that a high concentration of CO2 decreases cognitive ability and increases fatigue. In [11], the authors analyzed the performance in a cognitive test when the participants were exposed to different levels of CO2. Participants obtained significantly better cognitive scores when the CO2 level was lower than 1400 ppm. Similar results were obtained in [12]. In this work, the researchers analyzed the effects of CO2 on decision making. Twenty-two people participated in the experiment who took a decision-making test. In addition, the participants also filled out a questionnaire about their health and perceived air quality. The authors found that there was a moderate worsening of decision-making performance at 1000 ppm of CO2.
Autonomous vehicles could be a solution to reduce traffic accidents caused by human errors. However, on the one hand, these solutions still have a high cost and are not accurate enough [13]. In addition, in most countries, there are still no laws or regulations for this type of vehicle [14,15]. On the other hand, the autonomous vehicles that have been developed to date require that the driver maintain attention on the road and if an exceptional event takes place, he or she must take control. The first accidents have already occurred due to a lack of attention and the need for traditional and autonomous vehicles to coexist. In [16], the author used a Tesla Model S vehicle for six months. In this article, he analyzed the problems that these vehicles present for the driver in real driving conditions. The researcher points out that these vehicles can improve safety and driving comfort, but also can present challenges due to the transition between automatic and manual driving mode. Finally, a series of guidelines are proposed to improve the way in which this type of vehicle interacts with the driver. Reducing human errors while driving remains a significant concern.
The emotions experienced by the driver can be caused by events that occur during the driving task or before. In [17], McMurray analyzed driving reports. The researcher concluded that drivers who were in the process of a divorce had a higher probability of suffering traffic accidents and violating traffic rules than other drivers. Similar results were obtained by [18], where the authors examined how stressful environments and psychological characteristics of the driver affect driving behavior. The results showed that stress significantly increases the risk of traffic accidents. The researchers also highlighted the importance of experiential knowledge acquired without instruction to present good driving behavior. In [19], the authors found that financial problems increase the likelihood of suffering a traffic accident. Therefore, events unrelated to the driving task influence stress and driving skills.
Many of the works that analyze the driver’s mental state and its effect on driving are based on artificially inducing a certain emotion using music, images or words [20]. For example, in [21], the researchers studied the effect of joy, sadness and anger on driving behavior using induced emotions. The results showed that negative emotions cause dangerous driving behaviors. The authors also observed that, in some cases, the emotional state did not affect driving when the workload was high. In [22], the authors conducted an experiment where participants were induced with sadness, anger or neutral emotions. Participants with induced anger or sadness made more driving mistakes than participants induced with neutral emotions.
Originally, the works that analyzed drivers’ emotions used subjective measures [7]. These methods require the direct intervention of the participant. Therefore, the samples are obtained at a low rate. In recent years, the psychological methods have become less expensive and intrusive due to wearables. These devices allow us to monitor the driver continuously and without requiring his direct involvement. [23]. During driving, the use of non-intrusive devices is essential so as not to affect driving performance or cause safety problems [24,25]. In [26], we can find a review of the solutions to monitor a driver’s psychological state.

Contribution

Most of the works documented in the literature focus on ascertaining the emotions of the driver while driving. There are some studies in which the driver’s previous state is analyzed, but they are minimal. Furthermore, they do not investigate how emotions together with factors such as the interior state of the vehicle (temperature, humidity and CO2 concentration) or the music the driver listens to affect driving and the level of stress. Another problem we have found in previous works is that they artificially induced moods, which could lead to inaccuracies in the results.
The objective of this work is to analyze which elements affect driving behavior and stress levels, focusing on the drivers’ initial emotions, their characteristics and the comfort inside the car. The conclusions of this analysis can be used to include the emotional component in driving assistants. Most of them are limited to warning the driver when they invade the opposite lane or exceed the speed limit.

2. Related Work on Stress Detection

Stress is defined as a state of physical, psychological or emotional health experienced by a person when the perceived or actual demand requires a high number of resources [27]. Stress appears when the demand for mental workload exceeds the capabilities of the subject [28]. Stress may be accompanied by other emotions such as anxiety [29]. However, it is not always bad. Healey et al. [5] classified stress into two types: eustress and distress. Eustress encourages people to achieve a high level of performance. If the level of stress is too low, it can cause drivers to suffer fatigue and drowsiness, and they may lose control of the vehicle [30]. Distress appears when there is an excess in the level of demand that surpasses the capacity of the person and consequently discourages the driver [31]. The level of stress experienced while driving can be affected by four factors: the physical and mental condition of the driver, road and traffic conditions, vehicle condition and external disturbances. This paper focuses on the driver’s mental state and vehicle condition (music tempo and CO2 concentration).
Stress detection methods can be classified into four categories:
  • Self-report questionnaire assessment;
  • Physiological measures;
  • Driving behavior monitoring;
  • Visual-based and speech detection.
The self-report questionnaires analyze the driver’s behavior and strategies for coping with different types of stressful events. In addition, the characteristics of the driver are very important [32]. Data such as age or accident history have a strong relationship with stress. Drivers who have suffered more traffic accidents are more likely to feel anxiety and develop post-traumatic stress disorders [33]. One of the most used questionnaires in research is the driver behavior inventory (DBI) [34]. In this questionnaire, stress is defined by five elements: driving aggression, dislike of driving, tension and frustration connected with successful or unsuccessful overtaking, irritation when overtaken and heightened alertness and concentration. There are also many other questionnaires such as: the driving stress inventory (DSI) [35], stress arousal checklist (SACL) [36] and Dundee stress state questionnaire (DSSQ) [37]. In the case of workload measurement, NASA load index (NASA-TLX) [38] and driving activity load index (DALI) [39] are the most widely used. In the experiments, several of them can be used with different objectives. For example, in [40], the participants completed the DSI questionnaire before the test to estimate their vulnerability to stress. They then completed the DSSQ questionnaire to analyze the stress and workload caused by the task.
Stress detection models based on physiological signals allow us to objectively monitor the driver’s stress level in real time. They mainly use the heart rate signal, skin conductance, skin temperature and the encephalogram [41,42]. The main disadvantage of these methods is that they require the use of sensors, which increases the cost and reduces the number of potential participants. In addition, these solutions can cause discomfort if they are intrusive. However, in recent years, wearable devices have been developed that can monitor the driver without affecting mobility and at a relatively low cost. An example widely used in research is the Empatica E4 [43]. These portable devices are not as accurate as medical devices. However, there is a strong correlation between them, and they are valid for measuring stress and conducting long-term studies [44,45].
In the literature, we find many proposals of stress detection based on these types of signals. A strong relationship between driving stress and heart rate and blood pressure was reported in [32,46]. In [47], the authors proposed a binary logistic regression model to predict driving stress. This method uses galvanic skin response data obtained in real road driving situations to predict whether driver stress will be high or low. GSR data were collected using a wearable device (Empatica E4). The main advantage of this solution is that it is non-intrusive so it can be used in real driving. The authors achieved an accuracy higher than 80% using this model. In [48], the authors wanted to analyze the relationships between driving stress, traffic conditions and road types. The authors proposed using electrodermal activity (EDA) signals to estimate the levels of driving stress taking into account the road type and traffic conditions. The classification model developed was based on the data collected by a driver in real road driving conditions for 60 min a day for 21 days. The results showed than traffic conditions and road type are factors that influence driving stress.
Proposals using physiological signals can detect driver stress in real time using artificial intelligence algorithms [5,49]. Galvanic skin response (GSR) and heart rate variability (HRV) are considered the best indicators of stress in real time [5]. However, we should take into account the latency that in the case of skin conductivity can be up to 1.4 s [50].
A different alternative to using these sensors is to analyze the driver’s face and speech. This avoids having to wear sensors. For example, the authors in [51] used visual-based thermography to detect facial skin temperature. In [52], the authors proposed to analyze facial expression using an NIR camera. The drawback is that good illumination is required to achieve accuracy in stress detection. Voice speech is another variable that can be helpful for detecting stress. In [53], the authors analyzed the changes in pitch of the subjects to detect stress. The problem with this type of approach is that it requires the driver to perform additional tasks while driving in order to make the voice recording, which could cause distractions [54]. In addition, noise inside the vehicle cabin could make it difficult to detect stress [55].
There are some proposals to detect stress based on driving behavior. The authors in [56] highlighted that the autonomic system (ANS) and driving style change when the level of stress is high. Stressful events can be detected by analyzing the corrections the driver makes with the steering wheel and the pedals of the vehicle. In [57], the researchers proposed a system that monitors the turning patterns of the steering wheel and recognizes lanes and accelerating patterns in order to detect stress.
Finally, there are proposals that combine the use of physiological signals with vehicle telemetry (steering wheel movement, acceleration, deceleration). In [58], the authors presented a wearable glove system for monitoring stress while driving. The proposal extracted features of photoplethysmography (PPG) and inertial measurement unit (IMU) sensors located in the glove to assess the stress events. The proposal was able to detect stress events with an accuracy rate of over 95% using an SFS-SVM classifier with the RBF kernel function. The main limitation of this device is that participants cannot change the position of their hands on the steering wheel during the driving test.

3. Materials and Methods

In this section, we will describe the materials and the procedure to carry out the experiment. We present the sensors (Figure 1) used to monitor driving stress, to evaluate driving performance and to obtain the state of the simulation environment (temperature, humidity and CO2 level). Driving stress is tracked using an Empatica E4 wristband and a Polar H10 chest band. The environment is supervised using the Netatmo device. We also define the measurements that we will use to evaluate the drivers and their driving behavior from the data gathered by the sensors. In addition, the test scenario will be detailed, explaining the simulator used, as well as the music that the driver listened to during the driving task. It will specify the survey completed by the drivers before and after the test to ascertain their characteristics, their opinion of the experiment and their physical and mental state.

3.1. Heart Signal

We have used several sensors in this work to measure stress objectively. One of the vital signs most used in research on driving is the heart rate variability (HRV). There are numerous studies where this biosignal is measured due to its strong correlation with stress, and the fact that it can be obtained in a non-intrusive way [5].
Heart rate variability can be analyzed in two different domains: time and frequency. Time domain analysis of the HRV signal consists of measuring the mean or standard deviation of the time intervals between consecutive heartbeats. Frequency domain analysis is a method based on the amount of heart signal found in two different frequency bands. In the case of heart rate analysis, the ranges are (0.04–0.15 Hz) and (0.15–0.4 Hz). In this work, we use the following measurements obtained from the heart rate signal that have been widely used in the literature [59]:
  • pNN50 (%): this is the number of consecutive heartbeats differing more than 50 ms divided by the total number of measured heartbeats and expressed as a percentage. This variable decreases when driving stress is high.
  • LF/HF: this is the low-frequency (LF) power (0.04–0.15 Hz) modulated by the sympathetic and parasympathetic nervous system divided by the high-frequency (HF) power (0.15–0.4 Hz) associated with the parasympathetic nerve activity. This ratio captures the global sympathovagal balance [25]. A high LF/HF ratio means sympathetic dominance, which happens when driving stress is elevated.
There are several non-intrusive devices which obtain the heart rate. Many of them are based on the photo-plethysmography sensor that allows us to measure the blood volume pulse. This type of device has improved significantly in recent years. However, they are very sensitive to movement and the level of pressure on the skin [60]. Another type of sensor that allows measuring the heart rate non-intrusively is a chest band with electrodes. These solutions achieve higher accuracy than the photo-plethysmography sensor [61,62].
In our case, the heart signal is obtained using a Polar H10 chest band. Polar H10 is the successor to the Polar H7 device. Polar H10 introduces improvements to measure heart rate variability. This device can offer precision for measuring the time between successive heartbeats (also called RR interval) similar to that obtained by a Holter ECG [61]. Polar H10 was connected wirelessly to the EliteHRV© app [63] running on a Google Pixel 3a. This app directly receives the RR intervals and uses a proprietary algorithm to correct artifacts such as ectopic beats or signal noise to present a more valid signal for heart rate analysis (HRV). We exported the calculated HRV values (pNN50 and LF/HF ratio) from the web dashboard provided by this app. It is also important to mention that before starting the heart rate measurement, there is a 30 s sensor stabilization period. Table 1 shows the Polar H10 specifications.

3.2. Skin Conductivity

The variation of skin conductivity is linked to the sympathetic nervous system [62]. When the driver has high stress, the activity of sweat glands is triggered by postganglionic sudomotor fibers. The result is a change in the skin conductivity response (SCR) that can be measured by applying a low constant voltage. The SCR amplitude can be used as an indicator of sympathetic activity [33].
Skin conductivity is monitored using an Empatica E4 wristband. Table 2 [65] shows the characteristics of the sensors that the Empatica E4 device integrates. This device is certified as CE Medical class 2a [66] and has been validated in many works [67,68]. It includes a photo-plethysmography sensor that allows us to measure the blood volume pulse. It also has a galvanic sensor to measure sympathetic nervous system arousal as well as to derive features related to stress, engagement and excitement. The wristband features are a 3-axis accelerometer to capture motion-based activity and an infrared ray which reads peripheral skin temperature. This device has been designed for continuous, real-time data acquisition.
However, the calculation of the amplitude is not trivial. Usually, the SCRs overlap each other. In the standard peak detection method (trough-to-peak), the SCR amplitude is obtained by calculating the difference between the peak and the previous trough of the skin conductance data. This results in an underestimation of the amplitude of subsequent SCRs. The degree of underestimation depends on the amplitude and proximity of the preceding SCRs. There are different proposals in the literature to avoid this problem. In this paper, a deconvolution approach [35] is used, which separates skin conductivity data into continuous signals of tonic and phasic activity. This algorithm allows us to represent the overlapping SCRs by compact impulses, thus avoiding the underestimation problem. To that end, we use Ledalab 3.4.9 [69], which is recommended by Empatica. Before the signal deconvolution by continuous decomposition analysis, we pre-process it to eliminate high-frequency noise by applying a smoothening filter consisting of a 4-sample Gaussian window.

3.3. Environments

Temperature, humidity and CO2 concentration are variables that influence comfort and safety [70]. Vehicles tend to circulate in areas that are heavily contaminated. Many drivers close the windows and use the air conditioning in order to avoid polluting gases. However, the air that comes from this system is not clean. Besides, the reduced space of the vehicle causes a high amount of CO2 to accumulate due to the passengers themselves. If the level of CO2 inside the vehicle is very high, the driver may suffer from dizziness and nausea [71].
Temperature and humidity are other factors that can induce fatigue in the driver [72]. In the past, temperature was a significant cause of traffic accidents [73]. Currently, most vehicles integrate an air conditioning system. However, it is very difficult to adjust it correctly because the thermal sensation is different for each passenger [74]. An inadequate temperature, either too high or too low, causes a significant worsening of driving performance [75]. In order to monitor the interior of the vehicle, we used a Netatmo Healthy Home Coach [76]. This system allows us to obtain the air temperature, relative humidity and CO2 concentration. The measurements are taken every five minutes, and are uploaded to the cloud instantly. The data are processed internally using proprietary Netatmo algorithms. We directly downloaded the temperature, humidity and CO2 values using a Python script. We could not obtain the raw data. Regarding the validity of the use of the device to measure the CO2 concentration, there are several works where it has been verified, providing that a calibration has been previously performed [77,78].
The Home Coach Netatmo device allows manual calibration of the CO2 and temperature sensor. The calibration of the CO2 sensor of the device was carried out for 8 h inside a room without any occupants following the manufacturer’s instructions [79]. The temperature of the room during calibration was 25 °C. The temperature sensor was calibrated by calculating the average difference between the measurement obtained by the Netatmo device and the value offered by a weather station belonging to the State Meteorological Agency (AEMET), located in Asturias. The samples were collected over 7 days at 11 A.M. As a result, we fitted the temperature by +0.1 °C. In order to obtain the temperature reading using the Netatmo device at the location of the weather station, an external Samsung power bank was used. The Netatmo device has been validated by other authors previously obtaining good accuracy when the value of the air temperature under investigation is close to the air temperature in which the manual calibration occurs. In our case, the temperature during the calibration and test drive was very similar. Table 3 shows the specifications of the air quality sensor.
In our experiment, the temperature and humidity remained constant and we analyzed the CO2 concentration. In the literature, we find works where the CO2 concentration inside the vehicle cabin is analyzed [80]. However, we have not found works which study how a high CO2 concentration influences driving stress and driving behavior.

3.4. Driving Simulator

This experiment was carried out using the “City Car Driving” simulator [82]. The simulator uses advanced car physics to achieve a realistic car feeling and a high-quality render engine for graphical realism. The simulator implements German traffic rules and warns drivers if they fail to comply with some of these. Traffic density can also be adjusted with the simulator. The drivers’ behavior and pedestrians’ behavior are sometimes erratic as in a real environment. The vehicles can collide with the player’s car or with each other. Pedestrians sometimes cross the road in the wrong places. The scene selected for the experiment is named “Old District” and is characterized by narrow streets with simple crossing places and clear traffic patterns. This driving simulator was developed to train novice drivers in driving schools. It saves a log file with all the traffic rules that the driver violated as well as events such as traffic accidents.
The execution of the driving simulator on a computer and features are included in Table 4. Three 27-inch screens were connected to the computer. To operate the vehicle, we employed a Logitech G29 [83]. This device is an electronic steering wheel designed for driving video games with realistic force feedback. It includes a set of three pedals and a gearbox, and it allows us to archive an immersive perception in the virtual environment. Table 5 shows the specifications of the device.
In order to evaluate driving performance, we have developed a program based on the SFML library [85] that captures the angle of rotation of the steering wheel and the pressure applied by the participant on the pedals. In this study, we have defined the following variables to assess driving behavior:
  • Harsh braking: this is the percentage of time that the driver stopped abruptly concerning the total braking time. We have considered that the driver brakes sharply when the deceleration is −2.5 m/s2 or more. This value is considered by many authors as abrupt [86].
  • Braking time: this is the time of the total driving time (25 min) that the driver was pressing the brake pedal and is expressed as a percentage.
  • Harsh acceleration: this is the percentage of time that the driver sped up abruptly with respect to the total acceleration time. We have considered that the driver accelerates sharply when the value is 1.5 m/s2 or more. This value is considered by many authors as abrupt [86].
  • Acceleration time: this is the time of the total driving time (25 min) that the driver was pressing the accelerator pedal and is expressed as a percentage.

3.5. Music Tempo

Many people listen to music when they are driving. Studies show that music influences human behavior. In supermarkets, fast music causes customers to move faster through the store [87]. In bars, fast music makes people consume their drinks quickly [88]. The music tempo also causes an effect on the speed and accuracy of the tasks. In [89], fast music increased the rate and accuracy of mathematical computations in stock market environments. In driving, fast music also instigates the driver to drive faster [90]. However, in music, many parameters can affect the driver, such as the genre of music, instruments or volume, but the tempo is one of the most important in driving.
In the experiment, the participants listened to music through headphones. Drivers could adjust the volume according to their preferences to avoid discomfort. We created two playlists on Spotify [91]. One includes music with a slow tempo (65–71 bpm), and the other contains audio tracks with a fast tempo (155–188 bpm). Each of the participants was randomly assigned one of the two lists. Further, the song “Sonata for Two Pianos in D major” from Mozart was used to relax the participant at the beginning of the experiment. All songs were reproduced with the best sound quality that Spotify allows (OGG, 320 Kbps). In addition to the music, the drivers listened through headphones to the sound of the vehicle’s engine.

3.6. Survey

The participants completed two surveys: one at the beginning of the experiment and another at the end. The purpose of the pre-test survey was to obtain driver characteristics and the emotional and physical states. The survey contains questions about the level of stress, fatigue and sadness that the driver feels before the driving test. The participant should respond using a Likert scale. A Likert scale is a psychometric scale used in educational and social sciences research that employs questionnaires [92]. The Likert scale is composed of a set of statements (items). Participants are asked to show their level of agreement (from strongly disagree to strongly agree) with the given statement (items) on a metric scale. In our case, the scale is between 1 and 5, where 1 means that he or she does not suffer from that symptom or emotion and 5 that he or she develops it to a high degree.
The post-test survey was focused on ascertaining the emotional and physical states after completing the driving task. The objective was to check if the driving task had emotionally affected the driver. As previously mentioned, it comprises queries about the level of stress, fatigue and sadness that the driver feels but in this case after the driving test. This survey also includes questions about the degree of realism of the simulator, the satisfaction level of the drivers with their driving performance and the environmental conditions (temperature, noise and humidity). These questions will allow us to check if the subjective opinion of the participant corresponds to the data gathered by the sensors and if the simulator is realistic enough to infer that in a real environment, we would obtain similar results.

3.7. Procedure Description

First, the sensors were fitted to the participant, who then completed the initial survey. Then, he or she listened to Mozart’s Sonata for Two Pianos in D major using headphones. This track has been selected because it improves mental function [93]. The objective of this phase is to be relaxed before the driving test and to stabilize the sensors. A total of 50 drivers with an average age of 31.76 years (max: 57, min: 18; std. dev.: 10.48) and driving experience of 11.28 years (max 40, min: 1, std. dev: 10.24) participated in the experiment. The participants drove for 25 min. In the driving test, the heart signal, the skin conductivity and the environment (temperature, humidity and CO2 level) were monitored. The music and the sounds of the vehicle were listened to through headphones. The drivers had to complete the routes proposed by the GPS of the driving simulator. Each route has a length of 5 km and its level of difficulty is comparable because the concentration of vehicles and pedestrians is the same in all cases. The driving simulator assigns points to the participant at the beginning of the route. Each time an infraction is committed, points are deducted. When the score is zero, the route must be repeated. This allows the participant to be focused on the driving task as if in a real environment [94]. The driving time is 25 min to have enough time for the stress data to be valid [95].
A statistical analysis was conducted using R (version 3.6.0) in order to obtain conclusions from the data. We have used the Student’s test or Wilcoxon’s test for independent samples depending on whether the hypothesis of normality is verified or not. The significance level was set at 0.05. Therefore, if the p value is less than 0.05, we assume that there are significant differences between the analyzed groups.

4. Results

4.1. Effects of Initial Stress

The drivers have been grouped into two sets, “stressed” and “non-stressed”, according to the initial level of stress. The drivers indicated their stress level using a Likert scale with values between 1 and 5, where 1 means that they are not suffering from stress and 5 that they have a lot of stress. The “stressed” group is made up of 21 drivers. These indicated in the initial survey that their stress level was equal to or higher than 4. The “non-stressed” group consists of 29 drivers. These drivers indicated a stress level equal to or less than 3. In order to analyze if there are significant differences between the two groups, we conducted a Student’s test or a Wilcoxon’s test for independent samples, depending on whether or not the normality hypothesis is verified. We use p < 0.05 as the significance level.
Table 6 shows the variables related to stress during driving. The participants who initially indicated that they had stress also obtained values associated with high stress during the driving test. We have found significant differences in two of the three variables analyzed. The result of Wilcoxon´s test is Z = −3.116, p < 0.05 for pNN50, Z = −3.803, p < 0.05 for LF/HF ratio and Z = −3.491, p < 0.05 for SCR amplitude.
Stress also has consequences on driving behavior. Stressed drivers accelerate and brake more frequently and intensively than other drivers, as can be seen in Table 7. The difference in driving behavior is especially important in harsh accelerations and decelerations. The percentage of sudden accelerations is six times higher compared to unstressed drivers and twice as high in the case of sudden braking. The result of Wilcoxon´s test is Z = −5.376, p < 0.05 for harsh braking, Z = −2.428, p < 0.05 for braking time and Z = −5.063, p < 0.05 for harsh acceleration. In the case of the acceleration time, neither the normality hypothesis nor the equality hypothesis of variances are rejected. Therefore, we carry out a Student’s test whose result is t(48) = 2.703, p < 0.05.
Figure 2 shows the degree of compliance with traffic rules grouped by initial stress level. We have found significant differences between stressed drivers and non-stressed drivers in “Speed limit exceeded” (Z = −5.184, p < 0.05), “Do not yield to a pedestrian in a crosswalk” (Z = −2.695, p < 0.05) and “Crossing the lane markings illegally” (Z = −2.588, p <0.05). Drivers who are initially stressed often drive at high speed, invade the opposite lane to overtake other vehicles and do not stop at crosswalks.
Figure 3 compares the difference between initial and final fatigue for the two groups of drivers. These values were obtained from the pre-test and post-test surveys. On the one hand, stressed drivers suffer an important increase in the fatigue level after completing the driving test. The tiredness grew by 20%. In the case of drivers with low initial stress, the level of tiredness scarcely changed. On the other hand, at the beginning of the driving experiment, we found no significant differences in the fatigue level between the two groups of drivers analyzed. The result of Wilcoxon´s test is Z = −1.491, p > 0.05. However, we observed significant differences at the end of the experiment. The result of Wilcoxon´s test is Z = −4.545, p < 0.05.

4.2. Effects of Sadness

The drivers have been grouped into two sets according to the sadness level. The drivers indicated their sadness level using a Likert scale with values between 1 and 5, where 1 means that they are very happy and 5 indicates that they are very sad. The group of drivers with sadness is composed of 17 drivers. These indicated in the initial survey that their sadness level was equal to or higher than 4. The non-sadness group is formed by 33 drivers who rated their level of unhappiness with a value equal to or less than 3.
Table 8 shows the variables related to stress during driving. Drivers who show sadness are also those who have a higher level of stress. However, the differences are not significant. The result of Wilcoxon´s test is Z = −0.881, p > 0.05 for pNN50, Z = −0,522, p > 0.05 for LF/HF and Z = −0.420, p > 0.05 for SCR amplitude.
Table 9 presents the acceleration and deceleration values obtained by the drivers. We observe that drivers with sadness accelerate sharply more times than drivers without sadness, although the difference is not significant. The result of the Student’s test is t(48) = 2.001, p > 0.05. No significant differences were found either in the rest of the parameters.
Figure 4 captures the average number of traffic accidents. Drivers with sadness suffer traffic accidents more often than the group of drivers without sadness. The difference between the two groups is especially relevant, as the group with sadness is involved in four times as many accidents as the group of drivers without sadness. The result of Wilcoxon´s test is Z = −4.741, p < 0.05.
Figure 5 compares the level of fatigue before and after the driving test. Drivers suffering from sadness increased their fatigue level by 11.5% compared to their initial value. In the case of drivers without sadness, fatigue increased by 7.5%. However, we found no significant differences between both groups at the beginning and at the end of the experiment. On the one hand, the result of Wilcoxon´s test in the initial survey is Z = −0.361, p > 0.05. On the other hand, the result of Wilcoxon´s test in the post-experimental survey is Z = −1.472, p > 0.05.

4.3. Effects of Fatigue

In order to analyze this factor, we have divided the samples into two groups. The drivers indicated their initial fatigue level using a Likert scale with values between 1 and 5, where 1 means that they are very vigorous and 5 indicates that they are very tired. The non-fatigue group consists of 36 drivers. These drivers showed a tiredness level equal to or less than 3. The fatigue group is made up of 14 drivers. These indicated in the initial survey that their fatigue level was equal to or higher than 4.
Table 10 reveals the average stress level during the test grouped by the initial fatigue level. The results indicate that tired drivers suffer more stress while driving than the other drivers. The variable pNN50 is eight times lower in the group of drivers who are tired, and the LF/HF ratio and SCR amplitude are twice as high. Low values of pNN50 and high values of LF/HF ratio and SCR amplitude are correlated with high stress. In all variables, the differences are significant. The result of Wilcoxon´s test is Z = −4.905, p < 0.05 for pNN50, Z = −4.127, p < 0.05 for LF/HF and Z= −3.297 for SCR.
Driving behavior is also affected by this state. Table 11 shows the use of the accelerator and brake. Acceleration time and braking time is higher for tired drivers than for rested drivers. The differences are significant. The result of the Student’s test is t(48) = 2.905, p < 0.05 for acceleration time and t(48) = 3.754 p < 0.05 for braking time. This means that the drivers are continuously making speed corrections and increasing fuel consumption. No significant differences have been found in the case of abrupt maneuvers, although both average and median values are higher for tired drivers.
Figure 6 captures the number of broken driving rules in which there are significant differences between fatigued and non-fatigued drivers. The result of Wilcoxon´s test is Z = −4.402, p < 0.05 for “Stopping over the crosswalk” and Z = −3.459, p < 0.05 for “Do not yield to a pedestrian at a crosswalk”. Tired drivers stop over the crosswalk 4.5 more times more than the rest of the drivers. Furthermore, they did not yield to a pedestrian at a crosswalk two times more. This could increase the likelihood of running over a pedestrian.
Figure 7 compares the difference between initial and final fatigue for the two groups of drivers. On the one hand, there is a significant increase in the fatigue level of the non-tired drivers. Tiredness increased by 13.79% after completing the driving test. On the other hand, in the case of tired drivers, the average fatigue value decreases by 8.39%. This could be because for some participants, the driving test is like a leisure activity. Despite this, the level of fatigue manifested by the drivers who were initially tired remains significantly higher than that of the drivers who initially did not feel tired. The result of Wilcoxon´s test is Z = −3.105, p < 0.05.

4.4. Effects of CO2 Concentration

In order to analyze this factor, we have divided the samples into two groups. One group consists of 29 drivers who drove with an average CO2 value of less than 1400 ppm. We have chosen this threshold because it has been shown in many articles [11] that differences in cognitive performance appear above this value. The average value of CO2 concentration of this group was 319.67 ppm (max: 562.55 ppm, min: 149.8 ppm, std. dev: 119.17 ppm). The second group is made up of 21 drivers who drove with an average CO2 value equal to or higher than 1400 ppm. The average value of CO2 concentration of this group was 1572.96 ppm (max: 1734.56 ppm, min: 1434.81 ppm, std. dev: 107.43 ppm). The average temperature value during all the tests was 25.27 °C (maximum = 26.71 °C, minimum = 24.12 °C, standard deviation = 0.63 °C) and the average humidity was 50.64% (maximum = 58.13%, minimum = 48.35%, standard deviation = 3.11%).
Table 12 captures the value of the variables associated with stress. The difference between groups is not significant. The result of Wilcoxon’s test is Z = −0.147, p > 0.05 for pNN50, Z = −0.88, p > 0.05 for LF/HF and Z = −0.364, p > 0.05 for SCR amplitude.
Table 13 shows driving behavior. The results indicate that the driver brakes more frequently when the passenger compartment has a high concentration of CO2. The difference is significant between the two groups (high and low CO2 level). The result of Wilcoxon´s test was Z = −3.843, p < 0.05 for braking time. A high CO2 concentration causes drowsiness and a lack of concentration. The participant’s cognitive capacity is reduced and he or she responds more slowly to events that happen on the road.
Consequently, as we can see in Figure 8, the driver violates more traffic regulations and is involved in a higher number of traffic accidents. We found significant differences in “Crossing the lane markings illegally” (Z = −2.478, p < 0.05), “Not stopping at a red light” (Z = −2.752, p < 0.05) and “Traffic accidents” (Z = −2.105, p < 0.05). Figure 8 captures the traffic rules broken and traffic accidents grouped by CO2 level. We can see how drivers who are exposed to high concentrations of CO2 invade the opposite lane 95% more than the rest of the drivers. Moreover, they respect traffic lights less. The group of drivers who drive with a high concentration of CO2 ignored the red lights 1.14 times on average, while the drivers who drive with a low CO2 level passed red lights 0.59 times. Frequent decelerations along with non-compliance with traffic regulations result in a sharp increase in the number of accidents of the group with the high CO2 concentration. These drivers suffer 1.87 times more accidents than the rest of the drivers.
Figure 9 captures the initial and final level of fatigue for each group of drivers. The results show that when the CO2 concentration is high, the fatigue level increases by 12% compared to the initial value, while when the CO2 level is low, the level of fatigue does not change.

4.5. Effects of Music Tempo

As in the previous analyses, the driving samples were divided into two groups. One group is made up of 23 drivers who listened to slow tempo music. The other group consists of 27 participants, but in this case the music was fast tempo music.
Table 14 captures the value of the variables related to stress. In the case of drivers listening to fast-paced music, pnn50 and LF/HF ratio are higher than drivers listening to slow music, although the differences are not significant. The result of Wilcoxon’s test is Z = −0.049, p > 0.05 for pNN50, Z = −0.457, p > 0.05 for LF/HF and Z = −0.886, p > 0.05 for SCR amplitude.
Table 15 captures driving behavior grouped by music tempo. We observed that the average values of the four variables analyzed are higher in the case of drivers who listen to fast-paced music than participants who listen to slow-paced music. This means that drivers with fast-paced music show a more aggressive driving style, although we have only found significant differences in acceleration time. The result of the Student’s test is t(48) = −2.891, p < 0.05. Likewise, we have found significant differences in the violation of speed limits, as can be seen in Figure 10. The result of Wilcoxon´s test is Z = −1.980, p < 0.05. As future work, we want to conduct more experiments to verify whether the differences between the driving behavior variables are significant if the number of participants is increased.
Figure 11 shows the level of initial and final fatigue for the two groups of drivers using a Likert scale, where 1 means no fatigue and 5 a lot of fatigue. The level of fatigue only increased by 2.8% for drivers who listened to music at a slow pace. In contrast, drivers who listened to fast-paced music suffered a significant increase in the level of fatigue (by 7.5%). These results are consistent with those obtained by [95]. In this study, fast music deteriorated the level of fatigue.

4.6. Multivariate Analysis

Linear ANOVA models have been calculated for each of the factors analyzed: initial stress, sadness, initial fatigue, CO2 concentration and music tempo. In all models, the p value is less than 0.05. Therefore, we can state that the independent variables reliably predict the dependent variable. Table 16 shows the models with an adjusted R-squared (R2) higher than 55%. Adjusted R-squared is a statistic that gives information about the goodness of fit of a model. R-squared is defined as the fraction of the variance in the dependent variable that is explained by the model. The adjusted R-squared is a modified version of R-squared that has been adjusted for the number of predictors in the model. The higher the adjusted R-squared value, the more the model fits the real data. In Table 16, the labels labeled as “COEFFICIENT” are the values for the regression equation for predicting the dependent variable from the independent variables. Finally, the p value is a probability. It gauges the likelihood that the coefficient is not significant, so smaller is better. In our case, we consider that there is significance when the value is less than 0.05.
We can see that the best model is obtained in “Speeding”, where the adjusted R2 is higher than 70%. In view of the coefficient’s values and the p value, we can state that the initial stress level as well as the initial fatigue and fast-paced music significantly increase the number of times the speed limits are surpassed. We can also point out that both sadness and a high concentration of CO2 do not seem to influence speeding. In these two independent variables, the p values are higher than 0.05.
In the LF/HF ratio, we found that the initial stress level along with fatigue contributes to the occurrence of stress during driving. It is important to highlight the strong relationship between initial fatigue and the possibility of stress while driving, where the coefficient value is 4.152. In the case of the other two variables related to driving stress (pNN50 and SCR amplitude), the same thing happens, but we have not included them in the table because the adjusted R-squared value is lower than 50%. Finally, we can observe that when the driver suffers sadness, the value of the LF/HF ratio decreases, meaning less stress in driving. The p value for sadness is lower than 0.05 and the coefficient is −1.405. This could be explained because the drivers are focused on their own problems. Extremely low driving stress is also not good for safety because it could cause drowsiness [5].
The results of the “Harsh braking” variable are very similar to the “LF/HF” variable. However, the p value of sadness is higher than 0.05. Therefore, in this context, it does not significantly affect the model. The driver who is initially tired or stressed does not react early enough to road events, forcing aggressive maneuvers and increasing driving stress.
Regarding sudden accelerations, they characterize an aggressive driving style which appears especially when the driver is stressed. The coefficient value is 6.936 and the p value is lower than 0.05. Sadness is also an emotion that contributes. The coefficient value is 2.315 and the p value is lower than 0.05. People with sadness often adopt an aggressive driving style and a certain degree of passiveness that causes increased fuel consumption and can annoy other drivers [22]. On the contrary, a high concentration of CO2 decreases harsh accelerations. The coefficient value is −2.074 and the p value is lower than 0.05. This could be due to the possible appearance of drowsiness [96].

5. Discussion and Limitations of Our Experiment

In our experiment, the initial level of stress and fatigue has a strong impact on driving behavior and driving stress. The relationship between stress and road safety has been verified by many authors [97,98]. Several studies have corroborated that a high level of stress increases errors and traffic violations. In [46], the authors conducted a study involving 2806 drivers using the driver behavior questionnaire (DBQ) and the driver behavior inventory (DBI). The DBI assesses dimensions of driver stress, whereas the DBQ is concerned with assessing the relative frequencies with which drivers engage in different types of aberrant driving behavior. They found a strong correlation between an aggressive driving style and high levels of stress. They also observed that when the stress is high, drivers make more mistakes, although in this case, the dislike of driving also seems to play a role. This is consistent with our findings that stressed drivers accelerate and brake more often than non-stressed drivers. Furthermore, harsh accelerations are six times higher than the values obtained by non-stressed drivers. In the case of harsh braking, the values are twice as high as those obtained by non-stressed drivers. Harsh accelerations and harsh braking are indicative of an aggressive driving style. The main difference between our analysis and the previous literature is that we have monitored the driver’s state and driving behavior. Most of the proposals are based on self-reports of drivers or traffic accident databases provided by the government [99]. The problem with self-reports is that they depend on the drivers’ perception, which could be wrong. In [99], the authors found that drivers with high confinement had a low risk perception and reported driving errors incorrectly.
Regarding the sadness factor, we observe that it is mainly characterized by a very significant increase in the number of traffic accidents. This emotion also contributes significantly to the increase in sudden decelerations. Attentional self-focus and repetitive negative thoughts are two main elements in sadness [100,101]. These elements affect information processing and attention [102]. In [103], the authors observed that sadness-induced drivers made more errors in target location. This could explain why, in our experiment, drivers with sadness suffered more traffic accidents than drivers who do not feel this emotion. On the other hand, we also found in our driving test that drivers with sadness did not manifest more stress than other drivers. In [22], the researchers conducted a simulated driving experiment with two induced affective states to examine how sadness and anger differently influence driving-related risk perception, driving performance and perceived workload. The results they obtained showed that sad drivers make more driving errors, but do not perceive a higher workload than drivers with an emotionally neutral state. This could explain why we have not found significant differences in driving stress.
In the literature, many researchers focus on analyzing how fatigue that increases during driving affects driving performance and road safety [104]. These studies point out that fatigue is a very important factor that causes a lack of hazard perception [105]. This may lead to driving accidents [106]. In this regard, the European Union has a regulation that sets the maximum driving time for professional drivers [107]. The relationship between driver fatigue and hours of service regulations is a challenge [108]. Some authors have found that driving time is a significant predictor of accident risk [109]. In other studies, there is no evidence of a time-on-task effect [110]. This could be due to the repercussion of the driver’s initial fatigue level. In our study, we have observed that initial fatigue significantly influences driving behavior and driving stress. We have also observed a non-compliance with traffic regulations that require high attention from the subject such as “yield to a pedestrian at a crosswalk”. This demonstrates the need to not only monitor fatigue during driving, but also to do so beforehand in order to ensure driving safety.
Traditionally, the CO2 concentration inside the vehicle cabin was not considered dangerous because of its low level. However, several recent studies have shown that the concentration of CO2 can be quite high depending on the number of vehicle occupants, speed and the environment [111]. In addition, cognitive impairment has also been observed with low or moderate CO2 concentrations with short exposure times [112]. In [113], the authors observed that the mental task required more effort from the subjects when the CO2 concentration in the air reached 3000 ppm. In [12], the researchers concluded that decision-making performance decreased when participants were exposed to CO2 concentrations between 1000 and 2500 ppm. This is in line with what was observed in our study. The worsening of decision making when the CO2 concentration is high causes the number of traffic accidents to increase. A high CO2 concentration also causes fatigue and drowsiness in drivers, reducing reaction time [114]. As a consequence, we observed in our study an increase in the frequency and intensity of decelerations. Finally, the combination of high initial stress with fast-paced music causes, in our experiment, a significant increase in the number of times the maximum allowed speed is exceeded. There are many marketing studies where fast music is used to encourage customers to purchase [115,116]. In the field of driving, many researchers have observed a similar behavior. In [90], the authors concluded that listening to fast music in the background affects non-compliance with traffic rules such as speeding.
As a limitation in our study, we did not take into account variables such as personality, gender, socio-educational level or the driver’s history (fines and traffic accidents). In [117], the researchers conducted a study with 41 drivers using a driving simulator, where they observed that these variables affect driving behavior, especially when drivers are tired. These factors were not included in the survey in order not to extend our experiment and discourage participants. In most of the papers, the subjects only had to fill out surveys and did not drive. Another limitation is in the evaluation of the music factor. We have only analyzed the tempo. The subject could freely adjust the volume of the music and the playlist was the same for all participants. We have not considered other elements that can influence driving behavior such as gender or music familiarity [118].

6. Conclusions

In this work, we have analyzed how the mental state of the driver and the interior state of the vehicle affects driving and its relation to compliance with traffic regulations and accidents.
Among the factors analyzed, the negative influence of stress stands out. On the one hand, stress is strongly related to an aggressive driving style with sudden accelerations and decelerations. This behavior means that the rest of the road users are not able to predict their actions, increasing the probability of traffic accidents. In the driving tests, these drivers did not often respect the speed limits, they overtook other vehicles in areas where this action should not be performed and did not stop at the crosswalks. On the other hand, the driving style associated with this state increases fuel consumption. As the driver drives at an inappropriate speed, the brakes are used more, and the driver does not take advantage of the energy generated by burning the fuel.
Sadness also influences driving behavior. This emotion in combination with stress and listening to fast music increases the number of harsh accelerations, causing problems for both safety and the environment. Drivers suffering from sadness are frequently involved in traffic accidents because they are thinking about their own problems and do not focus on paying attention to the road.
Tiredness is another analyzed factor that has negative consequences. We have observed that tired drivers suffer more stress while driving than non-tired drivers. Tiredness increases response times, and as a result, drivers accelerate and brake more frequently. This could cause a traffic accident because the driver of the vehicle behind only has a short time to react.
Furthermore, we have observed that drivers who listen to music with a fast tempo drive at high speeds, not respecting the limits indicated on the traffic signs. High-speed driving demands more cognitive ability. If the demand is prolonged, it causes an increase in the level of fatigue.
Regarding the interior state of the vehicle, the results obtained when analyzing the data of drivers who were exposed to high concentrations of CO2 are very similar to those of drivers who were tired. A high concentration of CO2 causes fatigue and headache, reducing the concentration of the driver on the road. Finally, we want to highlight that we have observed that some drivers who liked video games and were very stressed or tired improved their initial state when doing the driving test. This result could be very useful for developing driving assistants.
In conclusion, this work shows that the driver’s behavior not only depends on the driving conditions, but that it is also influenced by the driver’s state. Factors such as stress or fatigue can intensify while driving, but the initial values before driving are also very relevant and strongly related to more erratic and dangerous driving. Researchers working on the design of driving assistants could explore whether issuing lifestyle advice improves driving safety and driving efficiency.
As future work, we would like to evaluate how the personality of the driver impacts driving. This, combined with the results obtained in this work, would allow us to develop an advanced driving assistant (ADAS) that fits with the driver profile. An ADAS could intelligently influence the driver’s emotions.

Author Contributions

Conceptualization, V.C.M. and W.D.S.; methodology, V.C.M. and W.D.S.; formal analysis, V.C.M.; investigation, all authors; resources, R.S. and X.G.P.; writing—original draft preparation, V.C.M.; writing—review and editing, all authors; supervision, R.F., N.M.M., X.G.P. and R.G.; funding acquisition, X.G.P. and R.G. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported in part by the Spanish National Research Program under Project TIN2017-82928-R.

Acknowledgments

This publication received technical support from the Statistical Consulting Unit of the Scientific-Technical Services of the University of Oviedo (Spain).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. DGT Report of Traffic Accidents in Spain. Available online: http://www.dgt.es/Galerias/prensa/2019/07/INFORME.pdf (accessed on 2 September 2020).
  2. Dewar, R.E. Review of Road user behavior and traffic accidents. Can. Psychol. Rev. Can. 1977, 18, 365. [Google Scholar] [CrossRef]
  3. Shi, Y. The research of road traffic accidents in Henan Province based on the Human Factors Engineering. In Proceedings of the 2011 IEEE 18th International Conference on Industrial Engineering and Engineering Management, Changchun, China, 3–5 September 2011; pp. 1424–1427. [Google Scholar]
  4. Bellis, E.A.; Page, J. National Motor Vehicle Crash Causation Survey (NMVCCS) SAS Analytical Users Manual. Security 2008, 1–47. [Google Scholar]
  5. Healey, J.A.; Picard, R.W. Detecting stress during real-world driving tasks using physiological sensors. IEEE Trans. Intell. Transp. Syst. 2005, 6, 156–166. [Google Scholar] [CrossRef] [Green Version]
  6. Balasubramanian, V.; Adalarasu, K. EMG-based analysis of change in muscle activity during simulated driving. J. Bodyw. Mov. Ther. 2007, 11, 151–158. [Google Scholar] [CrossRef]
  7. Deffenbacher, J.L.; Oetting, E.R.; Lynch, R.S. Development of a driving anger scale. Psychol. Rep. 1994, 74, 83–91. [Google Scholar] [CrossRef] [PubMed]
  8. Hu, T.-Y.; Xie, X.; Li, J. Negative or positive? The effect of emotion and mood on risky driving. Transp. Res. Part F Traffic Psychol. Behav. 2013, 16, 29–40. [Google Scholar] [CrossRef]
  9. Jeon, M. Don’t Cry While You’re Driving: Sad Driving Is as Bad as Angry Driving. Int. J. Hum.-Comput. Interact. 2016, 32, 777–790. [Google Scholar] [CrossRef]
  10. Braun, M.; Pfleging, B.; Alt, F. A Survey to Understand Emotional Situations on the Road and What They Mean for Affective Automotive UIs. Multimodal Technol. Interact. 2018, 2, 75. [Google Scholar] [CrossRef] [Green Version]
  11. Allen, J.G.; MacNaughton, P.; Satish, U.; Santanam, S.; Vallarino, J.; Spengler, J.D. Associations of Cognitive Function Scores with Carbon Dioxide, Ventilation, and Volatile Organic Compound Exposures in Office Workers: A Controlled Exposure Study of Green and Conventional Office Environments. Environ. Health Perspect. 2016, 124, 805–812. [Google Scholar] [CrossRef] [Green Version]
  12. Satish, U.; Mendell, M.J.; Shekhar, K.; Hotchi, T.; Sullivan, D.; Streufert, S.; Fisk, W.J. Is CO2 an Indoor Pollutant? Direct Effects of Low-to-Moderate CO2 Concentrations on Human Decision-Making Performance. Environ. Health Perspect. 2012, 120, 1671–1677. [Google Scholar] [CrossRef] [Green Version]
  13. Lutin, J.; Kornhauser, A.L.; Lerner-Lam, E. The Revolutionary Development of Self-Driving Vehicles and Implications for the Transportation Engineering Profession. Cell 2013, 215, 630–4125. [Google Scholar]
  14. Mladenović, M.N.; Abbas, M.; McPherson, T. Development of socially sustainable traffic-control principles for self-driving vehicles: The ethics of anthropocentric design. In Proceedings of the 2014 IEEE International Symposium on Ethics in Science, Technology and Engineering, Chicago, IL, USA, 23 May 2014; pp. 1–8. [Google Scholar]
  15. Greenblatt, N.A. Self-driving cars and the law. IEEE Spectr. 2016, 53, 46–51. [Google Scholar] [CrossRef]
  16. Endsley, M.R. Autonomous Driving Systems: A Preliminary Naturalistic Study of the Tesla Model S. J. Cogn. Eng. Decis. Mak. 2017, 11, 225–238. [Google Scholar] [CrossRef]
  17. McMurray, L. Emotional stress and driving performance: The effect of divorce. Behav. Res. Highw. Saf. 1970, 1, 100–114. [Google Scholar]
  18. Legree, P.J.; Heffner, T.S.; Psotka, J.; Martin, D.E.; Medsker, G.J. Traffic crash involvement: Experiential driving knowledge and stressful contextual antecedents. J. Appl. Psychol. 2003, 88, 15–26. [Google Scholar] [CrossRef] [PubMed]
  19. Norris, F.H.; Matthews, B.A.; Riad, J.K. Characterological, situational, and behavioral risk factors for motor vehicle accidents: A prospective examination. Accid. Anal. Prev. 2000, 32, 505–515. [Google Scholar] [CrossRef]
  20. Lu, J.; Xie, X.; Zhang, R. Focusing on appraisals: How and why anger and fear influence driving risk perception. J. Saf. Res. 2013, 45, 65–73. [Google Scholar] [CrossRef]
  21. Zimasa, T.; Jamson, S.; Henson, B. The influence of driver’s mood on car following and glance behaviour: Using cognitive load as an intervention. Transp. Res. Part F Traffic Psychol. Behav. 2019, 66, 87–100. [Google Scholar] [CrossRef]
  22. Jeon, M.; Zhang, W. Sadder but Wiser? Effects of Negative Emotions on Risk Perception, Driving Performance, and Perceived Workload. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, San Diego, CA, USA, 30 September 2013; pp. 1849–1853. [Google Scholar] [CrossRef]
  23. Gjoreski, M.; Gjoreski, H.; Luštrek, M.; Gams, M. Continuous stress detection using a wrist device: In laboratory and real life. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct; Association for Computing Machinery: Heidelberg, Germany, 2016; pp. 1185–1193. [Google Scholar]
  24. Halim, Z.; Rehan, M. On identification of driving-induced stress using electroencephalogram signals: A framework based on wearable safety-critical scheme and machine learning. Inf. Fusion 2020, 53, 66–79. [Google Scholar] [CrossRef]
  25. Izquierdo-Reyes, J.; Ramirez-Mendoza, R.A.; Bustamante-Bello, M.R.; Pons-Rovira, J.L.; Gonzalez-Vargas, J.E. Emotion recognition for semi-autonomous vehicles framework. Int. J. Interact. Des. Manuf. IJIDeM 2018, 12, 1447–1454. [Google Scholar] [CrossRef]
  26. Kaplan, S.; Guvensan, M.A.; Yavuz, A.G.; Karalurt, Y. Driver Behavior Analysis for Safe Driving: A Survey. IEEE Trans. Intell. Transp. Syst. 2015, 16, 3017–3032. [Google Scholar] [CrossRef]
  27. Lazarus, R.S.; Folkman, S. Stress, Appraisal, and Coping; Springer Publishing Company: New York, NY, USA, 1984; ISBN 978-0-8261-4192-7. [Google Scholar]
  28. Loft, S.; Sanderson, P.; Neal, A.; Mooij, M. Modeling and Predicting Mental Workload in En Route Air Traffic Control: Critical Review and Broader Implications. Hum. Factors 2007, 49, 376–399. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Hansen, J.H.L. Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition. Speech Commun. 1996, 20, 151–173. [Google Scholar] [CrossRef] [Green Version]
  30. Marksberry, K. What is Stress? The American Institute of Stress. Available online: https://www.stress.org/what-isstress (accessed on 11 September 2020).
  31. Selye, H. Stress without Distress. In Psychopathology of Human Adaptation; Serban, G., Ed.; Springer: Boston, MA, USA, 1976; pp. 137–146. [Google Scholar]
  32. Reimer, B.; Mehler, B.; Coughlin, J. An Evaluation of Driver Reactions to New Vehicle Parking Assist Technologies Developed to Reduce Driver Stress; Technical Report; New England University Transportation Center, Massachusetts Institute of Technology: Cambridge, MA, USA, 2010. [Google Scholar]
  33. Mayou, R.; Bryant, B. Consequences of road traffic accidents for different types of road user. Injury 2003, 34, 197–202. [Google Scholar] [CrossRef]
  34. Gulian, E.; Matthews, G.; Glendon, A.I.; Davies, D.R.; Debney, L.M. Dimensions of driver stress. Ergonomics 1989, 32, 585–602. [Google Scholar] [CrossRef]
  35. Matthews, G.; Desmond, P.A.; Joyner, L.; Carcary, B.; Gilliland, K. A Comprehensive Questionnaire Measure of Driver Stress and Affect. Available online: http://www.academia.edu/download/48157065/VALPROC.DOC (accessed on 14 September 2020).
  36. Mackay, C.; Cox, T.; Burrows, G.; Lazzerini, T. An inventory for the measurement of self-reported stress and arousal. Br. J. Soc. Clin. Psychol. 1978, 17, 283–284. [Google Scholar] [CrossRef]
  37. Matthews, G. Stress states, personality and cognitive functioning: A review of research with the Dundee Stress State Questionnaire. Personal. Individ. Differ. 2020, 110083. [Google Scholar] [CrossRef]
  38. Hart, S.G.; Staveland, L.E. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Advances in Psychology; Hancock, P.A., Meshkati, N., Eds.; Human Mental Workload; Elsevier: North-Holland, The Netherlands, 1988; Volume 52, pp. 139–183. [Google Scholar]
  39. Pauzié, A. A method to assess the driver mental workload: The driving activity load index (DALI). IET Intell. Transp. Syst. 2008, 2, 315–322. [Google Scholar] [CrossRef]
  40. Funke, G.; Matthews, G.; Warm, J.S.; Emo, A.K. Vehicle automation: A remedy for driver stress? Ergonomics 2007, 50, 1302–1323. [Google Scholar] [CrossRef]
  41. Munla, N.; Khalil, M.; Shahin, A.; Mourad, A. Driver stress level detection using HRV analysis. In Proceedings of the 2015 International Conference on Advances in Biomedical Engineering (ICABME), Beirut, Lebanon, 16–18 September 2015; pp. 61–64. [Google Scholar]
  42. Giannakakis, G.; Grigoriadis, D.; Giannakaki, K.; Simantiraki, O.; Roniotis, A.; Tsiknakis, M. Review on psychological stress detection using biosignals. IEEE Trans. Affect. Comput. 2019. [Google Scholar] [CrossRef]
  43. Can, Y.S.; Chalabianloo, N.; Ekiz, D.; Ersoy, C. Continuous Stress Detection Using Wearable Sensors in Real Life: Algorithmic Programming Contest Case Study. Sensors 2019, 19, 1849. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Nelson, B.W.; Allen, N.B. Accuracy of Consumer Wearable Heart Rate Measurement during an Ecologically Valid 24-Hour Period: Intraindividual Validation Study. JMIR mHealth uHealth 2019, 7, e10828. [Google Scholar] [CrossRef] [PubMed]
  45. Lee, B.-G.; Lee, B.-L.; Chung, W.-Y. Smartwatch-based driver alertness monitoring with wearable motion and physiological sensor. In Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy, 25–29 August 2015; pp. 6126–6129. [Google Scholar]
  46. Westerman, S.J.; Haigney, D. Individual differences in driver stress, error and violation. Personal. Individ. Differ. 2000, 29, 981–998. [Google Scholar] [CrossRef]
  47. Kim, J.; Park, J.; Park, J. Development of a statistical model to classify driving stress levels using galvanic skin responses. Hum. Factors Ergon. Manuf. Serv. Ind. 2020, 30, 321–328. [Google Scholar] [CrossRef]
  48. Bitkina, O.V.; Kim, J.; Park, J.; Park, J.; Kim, H.K. Identifying Traffic Context Using Driving Stress: A Longitudinal Preliminary Case Study. Sensors 2019, 19, 2152. [Google Scholar] [CrossRef] [Green Version]
  49. Coughlin, J.F.; Reimer, B.; Mehler, B. Driver Wellness, Safety & the Development of an Awarecar; Technical Report; New England University Transportation Center, Massachusetts Institute of Technology: Cambridge, MA, USA, 2009. [Google Scholar]
  50. Lockhart, R.A. Interrelations between Amplitude, Latency, Rise Time, and the Edelberg Recovery Measure of the Galvanic Skin Response. Psychophysiology 1972, 9, 437–442. [Google Scholar] [CrossRef]
  51. Yamakoshi, T.; Yamakoshi, K.; Tanaka, S.; Nogawa, M.; Park, S.B.; Shibata, M.; Sawada, Y.; Rolfe, P.; Hirose, Y. Feasibility study on driver’s stress detection from differential skin temperature measurement. In Proceedings of the 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vancouver, BC, Canada, 20–25 August 2008; pp. 1076–1079. [Google Scholar]
  52. Gao, H.; Yüce, A.; Thiran, J.-P. Detecting emotional stress from facial expressions for driving safety. In Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France, 27–30 October 2014; pp. 5961–5965. [Google Scholar]
  53. Automatic cognitive load detection from speech features. In Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces; Available online: https://dl.acm.org/doi/abs/10.1145/1324892.1324946 (accessed on 26 August 2020).
  54. Fernández, A.; Usamentiaga, R.; Carús, J.L.; Casado, R. Driver Distraction Using Visual-Based Sensors and Algorithms. Sensors 2016, 16, 1805. [Google Scholar] [CrossRef]
  55. Pruetz, J.; Watson, C.; Tousignant, T.; Govindswamy, K. Assessment of Automotive Environmental Noise on Mobile Phone Hands-Free Call Quality; Technical Report; SAE international: Warrendale, PA, USA, 2019. [Google Scholar] [CrossRef]
  56. Lanatà, A.; Valenza, G.; Greco, A.; Gentili, C.; Bartolozzi, R.; Bucchi, F.; Frendo, F.; Scilingo, E.P. How the Autonomic Nervous System and Driving Style Change With Incremental Stressing Conditions during Simulated Driving. IEEE Trans. Intell. Transp. Syst. 2015, 16, 1505–1517. [Google Scholar] [CrossRef]
  57. Meiring, G.A.M.; Myburgh, H.C. A Review of Intelligent Driving Style Analysis Systems and Related Artificial Intelligence Algorithms. Sensors 2015, 15, 30653–30682. [Google Scholar] [CrossRef]
  58. Lee, B.-G.; Chung, W.-Y. Wearable Glove-Type Driver Stress Detection Using a Motion Sensor. IEEE Trans. Intell. Transp. Syst. 2017, 18, 1835–1844. [Google Scholar] [CrossRef]
  59. Castaldo, R.; Melillo, P.; Bracale, U.; Caserta, M.; Triassi, M.; Pecchia, L. Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis. Biomed. Signal Process. Control 2015, 18, 370–377. [Google Scholar] [CrossRef] [Green Version]
  60. Georgiou, K.; Larentzakis, A.V.; Khamis, N.N.; Alsuhaibani, G.I.; Alaska, Y.A.; Giallafos, E.J. Can Wearable Devices Accurately Measure Heart Rate Variability? A Systematic Review. Folia Med. (Plovdiv) 2018, 60, 7–20. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  61. Gilgen-Ammann, R.; Schweizer, T.; Wyss, T. RR interval signal quality of a heart rate monitor and an ECG Holter at rest and during exercise. Eur. J. Appl. Physiol. 2019, 119, 1525–1532. [Google Scholar] [CrossRef] [PubMed]
  62. Kreibig, S.D.; Wilhelm, F.H.; Roth, W.T.; Gross, J.J. Cardiovascular, electrodermal, and respiratory response patterns to fear- and sadness-inducing films. Psychophysiology 2007, 44, 787–806. [Google Scholar] [CrossRef] [PubMed]
  63. Elite HRV—Top Heart Rate Variability App, Monitors, and Training. Available online: https://elitehrv.com/ (accessed on 26 August 2020).
  64. H10 User Manual Technical Specifications. Available online: https://support.polar.com/e_manuals/H10_HR_sensor/Polar_H10_user_manual_English/Content/Technical-Specifications.htm (accessed on 3 September 2020).
  65. E4 Wristband Technical Specifications. Available online: http://support.empatica.com/hc/en-us/articles/202581999 (accessed on 3 September 2020).
  66. E4 Wristband—Real-Time Physiological Signals—Wearable PPG, EDA, Temperature, Motion Sensors. Available online: https://www.empatica.com/research/e4 (accessed on 29 August 2020).
  67. McCarthy, C.; Pradhan, N.; Redpath, C.; Adler, A. Validation of the Empatica E4 wristband. In Proceedings of the 2016 IEEE EMBS International Student Conference (ISC), Ottawa, ON, Canada, 29–31 May 2016; pp. 1–4. [Google Scholar]
  68. Milstein, N.; Gordon, I. Validating Measures of Electrodermal Activity and Heart Rate Variability Derived From the Empatica E4 Utilized in Research Settings That Involve Interactive Dyadic States. Front. Behav. Neurosci. 2020, 14. [Google Scholar] [CrossRef]
  69. Ledalab. Available online: http://www.ledalab.de/ (accessed on 26 August 2020).
  70. Xianglong, S.; Hu, Z.; Shumin, F.; Zhenning, L. Bus drivers’ mood states and reaction abilities at high temperatures. Transp. Res. Part F Traffic Psychol. Behav. 2018, 59, 436–444. [Google Scholar] [CrossRef]
  71. Chan, A.T.; Chung, M.W. Indoor–outdoor air quality relationships in vehicle: Effect of driving environment and ventilation modes. Atmos. Environ. 2003, 37, 3795–3808. [Google Scholar] [CrossRef]
  72. Hancock, P.A.; Verwey, W.B. Fatigue, workload and adaptive driver systems. Accid. Anal. Prev. 1997, 29, 495–506. [Google Scholar] [CrossRef]
  73. Zlatoper, T.J. Determinants of motor vehicle deaths in the united states: A cross-sectional analysis. Accid. Anal. Prev. 1991, 23, 431–436. [Google Scholar] [CrossRef]
  74. Simion, M.; Socaciu, L.; Unguresan, P. Factors which Influence the Thermal Comfort Inside of Vehicles. Energy Procedia 2016, 85, 472–480. [Google Scholar] [CrossRef] [Green Version]
  75. Daanen, H.A.M.; van de Vliert, E.; Huang, X. Driving performance in cold, warm, and thermoneutral environments. Appl. Ergon. 2003, 34, 597–602. [Google Scholar] [CrossRef]
  76. Wörner, D.; von Bomhard, T.; Röschlin, M.; Wortmann, F. Look twice: Uncover hidden information in room climate sensor data. In Proceedings of the 2014 International Conference on the Internet of Things (IOT), Cambridge, MA, USA, 6–8 October 2014; pp. 25–30. [Google Scholar]
  77. MacNaughton, P.; Spengler, J.; Vallarino, J.; Santanam, S.; Satish, U.; Allen, J. Environmental perceptions and health before and after relocation to a green building. Build. Environ. 2016, 104, 138–144. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  78. Petersen, J.; Kristensen, J.; Elarga, H.; Andersen, R.K.; Midtstraum, A. Accuracy and Air Temperature Dependency of Commercial Low-cost NDIR CO2 Sensors: An Experimental Investigation. In Proceedings of the International Conference on Building Energy and Environment of COBEE2018, Melbourne, Australia, 5–9 February2018; pp. 203–207. [Google Scholar]
  79. Smart Indoor Air Quality Monitor—How Do I calibrate My Smart Indoor Air Quality Monitor? Netatmo Helpcenter. Available online: https://helpcenter.netatmo.com/en-us/smart-indoor-air-quality-monitor/measures-and-calibrations/how-do-i-calibrate-my-smart-indoor-air-quality-monitor (accessed on 29 August 2020).
  80. Goh, C.C.; Kamarudin, L.M.; Shukri, S.; Abdullah, N.S.; Zakaria, A. Monitoring of carbon dioxide (CO2) accumulation in vehicle cabin. In Proceedings of the 2016 3rd International Conference on Electronic Design (ICED), Phuket, Thailand, 11–12 August 2016; pp. 427–432. [Google Scholar]
  81. Specifications for the Smart Indoor Air Quality Monitor. Available online: https://www.netatmo.com/en-eu/aircare/homecoach/specifications (accessed on 3 September 2020).
  82. City Car Driving—Car Driving Simulator, PC Game. Available online: https://citycardriving.com/ (accessed on 27 July 2020).
  83. Logitech G920 & G29 Driving Force Steering Wheels & Pedals. Available online: https://www.logitechg.com/en-us/products/driving/driving-force-racing-wheel.html (accessed on 29 March 2020).
  84. Specifications of Logitech G920 & G29 Driving Force Steering Wheels & Pedals. Available online: https://www.logitechg.com/en-us/products/driving/driving-force-racing-wheel.html#product-tech-specs (accessed on 3 September 2020).
  85. SFML. Available online: https://www.sfml-dev.org/ (accessed on 27 July 2020).
  86. Ericsson, E. Independent Driving Pattern Factors and Their Influence on Fuel-Use and Exhaust Emission Factor. Transp. Res. Part Transp. Environ. 2001, 6, 325–345. [Google Scholar] [CrossRef]
  87. Duncan Herrington, J. Effects of music in service environments: A field study. J. Serv. Mark. 1996, 10, 26–41. [Google Scholar] [CrossRef]
  88. North, A.C.; Hargreaves, D.J. Can Music Move People? The Effects of Musical Complexity and Silence on Waiting Time. Environ. Behav. 2016. [Google Scholar] [CrossRef]
  89. Mayfield, C.; Moss, S. Effect of Music Tempo on Task Performance. Psychol. Rep. 1989, 65, 1283–1290. [Google Scholar] [CrossRef]
  90. Brodsky, W. The effects of music tempo on simulated driving performance and vehicular control. Transp. Res. Part F Traffic Psychol. Behav. 2001, 4, 219–241. [Google Scholar] [CrossRef]
  91. Spotify. Available online: https://www.spotify.com/es/ (accessed on 27 July 2020).
  92. Joshi, A.; Kale, S.; Chandel, S.; Pal, D.K. Likert Scale: Explored and Explained. Curr. J. Appl. Sci. Technol. 2015, 396–403. [Google Scholar] [CrossRef]
  93. Limyati, Y.; Wahyudianingsih, R.; Maharani, R.D.; Christabella, M.T. Mozart’s Sonata for Two Pianos K448 in D-Major 2nd Movement Improves Short-Term Memory and Concentration. J. Med. Health 2019, 2. [Google Scholar] [CrossRef]
  94. Rendon-Velez, E.; van Leeuwen, P.M.; Happee, R.; Horváth, I.; van der Vegte, W.F.; de Winter, J.C.F. The effects of time pressure on driver performance and physiological activity: A driving simulator study. Transp. Res. Part F Traffic Psychol. Behav. 2016, 41, 150–169. [Google Scholar] [CrossRef] [Green Version]
  95. Malik, M. Heart Rate Variability. Ann. Noninvasive Electrocardiol. 1996, 1, 151–181. [Google Scholar] [CrossRef]
  96. Snow, S.; Boyson, A.; Felipe-King, M.; Malik, O.; Coutts, L.; Noakes, C.J.; Gough, H.; Barlow, J.; Schraefel, M.C. Using EEG to characterise drowsiness during short duration exposure to elevated indoor Carbon Dioxide concentrations. bioRxiv 2018, 483750. [Google Scholar] [CrossRef]
  97. Nævestad, T.-O.; Laiou, A.; Phillips, R.O.; Bjørnskau, T.; Yannis, G. Safety Culture among Private and Professional Drivers in Norway and Greece: Examining the Influence of National Road Safety Culture. Safety 2019, 5, 20. [Google Scholar] [CrossRef] [Green Version]
  98. Rony, R.J.; Ahmed, N. Monitoring Driving Stress using HRV. In Proceedings of the 2019 11th International Conference on Communication Systems Networks (COMSNETS), Bengaluru, India, 7–11 January 2019; pp. 417–419. [Google Scholar]
  99. Kontogiannis, T. Patterns of driver stress and coping strategies in a Greek sample and their relationship to aberrant behaviors and traffic accidents. Accid. Anal. Prev. 2006, 38, 913–924. [Google Scholar] [CrossRef] [PubMed]
  100. Lazarus, R.S.; Lazarus, R.S. Emotion and Adaptation; Oxford University Press: New York, NY, USA, 1991. [Google Scholar]
  101. Frijda, N.H.; Fridja, N.H.A. The Emotions; Cambridge University Press: Cambridge, UK, 1986; ISBN 0521301556. [Google Scholar]
  102. Huffziger, S.; Kuehner, C. Rumination, distraction, and mindful self-focus in depressed patients. Behav. Res. Ther. 2009, 47, 224–230. [Google Scholar] [CrossRef]
  103. Jallais, C.; Gabaude, C.; Paire-ficout, L. When emotions disturb the localization of road elements: Effects of anger and sadness. Transp. Res. Part F Traffic Psychol. Behav. 2014, 23, 125–132. [Google Scholar] [CrossRef]
  104. Sikander, G.; Anwar, S. Driver Fatigue Detection Systems: A Review. IEEE Trans. Intell. Transp. Syst. 2019, 20, 2339–2352. [Google Scholar] [CrossRef]
  105. Alkinani, M.H.; Khan, W.Z.; Arshad, Q. Detecting Human Driver Inattentive and Aggressive Driving Behavior Using Deep Learning: Recent Advances, Requirements and Open Challenges. IEEE Access 2020, 8, 105008–105030. [Google Scholar] [CrossRef]
  106. Hartley, L.R. Fatigue and Driving: Driver Impairment, Driver Fatigue, and Driving Simulation; Routledge: London, UK, 2019; ISBN 978-1-351-44885-7. [Google Scholar]
  107. Driving Time and Rest Periods. Available online: https://ec.europa.eu/transport/modes/road/social_provisions/driving_time_en (accessed on 25 August 2020).
  108. Stern, H.S.; Blower, D.; Cohen, M.L.; Czeisler, C.A.; Dinges, D.F.; Greenhouse, J.B.; Guo, F.; Hanowski, R.J.; Hartenbaum, N.P.; Krueger, G.P.; et al. Data and methods for studying commercial motor vehicle driver fatigue, highway safety and long-term driver health. Accid. Anal. Prev. 2019, 126, 37–42. [Google Scholar] [CrossRef]
  109. Jovanis, P.P.; Wu, K.-F.; Chen, C. Hours of Service and Driver Fatigue: Driver Characteristics Research. Available online: https://rosap.ntl.bts.gov/view/dot/70 (accessed on 11 September 2020).
  110. Hanowski, R.J.; Olson, R.L.; Bocanegra, J.; Hickman, J.S. Analysis of Risk as a Function of Driving-Hour: Assessment of Driving Hours 1 through 11. Available online: https://rosap.ntl.bts.gov/view/dot/69/dot_69_DS1.pdf? (accessed on 14 September 2020).
  111. Jung, H.S.; Grady, M.L.; Victoroff, T.; Miller, A.L. Simultaneously reducing CO2 and particulate exposures via fractional recirculation of vehicle cabin air. Atmos. Environ. 2017, 160, 77–88. [Google Scholar] [CrossRef] [Green Version]
  112. Kajtár, L.; Herczeg, L.; Lang, E. Examination of influence of CO2 concentration by scientific methods in the laboratory. Proc. Healthy Build. 2003, 3, 176–181. [Google Scholar]
  113. Kajtár, L.; Herczeg, L. Influence of carbon-dioxide concentration on human well-being and intensity of mental work. Időjárás 2012, 116, 145–169. [Google Scholar]
  114. Rödjegård, H.; Franchy, M.; Ehde, S.; Zoubir, Y.; Al-Khaldy, S.; Olsson, P.; Bengtsson, C.; Nowak, T.; O’Brien, D. Drowsy Driver & Child Left Behind-Prevention via in Cabin CO2 Sensing; SAE International: Warrendale, PA, USA, 2020. [Google Scholar]
  115. Kuribayashi, R.; Nittono, H. Speeding up the tempo of background sounds accelerates the pace of behavior. Psychol. Music 2014. [Google Scholar] [CrossRef]
  116. Oakes, S. The influence of the musicscape within service environments. J. Serv. Mark. 2000, 14, 539–556. [Google Scholar] [CrossRef]
  117. Fountas, G.; Pantangi, S.S.; Hulme, K.F.; Anastasopoulos, P.C. The effects of driver fatigue, gender, and distracted driving on perceived and observed aggressive driving behavior: A correlated grouped random parameters bivariate probit approach. Anal. Methods Accid. Res. 2019, 22, 100091. [Google Scholar] [CrossRef]
  118. Millet, B.; Ahn, S.; Chattah, J. The impact of music on vehicular performance: A meta-analysis. Transp. Res. Part F Traffic Psychol. Behav. 2019, 60, 743–760. [Google Scholar] [CrossRef]
Figure 1. Sensors used in the experiment.
Figure 1. Sensors used in the experiment.
Sensors 20 05274 g001
Figure 2. Average number of traffic rules broken grouped by initial stress level: (a) Speeding; (b) Do not yield to a pedestrian at a crosswalk; and (c) Crossing the lane markings illegally.
Figure 2. Average number of traffic rules broken grouped by initial stress level: (a) Speeding; (b) Do not yield to a pedestrian at a crosswalk; and (c) Crossing the lane markings illegally.
Sensors 20 05274 g002
Figure 3. Fatigue evolution grouped by initial stress level.
Figure 3. Fatigue evolution grouped by initial stress level.
Sensors 20 05274 g003
Figure 4. Number of traffic accidents grouped by sadness level.
Figure 4. Number of traffic accidents grouped by sadness level.
Sensors 20 05274 g004
Figure 5. Fatigue evolution grouped by sadness level.
Figure 5. Fatigue evolution grouped by sadness level.
Sensors 20 05274 g005
Figure 6. Average number of traffic rules broken grouped by tiredness level: (a) Stopping over the crosswalk; and (b) Do not yield to a pedestrian at a crosswalk.
Figure 6. Average number of traffic rules broken grouped by tiredness level: (a) Stopping over the crosswalk; and (b) Do not yield to a pedestrian at a crosswalk.
Sensors 20 05274 g006
Figure 7. Fatigue evolution.
Figure 7. Fatigue evolution.
Sensors 20 05274 g007
Figure 8. (a) Number of times drivers cross the lane markings illegally; (b) number of times that drivers do not stop at a red light; and (c) number of traffic accidents.
Figure 8. (a) Number of times drivers cross the lane markings illegally; (b) number of times that drivers do not stop at a red light; and (c) number of traffic accidents.
Sensors 20 05274 g008
Figure 9. Evolution of fatigue grouped by CO2 level.
Figure 9. Evolution of fatigue grouped by CO2 level.
Sensors 20 05274 g009
Figure 10. Number of times the driver exceeds the speed limit.
Figure 10. Number of times the driver exceeds the speed limit.
Sensors 20 05274 g010
Figure 11. Fatigue evolution grouped by music tempo.
Figure 11. Fatigue evolution grouped by music tempo.
Sensors 20 05274 g011
Table 1. Polar H10 specifications. Data from [64].
Table 1. Polar H10 specifications. Data from [64].
Battery TypeCR 2025
Battery sealing ringO-ring 20.0 × 0.90 Material Silicone
Battery lifetime400 h
Sampling rate1 Hz
Operating temperature−10 °C to +50 °C/14 °F to 122 °F
Connector materialABS, ABS + GF, PC, Stainless steel
Strap material38% Polyamide, 29% Polyurethane, 20%
Table 2. Empatica E4 specifications. Data from [65].
Table 2. Empatica E4 specifications. Data from [65].
PPG sensor
  • Sampling frequency 64 Hz
  • LEDs: Green (2 LEDs), Red (2 LEDs) Photodiodes: 2 units, total 15.5 mm2 sensitive area
  • Sensor output resolution 0.9 nW/Digit
EDA sensor
  • Sampling frequency: 4 Hz
  • Resolution: 1 digit ~900 pSiemens
  • Range: 0.01 μSiemens–100 μSiemens
Infrared thermopile
  • Sampling frequency: 4 Hz
  • Range: −40…115 °C
  • Resolution: 0.02 °C
  • Accuracy ±0.2 °C within 36–39 °C
3-Axis accelerometer
  • Sampling frequency: 32 Hz
  • Range ±2 g
E4 operating range
  • Relative Humidity 60 ± 25% H.R.
Water resistance
  • IP 22
Memory
  • Device storage capacity exceeds 60 recording hours.
Connectivity
  • Bluetooth LE
  • Operating range: 10 m
Size
  • 44 × 30 × 16 mm
Table 3. Specifications of the Netatmo Indoor Air Quality Monitor. Data from [81].
Table 3. Specifications of the Netatmo Indoor Air Quality Monitor. Data from [81].
TemperatureRange0 °C to 50 °C
Accuracy±0.3 °C
HumidityRange0 to 100%
Accuracy±3%
CO2Range0 to 5000 ppm
Accuracy±50 ppm (from 0 to 1000 ppm) or ±5% (from 1000 to 5000 ppm)
Sound meterRanges from: 35 to 120 dB
Records frequencyEvery 5 min
Connectivity specificationsWi-Fi 802.11 b/g/n compatible (2.4 GHz)
Supported security: Open/WEP/WPA/WPA2-personal (TKIP and AES)
Size45 × 45 × 155 mm
Table 4. Specifications of the PC on which the driving simulator is run.
Table 4. Specifications of the PC on which the driving simulator is run.
ModelAlienware Area-51 R4
ProcessorIntel Core i7-7800X
ChipsetIntel X299 PCH
Memory16 GB DDR4 2666 MHz
GPU2 X Geforce 1080 TI SLI
Storage128 GB SanDisk M.2 SSD
Table 5. Specifications of the G29. Data from [84].
Table 5. Specifications of the G29. Data from [84].
WheelRotation: 900 degrees lock-to-lock
Hall-effect steering sensor
Dual-Motor Force Feedback
Overheat safeguard
PedalsNonlinear brake pedal
Patented carpet grip system
Textured heel grip
Self-calibrating
SizeWheel: 270 × 260 × 278 mm
Pedals: 167 × 428.5 × 311 mm
ConnectionUSB 2.0
Compatible OSWindows 10, 8.1 Windows 8 or Windows 7
macOS 10.10
Playstation 4 or Playstation 3
Table 6. Heart rate variability and skin conductivity during the driving test grouped by initial stress level.
Table 6. Heart rate variability and skin conductivity during the driving test grouped by initial stress level.
StressedNon-Stressedp Value
pNN50Average Value5.08%17.95%0.002
Median Value2.90%10.88%
Std. Deviation7.03%19.96%
P251.07%3.20%
P755.52%23.25%
LF/HFAverage Value6.833.61<0.001
Median Value6.282.83
Std. Deviation2.642.80
P254.951.22
P758.865.93
SCR AmplitudeAverage Value0.55 µS0.25 µS<0.001
Median Value0.48 µS0.11 µS
Std. Deviation0.35 µS0.31 µS
P250.33 µS0.08 µS
P750.71 µS0.26 µS
Table 7. Driving behavior grouped by initial stress level.
Table 7. Driving behavior grouped by initial stress level.
StressedNon-Stressedp Value
Harsh brakingAverage Value24.43%9.12%<0.001
Median Value25.25%7.47%
Std. Deviation6.38%6.20%
P2519.36%4.95%
P7528.80%10.10%
Braking timeAverage Value24.55%17.86%0.015
Median Value24.05%17.11%
Std. Deviation6.77%9.27%
P2521.94%9.05%
P7529.26%25.35%
Harsh AccelerationAverage Value8.16%1.37%<0.001
Median Value6.48%0.48%
Std. Deviation4.83%1.87%
P256.14%0.15%
P7512.58%1.65%
Acceleration timeAverage Value67.01%61.018%0.009
Median Value68.67%61.34%
Std. Deviation7.69%7.40%
P2560.43%55.11%
P7572.94%66.02%
Table 8. Heart rate variability and skin conductivity during the driving test grouped by sadness level.
Table 8. Heart rate variability and skin conductivity during the driving test grouped by sadness level.
SadnessNon-Sadnessp Value
pNN50Average Value10.90%13.39%0.384
Median Value3.94%6.66%
Std. Deviation17.94%16.72%
P251.12%2.61%
P7511.58%17.08%
LF/HFAverage Value4.685.110.647
Median Value4.404.67
Std. Deviation3.103.21
P252.102.65
P757.197.68
SCR AmplitudeAverage Value0.45 µS0.34 µS0.682
Median Value0.26 µS0.26 µS
Std. Deviation0.41 µS0.32 µS
P250.12 µS0.10 µS
P750.89 µS0.48 µS
Table 9. Driving behavior grouped by sadness level.
Table 9. Driving behavior grouped by sadness level.
SadnessNon-Sadnessp Value
Harsh brakingAverage Value16.3615.230.757
Median Value16.6914.39
Std. Deviation11.039.34
P257.475.89
P7526.6924.03
Braking timeAverage Value20.7320.640.935
Median Value23.7421.05
Std. Deviation8.299.30
P2514.4711.45
P7526.4029.26
Harsh AccelerationAverage Value6.063.280.051
Median Value5.511.02
Std. Deviation5.364.26
P251.090.33
P759.066.18
Acceleration timeAverage Value64.5563.160.565
Median Value61.0463.15
Std. Deviation8.357.90
P2557.4559.45
P7570.9168.67
Table 10. Heart rate variability and skin conductivity during driving test grouped by tiredness level.
Table 10. Heart rate variability and skin conductivity during driving test grouped by tiredness level.
FatigueNon-Fatiguep Value
pNN50Average Value1.47%16.85%<0.001
Median Value1.10%9.45%
Std. Deviation1.45%18.32%
P250.60%3.89%
P752.15%21.66%
LF/HFAverage Value7.963.80<0.001
Median Value7.483.08
Std. Deviation1.822.76
P256.831.77
P758.504.96
SCR AmplitudeAverage Value0.62 µS0.28 µS0.001
Median Value0.61 µS0.16 µS
Std. Deviation0.35 µS0.31 µS
P250.28 µS0.08 µS
P751.00 µS0.44 µS
Table 11. Driving behavior grouped by level of tiredness.
Table 11. Driving behavior grouped by level of tiredness.
FatigueNon-Fatiguep Value
Harsh brakingAverage Value16.16%15.23%0.757
Median Value16.69%14.39%
Std. Deviation11.03%9.34%
P257.47%5.89%
P7526.69%24.03%
Braking timeAverage Value27.39%18.06%<0.001
Median Value26.50%17.37%
Std. Deviation5.33%8.65%
P2524.07%10.09%
P7529.51%24.29%
Harsh AccelerationAverage Value5.74%3.64%0.166
Median Value5.83%1.19%
Std. Deviation5.24%4.55%
P250.81%0.36%
P756.85%6.31%
Acceleration timeAverage Value68.54%61.72%0.006
Median Value68.83%60.96%
Std. Deviation7.36%7.48%
P2562.79%55.37%
P7575.22%67.93%
Table 12. Heart rate variability and skin conductivity during driving test grouped by CO2 level.
Table 12. Heart rate variability and skin conductivity during driving test grouped by CO2 level.
CO2 ≥ 1400 ppmCO2 < 1400 ppmp Value
pNN50Average Value15.21%10.61%0.891
Median Value3.94%5.57%
Std. Deviation20.11%14.41%
P251.75%2.61%
P7528.31%10.93%
LF/HFAverage Value5.014.940.938
Median Value4.673.53
Std. Deviation3.323.08
P252.652.49
P756.767.28
SCR AmplitudeAverage Value0.39 µS0.37 µS0.723
Median Value0.29 µS0.20 µS
Std. Deviation0.34 µS0.37 µS
P2515.21%10.61%
P753.94%5.57%
Table 13. Driving behavior grouped by CO2 level.
Table 13. Driving behavior grouped by CO2 level.
CO2 ≥ 1400 ppmCO2 < 1400 ppmp Value
Harsh brakingAverage Value18.66%13.30%0.070
Median Value17.45%9.57%
Std. Deviation10.25%9.05%
P259.15%5.80%
P7526.69%20.58%
Braking timeAverage Value26.40%16.52%<0.001
Median Value27.47%14.90%
Std. Deviation7.69%7.31%
P2522.74%9.87%
P7531.24%23.93%
Harsh AccelerationAverage Value3.85%4.50%0.930
Median Value4.24%1.65%
Std. Deviation3.83%5.44%
P250.48%0.33%
P756.54%7.26%
Acceleration timeAverage Value63.53%63.70%0.943
Median Value61.04%63.15%
Std. Deviation7.87%8.22%
P2559.22%57.45%
P7570.36%69.43%
Table 14. Heart rate variability and skin conductivity during the driving test grouped by music tempo.
Table 14. Heart rate variability and skin conductivity during the driving test grouped by music tempo.
Slow TempoFast Tempop Value
pNN50Average Value12.30%12.76%0.969
Median Value3.94%7.10%
Std. Deviation17.20%17.15%
P252.41%1.44%
P7512.72%16.80%
LF/HFAverage Value4.655.230.657
Median Value4.953.53
Std. Deviation2.323.73
P253.011.95
P756.268.74
SCR AmplitudeAverage Value0.40 µS0.36 µS0.381
Median Value0.35 µS0.25 µS
Std. Deviation0.33 µS0.38 µS
P250.14 µS0.08 µS
P750.44 µS0.44 µS
Table 15. Driving behavior grouped by music tempo.
Table 15. Driving behavior grouped by music tempo.
Slow TempoFast Tempop Value
Harsh brakingAverage Value14.48%16.45%0.428
Median Value15.51%12.99%
Std. Deviation8.81%10.72%
P256.03%7.05%
P7519.33%26.57%
Braking timeAverage Value20.04%21.21%0.649
Median Value21.94%22.74%
Std. Deviation9.38%8.58%
P2510.75%14.68%
P7526.50%29.45%
Harsh AccelerationAverage Value3.56%4.79%0.876
Median Value1.65%2.03%
Std. Deviation4.02%5.38%
P250.55%0.20%
P755.37%7.10%
Acceleration timeAverage Value60.33%66.44%0.006
Median Value59.56%68.05%
Std. Deviation7.70%7.24%
P2557.04%62.70%
P7561.75%70.86%
Table 16. Results of multivariate analysis with high R2.
Table 16. Results of multivariate analysis with high R2.
FactorCoefficientp ValueR2
LF/HFHigh Initial Stress2.744<0.00156.69%
Sadness−1.4050.032
Tiredness4.152<0.001
High CO2 Concentration−0.6720.273
Fast Music1.1380.062
HARSH ACCELERATIONHigh Initial Stress6.936<0.00157.56%
Sadness2.3150.020
Tiredness0.5860.574
High CO2 Concentration−2.0740.028
Fast Music1.4690.108
HARSH BRAKINGHigh Initial Stress14.234<0.00163.79%
Sadness−1.2150.506
Tiredness4.5090.026
High CO2 Concentration2.5670.145
Fast Music2.9780.086
SPEEDINGHigh Initial Stress23.641<0.00171.72%
Sadness−3.8840.162
Tiredness6.2090.042
High CO2 Concentration−0.5380.838
Fast Music16.003<0.001

Share and Cite

MDPI and ACS Style

Magaña, V.C.; Scherz, W.D.; Seepold, R.; Madrid, N.M.; Pañeda, X.G.; Garcia, R. The Effects of the Driver’s Mental State and Passenger Compartment Conditions on Driving Performance and Driving Stress. Sensors 2020, 20, 5274. https://doi.org/10.3390/s20185274

AMA Style

Magaña VC, Scherz WD, Seepold R, Madrid NM, Pañeda XG, Garcia R. The Effects of the Driver’s Mental State and Passenger Compartment Conditions on Driving Performance and Driving Stress. Sensors. 2020; 20(18):5274. https://doi.org/10.3390/s20185274

Chicago/Turabian Style

Magaña, Víctor Corcoba, Wilhelm Daniel Scherz, Ralf Seepold, Natividad Martínez Madrid, Xabiel García Pañeda, and Roberto Garcia. 2020. "The Effects of the Driver’s Mental State and Passenger Compartment Conditions on Driving Performance and Driving Stress" Sensors 20, no. 18: 5274. https://doi.org/10.3390/s20185274

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop