Next Article in Journal
How Will the COVID-19 Pandemic Affect the Future of Urban Life? Early Evidence from Highly-Educated Respondents in the United States
Previous Article in Journal
Built Environment Evaluation in Virtual Reality Environments—A Cognitive Neuroscience Approach
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comprehensive Analysis of Dynamic Message Sign Impact on Driver Behavior: A Random Forest Approach

Transportation and Urban Infrastructure Studies, Morgan State University, Baltimore, MD 21251, USA
*
Author to whom correspondence should be addressed.
Urban Sci. 2020, 4(4), 49; https://doi.org/10.3390/urbansci4040049
Submission received: 9 August 2020 / Revised: 25 September 2020 / Accepted: 30 September 2020 / Published: 4 October 2020

Abstract

:
This study investigates the potential effect(s) of different dynamic message signs (DMSs) on driver behavior using a full-scale high-fidelity driving simulator. Different DMSs are categorized by their content, structure, and type of messages. A random forest algorithm is used for three separate behavioral analyses—a route diversion analysis, a route choice analysis, and a compliance analysis—to identify the potential and relative influences of different DMSs on these aspects of driver behavior. A total of 390 simulation runs are conducted using a sample of 65 participants from diverse socioeconomic backgrounds. Results obtained suggest that DMSs displaying lane closure and delay information with advisory messages are most influential with regards to diversion, while color-coded DMSs and DMSs with avoid route advice are the top contributors potentially impacting route choice decisions and DMS compliance. In this first-of-a-kind study, based on the responses to the pre- and post-simulation surveys as well as results obtained from the analysis of driving-simulation-session data, the authors found that color-coded DMSs are more effective than alphanumeric DMSs, especially in scenarios that demand high compliance from drivers. The increased effectiveness may be attributed to reduced comprehension time and ease with which such DMSs are understood by a greater percentage of road users.

1. Introduction

Over the past couple of decades, numerous attempts have been made by researchers to understand the influence of various design, traffic, and environmental factors on driving behavior [1,2,3,4,5,6,7]. Efforts have also been made to develop accurate model(s) of drivers’ behavioral response(s) to these factors [8,9,10,11,12]. The understanding and analysis of driving behavior is vital to the provision of safe driving environments [13,14,15], as such knowledge is necessary for the development of effective tools designed to influence driver’s decisions, speed selection, and route choice, and by so doing enhance driving experience and safety. Dynamic message signs (DMS), a component of the advanced traveler information system (ATIS), is one such tool deployed to influence driver behavior. Dynamic message signs (DMSs), also known as variable message signs (VMSs) or changeable message signs (CMSs), are readable forms of intelligent transportation systems (ITS) positioned either above or beside a roadway [16], in a manner that is intended to facilitate the efficient and timely transmission of information to road users. They are essential components of numerous ITS and traffic management strategies aimed at regulating, routing or re-routing, warning, and managing traffic. Traffic managers use DMSs to influence driver behavior by providing traffic-related information in real time [17]. Figure 1 depicts an example of DMSs displaying information to drivers. A large variety of messages —incident-management, advisory, diversion, special events, adverse road weather condition, speed control, construction, maintenance messages, and safety campaign messages—can be displayed on DMSs [18]. These messages are carefully phrased and DMSs strategically positioned to elicit driving behavior that enhances the safety and efficiency of the transportation network as a whole.
Pictograms are increasingly being used in DMSs around the world [20]. Tay et al. [20] found that even though most pictograms were easily understood, in cases of incidence occurrence, less than 50% of study participants accurately comprehended information displayed.
The use of DMSs in the United States of America is so widespread that the Department of Transportation (DOT) of 29 states have written guidelines or policies on DMS design and operation [17]. Despite their widespread use, the impact of DMSs on driver behavior and road safety has been questioned and researched by many [4,21,22]. Several studies [23,24,25] show that the type, form, length, and phrasing of information presented on DMSs directly affects drivers’ level of comprehension. The level of comprehension influences different aspects of driver behavior, especially route choice and compliance. Since diversion and route choice behavior, especially during inclement weather conditions or incident occurrence, are among the top aspects of driver behavior targeted by DMSs, there is a need to study the impact(s) of different message displays on DMS diversion rate as well as driver’s compliance and route choice behavior. Very few researchers have utilized a driving simulator to perform DMS-related studies due to a lack of route choice capability in most of the existing driver simulators. A comprehensive view of route choice behavior can be captured only in suitably equipped driving simulators. This becomes possible as alternative routes are revealed when a driver chooses a route and complete information about all possible routes is available. Furthermore, a driving simulator provides a controlled environment with fairly realistic traffic and environmental scenarios, which is not possible in other methods.
This driving simulator-based study fills the aforementioned gap in the literature by analyzing route diversion behavior, route choice, and compliance behavior under the influence of different content, structure, and type of DMSs using random forest technique. Random forest, a machine-learning algorithm, was used for the analysis instead of the predominantly used multinomial logistic or binary logistic regression [26,27,28,29,30,31] because of its ability to handle complex behavioral classifications that may be nonlinear or involve a multitude of interactions. In addition, random forest has been found to be more accurate than logistic regression, as it can handle multicollinearity and presents a different approach to measure important variables [32,33,34,35]. It is important to note that although a random forest approach has been used to identify factors that impact crash and injury severity [36,37,38,39], the authors found no study that utilized random forest to analyze driver’s behavioral response(s) to DMSs or other advanced information systems. In addition to analyzing driver behavior, the study explored the usefulness of two color-coded/graphic DMS displays, created with consideration for the colorblind.

2. Review of Related Work

Impacts of DMSs can be studied through different approaches, mainly stated preference (SP) and revealed preference (RP). The SP approach relies on surveys—mail-back, telephone, and more recently, internet surveys—to gather data regarding mode choice, route choice and other aspects of driver’s behavior [40,41,42]. Different hypothetical travel scenarios, carefully designed to capture apparent and latent factors that may affect drivers’ choice of route, are presented to drivers/participants in a survey. The RP approach, on the other hand, uses data obtained from drivers as they engage in real-world driving scenarios. It comprises of data collected from loop detectors, driver’s report, in-vehicle data collection systems, and driving simulators.
Levinson and Huo [43] determined the effect of DMSs on total travel time and delay using a before and after study of inductive loop detectors data in different locations in the twin cities of Minneapolis and St. Paul, Minnesota. They concluded that even though the DMSs had no significant effect on the reduction in travel time, they were effective in traffic delay alleviation as drivers’ diversion increased when warning messages about traffic conditions were displayed. Horowitz et al. [44] reported that even though majority of drivers in their study responded to traffic delay warnings and diverted to the suggested route, a subset of drivers ignored such warning messages and refused to divert. The result was consistent with that obtained by Xuan et al. [45]; some drivers stick to their preplanned route choice regardless of message(s) displayed on DMSs.
Tian et al. [46] categorized the route choice decision making process into strategic and non-strategic and demonstrated with the aid of a driving simulator and surveys that route choice decisions were mainly strategic. However, their result suggested that the cognitive demands of driving affect driver’s strategic thinking ability; the simpler the network the more strategic the route choice decision. Jindahra et al. [47] used SP data in their quest to determine the route changing propensity of different DMSs in Bangkok, Thailand. They found a correlation between the phrasing of messages on DMSs and diversion rate. Qualitative delay and suggested route information were found to be the most important component of messages intended for route diversion management whereas quantitative messages were important for keeping drivers on the same route. Similar results were obtained by other studies [40,48] in which questionnaires were used to gather route choice decisions and general behavioral responses of drivers to DMS. Analysis of responses revealed a strong correlation among DMS message content, driver’s general behavioral response, the significant effect the information type presented on DMSs, environmental conditions, and driver’s characteristics have on driver’s route choice decisions. Bluetooth sensor technology was innovatively used by Fish et al. [49] in their empirical analysis on the impacts of highway DMSs. The result showed that diversion messages influence the route choice decisions of travelers. Jeihani et al. [50] investigated the factors that influence driver route choice decisions in the presence of DMSs, using a driving simulator integrated with a traffic simulator. They found that the original chosen route, information displayed on DMSs, subject’s perception of the relevance, accuracy of displayed information, and exposure to DMS affect route diversion. Dia et al. [51] modeled drivers’ route choice and compliance behavior using a Neugent model. The model allowed them to capture the dynamic nature of driver behavior and driver’s compliance with advisory messages displayed. Simulation results showed that a driver’s decision to divert is influenced by how familiar a driver is with network conditions, socioeconomic characteristics, and the expectation of improvement in travel time by a margin unique to every driver. Scroeder and Demetsky [52] used loop detector data to identify trends where the usage of particular words in messages was found to be more effective than others in diverting traffic.

3. Origin–Destination Matrix Development and Analysis

A full-scale high-fidelity driving simulator, in the Safety and Behavioral Analysis (SABA) Center at Morgan State University, was utilized for this study. The simulator, as seen in Figure 2, is physically comprised of a cockpit, three surrounding monitors to project front and peripheral views as subjects travel though the virtual network, an ignition key, safety seat belt, and other components necessary for the operation of the vehicle in the simulated environment: steering wheel, hand brake, throttle, signal light controllers, emergency blinkers, and brake pedals as well as an automatic gear stick.
The use of a driving simulator enables researchers to capture the effect(s) of environmental factors and surrounding traffic on subjects’ compliance, diversion, and route choice decision(s)—an essential component missing from SP data collection methods.
Human subjects, henceforth referred to as participants, were asked to drive from a clearly defined origin through the virtual road network to a fixed destination. Participants were free to choose and change routes as they drove through 6 different scenarios consisting of different DMS contents, types, structure, and length.

3.1. Scenario Design

Six virtual driving scenarios were created, with the aid of a proprietary software–VR design studio-developed by FORUM Co. The types of DMSs are shown in Table 1. DMS-4 from all scenarios were not used in this study, as they were near the destination and the behavior in terms of route choice, diversion, or compliance and could not be recorded for lack of an exit route. The virtual scenarios were complete with traffic lights, trees, building structures, and other objects as seen in Figure 3. Driving behavior data: brake, throttling, and steering handling parameters, as well as route choice data were automatically recorded by the driving simulator. However, for this study, only route information was utilized. MUTCD (Manual on Uniform Traffic Control Devices) guidelines were referred to for designing the DMS but were not strictly adhered to, keeping the simulation environment in mind and that the participants needed to visualize the signs the way they would do in real life.

3.2. Network Characteristics

A study area of 400 square kilometers (20 × 20 km) southwest of the Baltimore metropolitan area was utilized for this study.
The origin was set at the Washington Blvd–Montevideo intersection, while the destination was fixed at the M&T Bank Stadium (intersection of Russell Street and Baltimore–Washington Parkway (MD-295)). Google Maps was used as the reference to develop all roadway signs, trees, and intersections in the virtual network similar to the real world. Realism in simulation sessions was achieved by carefully setting traffic volume and characteristics to emulate those obtainable in real-life driving environments. An afternoon environment with clear skies was set with traffic based on the messages on the DMS. Figure 4 shows the study network, the origin and destination of the study, and the location of the DMSs. As seen from the Figure 4, the network has nine decision points (at which participants can switch routes between US-1, I-95, and I-295) and 10 DMSs locations, four of which are on US-1, three on I-295, and three on I-95. As presented in Figure 4, there are three routes between the origin and the destination. I-95 is a 4-lane interstate route with a speed limit of 65 mph in the study area. Washington Blvd (US-1) is a 2-lane highway with a speed limit of 40 mph. The study area has frequent traffic signals on US-1. MD-295 is a 2-lane highway, which expands into a 3-lane, with a speed limit of 55 mph. During non-peak hours, I-95 is typically the fastest route, taking between 12–16 min to reach M&T Bank Stadium from the origin in the study area, whereas MD-295 and US-1 take anywhere between 14–18 min and 14–20 min, respectively. In the study, traffic on I-95 was designed to be heavy to test behavior of drivers who are acquainted with I-95. Traffic on US-1 and MD-295 were set to mimic real-life non-peak hour traffic. In this study, the 3 routes are connected via MD-100, I-195, and I-695, respectively. A categorical list of some of the DMSs displayed in different scenarios of the study as mentioned in Table 1 is shown in Table 2.

3.3. Survey Questionnaires

Eight surveys—two pre-simulation and six post-simulation surveys—were designed to capture essential information about participants. Of the pre-simulation surveys, the first survey captured participants’ gender, age, household income, educational status, and other socioeconomic data as well as participants’ familiarity with and trust in messages displayed in DMSs and compliance. The second pre-simulation survey attempted to determine participants’ familiarity with the study area, their preferred route, level of comprehension of messages displayed on DMSs, and level of preference of different types of messages. A post-simulation survey was completed by the participant after each of the six scenarios to test the participant’s comprehension of displayed messages and recollection of DMSs encountered.

3.4. Recruitment Process

Institutional Review Board (IRB) approval was received before human participants were recruited. Social media advertisement, word of mouth, and fliers were utilized to recruit participants to drive the simulator. Participants were compensated at the rate of 15 USD per hour for their involvement in the study. A total of 68 participants were recruited but only 65 completed all scenarios. A total of 390 simulation sessions were conducted and recorded. Participants drove for five to 10 min to become familiar with the driving simulator environment before driving the six scenarios. They were also given a 5-min break between scenarios to avoid fatigue. Rules were set to ensure participants handled the simulator, as they would their vehicle in the real world. Warnings, red-light running, and speeding tickets, in the form of deduction(s) from compensation/payments, were randomly issued for non-compliance with traffic rules and for crashes to ensure driving realism. The participants were not informed about the meaning of the messages/signs beforehand, and this study is completely based on their understanding. Post driving, the participants were informed about any signs/messages that they did not understand.

4. Data

In this study, the data collected from the surveys, sociodemographics of the participants, and category of DMS signs were used as predictor variables. Diversion, compliance, and route choice were the response variables in the three separate datasets, created for behavioral analysis. In a bid to determine the impact of DMS messages on driver behavior, all the categories of message types were transformed to separate dummy variables. The datasets were unbalanced due to drivers’ route choices, with some signs being less frequently encountered. Although a random forest algorithm handles categorical data well, it is biased towards categorical variables with a high number of levels [53]. To address this issue, all the categorical variables were converted to dummy variables to improve outcome interpretability. Descriptive statistics of the sociodemographic and survey data after this transformation, used in all 3 datasets, are shown in Table 3.
The sum of the percentages for some variables shown in Table 3 may not add up to 100%, as some sections in the survey were left blank by the participants. Analyses were carried out using the open source R-project statistical software [54].

Random Forest

Random forest is a supervised learning algorithm, which can be used for both classification and regression modeling [55]. It consists of an ensemble of decision trees, i.e., CART (classification and regression trees), commonly trained with the bagging technique where the idea is to combine multiple models to improve classification accuracy thereby reducing the risk of overfitting [56]. The decision trees in a random forest are grown from bagged samples from the training set using the following equation [34]:
Y = j = 1 r β j I x   ϵ   R j   +   ε
where the coefficients β j is the average of the Y values in the region R j , which is estimated from the dataset. Once the set of decision trees have grown, the unsampled observations are dropped down each tree from the test dataset and these “out of bag” (OOB) observations are used for internal cross validation and to calculate prediction error rates. The error calculated is the mean decrease in node impurity (mean decrease Gini or MDG), which can be used for variable selection by ranking variables in the order of importance. The random forest package in “R” [57] was used to compute MDG, which is the sum of all decreases in Gini impurity due to a given variable and then normalized toward the end of the forest growing stage. MDG is the predictive accuracy lost by permuting a given predictor variable from the tree used to generate predictions about the class of observation I, where i ε [0,1], the Gini score range. Thus, predictor variables with a higher MDG score more accurately predict the true class of observation i, which is also termed as the variable importance measure (VIM) in random forests. As VIMs are not sufficient to capture the trend of influence of the predictor variables on the dependent variable, partial dependency plots (PDPs) are used to address this limitation. PDPs offer a graphical portrayal of the marginal effect of a variable on the class probability. The function is represented mathematically as [34]:
f x = l o g p n x 1 N m = 1 n l o g p m x
where N represents the number of classes for the dependent variable y, n is the predicted class, and pm represents the fraction of votes for class m. On a PDP, the values of the y axis indicate the change in log-odds for the fraction of votes among all decision trees in the forest. A positive slope indicates that the variable predicts a greater fraction of votes for that particular class of the dependent variable and vice versa.

5. Results

The following sub-sections discuss in detail the findings of this study.

5.1. Stated Preference vs. Revealed Travel Behavior

In response to the survey, most participants indicated a preference for either I-95 or whichever route was suggested by a global positioning system (GPS) or a smartphone to go from the origin to the destination in the study area. The stated route choice of participants as obtained from the survey responses is shown in Figure 5. However, disparity was observed between route choice selected in survey and route choice during the simulation sessions, which indicates that driving simulators are a valuable tool in this kind of research. This suggests that route choice was influenced by DMSs and environmental conditions. Figure 6 displays the categories of DMSs that potentially influenced route choice decisions. Similar disparity was also found in previous studies in the literature in which the perceived driving behavior differed from the observed one. For instance, Abou-Zeid et al. [58] found that although drivers who self-report themselves as non-aggressive, tend to be aggressive drivers in the real environment, as frustrating driving events can trigger them to drive aggressively. Moreover, Sarwar et al. [59] used driving simulation experiments to study the drivers’ observed behavior versus their perceived ones that were collected through surveys, and the findings imply that drivers observed driving behavior differs from their perceived one, as they perceive their driving behavior as aggressive, when it is actually non-aggressive. In addition, in a review of driving simulation validity studies, Mullen et al. [60] showed that simulators provide a valid tool for assessing a variety of driving performance measures.
“Distance time with alternate routes” and “Distance time” DMSs do not seem that effective in influencing a particular route, as shown in Figure 6. “Color-coded DMS” and “Crash-related DMS,” on the other hand, seem to have a potential in influencing the route choice decisions. Design II was the preferred option in comparison to Design I of color-coded DMS, as mentioned in the SP survey.

5.2. Route Diversion Behavioral Analysis

For this analysis, only DMSs preceding an exit ramp were selected from the six scenarios to examine the patterns of diversion in response to messages displayed on such DMSs. In all scenarios, the first DMS encountered by participants was excluded from this behavioral analysis to avoid biases that may arise from a participant’s pre-selected choice of route. With the aid of the random forest algorithm, the sociodemographic and survey data as mentioned in Table 3 and the DMS categories mentioned in Table 4 were used for this analysis.
The OOB classification error estimate for this analysis was 36.14% built with 500 trees in the forest. Figure 7 shows the MDG score for all the variables used for route diversion analysis. It can be seen that four variables (travel time without alternate routes, lane closure information with alternate routes, delay-related DMS with advice, and when DMS/GPS conflict, I follow GPS) stand out and are thus selected as the important variables.
To determine the trend of influence these variables have on diversion, PDPs were drawn as shown in Figure 8. The PDPs for this dataset are bar charts with binary outcomes of Yes (1) and No (0) with an increasing or decreasing trend as shown in Figure 8.
Although travel time without alternate route is the most important variable, it has a negative influence on diversion, which means that it is ineffective for diversion. This might be due to the non-provision of any pertinent information related to diversion other than just the travel time to the destination. Drivers who stated that they would follow their GPS in case the DMS message conflicts with their GPS were less likely to divert from the chosen route even in the absence of a navigation system. Delay-related messages with advice and lane closure messages with alternate route information were found to have a positive influence on diversion. This means that DMSs displaying such messages will most likely impact route diversion decisions.

5.3. Route Choice Behavioral Analysis

For this analysis, the first sign participants encountered in the network was selected to determine route choice behavior.
The sociodemographic and survey data as mentioned in Table 3 and the sign categories mentioned in Table 5 were used for this behavioral analysis.
The OOB error estimate for this analysis was 39.86% built with 500 trees in the forest. Figure 9 shows the MDG score for all the variables used for route choice analysis. The results show that three variables (color-coded DMS, crash-related DMS, and when DMS/GPS conflict, I follow GPS) stand out and are thus selected as the important variables.
To determine the trend of influence these variables have on route choice, PDPs were drawn for each class, as shown in Figure 10. The binary outcomes for each route are shown for the selected important variables.
Color-coded DMS was found to be the most important variable, and as can be seen in Figure 10, participants have a higher likelihood to pick US-1 over other routes, as the DMS showed heavy traffic on I-95, medium traffic on MD-295, and light traffic on US-1. Similarly, the crash-related DMS with avoid route advice rendered information of a crash on I-95 and advised participants to avoid it. Participants responded to the DMS by using either MD-295 or US-1. Participants who answered that they would follow GPS in case of conflicting DMS route suggestions showed less likelihood of picking I-95 in the absence of a GPS, as advised by the DMS to avoid that route.

5.4. DMS Compliance Behavioral Analysis

All signs with advisory messages were selected to test compliance. The sociodemographic and survey data, as mentioned in Table 3, and the sign categories, mentioned in Table 6, are used for this behavioral analysis.
The OOB error estimate for this analysis was 36.62% built with 500 trees in the forest. Figure 11 shows the MDG score for all the variables used for DMS compliance analysis. The results show that four variables (distance time with alternate routes, color-coded DMS, DMS with avoid route advice, and crash-related DMS with advice) stand out and are thus selected as the important variables.
To determine the trend of influence these variables have on message compliance, PDPs were drawn as shown in Figure 12.
Although DMS with “distance time with alternate routes” message is an important variable, it has a negative influence on compliance. This may be attributed to the very low travel time differences between the three routes—a maximum difference of 10 min between all of them. Results from the compliance analysis also showed that “crash-related DMS with advice” had a high likelihood of non-compliance. This might be because the advice tested in this study was vague—“choose alternate route.” Color-coded DMS had a higher likelihood of compliance, as the color-coded DMS was easy to comprehend (as expressed in survey responses), and time taken to perceive it is less than alphanumeric text [20]. Avoid route advice, on the other hand, is very specific and is most likely the reason why the compliance rate is high.

6. Conclusions and Discussion

This study investigated the impact of content, structure, and type of DMS messages on driver behavior using a full-scale high-fidelity driving simulator. A route diversion analysis, a route choice analysis, and a DMS compliance analysis were conducted using a random forest algorithm to gauge how people react to different signs and how it impacts their decision making. Prior research on this study corridor showed that people have a tendency of usually choosing I-95 as their default route, since it is wider, has a higher speed limit, and is faster under normal traffic conditions [61]. This driving behavior is altered under non-recurrent situations such as roadwork or crashes. In this study, the DMS messages have stated throughout the six scenarios that I-95 had heavy traffic. The results indicate that the participants tend to comply with crash-related DMSs with advice, especially advice that mentions “avoid,” lane closure with alternate route advice, and delay-related DMS with advice. In contemporary times, the majority of drivers depend on their GPS/smartphones for turn-by-turn guidance to reach their destination. Some 98% of the participants in this study stated that they use GPS/smartphone for navigation at least sometimes. In such scenarios, drivers hardly pay attention to travel-time-related DMS messages. Smartphone navigation informs the driver of a delay before even starting from the point of origin. However, incidents such as crashes can happen at any time and appropriate DMS messages are useful in such situations, which can prevent delay and congestion. Lane closure, delay DMS with route diversion, and avoid route information will likely be useful in such situations once drivers start experiencing a slow down on their choice of route.
Another interesting finding in this study is the effectiveness of color-coded DMS on driver compliance and route choice as input from colorblind people was used to design the DMS. Approximately 7.5% (~11 million) of the United States population cannot distinguish between red and/or green colors. As they have become familiar with traffic lights, the authors designed the color coded DMS messages to be colorblind-people friendly. Although the red and yellow colors on the DMS sign were to show heavy traffic and medium traffic, they were in the shape of horizontal bars as shown in Figure 6 (Design II). The length of the bars would depict traffic congestion levels making them colorblind-people friendly based on the input received. Even though there were not any colorblind participants, the overall compliance of color-coded DMS, and its influence in determining route choice, makes it a promising means of signage that warrant further investigation. DMS displays in the United States are predominantly alphanumeric text as opposed to graphical displays [62]. The New Jersey turnpike and some freeways in Colorado employ color-coded DMS to direct traffic as shown in Figure 13. Color-coded DMS has not yet found widespread use in the United States, and its effectiveness has yet to be tapped. Pilot studies can be carried out in certain corridors using color-coded DMSs to balance traffic flow on congested routes. The lack of widespread use of color-coded signs is maybe due to its downsides that were mentioned in previous research. Drivers might misinterpret the meaning of different colors; thus, they may make decisions based on incorrect assumptions, which can impact the credibility and effectiveness of the entire message [62]. In addition, adding color demonstration to the displayed message did not yield any change in the drivers’ understanding of the sign/message [62]. Due to these downsides, the MUTCD specified certain meanings and usage for the different colors when used in signs. For instance, the color green is used to indicate that movements are permitted and provide direction guidance. In addition, this manual restricts the use of certain colors; for example, the color purple can be only used as a background color when the information associated with the appropriate electronic toll collection account is displayed on that portion of the sign [63].
One of the limitations of this study was the lack of a navigation system to supplement the DMS messages. Future studies will involve scenarios with GPS guidance as well as interaction with DMS messages. The advent of autonomous vehicles will most likely affect future road signs and DMS. The standards needed to stay abreast of technological developments are needed as part of future research.

Author Contributions

The contribution of the authors of this paper is as follows: conceptualization, S.B., M.J.; methodology, S.B., M.J.; data collection, D.D.B., S.B., S.A.; analysis and interpretation, S.B., M.J., D.D.B.; writing—review and editing, S.B., M.J., D.D.B., S.A.; visualization, S.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Maryland State Highway Administration, grant number SP709B4H.

Acknowledgments

The authors would like to thank the Maryland State Highway Administration for its funding support throughout the study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Brown, D.; Danny, I.; Jeihani, M.; Rashidi Moghaddam, Z.; Chavis, C.; Karmakar, N.; Aghdashi, S. Impact of Level of Service (LOS) on the Driver’s Behavior on Arterials; The National of Academies of Sciences, Engineering, and Medicine: Washington, DC, USA, 2018. [Google Scholar]
  2. Dutta, A.; Fisher, D.L.; Noyce, D.A. Use of a driving simulator to evaluate and optimize factors affecting understandability of variable message signs. Transp. Res. Part F Traffic Psychol. Behav. 2004, 7, 209–227. [Google Scholar] [CrossRef]
  3. McCall, J.C.; Trivedi, M.M. Driver behavior and situation aware brake assistance for intelligent vehicles. Proc. IEEE 2007, 95, 374–387. [Google Scholar] [CrossRef]
  4. Rämä, P. Effects of weather-controlled variable speed limits and warning signs on driver behavior. Transp. Res. Rec. J. Transp. Res. Board 1999, 1689, 53–59. [Google Scholar] [CrossRef]
  5. Banerjee, S.; Jeihani, M.; Khadem, N.K. Influence of work zone signage on driver speeding behavior. J. Mod. Transp. 2019, 27, 52–60. [Google Scholar] [CrossRef] [Green Version]
  6. Banerjee, S.; Jeihani, M.; Moghaddam, R. Impact of mobile work zone barriers on driving behavior on arterial roads. J. Traffic Logist. Eng. 2018, 6, 37–42. [Google Scholar] [CrossRef]
  7. Jeihani, M.; Banerjee, S. Drivers’ behavior analysis under reduced visibility conditions using a driving simulator. J. Traffic Logist. Eng. 2018, 6, 48–52. [Google Scholar] [CrossRef] [Green Version]
  8. Dia, H. An agent-based approach to modelling driver route choice behaviour under the influence of real-time information. Transp. Res. Part C Emerg. Technol. 2002, 10, 331–349. [Google Scholar] [CrossRef] [Green Version]
  9. Oliver, N.; Pentland, A.P. Graphical models for driver behavior recognition in a smartcar. In Proceedings of the Intelligent Vehicles Symposium, Dearborn, MI, USA, USA, 5 October 2000; pp. 7–12. [Google Scholar]
  10. Salvucci, D.D. Modeling driver behavior in a cognitive architecture. Hum. Factors 2006, 48, 362–380. [Google Scholar] [CrossRef] [Green Version]
  11. Banerjee, S.; Jeihani, M.; Khadem, N.K.; Brown, D.D. Units of information on dynamic message signs: A speed pattern analysis. Eur. Transp. Res. Rev. 2019, 11, 15. [Google Scholar] [CrossRef]
  12. Jeihani, M.; Banerjee, S.; Ahangari, S.; Brown, D.D. The Potential Effects of Composition and Structure of Dynamic Message Sign Messages on Driver Behavior Using a Driving Simulator; The National of Academies of Sciences, Engineering, and Medicine: Washington, DC, USA, 2018. [Google Scholar]
  13. AbuAli, N.; Abou-zeid, H. Driver behavior modeling: Developments and future directions. Int. J. Veh. Technol. 2016, 2016, 1–12. [Google Scholar] [CrossRef] [Green Version]
  14. Evans, L. The dominant role of driver behavior in traffic safety. Am. J. Public Health 1996, 86, 784–786. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Dabiri, S.; Kelarestaghi, K.B.; Heaslip, K. Probe people and vehicle-based data sources application in the smart transportation. In Artificial Intelligence and Machine Learning Applications in Civil, Mechanical, and Industrial Engineering; IGI Global: Hershey, PA, USA, 2020. [Google Scholar] [CrossRef]
  16. Edwards, M.; Young, R. Developing System for Consistent Messaging on Interstate 80’s Dynamic Message Signs: Phase I; The National of Academies of Sciences, Engineering, and Medicine: Washington, DC, USA, 2009. [Google Scholar]
  17. Dudek, C.L. Changeable Message Sign Displays During Non-incident, Non-roadwork Periods; Transportation Research Board: Washington, DC, USA, 2008; Volume 383. [Google Scholar]
  18. Dudek, C.L. Changeable Message Sign Operation and Messaging Handbook. Available online: https://tmcpfs.ops.fhwa.dot.gov/cfprojects/uploaded_files/CMS%20Operation%20and%20Messaging%20Handbook-Final%20Draft.pdf (accessed on 31 July 2020).
  19. Anya. Department of Transportation Signs. Available online: http://transport.forgiveokey.site/department-of-transportation-signs/ (accessed on 31 July 2020).
  20. Richard, T.; Jaisung, C. Evaluation of pictograms in dynamic lane control systems in the Republic of Korea. J. Transp. Syst. Eng. Inf. Technol. 2009, 9, 56–61. [Google Scholar]
  21. Jeihani, M.; Ardeshiri, A. Exploring Travelers’ Behavior in Response to Dynamic Message Signs (DMS) Using a Driving Simulator; State Highway Administration, Research Division: Baltimore, MD, USA, 2013. [Google Scholar]
  22. Richard, T.; De Barros, A. Effectiveness of road safety messages on variable message signs. J. Transp. Syst. Eng. Inf. Technol. 2010, 10, 18–23. [Google Scholar]
  23. Dudek, C.; Ullman, G. Flashing messages, flashing lines, and alternating one line on changeable message signs. Transp. Res. Rec. J. Transp. Res. Board 2002, 1803, 94–101. [Google Scholar] [CrossRef]
  24. Ullman, B.; Ullman, G.; Dudek, C.; Williams, A. Driver understanding of sequential portable changeable message signs in work zones. Transp. Res. Rec. J. Transp. Res. Board 2007, 2015, 28–35. [Google Scholar] [CrossRef]
  25. Wang, J.-H.; Cao, Y. Assessing message display formats of portable variable message signs. Transp. Res. Rec. J. Transp. Res. Board 2005, 1937, 113–119. [Google Scholar] [CrossRef]
  26. Ardeshiri, A.; Jeihani, M. A speed limit compliance model for dynamic speed display sign. J. Saf. Res. 2014, 51, 33–40. [Google Scholar] [CrossRef] [PubMed]
  27. Oltedal, S.; Rundmo, T. The effects of personality and gender on risky driving behaviour and accident involvement. Saf. Sci. 2006, 44, 621–628. [Google Scholar] [CrossRef]
  28. Tsirimpa, A.; Polydoropoulou, A.; Antoniou, C. Development of a mixed multi-nomial logit model to capture the impact of information systems on travelers’ switching behavior. J. Intell. Transp. Syst. 2007, 11, 79–89. [Google Scholar] [CrossRef]
  29. Zhang, L.; Levinson, D. Determinants of route choice and value of traveler information: A field experiment. Transp. Res. Rec. J. Transp. Res. Board 2008, 2086, 81–92. [Google Scholar] [CrossRef] [Green Version]
  30. Islam, M.R.; Kelarestaghi, K.B.; Ermagun, A.; Banerjee, S. Gender Differences in Injury Severity Risk of Single-Vehicle Crashes in Virginia: A Nested Logit Analysis of Heterogeneity. arXiv, 2019; arXiv:1901.03289. [Google Scholar]
  31. Kelarestaghi, K.B.; Zhang, W.; Wang, Y.; Xiao, L.; Hancock, K.; Heaslip, K.P. Impacts to crash severity outcome due to adverse weather and other causation factors. Adv. Transp. Stud. 2017, 43, 31–42. [Google Scholar]
  32. Couronné, R.; Probst, P.; Boulesteix, A.-L. Random forest versus logistic regression: A large-scale benchmark experiment. BMC Bioinform. 2017, 19, 270. [Google Scholar] [CrossRef] [PubMed]
  33. Hjerpe, A. Computing Random Forests Variable Importance Measures (VIM) on Mixed Numerical and Categorical Data. Master’s Thesis, KTH, School of Computer Science and Communication (CSC), Stockholm, Sweden, 2016. [Google Scholar]
  34. Muchlinski, D.; Siroky, D.; He, J.; Kocher, M. Comparing random forest with logistic regression for predicting class-imbalanced civil war onset data. Political Anal. 2015, 24, 87–103. [Google Scholar] [CrossRef]
  35. Yoo, W.; Ference, B.A.; Cote, M.L.; Schwartz, A. A comparison of logistic regression, logic regression, classification tree, and random forests to identify effective gene-gene and gene-environmental interactions. Int. J. Appl. Sci. Technol. 2012, 2, 268. [Google Scholar]
  36. Yu, R.; Abdel-Aty, M. Analyzing crash injury severity for a mountainous freeway incorporating real-time traffic and weather data. Saf. Sci. 2014, 63, 50–56. [Google Scholar] [CrossRef]
  37. Pham, M.-H.; Bhaskar, A.; Chung, E.; Dumont, A.-G. Random forest models for identifying motorway rear-end crash risks using disaggregate data. In Proceedings of the 13th International IEEE Conference on Intelligent Transportation Systems (ITSC), Funchal, Portugal, 19–22 September 2010; pp. 468–473. [Google Scholar]
  38. Das, A.; Abdel-Aty, M.; Pande, A. Using conditional inference forests to identify the factors affecting crash severity on arterial corridors. J. Saf. Res. 2009, 40, 317–327. [Google Scholar] [CrossRef] [Green Version]
  39. Krishnaveni, S.; Hemalatha, M. A perspective analysis of traffic accident using data mining techniques. Int. J. Comput. Appl. 2011, 23, 40–48. [Google Scholar] [CrossRef]
  40. Peeta, S.; Ramos, J.L. Driver response to variable message signs-based traffic information. In Intelligent Transport Systems; IEEE: New York, NY, USA, 2006; Volume 153, pp. 2–10. [Google Scholar] [CrossRef] [Green Version]
  41. Feng, T.; Arentze, T.A.; Timmermans, H.J. Assessing the relative importance of input variables for route choice modeling: A neural network approach. J. Eastern Asia Soc. Transp. Stud. 2011, 9, 341–353. [Google Scholar]
  42. Moghaddam, Z.R.; Jeihani, M.; Peeta, S.; Banerjee, S. Comprehending the roles of traveler perception of travel time reliability on route choice behavior. Travel Behav. Soc. 2019, 16, 13–22. [Google Scholar] [CrossRef]
  43. Levinson, D.M.; Huo, H. Effectiveness of variable message signs using empirical loop detector data. Available online: https://conservancy.umn.edu/handle/11299/179809 (accessed on 31 July 2020).
  44. Horowitz, A.; Weisser, I.; Notbohm, T. Diversion from a rural work zone with traffic-responsive variable message signage system. Transp. Res. Rec. J. Transp. Res. Board 2003, 1824, 23–28. [Google Scholar] [CrossRef]
  45. Xuan, Y.E.; Kanafani, A.K. Empirical Evaluation of Drivers’ Behavior Response to Accident Information on Freeway Changeable Message Signs; The National of Academies of Sciences, Engineering, and Medicine: Washington, DC, USA, 2014. [Google Scholar]
  46. Tian, H.; Gao, S.; Fisher, D.; Post, B. Route choice behavior in a driving simulator with real-time information. Available online: https://www.mobt3ath.com/uplode/book/book-3711.pdf (accessed on 31 July 2020).
  47. Jindahra, P.; Choocharukul, K. Short-run route diversion: An empirical investigation into variable message sign design and policy experiments. IEEE Trans. Intell. Transp. Syst. 2013, 14, 388–397. [Google Scholar] [CrossRef]
  48. Chatterjee, K.; Hounsell, N.; Firmin, P.; Bonsall, P. Driver response to variable message sign information in London. Transp. Res. Part C Emerg. Technol. 2002, 10, 149–169. [Google Scholar] [CrossRef]
  49. Fish, R.L.W.; Haghani, A.; Hamedi, M. Analysis of Traffic Speed Response to Display of Dynamic Message Sign Messages; The National of Academies of Sciences, Engineering, and Medicine: Washington, DC, USA, 2012. [Google Scholar]
  50. Jeihani, M.; NarooieNezhad, S.; Kelarestaghi, K.B. Integration of a driving simulator and a traffic simulator case study: Exploring drivers’ behavior in response to variable message signs. IATSS Res. 2017, 41, 164–171. [Google Scholar] [CrossRef]
  51. Dia, H.; Panwai, S. Modelling drivers’ compliance and route choice behaviour in response to travel information. Nonlinear Dyn. 2007, 49, 493–509. [Google Scholar] [CrossRef]
  52. Schroeder, J.L.; Demetsky, M.J. Data analysis of diversion and dynamic message signs. J. Transp. Eng. 2011, 137, 608–614. [Google Scholar] [CrossRef]
  53. Strobl, C.; Boulesteix, A.-L.; Zeileis, A.; Hothorn, T. Bias in random forest variable importance measures: Illustrations, sources and a solution. BMC Bioinform. 2007, 8, 25. [Google Scholar] [CrossRef] [Green Version]
  54. Team, R.C. R: A Language and Environment for Statistical Computing. Available online: http://softlibre.unizar.es/manuales/aplicaciones/r/fullrefman.pdf (accessed on 31 July 2020).
  55. Breiman, L. Random forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Green Version]
  56. Breiman, L. Bagging predictors. Mach. Learn. 1996, 24, 123–140. [Google Scholar] [CrossRef] [Green Version]
  57. Liaw, A.; Wiener, M. Breiman and Cutlers random forests for classification and regression. Available online: https://www.researchgate.net/publication/304378707_Package_%27randomForest%27_Breiman_and_Cutler%27s_random_forests_for_classification_and_regression (accessed on 31 July 2020).
  58. Abou-Zeid, M.; Kaysi, I.; Al-Naghi, H. Measuring aggressive driving behavior using a driving simulator: An exploratory study. In Proceedings of the 3rd International Conference on Road Safety and Simulation, Indianapolis, IN, USA, 14–16 September 2011. [Google Scholar]
  59. Sarwar, M.T.; Anastasopoulos, P.C.; Golshani, N.; Hulme, K.F. Grouped random parameters bivariate probit analysis of perceived and observed aggressive driving behavior: A driving simulation study. Anal. Methods Accid. Res. 2017, 13, 52–64. [Google Scholar] [CrossRef]
  60. Mullen, N.; Charlton, J.; Devlin, A.; Bedard, M. Simulator validity: Behaviours observed on the simulator and on the road. In Handbook of Driving Simulation for Engineering, Medicine and Psychology; CRC Press: Boca Raton, FL, USA, 2011; pp. 1–18. [Google Scholar]
  61. Ardeshiri, A.; Jeihani, M.; Peeta, S. Driving Simulator Based Analysis of Driver Compliance Behavior under Dynamic Message Sign Based Route Guidance. The National of Academies of Sciences, Engineering, and Medicine: Washington, DC, USA, 2014. [Google Scholar]
  62. Ullman, B.R.; Trout, N.D.; Dudek, C.L. Use of Graphics and Symbols on Dynamic Message Signs: Technical Report; Texas Transportation Institute, The Texas A & M University System: College Station, TX, USA, 2009. [Google Scholar]
  63. FHWA. Manual on Uniform Traffic Control Devices for Streets and Highways; United States Department of Transportation: Washington, DC, USA, 2009. [Google Scholar]
Figure 1. Picture of dynamic message signs (Source: [19]).
Figure 1. Picture of dynamic message signs (Source: [19]).
Urbansci 04 00049 g001
Figure 2. Driving simulator at the Safety and Behavioral Analysis (SABA) Center, Morgan State University.
Figure 2. Driving simulator at the Safety and Behavioral Analysis (SABA) Center, Morgan State University.
Urbansci 04 00049 g002
Figure 3. A screenshot of the simulated driving environment and some DMS signs.
Figure 3. A screenshot of the simulated driving environment and some DMS signs.
Urbansci 04 00049 g003
Figure 4. Study Network.
Figure 4. Study Network.
Urbansci 04 00049 g004
Figure 5. Stated route choice responses.
Figure 5. Stated route choice responses.
Urbansci 04 00049 g005
Figure 6. Revealed route choice behavior.
Figure 6. Revealed route choice behavior.
Urbansci 04 00049 g006aUrbansci 04 00049 g006b
Figure 7. Plot of variable importance for diversion by MDG score.
Figure 7. Plot of variable importance for diversion by MDG score.
Urbansci 04 00049 g007
Figure 8. Partial dependency plots (PDPs) of important variables impacting diversion behavior (the direction of the trend is shown by the red arrows).
Figure 8. Partial dependency plots (PDPs) of important variables impacting diversion behavior (the direction of the trend is shown by the red arrows).
Urbansci 04 00049 g008
Figure 9. Plot of variable importance for route choice by MDG score.
Figure 9. Plot of variable importance for route choice by MDG score.
Urbansci 04 00049 g009
Figure 10. PDPs of important variables impacting diversion behavior (the direction of the trend is shown by the red arrows).
Figure 10. PDPs of important variables impacting diversion behavior (the direction of the trend is shown by the red arrows).
Urbansci 04 00049 g010
Figure 11. Plot of variable importance for compliance by MDG score.
Figure 11. Plot of variable importance for compliance by MDG score.
Urbansci 04 00049 g011
Figure 12. PDPs of important variables impacting compliance behavior (the direction of the trend is shown by the red arrows.).
Figure 12. PDPs of important variables impacting compliance behavior (the direction of the trend is shown by the red arrows.).
Urbansci 04 00049 g012
Figure 13. DMS’s in New Jersey (Daktronics Transportation) and Colorado (Techknow-Eng).
Figure 13. DMS’s in New Jersey (Daktronics Transportation) and Colorado (Techknow-Eng).
Urbansci 04 00049 g013
Table 1. Types of DMS signs used in 6 scenarios.
Table 1. Types of DMS signs used in 6 scenarios.
Order of DMS ENCOUNTEREDTravel TimeLane ClosureDelay
Scenario 1Scenario 2Scenario 3Scenario 4Scenario 5Scenario 6
DMS-1Distance timeDistance timeCrash-relatedCrashColor CodedColor Coded
With alternative routesW/O alternative routesWith avoid adviceW/O adviceDesign IDesign II
DMS-2Distance timeTravel timeLane closureDMSDMSDelay
With alternative routesWith alternative routesWith alternate routeWith avoid adviceWith save time adviceWith advice
DMS-3Travel timeTravel timeCrashDMSDelayDelay
With alternative routesW/O alternative routesWith adviceW/O adviceWith adviceW/O advice
DMS-4Distance timeTravel timeLane closureIncidentN/AN/A
W/O alternative routesW/O alternative routesW/O adviceW/O advice
Table 2. List of DMS signs utilized in this study.
Table 2. List of DMS signs utilized in this study.
DMS CategoriesSigns Used
Distance Time with Alternate Routes Urbansci 04 00049 i001
Travel Time with Alternate Routes Urbansci 04 00049 i002
Travel Time without Alternate Routes Urbansci 04 00049 i003
Lane Closure Information with Alternate Route Urbansci 04 00049 i004
Crash-Related DMS with Advice Urbansci 04 00049 i005
Delay-Related DMS with Advice Urbansci 04 00049 i006
Delay-Related DMS without Advice Urbansci 04 00049 i007
Color-Coded DMS (Design I) Urbansci 04 00049 i008
Color-Coded DMS (Design II) Urbansci 04 00049 i009
DMS with Avoid Route Advice Urbansci 04 00049 i010
DMS with Save Time Advice Urbansci 04 00049 i011
Table 3. Sociodemographic and survey data descriptive statistics.
Table 3. Sociodemographic and survey data descriptive statistics.
VariablesDescriptionPercentage
GenderMale55%
Female45%
Age18–2533%
26–3539%
36–4511%
46–5510%
56–657%
Familiarity with Study AreaYes53%
Somewhat28%
No13%
Frequency of TravelVery frequently25%
Often37%
Occasionally24%
Never been there9%
Route Usually TakenMD-29519%
US-15%
I-9534%
Follow my GPS30%
Not Sure8%
DMS Influences DecisionsAlways18%
Sometimes77%
Never3%
When DMS GPS ConflictI follow DMS27%
I follow GPS38%
Table 4. Descriptive statistics of route diversion dataset.
Table 4. Descriptive statistics of route diversion dataset.
VariablesDescriptionPercentage
Distance Time with Alternate RoutesEncountered11%
Did not encounter89%
Travel Time with Alternate RoutesEncountered22%
Did not encounter78%
Travel Time without Alternate RoutesEncountered12%
Did not encounter88%
Lane Closure Information with Alternate RouteEncountered11%
Did not encounter89%
Crash-Related DMS With AdviceEncountered11%
Did not encounter89%
Delay-Related DMS With AdviceEncountered22%
Did not encounter78%
Delay-Related DMS Without AdviceEncountered11%
Did not encounter89%
DiversionDiverted42%
Did not divert58%
Table 5. Descriptive statistics of route choice dataset.
Table 5. Descriptive statistics of route choice dataset.
VariablesDescriptionPercentage
DMS MessagesDistance Time with Alternate
Routes17%
Distance Time17%
Crash-Related DMS with 33%
Advice
Color-Coded DMS33%
Route ChoiceMD-29544%
US-147%
I-959%
Table 6. Descriptive statistics of compliance dataset.
Table 6. Descriptive statistics of compliance dataset.
VariablesDescriptionPercentage
DMS MessageDistance Time with Alternate Routes18%
DMS MessageTravel Time with Alternate Routes 18%
DMS MessageColor-Coded DMS17%
DMS MessageLane Closure Information with Alternate Routes9%
DMS MessageCrash-Related DMS with Advice8%
DMS MessageDMS with Avoid Route Advice4%
DMS MessageDelay-Related DMS with Advice17%
DMS MessageDMS with Save Time Advice9%
ComplianceComplied
Did Not Comply
53%
47%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Banerjee, S.; Jeihani, M.; Brown, D.D.; Ahangari, S. Comprehensive Analysis of Dynamic Message Sign Impact on Driver Behavior: A Random Forest Approach. Urban Sci. 2020, 4, 49. https://doi.org/10.3390/urbansci4040049

AMA Style

Banerjee S, Jeihani M, Brown DD, Ahangari S. Comprehensive Analysis of Dynamic Message Sign Impact on Driver Behavior: A Random Forest Approach. Urban Science. 2020; 4(4):49. https://doi.org/10.3390/urbansci4040049

Chicago/Turabian Style

Banerjee, Snehanshu, Mansoureh Jeihani, Danny D. Brown, and Samira Ahangari. 2020. "Comprehensive Analysis of Dynamic Message Sign Impact on Driver Behavior: A Random Forest Approach" Urban Science 4, no. 4: 49. https://doi.org/10.3390/urbansci4040049

Article Metrics

Back to TopTop