Next Article in Journal
DoH Tunneling Detection System for Enterprise Network Using Deep Learning Technique
Next Article in Special Issue
Road Infrastructure Challenges Faced by Automated Driving: A Review
Previous Article in Journal
Noise-Free Security Assessment of Eviction Set Construction Algorithms with Randomized Caches
Previous Article in Special Issue
Predicting Traffic Sign Retro-Reflectivity Degradation Using Deep Neural Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Analysis of the Factors Influencing the Retroreflectivity Performance of In-Service Road Traffic Signs

1
School of Information and Engineering, Dalarna University, 781 70 Borlänge, Sweden
2
Swedish Transport Administration, Röda Vägen 1, 781 89 Borlänge, Sweden
*
Author to whom correspondence should be addressed.
Appl. Sci. 2022, 12(5), 2413; https://doi.org/10.3390/app12052413
Submission received: 24 January 2022 / Revised: 19 February 2022 / Accepted: 23 February 2022 / Published: 25 February 2022
(This article belongs to the Special Issue Traffic Sign Detection and Recognition)

Abstract

:
The road traffic signs in Sweden have no inventory system and it is unknown when a sign has reached the end of its service life and needs to be replaced. As a result, the road authorities do not have a systematic maintenance program for road traffic signs, and many signs which are not in compliance with the minimum retroreflectivity performance requirements are still found on the roads. Therefore, it is very important to find an inexpensive, safe, easy, and highly accurate method to judge the retroreflectivity performance of road signs. This will enable maintenance staff to determine the retroreflectivity of road signs without requiring measuring instruments for retroreflectivity or colors performance. As a first step toward the above goal, this paper aims to identify factors affecting the retroreflectivity of road signs. Two different datasets were used, namely, the VTI dataset from Sweden and NMF dataset from Denmark. After testing different models, two logarithmic regression models were found to be the best-fitting models, with R2 values of 0.50 and 0.95 for the VTI and NMF datasets, respectively. The first model identified the age, direction, GPS positions, color, and class of road signs as significant predictors, while the second model used age, color, and the class of road signs.

1. Introduction

Road traffic signs are fundamental tools to regulate traffic and provide clear and important information to road users [1,2]. They are used on roads to inform road users about traffic rules and aim to avoid traffic accidents. Therefore, the biggest challenge for the road authorities is to make sure that these signs are readable and visible during their lifetime to provide consistent information to road users. This is particularly important at night when driving is more difficult, with more accidents per vehicle happening on roads during this time [3].
At night, road traffic signs reflect the light coming from vehicles to the road users so that they can see these signs [4,5]. The property of returning the light to the source (vehicle, in this case) is called retroreflectivity [6]. Retroreflectivity of the signs, therefore, plays an important role in increasing traffic safety, especially during the night, but also in daylight when the weather conditions may not always provide enough light.
Fading of the retroreflectivity or color of the road traffic signs makes these signs useless. The service life of road traffic signs is determined by several parameters, but primarily by retroreflection and color requirements according to the road authorities’ regulation and based on European standards [7]. As the retroreflective material ages, its retroreflectivity coefficient (RA) constantly weakens and the sign legibility declines [8]. The maintenance regulation specifies the minimum level of retroreflectivity that the road traffic signs should have. The road authorities require signs to be replaced if retroreflectivity reaches this minimum level.
European standards [7] regulate the color (chromaticity) of road traffic signs based on the CIE color space that was created by the International Commission on Illumination. Permissible colors are indicated by color regions or color boxes in the chromaticity diagram shown in Figure 1. The two chromaticity coordinates, X and Y, for retroreflective sheeting determine a location in the CIE chromaticity diagram which represents a certain color. Accepted colors must be within the color boxes to ensure that road traffic signs have the right color and are suitable for the intended purpose. The color is no longer accepted when it deteriorates beyond these chromaticity limits (color boxes).
The coefficient of retroreflection can be measured using retroreflectometers, while spectrophotometers are used for measuring colors. In the field, measurements can be recorded using either handheld or mobile equipment. Currently, handheld devices are most frequently used for measuring sign retroreflectivity and colors, although this approach needs to address safety challenges and the high cost of data collection. Handheld instruments are relatively expensive, must be in direct contact with the sign, and data collection must take place under special weather conditions. Maintenance workers who use these instruments must stand close to the road sign for a relatively long time and they may need to block the traffic, in particular, on motorways or when using a lift. Although mobile devices have several advantages over handheld devices, mobile equipment is much more expensive and has lower accuracy compared to handheld devices.
To summarize, the methods used to measure the retroreflection and colors of in-use road traffic signs are costly, time-consuming, need to be performed under special weather conditions, and involve an accident risk for maintenance staff. Therefore, many countries, including Sweden, do not have a systematic program for the inventory of the performance of road traffic signs. At the same time, it is very important to specify when a sign reaches the end of its service life and must be replaced.
This study aims to find a safe, easy, inexpensive, and accurate method that can be used by road authorities to analyze the performance and deterioration of retroreflective road traffic signs mounted on roads. Two datasets were used to fit models to predict the retroreflectivity of road traffic signs. The proposed method is to use linear and logarithmic regression models to predict retroreflectivity without needing to use measuring instruments.
Previous studies have suggested prediction models based on two features (sheeting type and color). Most of these studies focused on age as the only predictor for retroreflectivity performance, with Alkhulaifi [9], who considered color and observation angle, in addition to age and sheeting type, being an exception. Therefore, the accuracy of the models in these studies was low.
This study proposed regression models with multiple predictors to identify (statistically) significant factors that affect retroreflectivity. Furthermore, efforts have been made to find and evaluate models that include only the predictors that can be collected without the need for any expensive measuring instruments. For this reason, the predictors included were the age of the road traffic sign, its GPS position, and the direction of the sign, as well as the color and class of the retroreflective sheeting.
One other important issue in this paper was investigating the significance of the chromaticity, luminance factor, and GPS positions on the retroreflectivity of road traffic signs. These factors were not previously investigated and their effects on retroreflectivity were not included in the state of the art.
The main contributions of this study are:
  • Firstly, the relationship between retroreflectivity and other factors such as the CIE color coordinates, sign age, its class, GPS position, and direction are investigated. Linear and logarithmic regression models were conducted to identify the significant factors that affect retroreflectivity.
  • Secondly, the study tries to find a connection between the performance and deterioration of retroreflectivity and the other factors mentioned above.
  • Finally, the study proposes a way to analyze and calculate the performance and deterioration of retroreflectivity using factors that can be collected without using expensive instruments. Such factors include the traffic sign’s color, age, class, GPS position, and direction.
The rest of the paper is organized as follows. Section 2 discusses the prior literature, while Section 3 presents the description of the datasets used in this study and reviews the statistical methods applied. The results and discussion are provided in Section 4. Finally, the limitations, suggestions for further research, and conclusions are presented in Section 5 and Section 6.

2. Systematic Literature Review

A systematic review was conducted in this paper, with Google Scholar used to identify peer-reviewed articles. The keywords used in the literature search were “retroreflectivity performance”, “road traffic signs”, “regression models”, “retroreflective sheeting”, and “aging”. Additionally, the synonyms of these keywords were used in the search. A total of 192 articles were collected from 2000 to 2021 but after screening their titles and abstracts, only 17 articles were related.
The issue of a controlled study for sign deterioration was addressed in 1983 by Kenyon et al., who studied the deterioration of road signs in New York [10]. Retroreflectivity deterioration is an interactive process between many factors [6]. The main factors that affect retroreflectivity deterioration were identified by different researchers and were summarized in [6]. Among the important factors were the geographic area, weather conditions, sheeting type, sheeting age, sheeting color, and sunlight exposure [6,11]. Many researchers identified age as being the most significant factor that affects retroreflectivity deterioration, as shown in Table 1. The orientation of the sheeting in relation to the sun and the distance of the sign from the edge of the pavement were found to be insignificant [6,12,13].
Although many studies aiming to understand traffic sign retroreflection degradation have been conducted in the past three decades [1], only a few researchers have developed models that can accurately predict retroreflectivity performance and the durability of sign sheeting. In a 2017 study, developed regression models showed an average coefficient of determination (R-square) of 0.57 for linear models, 0.52 for logarithmic models, and 0.56 for exponential models [1]. Regression models in earlier studies produced R-squared values that were relatively low, in the range of 0.10 to 0.30 [12].
Swargam [6] compared the performance of multi-linear regression models with artificial neural network models (NN) used to predict the reflectivity of sign sheeting. The NN models predicted the retroreflectivity of signs closer to the in-field values for eight out of ten models, while two regression models estimated the reflectivity values closer to the in-field values than did the NN models. Even the other regression models produced nearly the same accuracy as the NN models. Generally, NN models are more competitively expensive than multi-linear regression models.
In a 2021 study, Alkhulaifi et al. [9] used regression models and neural networks based on deep learning models. The neural network with one-hot encoding achieved the best results with an R2 value of 0.976, while polynomial regression models achieved an R2 of 0.759.
Of all the sign types and colors studied in the past, attention has been paid to seven factors that are used as predictors for the retroreflectivity performance of road traffic signs. These factors are: sheeting type, sheeting age, sheeting color, the orientation of the sign concerning the sun, region, observation angle, and the distance from the edge of the pavement. Previously, only five factors—age, color, observation angle, sheeting type, and sign orientation—were included as predictors for retroreflectivity performance [1,14].
The developed regression models in previous studies showed relatively low R-squared values, with the suggested models needing improvement to achieve an accurate method of predicting the retroreflectivity performance of road traffic signs. For example, sheeting type, sheeting color, region, and distance from the edge of the pavement can be used as predictors, since including more predictors gives better prediction accuracy [6] and increases the goodness of fit of the models.
Although the state of the art found that the color of the retroreflective sheeting has a big effect on the deterioration of road traffic signs, no studies have evaluated the significance of chromaticity of the color (X and Y coordinates) on retroreflectivity. Despite the requirements according to the European standards 12899-1 [7] for the chromaticity and luminance factor of reflective sheeting, the effect of both the chromaticity and luminance factor on retroreflectivity was not investigated in any study.

3. Materials and Methods

3.1. Data Description and Data Pre-Processing

Two datasets were used in this study; the first one was collected in Sweden and the second one was collected in Denmark. Generally, the weather conditions and sheeting materials are almost identical in both countries.
The Road and Transport Research Institute (VTI) in Sweden collected the data from randomly selected signs mounted in the Swedish Transport Administration’s West and Mid regions, with examples shown in Figure 2. The purpose of the collected data (VTI data) was to analyze the life cycle costs for road signs. The selected road signs were equally distributed between the northern and southern parts of Sweden. Only road signs on the right side of the road in urban and rural areas were investigated. Since road traffic signs can be in stock and the year of manufacture can thus be earlier than the year of installation, the inventory of four location signs was carried out. The selected location signs were manufactured to order and were thus set up soon after delivery. Stop signs were also investigated in VTI data to analyze the red retroreflective material.
The NMF group, a voluntary Nordic research cooperation, measured 10 × 10 cm reflective sheeting samples (shown in Figure 3) which were mounted on a test stand and placed on the roof of the Danish Technical University, at its campus in Risø.
The datasets were cleaned of incomplete and unnecessary data, such as the manufacturer’s name and description of the surrounding environment, because these data were not suitable for this study. The relevant features that remained after cleaning are listed in Table 2.
The coefficient of retroreflection (RA) was measured in cd/lx/m2 at an observation angle of 0.33° and measuring angle of 5°. In this study, the coefficient of retroreflection is named retroreflection, which is the coefficient of luminous intensity of a plane retroreflection surface to its area, or a ratio of the returned intensity to incident illumination divided by the area of the retroreflection [1].
Daylight chromaticity (X, Y) was measured according to the CIE color space system.
The luminance factor (β) is the ratio of the flux reflected from a specimen relative to the flux reflected from a perfect reflecting diffuser under the same geometric and spectral conditions of measurement. Β is used to measure the brightness of the material and ranges from 0 for perfect black to 1 for perfect white.
This work investigated five colors: blue, green, red, white, and yellow
At the same time, three different types of retroreflective sheeting were included in both datasets (Class 1, 2, and 3). The main difference between the classes is the amount of reflected light by each sheeting, with Class 3 reflecting the most, as described below:
  • Class 1:
Three different sheetings belong to this class. The first one is Engineer Grade (EG) sheeting that has glass beads as a reflective material and it represents the least reflective type of foil. The second one is the Engineer Grade Prismatic (EGP) that has prisms instead of glass beads as reflective material. The last one is the Super Engineer Grade (SEG), which is similar to the Engineer Grade but with less variance in the size of the glass beads.
  • Class 2:
High Reflectivity (HR) or High Intensity (HI) has glass beads as reflective material, but the encapsulation of the beads is of a different type, which gives the reflected light a narrower beam.
  • Class 3:
Diamond Grade (DG) is a highly reflective prismatic material.
Finally, the direction in degrees gives the azimuth angle to which the sign is facing, where north, east, south, and west are 0, 90, 180, and 270 degrees, respectively.

3.2. Statistical Analysis

Results from previous studies indicated that the best-fitting relationships between retroreflectivity and age were generally linear and that the linear models were significant despite their low R2 values [1,6,12,13,15,16,17]. Therefore, linear regression models were conducted in this study. However, possible nonlinearity in the regression model was checked using residual plots, with their remedies attempted through Box–Cox transformations [18] of the response factor.
The Box–Cox transformation was used to transform the dataset into a more normally distributed one. This transformation procedure is used to modify the distributional shape of the response variable so that the residuals are more normally distributed, which is important for ensuring a stable estimate and valid inference [19,20], especially with a small sample size. The Box–Cox transformation is a family of power transformation and has the following mathematical form:
Y i ( λ ) = { Y i ( λ ) 1 λ   ( λ 0 ) log ( Y i )   ( λ = 0 )  
where Y represents the data and λ is the “power” to which each data value is raised.
The Box–Cox plot is a plot of the correlation from the data transformation for given values of λ. The Box–Cox plot, shown in Figure 4, is considered as a guide to choosing a value of the parameter of power transformation (λ) that is as close as possible to the one that maximizes the log-likelihood function and is easy to interpret [18]. Figure 4 indicated the optimal value of λ was close to zero for the two datasets, therefore logarithmic regression models were used to transform the data according to Equation (1). The plot of the profile likelihood in Figure 4 is not very flat, indicating that the Box–Cox transformation is likely to be successful with the data [21].
Linear and logarithmic regression models with multiple predictors were applied to analyze the retroreflectivity, as shown in Figure 5. Firstly, the models were used to find the relationship between retroreflectivity and all the factors in the datasets. A backward stepwise selection [18] was then used to find the best subset selection for the significant factors, as described in Section 4.1. Secondly, logarithmic regression models were used to calculate the performance and deterioration of retroreflective road traffic signs mounted on the roads, as shown in Section 4.2 and Section 4.3.
The analysis performed in this work is two-fold. Firstly, all the factors in the datasets (X, Y, age, color, class, GPS position, direction, and β) were included in the analyses and models (Section 4.1 and Section 4.2). Secondly, only the factors that can be collected without the need for expensive measuring instruments were used in the models to calculate the retroreflectivity (Section 4.3). The predictors included the age of the road traffic sign, its GPS position, and the direction of the sign, as well as its color and the class of its retroreflective sheeting.
Linear and logarithmic regression were used to determine equations that produce the minimum distance between the fitted values and all data points, with R2 used to measure, statistically, how close the data are to the fitted values. R2 was selected to assess the goodness of fit (model performance) because it had been used in previous studies investigating retroreflectivity deterioration, thereby leaving scope for comparability between studies.
Because the predictive performance of the model is not the prime concern of this work, we did not conduct any cross-validation or other type of out-of-sample performance assessment.

4. Results and Discussion

4.1. The Relationship between Retroreflectivity and Other Factors

The results from linear regression models, two logarithmic models (Model 1 and Model 2), and backward selection on Model 1 for the VTI and NMF data are shown in Table 3 and Table 4, respectively. Model 1 is a logarithmic regression model that uses all factors in the data as predictors without considering interaction between any two predictors. Model 2 is a logarithmic regression model that investigates the effects of interaction between age and three other predictors (direction, colors, and classes). As color and classes are categorical factors, the blue color was used as a reference factor for colors and Class 1 was used as a reference factor for classes in the regression models (Model 2).
In this study, GPS position is used to locate the region where the signs are mounted and included as predictors in the models to find the relationship between the location of the traffic sign and its deterioration.
Model 2 for the VTI data shows that the interaction between age and the other three predictors (direction, white color, and classes) was significant, but the estimate of the interaction effect with age was very small and had no visible impact on the prediction models (almost identical R2 values for Model 1 and Model 2). Model 2 for the NMF data shows that age has no significant interaction with colors or classes.
Because of the small or marginal effect of interaction between age and other predictors, the models used in the additional analysis do not consider interaction between any factors in the data.
As depicted in Table 3 and Table 4 for Model 1, the age of the road traffic sign was significant in both the VTI and NMF data. In addition, the X coordinate of the CIE color space and the class of road traffic signs were also significant in both datasets.
The backward stepwise selection begins with the full least squares model containing all predictors and then iteratively removes the least useful predictor, one at a time [22]. The reduced model that best explains the VTI and NMF data is shown in Table 3 and Table 4, respectively. It is worth mentioning that logarithmic models were used for backward stepwise selection because they satisfied all the model diagnostics reasonably well and gave higher R2 values compared to the linear models (no transformation of the response factor). GPS longitude was insignificant in the backward stepwise models for the VTI data, while the Y coordinate of the CIE color space and β were insignificant in the model for the NMF data.
An important finding is that the effect of GPS position on retroreflectivity is significant for the latitude but not longitude (shown in Table 3). It is clear from the results that road signs mounted in the southern regions of Sweden fade faster compared with those in the northern parts. There are many reasons why road signs fade faster in the southern regions. The high intensity of traffic and high humidity in the south may be the main factors that distinguish it from the north. The population size in the north is considerably smaller than that in the southern and central regions, while the summer period lasts longer in the south. In addition, Sweden’s four largest lakes lie within the southern regions and they may increase the humidity in these regions.
A logarithmic regression model (Model 1) was further conducted in Section 4.2, with the R2 values of 0.57 and 0.95 for the VTI and NMF data, respectively (see Table 3 and Table 4), being higher than the R2 for a linear regression model (0.53 and 0.75).

4.2. Prediction Models Using All Factors in the Data

Further analysis was conducted to test the effect of the data divided according to the classes of retroreflective sheeting on the performance of the models expressed in terms of R2 (see Table 5). Generally, the R2 value decreased for the VTI data, from 0.57 when using all the data points to 0.22 for Class 3, while the NMF data R2 value was approximately the same (0.95 to 0.92).
The reason for the decrease in R2 values was because of the low number of observations in the divided data (a subset of data according to classes) compared with the total datasets which contain all classes.
The R2 values of Class 3 in the VTI data decreased from 0.57 to 0.22 because the age of the reflective sheeting of this class had a maximum of 14 years compared with 36 years for all classes in the dataset. The lower age of Class 3 makes the prediction more difficult because of a lack of information about what happens to retroreflectivity after 14 years. Even models of Class 1 and Class 2 were less accurate, with the prediction difficult for all colors because Class 1 includes no red and green colors while no green color was included in Class 2. The colors were significant in predicting retroreflectivity, so omitting information about some colors is expected to affect the model’s performance.
All classes in NMF showed a higher R2 value than for VTI data (see Table 5). The high R2 values for models fitted on NMF data indicate a linear relationship. The linearity was clearer in NMF data compared with the VTI dataset. This was because the weather conditions, locations, directions, and GPS positions were the same for the retroreflective samples in the NMF data, while in the VTI data, measurements were recorded on different road signs that were mounted in different locations, directions, and GPS positions, and were exposed to different weather conditions.
The datasets were further divided according to the classes and colors of the retroreflective sheeting to investigate the effect on the performance of the regression models applied on the divided data, as shown in Table 6.
Generally, the models for the VTI dataset give higher R2 values for individual colors compared with the models containing all colors. The higher R2 value of the VTI data can be explained by the fact that the data contained neither green nor red in some classes, which makes the comparison more reasonable when the data is grouped according to class and color.
The R2 values for the NMF data decreased despite the color being significant to retroreflectivity. Since the NMF data has fewer predictors, removing color and class makes the models less accurate. As previously mentioned, fewer predictors decreases the R2 value, especially for NMF data that have only six predictors and a low age of five years.
It was also noticed that logarithmic regression models of the yellow, red, and white colors in NMF data produced relatively higher R2 values than other colors. These three colors have the highest β among the other colors.
As shown in Table 3 and Table 4, the logarithmic regression models applied on the datasets that include all factors were more accurate than the linear regression models. The best regression models came from using backward stepwise selection on logarithmic regression models, as shown in Equations (2) and (3).
Based on VTI data (R2 = 0.57):
log(1 + RA) = −5.25 − 1.74 × X + 8.84 × Y − 0.71 × G − 0.46 × R + 0.05 × W − 0.98 × Ye − 0.25 × (Dir/360) + 0.12 × lat − 0.05 × Age + 1.39 × Cl2 + 1.90 × Cl3
Based on NMF data (R2 = 0.95):
log(1 + RA) = 1.92 + 1.47 × X + 0.57 × G + 0.18 × R + 2.09 × W + 1.51 × Ye − 0.04 × Age + 0.89 × Cl2 + 1.89 × Cl3
where:
RA = The calculated coefficient of retroreflectivity.
X, Y = Daylight chromaticity.
Age = The age of the road sign in years.
G = A constant must be set to 1 if the color is Green, otherwise set to 0.
R = A constant must be set to 1 if the color is Red, otherwise set to 0.
W = A constant must be set to 1 if the color is White, otherwise set to 0.
Ye = A constant must be set to 1 if the color is Yellow, otherwise set to 0.
Cl2 = A constant must be set to 1 if the class is 2, otherwise set to 0.
Cl3 = A constant must be set to 1 if the class is 3, otherwise set to 0.
Dir: The compass direction (Direction) in degrees gives the direction that the sign is facing (0, 90, 180, and 270 represent north, east, south, and west, respectively).
lat, long: The coordinates (GPSlat, GPSlong) where the sign is mounted at the geographic coordinate system.
The performance of the prediction models in Equations (2) and (3) differs for each dataset because of the differences in the size, age, and placing of the retroreflective sheeting. The logarithmic regression models on the NMF data showed a higher R2 value than for the VTI data because the NMF data were collected from samples that have the same size and are exposed to the same conditions.
Age has a negative coefficient in Equations (2) and (3), confirming that the retroreflectivity decreases (by 4–5%) for a unit increase in age of the road sign, given all other factors in the model are held constant.
There is a big difference in the age of traffic signs included in the two datasets. While the age of traffic signs in the NMF data is just five years, the age of the traffic signs in the VTI dataset has a maximum of 36 years. Referring to Equations (2) and (3), the VTI dataset gives a negative X coordinate (−1.74), while the coefficient of the NMF dataset is positive (+1.47). One possible explanation for this difference is that at the beginning of the life cycle of the traffic sign, the color deteriorates much faster than the retroreflectivity which makes the traffic sign reflect more light and hence increases retroreflectivity. This happens in the case of the NMF dataset. By the end of the traffic sign life cycle, both the color and retroreflectivity deteriorate, which explains the negative sign in the equation. This was seen in the case of the VTI dataset.

4.3. Prediction Models Using Factors That Can Be Collected without Instruments

Thus far, regression models were applied to all factors in the data to investigate the relationship between retroreflectivity and the other predictors, as well as find the best prediction models.
To achieve the aim of building a model to calculate retroreflectivity using predictors that can be collected easily, quickly, safely, and cheaply, further regression models were generated. Predictors that need expensive measuring instruments and complex methods to be collected should not be included in the predicting models. Therefore, X, Y, and β were removed from the linear and logarithmic regression models, with the results shown in Table 7, Table 8 and Table 9.
Firstly, linear and logarithmic regression were conducted on the datasets (see Table 7), using age, color, class, direction, and GPS position as predictors for models on the VTI data, while age, color, and class were predictors for models on the NMF data. Secondly, the regression models were further applied on the datasets that were divided according to classes (see Table 8). Finally, regression models were applied on the data divided according to class and color (see Table 9). The number of observations in the divided data is shown in Table 10.
The divided data, according to colors and classes, have few observations and give less information (see Table 10). Therefore, a decrease in the performance of models, expressed by lower R2 values, was expected in models including only one color or one class (see Table 8 and Table 9). The most accurate regression models producing the highest R2 values (0.50 and 0.95) are logarithmic regression models, which include the class and color as predictors together with age (see Table 7).
As shown in Table 7, using logarithmic regression models produces R2 values of 0.50 and 0.95 for VTI and NMF data, respectively, when omitting X, Y, and β. Removing these significant predictors (X, Y, and β) from the predicting models has no impact on the performance of models, with the R2 values unchanged when compared with those for Equations (2) and (3).
The best regression models using only the factors that can be collected without instruments were the logarithmic regression models in Equations (4) and (5), as shown in Table 7:
Based on VTI data (R2 = 0.50):
log(1 + RA) = −3.45 + 0.43 × G + 0.34×R + 0.39 × W − 0.39 × Ye − 0.26 × (Dir/360) + 0.12 × lat + 0.01 × long − 0.05 × Age + 1.39 × Cl2 + 1.89 × Cl3
Based on NMF data (R2 = 0.95):
log(1 + RA) = 2.14 + 0.57 × G + 0.91 × R + 2.34 × W + 2.02 × Ye − 0.04 × Age + 0.9 × Cl2 + 1.89 × Cl3
Six predictors can be used in Equation (4) to predict retroreflectivity: the class of the retroreflective sheeting, the color of the sign, the direction of the sign, the GPS latitude of the sign, the GPS longitude of the sign, and the age of the sign. These predictors can be easily collected without the need for expensive measuring instruments. Three predictors can be used in Equation (5) to predict retroreflectivity: the class of the retroreflective sheeting, the color of the sign, and the age of the sign.
The two models described in Equations (4) and (5) give a different predictive performance in terms of R2 values, which are 0.50 and 0.95 for prediction models based on the VTI and NMF datasets, respectively. The two datasets differ in size and the age, size, and placing of the tested sheeting in each dataset are different, explaining why the performance of the prediction models differs for each dataset.
Age has a negative coefficient in Equations (4) and (5), confirming that retroreflectivity decreases (by 4–5%) for a unit increase in age of the road sign, given all other factors in the model are held constant.
The negative coefficient (−0.26) in Equation (4) for the direction of the road indicates that direction is negatively correlated with RA and that retroreflectivity decreases (by 26%) when the azimuth angle of the road traffic sign increases (by one unit). In particular, the road signs that faces south and west (directions of 180 and 270 degrees from north) fade faster than signs facing north and east (directions of 0 and 90 degrees) and need to be replaced more often. This conclusion is supported by the fact that solar radiation can affect road signs negatively.
Four assumptions are necessary so that the regression model can be applied for hypothesis testing, confidence intervals, and prediction [20]. The assumptions of a linearity relationship, homogeneity of variance, uncorrelated errors, and normally distributed errors can be checked using diagnostic plots [19]. The diagnostic plots of the logarithmic models (Figure 6 and Figure 7) showed that:
  • The Residuals vs. Fitted values plot shows an almost horizontal line around the zero value. This indicates a linearity relationship between retroreflectivity and the predictors for the VTI and NMF data.
  • The residuals are more normally distributed in the NMF data because the Normal Q-Q plot shows that the residual points almost follow the straight dashed line. However, the VTI data residuals follow the dashed line only in the middle part of the plot.
  • The Scale-Location plot that was used to check the homogeneity of variance of the residuals (homoscedasticity) gives no indications of heteroscedasticity problems. A horizontal line with equally spread points is expected to indicate good homoscedasticity, and this is the case with both the VTI and NMF data.
  • The Residuals vs. Leverage plots indicate the presence of some outliers in both datasets.
The performance in terms of the R2 values of the two models that were suggested in Equations (4) and (5) are almost equal to those of the models in Equations (2) and (3). This means that predictors requiring instruments to measure them can be excluded from the predicting models without affecting the models’ performance. In summary, the models described in Equations (4) and (5) can be used to predict retroreflectivity and provide an accurate, safe, and unexpressive method. The regression models from studies as early as 2011 produced R2 values ranging from 0.10 to 0.30 [12], while a 2017 study had R2 values ranging from 0.52 to 0.57 [1]. However, the regression models in Equations (4) and (5) of this study showed a better fit with the data than previous models, with R2 values of 0.50 and 0.95.

5. Limitations and Suggestions for Further Research

This study has some limitations with implications for future research. The first limitation is due to the used datasets (the variables measured in each dataset, including the age of retroreflected sheeting, the region included, and the type of retroreflective sheeting). The present study had a focus on linear and logarithmic models, which limits the performance of the models in terms of R2 values of 0.50. Additionally, the study had a national focus on road signs mounted in Sweden.
The NMF data has some limitations because the age of signs was only up to five years old and the fading rate of retroreflectivity may deteriorate quicker after these first five years. The Nordic group plans to continue collecting data by measuring the retroreflectivity, daylight chromaticity, and luminance factor once a year. A follow-up is suggested on the data that will be collected by NMF to obtain a more accurate prediction. Future research must consider data collected from other regions and with higher ages to accomplish more accurate predictions. Nonlinear models such as neural networks, support vector machines, regression trees, generalized additive models, etc., need to be tested in future work for better prediction. Given the short time series on the retroreflectivity of road traffic signs, it is not currently feasible to develop a more complex prediction, and we leave this issue for future work when we acquire more data. Finally, the significance of other factors needs to be investigated, including the distance from the sea, weather zones, surrounding environment, and weather. The road traffic signs mounted in high-speed or crowded roads need to be studied separately to other road signs to obtain more accurate models for prediction.

6. Conclusions

The main goal of this study was to build an accurate, easy, fast, inexpensive, and safe method to predict the retroreflectivity performance for road traffic signs mounted on roads. The logarithmic models suggested in this study provide an accurate and easy method to predict the retroreflectivity performance of road signs, to help decide if these signs should be replaced.
The color, age, class, GPS position, and direction of road signs are factors needed to predict retroreflectivity in the logarithmic regression models proposed by this study. These predictors can be collected easily, cheaply, safely, and quickly, with no expensive instruments needed to measure them. The proposed models in this paper are more accurate than other equations proposed in previous studies, which include only age as a predictor to evaluate the retroreflectivity of road signs.
The suggested logarithmic regression models give R2 values of 0.50 and 0.95 for VTI and NMF data, respectively. Even linear models showed a good performance, with the coefficients of determination (R2 values) being 0.44 and 0.72.
The suggested models differ from those suggested by the state of the art [1,6,12,13,15,16,17] and give higher R2 values. Previous studies investigated the effect of road signs’ age, region, orientation concerning the Sun, distance from the road, and visual condition (daytime appearance, message integrity, and general condition) on retroreflectivity. They found that only age and region were significant predictors of retroreflectivity, while this study determined that age, color, class, GPS latitude positions, and direction of the road traffic sign were significant. In addition, the statistical analysis in this study revealed that GPS longitude and luminance factors were insignificant to retroreflectivity.
In this study, particular models included color and class as predictors, while previous studies used different sets of predicting equations according to color and class and included only age as a predictor. Furthermore, including colors and classes as predictors was found to increase the performance of the models compared to previous studies.

Author Contributions

Conceptualization, R.S. and H.F.; methodology, R.S. and M.A.; software, R.S. and M.A.; validation, R.S., M.A. and H.F.; formal analysis, R.S., H.F. and M.A.; investigation, R.S. and H.F.; resources, R.S. and H.F.; data curation R.S.; writing—original draft preparation, R.S.; writing—review and editing, H.F.; visualization, R.S.; supervision H.F.; project administration, R.S.; funding acquisition, R.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Swedish Road Administration, grant number TVR 2019/31837.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The two datasets used to support the findings of this study were supplied by Road and Transport Research Institute (VTI) and NMF group and under license and so cannot be made freely available. Requests for access to these data should be made to VTI and NMF.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Babić, D.; Babić, D.; Macura, D. Model for Predicting Traffic Signs Functional Service Life—The Republic of Croatia Case Study. Promet-Traffic Transp. 2017, 29, 343–349. [Google Scholar] [CrossRef] [Green Version]
  2. Costa, M.; Simone, A.; Vignali, V.; Lantieri, C.; Bucchi, A.; Dondi, G. Looking behavior for vertical road signs. Transp. Res. Part F Traffic Psychol. Behav. 2014, 23, 147–155. [Google Scholar] [CrossRef]
  3. Berzinsh, J.; Ozolinsh, M.; Cikmacs, P.; Pesudovs, K. Recognition of Retroreflective Road Signs during Night Driving. Human Factors in Transportation, Communication, Health, and the Workplace; Shaker Publishing: Maastricht, The Netherlands, 2002. [Google Scholar]
  4. Bible, R.C.; Johnson, N. Retroreflective Material Specifications and On-Road Sign Performance. Transp. Res. Rec. 2002, 1801, 61–72. [Google Scholar] [CrossRef]
  5. Hildebrand, E.D. Reductions in Traffic Sign Retroreflectivity Caused by Frost and Dew. Transp. Res. Rec. 2003, 1844, 79–84. [Google Scholar] [CrossRef]
  6. Swargam, N. Development of a Neural Network Approach for the Assessment of the Performance of Traffic Sign Retroreflectivity. Master’s Thesis, Louisiana State University, Baton Rouge, LA, USA, 2004. [Google Scholar]
  7. European Committee for Standardization. EN 12899-1. Fixed, Vertical Road Traffic Signs—Part 1: Fixed Sign. European Committee for Standardization: Brussels, Belgium, 2007; 57p. [Google Scholar]
  8. Ma, X.F.; Su, W.Y.; Li, D.; Wang, W. The Research for the Aging Performance of Reflective Sheeting by Artificial Accelerated Method. AMM 2013, 361–363, 2326–2329. [Google Scholar] [CrossRef]
  9. Alkhulaifi, A.; Jamal, A.; Ahmad, I. Predicting Traffic Sign Retro-Reflectivity Degradation Using Deep Neural Networks. Appl. Sci. 2021, 11, 11595. [Google Scholar] [CrossRef]
  10. Brimley, B.K.; Carlson, P. The Current State of Research on the Long-Term Deterioration of Traffic Signs. In Proceedings of the Transportation Research Board 92nd Annual Meeting and Publication in the Transportation Research Record, Washington, DC, USA, 13–17 January 2013. Paper 13-0033. [Google Scholar]
  11. Saleh, R.; Fleyeh, H. Factors Affecting Night-Time Visibility of Retroreflective Road Traffic Signs: A Review. Int. J. Traffic Transp. Eng. (IJTTE) 2021, 11, 115–128. [Google Scholar]
  12. Ré, J.M.; Miles, J.D.; Carlson, P.J. Analysis of In-Service Traffic Sign Retroreflectivity and Deterioration Rates in Texas. Transp. Res. Rec. 2011, 2258, 88–94. [Google Scholar] [CrossRef]
  13. Wolshon, B.; Degeyter, R.; Swargam, J. Analysis and Predictive Modeling of Road Sign Retroreflectivity Performance. In Proceedings of the 16th Biennial Symposium on Visibility and Simulation, Iowa City, IA, USA, 2–4 June 2002. [Google Scholar]
  14. Venkata, P.I.; Hummer, J.E.; Rasdorf, W.J.; Elizabeth, A.H.; Chunho, Y. Synthesis of Sign Deterioration Rates Across the United States. J. Transp. Eng. 2009, 135, 3. [Google Scholar]
  15. Huynh, N.; Mullen, R.; Pulver, Z.; Shiri, S. Sign Life Expectancy; Transport Research International Documentation (TRID): Washington, DC, USA, 2018. [Google Scholar]
  16. Immaneni, V.P.; Hummer, J.E.; Rasdorf, W.J.; Harris, E.A.; Yeom, C. Synthesis of sign deterioration rates across the United States. J. Transp. Eng. 2009, 135, 94–103. [Google Scholar] [CrossRef]
  17. Rasdorf, W.J.; Hummer, J.E.; Harris, E.A.; Immaneni, V.P.K.; Yeom, C. Designing an Efficient Nighttime Sign Inspection Procedure to Ensure Motorist Safety; North Carolina Department of Transportation: Raleigh, NC, USA, 2006. [Google Scholar]
  18. Venables, W.N.; Ripley, B.D. Modern Applied Statistics with S; Springer: New York, NY, USA, 2002. [Google Scholar]
  19. Osborne, J.W.; Waters, E. Multiple Regression Assumptions. ERIC Digest; ERIC Publications: College Park, MD, USA, 2002; ED470205. [Google Scholar]
  20. Osborne, J.W.; Waters, E. Four assumptions of multiple regression that researchers should always test. Pract. Assess. Res. Eval. 2002, 8, 2. [Google Scholar]
  21. Pawitan, Y. All Likelihood: Statistical Modeling and Inference Using Likelihood; Oxford University Press: Oxford, UK, 2001. [Google Scholar]
  22. Shao, C. Backward Selection—A Way to Final Model; PharmaSUG; Boehringer Ingelheim (China) Investment Co., Ltd.: Shanghai, China, 2019; Paper PO-077. [Google Scholar]
Figure 1. CIE color space with color boxes according to SS-EN 12899-1.
Figure 1. CIE color space with color boxes according to SS-EN 12899-1.
Applsci 12 02413 g001
Figure 2. Randomly selected road signs in VTI data.
Figure 2. Randomly selected road signs in VTI data.
Applsci 12 02413 g002
Figure 3. Reflective sheeting samples in the NMF data.
Figure 3. Reflective sheeting samples in the NMF data.
Applsci 12 02413 g003
Figure 4. Profile–likelihood plot for the Box–Cox transformation of the VTI data (left) and NMF data (right).
Figure 4. Profile–likelihood plot for the Box–Cox transformation of the VTI data (left) and NMF data (right).
Applsci 12 02413 g004
Figure 5. Statistical analysis design to determine those factors/predictors that significantly affect retroreflectivity and also predict retroreflectivity.
Figure 5. Statistical analysis design to determine those factors/predictors that significantly affect retroreflectivity and also predict retroreflectivity.
Applsci 12 02413 g005
Figure 6. Checking the assumptions for logarithmic regression of the VTI data.
Figure 6. Checking the assumptions for logarithmic regression of the VTI data.
Applsci 12 02413 g006
Figure 7. Checking the assumptions for logarithmic regression of the NMF data.
Figure 7. Checking the assumptions for logarithmic regression of the NMF data.
Applsci 12 02413 g007
Table 1. Summary of the previous literature discussing retroreflectivity deterioration.
Table 1. Summary of the previous literature discussing retroreflectivity deterioration.
ReferencesSheeting TypesSheeting ColorsModelsSignificant FactorsInsignificant Factors
Wolshon et al. [13]I, IIIgreen, white, yellowMathematical linearAgeOrientation concerning the Sun,
The distance from the road
Swargam [6]I, IIIgreen, white, yellowMulti-linear regression,
Artificial neural networks (ANNs)
AgeOrientation concerning the Sun,
The distance from the road
Ré et al. [12]IIIred, white,
yellow
Linear regressionAge,
Region
Visual condition (daytime appearance, message integrity, and general condition),
Orientation concerning the Sun
Babić et al. [1]I, II, IIIwhite, red,
blue, yellow
Regression:
linear,
logarithmic,
exponential
Age
Alkhulaifi et al. [9]I, II, IIIgreen, white, blue, yellowDeep neural network,
Regression:
linear, polynomial
Color,
Observation angle,
Sheeting type,
Age
Sign orientation,
Sheeting brand
Table 2. Description of the datasets used in this study.
Table 2. Description of the datasets used in this study.
VTI DataNMF Data
VariablesRA, X, Y, Age, Color, Class,
Direction, GPSlat, GPSlong
RA, X, Y, β, Age, Color, Class
Number of studied samples/signs302 signs120 reflective sheeting samples
Daylight chromaticity (X, Y)Background and borderFor each sample
Retroreflection values (RA)Background and borderFor each sample
Data collectionData collected from different signs in 2018Data collected from the same samples once a year from 2015 to 2020
Year of manufacture(1983–2018)2015
DirectionAzimuth direction (0–359 degrees)Facing south and tilts 45°
GPS coordinatesWhere the sign is mountedDanish Technical University in Risø.
Type of retroreflectionClass 1, 2, and 3Class 1, 2, and 3
Data size9 columns and 1813 rows7 columns * 717 rows
Table 3. The relationship between retroreflectivity and other factors in the VTI data.
Table 3. The relationship between retroreflectivity and other factors in the VTI data.
FactorsLinear
Regression
Logarithmic Regression
Model 1
Logarithmic Regression Model 2Backward Selection 3
X−615.12***−1.73***−1.85***−1.74***
Y1086.71***8.84***8.85***8.84***
Green color−88.19***−0.72***−0.53 −0.71***
Red color−18.65 −0.46**−0.41 −0.46**
White color86.66***0.05 0.58**0.05
Yellow color−32.12*−0.97***−1.11***−0.98***
(Direction/360)−10.05 −0.25*0.10 −0.25*
GPS latitude8.44**0.12***0.11***0.12***
GPS longitude−2.54 0.01 0.03 -
Age−3.34***−0.05***−0.07***−0.05***
Class 242.77**1.39***−0.24 1.39***
Class 3254.47***1.90***1.16***1.90***
I (Direction/360): Age −0.02*
Green color: Age −0.02
Red color: Age −0.00
White color: Age −0.04***
Yellow color: Age 0.01
Class 2: Age 0.09***
Class 3: Age 0.06***
R20.53 0.57 0.58 0.57
*, **, *** indicates significance at the 5%, 1%, and 0.1% level, respectively; 1 No interaction between predictors included; 2 Interaction between age and three predictors (direction, color, and class) is included; 3 Logarithmic regression considering no interaction between predictors.
Table 4. The relationship between retroreflectivity and other factors in the NMF data.
Table 4. The relationship between retroreflectivity and other factors in the NMF data.
FactorsLinear
Regression
Logarithmic
Regression Model 1
Logarithmic Regression Model 2Backward
Selection 3
X34.19 1.45*1.68**1.47**
Y−231.24 −0.58 −0.72
β−559.15***−0.30 −0.30 -
Green color106.85*0.75***0.82***0.57***
Red color81.51 0.32 0.15 0.18
White color548.87***2.34***2.27***2.09***
Yellow color417.25***1.79***1.69***1.51***
Age−4.36*−0.04***−0.04**−0.04***
Class 236.00***0.88***0.91***0.89***
Class 3165.05***1.88***1.89***1.89***
Green color: Age −0.01
Red color: Age 0.02
White color: Age 0.01
Yellow color: Age 0.02
Class2: Age −0.01
Class3: Age −0.00
R20.74 0.95 0.95 0.95
*, **, *** indicates significance at the 5%, 1%, and 0.1% level, respectively; 1 No interaction between predictors included; 2 Interaction between age and two predictors (color and class) is included; 3 Logarithmic regression considering no interaction between predictors.
Table 5. R2 values for each class for VTI and NMF data (using logarithmic regression).
Table 5. R2 values for each class for VTI and NMF data (using logarithmic regression).
DATAPredictorsClass of RetroreflectionR2
VTIX + Y + Direction + GPSlat + GPSlong + Age + Color10.44
20.49
30.22
NMFX + Y+ β +Age + Color10.94
20.93
30.92
Table 6. R2 values for each color and class for VTI and NMF data (using logarithmic regression).
Table 6. R2 values for each color and class for VTI and NMF data (using logarithmic regression).
ColorClassVTI DataNMF Data
Predictors:
X + Y + Direction + GPSlat + GPSlong + Age
Predictors:
X + Y + β + Age
Blue10.640.32
20.970.36
30.730.21
Green1No green in Class 10.34
2No green in Class 10.49
30.710.23
Yellow10.740.62
20.990.44
30.810.07
Red1No red in Class 10.39
20.420.50
30.970.63
White10.500.62
20.980.12
30.740.50
Table 7. Regression models for estimating retroreflectivity performance for VTI and NMF data.
Table 7. Regression models for estimating retroreflectivity performance for VTI and NMF data.
VTI DataNMF Data
Predictors:
Age + Direction + GPS Position + Color + Class
Predictors:
Age + Color + Class
Linear RegressionLogarithmic RegressionLinear RegressionLogarithmic Regression
R20.440.500.720.95
Table 8. R2 values for VTI and NMF regression models for all colors.
Table 8. R2 values for VTI and NMF regression models for all colors.
ClassVTI DataNMF Data
Predictors:
Age + Direction + GPS Position + Color
Predictors:
Age + Color
Linear
Regression
Logarithmic
Regression
Linear
Regression
Logarithmic
Regression
10.380.300.930.94
20.010.020.830.92
30.060.130.850.91
Table 9. R2 values for VTI and NMF regression models for each color and class.
Table 9. R2 values for VTI and NMF regression models for each color and class.
ColorClassVTI DataNMF Data
Predictors:
Age + Direction + GPS Position
Predictors:
Age
Linear RegressionLogarithmic RegressionLinear RegressionLogarithmic Regression
Blue10.310.250.100.12
20.020.010.220.29
30.020.020.100.10
Green1--0.090.12
2--0.130.09
30.040.040.090.10
Yellow10.570.580.070.06
20.000.010.050.06
30.030.040.040.06
Red1--0.080.07
20.010.060.110.11
30.040.030.080.09
White10.380.240.030.03
20.190.130.060.05
30.060.050.030.04
Table 10. The number of observations for divided data.
Table 10. The number of observations for divided data.
Colors Included in the ModelClasses Included in the ModelsVTI DataNMF Data
Number of ObservationsNumber of Observations
All(blue + green + yellow + red + white)All (1 + 2 + 3)1544710
1603154
2258191
3683365
Blue119632
29842
311778
Green1-32
2-42
36078
Yellow120532
22442
318647
Red1-26
212024
319247
White120232
21641
312884
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Saleh, R.; Fleyeh, H.; Alam, M. An Analysis of the Factors Influencing the Retroreflectivity Performance of In-Service Road Traffic Signs. Appl. Sci. 2022, 12, 2413. https://doi.org/10.3390/app12052413

AMA Style

Saleh R, Fleyeh H, Alam M. An Analysis of the Factors Influencing the Retroreflectivity Performance of In-Service Road Traffic Signs. Applied Sciences. 2022; 12(5):2413. https://doi.org/10.3390/app12052413

Chicago/Turabian Style

Saleh, Roxan, Hasan Fleyeh, and Moudud Alam. 2022. "An Analysis of the Factors Influencing the Retroreflectivity Performance of In-Service Road Traffic Signs" Applied Sciences 12, no. 5: 2413. https://doi.org/10.3390/app12052413

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop