Next Article in Journal
Comment on Verteramo Chiu, L.J.; Gomez, M.I. A Tale of Two Strawberries: Conventional and Organic Open-Field Production in California. Sustainability 2023, 15, 14363
Previous Article in Journal
A Systematic Review for Indoor and Outdoor Air Pollution Monitoring Systems Based on Internet of Things
Previous Article in Special Issue
Development and Evaluation of Vegetable Resin Bio-Binders as Technological Alternatives to Bitumen
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Uncontrollable Factors Analysis on Sustainable Highway Routine Maintenance Management: A Case Study of Shaanxi Province in China

1
School of Highway, Chang’an University, Xi’an 710064, China
2
Xi’an Municipal Engineering Design & Research Institute Co., Ltd., Xi’an 710068, China
*
Author to whom correspondence should be addressed.
Sustainability 2024, 16(11), 4355; https://doi.org/10.3390/su16114355
Submission received: 19 April 2024 / Revised: 17 May 2024 / Accepted: 18 May 2024 / Published: 22 May 2024

Abstract

:
To figure out the primary factors that significantly impact the sustainability of highway routine maintenance management (HRMM), this paper examined 23 highway operating subsidiaries (evaluated decision-making units, DMUs) affiliated with Shaanxi Transportation Holding Group (STHG) in Shaanxi Province as an example. First, data envelopment analysis (DEA) was used to evaluate the performance of HRMM for each DMU. Subsequently, a truncated regression model was utilized to analyze the primary factors that impact the outcomes of HRMM. The conclusions indicated that except for the widely recognized input and output factors, there exist some uncontrollable factors that can affect HRMM efficiency, including the amount of natural dustfall, urbanization rate, tunnel length, and bridge length. These findings offer suggestions for STHG focusing on DMUs facing challenges with high dustfall and urbanization rate and long bridges and tunnels when allocating maintenance resources to improve HRMM efficiency and achieve sustainable highway maintenance management. Moreover, the methodology for analyzing uncontrollable factors can also serve as a valuable reference for other maintenance types or fields, contributing to the broader goal of promoting sustainability in transportation infrastructure development.

1. Introduction

With the growing travel demand, highway maintenance is facing grave challenges due to the long-term effects of environmental and traffic loading factors. In response to the above problem, highway agencies are increasingly focusing on the sustainability of highway maintenance, which refers to the application of environmentally friendly, efficient, and sustainable technologies and management practices to maintain and manage highway infrastructure assets, which can achieve the preservation and appreciation of highway assets while the reducing environmental impact and ensuring user safety. In recent years, numerous scholars have conducted research on the innovation of maintenance decision-making [1,2], maintenance management [3,4], maintenance assessment [5,6,7], and maintenance technology [8,9], which provide new development directions for sustainable highway maintenance.
Among the above sustainable maintenance aspects, this paper mainly focuses on performance evaluation in maintenance assessment. Performance evaluation aims to enhance the effectiveness of asset management practices, and it has been widely applied in areas such as corporate management [10], factory equipment maintenance [11], and manufacturing [12]. In the context of transportation asset management, corresponding standards and guidelines have been introduced [13,14,15,16]. Highways, as critical national infrastructure assets, attract significant attention from transportation departments regarding the final conditions and service levels. Transportation departments increasingly emphasize performance-based management in the maintenance and operation of highways to ensure an objective and scientifically-driven assessment [17], which plays an important role in sustainable highway asset management.
To objectively and fairly evaluate highway maintenance management (HMM), many scholars have integrated the concept of performance evaluation into management practices [18,19,20,21]. The fundamental content of performance evaluation is the measurement of efficiency, which can be achieved through two principal methodologies: stochastic frontier analysis (SFA, parametric approach) and data envelopment analysis (DEA, non-parametric approach). In contrast to SFA, DEA does not necessitate any parametric assumptions about the production frontiers and employs linear programming techniques to assess the relative efficiency of organizations, making it well suited to multi-input and multi-output problems. Since its inception, DEA has been employed extensively for performance evaluation in a multitude of fields, including higher education, healthcare, supply chain management, the defense sector, and transportation [22,23,24,25,26,27].
The asset management goal of highway management agencies is to attain optimal maintenance management results by minimizing the inputs of maintenance in order to maximize the generated maintenance benefits and achieve the sustainable development of highway infrastructures. In essence, this can be viewed as a process involving multiple inputs and multiple outputs. Based on this characteristic, DEA is one appropriate method to evaluate highway maintenance management performance (HMMP), which can be mainly classified into two aspects in existing studies: maintenance operations [28,29,30,31,32,33] or bridge maintenance [19,34,35,36,37].
It is noteworthy that highways are subject to a myriad of complex factors (i.e., climate, the natural environment, etc.) during operation, and these factors are objective and not under human control, which can be referred to as external factors or uncontrolled factors. Especially for routine maintenance, the fundamental type throughout the entire highway asset lifecycle, involving routine cleaning and minor repairs to ensure that highway assets are maintained at a high level, plays a significant role during the sustainable development of the operation period. Identifying the impact on highway routine maintenance management (HRMM) of uncontrollable factors is critical to improving highway routine maintenance management performance (HRMMP); however, few studies have focused on this problem.
Consequently, this paper intends to explore how uncontrollable factors affect HRMMP based on a case study of 23 highway operating subsidiaries affiliated with Shaanxi Transportation Holding Group (STHG) in Shaanxi Province so as to fulfill sustainable HRMM. First, in accordance with the principles of the DEA method’s evaluation indicators selection and considering the content and background of routine maintenance management work, input and output indicators were selected. Next, according to the characteristics of HRMM, the input-oriented DEA model was employed to calculate the routine maintenance management efficiency values of each subsidiary. Lastly, based on the obtained efficiency values, this paper utilized a truncated regression model to analyze the impact on HRMMP of potential uncontrollable factors, which explained the key aspects to be considered in sustainable HRMM.

2. Literature Review

2.1. Performance Evaluation of HMM

In the process of performance evaluation, the determination of evaluation subjects, indicators, and methods is important. For HMM, when selecting evaluation indicators, it is essential to consider the actual situation of the evaluation subject (i.e., operating agency or bridge), the relevant influencing factors, the main work contents, and the involved information comprehensively to ensure the comprehensiveness and scientific rationality of the indicators. Simultaneously, the selection of evaluation indicators will also depend on the characteristics of the evaluation method. It is required to satisfy the conditions of the evaluation model while objectively and accurately reflecting the substance of the evaluation subject. Table 1 reviews the partial research on the performance evaluation of HMM, indicating that scholars have various research contents and focuses based on evaluation indicators. The construction process and contents of evaluation indicators can provide a reference for the subsequent evaluation of HRMMP in this paper.

2.2. Uncontrollable Factors Considered in Performance Evaluation of HMM

The maintenance and operation of highways are influenced by various factors, each with a specific impact to a greater or lesser extent. These factors, known as external, uncontrollable (used in this paper), or challenge factors, are objective and outside the control of decision makers (i.e., climate and location), whose impact must be considered in the performance evaluation of HMM [18,45]. Table 2 reviews the partial research on uncontrollable factors considered in the performance evaluation of HMM, which can inform the selection of the uncontrollable factors of HRMMP in the following parts.

2.3. Approaches to Deal with Uncontrollable Factors in DEA

As previously stated, uncontrollable factors have a significant impact on HMMP, particularly in performance evaluation using DEA. Uncontrollable factors may impact the ability of the decision-making unit (DMU) to increase outputs with a given number of inputs or limit the ability of the DMU to decrease inputs while maintaining a certain level of outputs. To address the above issues, there are two main types of approaches in past studies: one-stage approaches and multi-stage approaches [45]. One-stage approaches take uncontrollable factors into account when running a DEA model by refining the traditional DEA formula [47,48] or categorizing the uncontrollable factors of the DMU operation environment to compare the efficiency of DMUs in different environments [49,50]. Multi-stage approaches are carried out to explore the relevant effects by performing a regression analysis of uncontrollable factors based on the obtained DMU efficiency values [51,52,53]. The details and application situation of the above approaches can be found in the research of [45].
For the performance evaluation of HMM, one-stage approaches have been employed the most. One practice is to run the DEA model with and without considering the uncontrollable factors and analyze the impact of these factors on the HMMP by comparing the two results obtained [35,37]. Another one is to categorize the environment in which the DMU is located based on uncontrollable factors (i.e., climate and terrain condition) to capture their effects [28]. One disadvantage of the above approaches is that it is difficult to determine the specific quantitative impact of each factor on HMMP, making it challenging to use as a guide for decision-making. One study [46] provided an alternative method, two-stage bootstrapping regression, analyzing how uncontrollable factors affect the highway deterioration processes, which has inspired subsequent research. Through the above analysis, based on the characteristics of HRMM and DEA efficiency values, this paper opted for the regression method to explore the effects of uncontrollable factors on HRMMP.

2.4. Uncontrollable Factors Analysis of DEA Efficiency Values

The efficiency value θ obtained by DEA is a restricted dependent variable situation when analyzed as a dependent variable because it falls between 0 and 1 ( θ ( 0,1 ] ). The traditional ordinary least squares (OLS) estimation method for regression, whether applied to the entire sample or a subsample after the discrete points have been excluded, results in inconsistent estimation due to the inclusion of the nonlinear term in the disturbance term [54]. Two primary methodologies are utilized to address the challenge of regression analysis of restricted dependent variables: the Tobit model and the truncated regression model.
  • The Tobit method, introduced by Tobin in 1985, employs maximum likelihood estimation (MLE) to estimate censored regression models. Censored regression is one of the scenarios for a restricted dependent variable analysis. In the linear model y i = x i β + ε i , when censoring y i as c for certain cases where y i c or y i c (where c is a constant), this type of data is referred to as “censored data” [55].
  • In the linear model y i = x i β + ε i , it is assumed that due to certain reasons, data can only be observed when y i c (where c is a constant). Therefore, when y i < c , no data regarding the variables y i , x i are available, and this phenomenon is referred to as “truncation”. For instance, data can only be observed when y i is greater than c, resulting in a “left truncation” at c .
In past studies, researchers have commonly employed the Tobit model to analyze the factors influencing DEA efficiency values [56,57,58,59,60]; however, the actual DEA efficiency value does not exhibit censoring issues and does not fall into the category of censored data. Considering the initial efficiency value θ ( 0,1 ] as a whole and denoting the efficiency value θ in the worst state as θ m i n , the application of the Tobit method implies that θ values are censored data within the data set; consequently, all values below θ m i n are replaced by θ m i n , as illustrated in Figure 1a. Nevertheless, for any evaluated DMU, the efficiency value will never be lower than θ m i n in the worst state, much less reach or descend below 0. To put it another way, the scenario depicted in Figure 1a is not compatible with the actual DEA efficiency values. As shown in Figure 1b, the data in the range between 0 and θ m i n are unobservable, which can be referred to as truncating at the left. Consequently, DEA efficiency values are more consistent with the truncated data, which can be processed by a truncated regression model [61,62,63,64].

2.5. Knowledge Gap

The literature review above highlights the following two research gaps:
  • The importance of routine maintenance in the preservation and appreciation of highway assets has been overlooked in studies that focus on overall highway maintenance or bridge maintenance, that is, there is a lack of research specifically focusing on HRMMP.
  • Researchers often concentrate solely on the methods and conclusions of performance evaluation, neglecting to investigate the factors that influence HMMP, particularly in HRMMP. This lack of investigation hinders a more comprehensive understanding of maintenance management performance assessment and improvement.
Therefore, according to the characteristics of routine maintenance and management, this paper employed the DEA method to construct the performance evaluation indicators set and evaluated HRMMP. In addition, a truncated regression model was proposed to analyze the impact of uncontrollable factors on HRMMP, overcoming the shortcomings of the Tobit model.

3. Data Collection

STHG is primarily responsible for the investment, construction, and operation of highways within Shaanxi Province. It adopts a hierarchical management model of group–operation company–maintenance management subsidiary for HMM; the organizational structure and corresponding responsibilities are depicted in Figure 2.
In a previous study conducted by the authors, Shaanxi Province can be typically divided into three regions based on topography [65]: the Shaanbei plateau (northern Shaanxi), the Guanzhong plain (central Shaanxi), and the Shaannan mountains (southern Shannxi). There are 23 maintenance management subsidiaries (23 DMUs) responsible for the maintenance management of different road sections, the distribution of which is illustrated in Figure 3. The relative maintenance management data from 2020 to 2022 was provided by STHG, which involves the climate conditions, traffic, maintenance mileages, maintenance management resources, road conditions, etc., of each subsidiary, providing a strong foundation for the following research.

4. Methodology

4.1. Input-Oriented DEA Model

Traditional DEA models consist of the Banker–Charnes–Cooper (BCC) model, which is based on variable returns to scale (VRS), and the Charness–Cooper–Rhodes (CCR) model, which is based on constant returns to scale (CRS). The efficiency obtained by the CCR model is known as combined technical efficiency (TE) because it incorporates scale efficiency (SE), while the efficiency obtained by the BCC model is pure technical efficiency (PTE). SE can be calculated by Equation (1).
SE = TE/PTE
CRS efficiency values reflect TE under a constant scale, highlighting the excellence of highway management agencies in terms of maintenance operation mechanisms and overall management levels. In contrast, VRS efficiency values indicate PTE under a variable scale, revealing whether there is redundancy in the maintenance management resources invested by highway management agencies. Moreover, the models mentioned above can be categorized as either input-oriented or output-oriented. From an input-oriented perspective, organizations usually want to keep the amount of input resources to a minimum while maintaining a constant level of output. From an output-oriented point of view, organizations strive to achieve more outputs while maintaining a constant level of input resources. Highway management agencies often have limited resources for maintenance, focusing on minimizing inputs while sustaining a certain level of maintenance performance; therefore, the input-oriented DEA model was selected to evaluate HRMMP, which is shown in Table 3.

4.2. Return to Scale (RTS)

The concept of returns to scale (RTS) is a crucial foundation in economics for analyzing the variations in production factors and outputs. With the ongoing evolution of DEA methodology, the application of RTS has been extended. When inputs and outputs vary in the same proportion, the evaluated DMU is in a CRS state. If the proportional change in output exceeds that of the input when increasing or the proportional change in output is less than that of the input when decreasing, the evaluated DMU is in an increasing returns to scale (IRS) state. Conversely, if the smaller proportional change in output exceeds that of the input when increasing or the proportional change in output when increasing is less than that of the input, the evaluated DMU is in a decreasing returns to scale (DRS) state. IRS and DRS fall under the VRS category.
There are the three following criteria to determine the RTS of DMU:
  • When θ C R S = θ V R S , the evaluated DMU satisfies CRS. Or else:
  • When j = 1 n λ j * < 1 , the evaluated DMU satisfies IRS.
  • When j = 1 n λ j * > 1 , the evaluated DMU satisfies DRS.

4.3. Truncated Regression Model

For a random variable y in the linear model y i = x i β + ε i , when it experiences truncation, the corresponding probability density function is altered. Let the initial probability density function be denoted as f ( y ) ; then, the conditional probability density function after left truncation at point c is represented by Equation (2) [54].
f ( y | y > c ) = f ( y ) P ( y > c ) ,   y > c 0 ,   y c
The area under the probability density function curve must sum to 1. Due to truncation, where data are unobservable at the left of point c, the probability density at the location of c is elevated to ensure that the area under the curve adds up to 1. This elevation continues until the entire area under the curve adds up to 1 [55]. For illustration, the impact of truncated data on the classical normal distribution’s probability density function is visually evident in Figure 4.
Then, the conditional expectation of the truncation distribution in the case of “left truncation” is calculated; the simplest case y N ( 0,1 ) of the normal distribution is still used as an example.
E ( y | y > c ) = ϕ ( c ) 1 ϕ ( c )
For any real number c , the inverse Mills’s ratio (IMR) is defined as λ ( c ) = ϕ ( c ) 1 ϕ ( c ) , which is the density function ϕ ( c ) of the standard normal divided by the area 1 ϕ ( c ) (referred to as the gray area, as illustrated in Figure 5) under the curve larger than c . Consequently, E ( y | y > c ) = λ ( c ) can be obtained, as shown in Equation (3).
For a general normal distribution y N ( μ , σ 2 ) , let z y μ σ N ( 0,1 ) , so that y = μ + σ z . Therefore, the conditional expectation in the case of a general normal distribution with truncation is shown in Equation (4).
E ( y | y > c ) = E ( μ + σ z | μ + σ z > c ) = E [ μ + σ z | z > ( c μ ) / σ ] = μ + σ E [ z | z > ( c μ ) / σ ] = μ + σ λ [ ( c μ ) / σ ]
Assume that ε i | x i N ( 0 , σ 2 ) , so that y i | x i N ( x i β , σ 2 ) , and then Equation (5) can be obtained from Equation (4).
E ( y i | y i > c ) = x i β + σ λ [ ( c x i β ) / σ ]
The sample data can only be observed in the case of left truncation ( y i c ); if OLS is applied to estimate y i = x i β + ε i , the nonlinear term σ · λ [ ( c x i β ) / σ ] will be omitted and then included in the perturbation term. It can be seen that σ · λ [ ( c x i β ) / σ ] is a function of x i , and thus the inclusion of the nonlinear term in the perturbation term in the OLS regression leads to estimation bias.
To address the above problems, MLE is used to obtain a consistent estimate of the truncated regression. The initial probability density function for MLE of the regression model is shown in Equation (6).
f ( y i ) = 1 2 π σ 2 exp 1 2 ( y i x i β σ ) 2 = 1 σ ϕ ( y i x i β σ )
The conditional probability that the sample data can be observed is shown in Equation (7), where the perturbation term obeys a normal distribution, that is, ε i / σ N ( 0,1 ) .
P y i > c x i = 1 P y i c x i = 1 P y i x i β σ c x i β σ x i = 1 P ( ε i σ c x i β σ | x i ) = 1 ϕ ( c x i β σ )
Then, the conditional density after truncation is shown in Equation (8).
f ( y i | y i > c , x i ) = 1 σ ϕ [ ( y i x i β ) / σ ] 1 ϕ [ ( c x i β ) / σ ]
The research frame in this study is shown in Figure 6.

5. Performance Evaluation

5.1. Selection of Potential Input and Output Indicators

Most organizations consider financial, material, and human resources as the three input factors in the performance evaluation process, and the results obtained through the transformation of inputs naturally become outputs. For the highway routine maintenance management process, financial input factors include the total maintenance costs, material input factors include maintenance materials and equipment other than contractors’ input, and human input factors include maintenance management personnel. Additionally, activities conducted by the maintenance management department, such as road inspections and road appearance improvements, which contribute to maintenance management, should also be considered. The output factors that require consideration primarily encompass maintenance mileage, traffic volume, various technical condition indices, user satisfaction, user costs, and so on.
By investigating the HRMM work and operational mechanisms of STHG, combined with Table 1, a compilation and summary were conducted to obtain the potential input and output indicators set illustrated in Table 4.

5.2. Correlation Tests of Input and Output Indicators

The premise of DEA is that changes in input indicators should lead to positive proportional changes in output indicators [66]. Therefore, based on the availability and effectiveness of the data, the input and output indicators selected from Table 4 and data corresponding to STHG in the year 2022 are shown in Table 5. Spearman’s correlation tests were performed on the input and output data of 23 DMUs using the correlation analysis feature in the SPSS 26.0 software [67], as shown in Table 6.
Analyzing the results of the correlation analysis presented in Table 6, it is observed that MP and MC among the input indicators exhibited positive correlations with MM, AADT, and TSA among the output indicators. Conversely, ME and MA among the input indicators showed either no correlation or a negative correlation with MQI among the output indicators. These findings suggest that the initially identified input–output indicators, based on subjective significance, may not necessarily hold practical meaning in the analytical process. In consideration of the correlation analysis results, the revised selection of input indicators included MP and MC, while the output indicators consisted of MM, AADT, and TSA.
Building upon this analysis, a correlation test was conducted on the input and output data for each DMU from 2020 to 2022, and the results are presented in Table 7. Based on the outcomes shown in Table 7, the ultimate selection of the input indicators included MP and MC, while MM and TSA were chosen as the output indicators.

5.3. Determination of Efficiency Value and RTS

Based on the identified input and output indicators from the above analysis, the efficiency value of HRMMP for each DMU under the CCR and BCC scenarios was calculated, respectively, using the input-oriented DEA model, and the RTS of each DMU was determined; the results are presented in Table 8.
According to Table 8, it can be observed that under the CCR model (CRS state), DMUs 11, 16, 19, 20, and 21 were on the efficiency frontier ( θ C C R = θ B C C = 1 ). Furthermore, under the BCC model (VRS state), the DMUs on the efficiency frontier ( θ B C C = 1 ) included DMUs 2, 3, 12, and 22 in addition to those under the CRS state. For a DMU that is effective under a CRS state, it remains effective under a VRS state; however, effectiveness under a VRS state does not guarantee effectiveness under a CRS state. When a DMU is effective under both conditions, it is in a state of RTS with CRS, such as DMUs 11, 16, 19, 20, and 21. When the efficiency values under a CRS state and VRS state are not both 1, or when they are both not 1, there exist other RTS: IRS (DMU 2, 4, 8, 12, 13, 14, 15, 17, and 18) or DRS (DMU 1, 3, 5, 6, 7, 9, 10, 22, and 23). In summary, when the θ C C R and θ B C C values in Table 8 are not equal to 1, it indicates that the respective DMU is ineffective under a CRS state or VRS state.
Regarding the RTS, among the 23 DMUs, 5 operated under a CRS state. Additionally, nine DMUs experienced IRS, indicating an ongoing improvement in their maintenance management efficiency and an optimistic trend in efficiency development. On the other hand, nine DMUs faced DRS, suggesting a regression in their maintenance management efficiency. In comparison to the subsidiaries with IRS, those experiencing DRS may need to allocate more effort and intensify their optimization of input resource allocation in their later-stage management efforts.

6. Uncontrollable Factors Analysis

6.1. Selection of Potential Uncontrollable Factors

HRMMP is influenced by various uncontrollable factors, including natural conditions like climate and geography, maintenance history, years of operation, unexpected situations such as traffic accidents and natural disasters, and regional socio-economic development. Section 5.3 demonstrates significant variations in the HRMMP efficiency values among the 23 DMUs. It is unclear whether uncontrollable factors, in addition to their input resources, impact sustainable HRMM. To explore the problems, combined with Table 2 and the investigation into the HRMM work of STHG, the potential uncontrollable factors were analyzed as follows.
  • Climate condition. When analyzing sustainable HRMM, it is important to consider the influence of climatic conditions, which can vary greatly. This study mainly focused on daily weather statistics in areas where each DUM is located, including the number of extreme weather days such as moderate-to-heavy rain days, snowy days, and hazy days. Additionally, the quantity of natural dustfall in the area was measured using the annual province-wide environmental quality status information provided by the Shaanxi Provincial Department of Ecology and Environment.
  • Geographic location. The geographic location is mainly based on topography and geomorphology, which is reflected in this study by three main categories: the Shaanbei plateau, the Guanzhong plain, and the Shaannan mountains.
  • Maintenance history. Maintenance history mainly refers to the data on corrective maintenance, preventive maintenance, emergencies, and special maintenance organized by each DMU of the specific road section from the opening of the operation to date, which was used to analyze the impact on HRMM.
  • Years of operation. Years of operation refer to the service life of the road from the year of commissioning to the present.
  • Emergencies. The data on emergencies mainly count the number of traffic accidents, landslides and mudslides, and other natural disasters that occurred during the statistical year of each DMU as analysis data.
  • Regional characteristics. Regional characteristics primarily include population size, urbanization rate, and gross domestic product (GDP), as well as other indicators of socio-economic development in the regions where each DMU is located.
  • Special asset type. Bridges and tunnels are considered special asset types that require more attention to routine maintenance than other asset types such as pavements and subgrades. This is due to the incalculable impact of damage to bridges and tunnels. The available data show that the length of bridges and tunnels managed by each DMU had significant variations, the impact of which on HRMMP cannot be ignored.
Based on the above analysis and available data, Table 9 summarizes the potential uncontrollable factors. In order to meet the requirements of the sample data volume in the truncated regression analysis, the efficiency values of each DMU from 2020 to 2022 were calculated. The data of the potential uncontrollable factors from Table 9 and the efficiency values of each DMU are listed in Table 10.

6.2. Multicollinearity Test of Possible Uncontrollable Factors

Prior to commencing regression analysis, it is crucial to conduct multicollinearity tests on potential uncontrollable factors using the STATA 18.0 MP software and to exclude factors exhibiting high collinearity. Conventionally, factors with a variance inflation factor (VIF) exceeding 10 may suggest the presence of multicollinearity. To begin the regression analysis, considering the efficiency values of CRS or VRS from 2020 to 2022 as the dependent variable and various potential uncontrollable factors as independent variables, the VIF values for each potential uncontrollable factor were calculated. In this context, the regional factors underwent virtualization using the STATA software. Three dummy variables, namely r1 (Shaanbei), r2 (Guanzhong), and r3 (Shaannan), were generated. To address multicollinearity concerns, only r2 and r3 were included as indicators in the analysis.
The analysis results shown in Table 11 revealed notable multicollinearity issues among the factors of population, UR, and region (r2, r3). Although UR had a lower VIF value compared to population and region, due to multicollinearity concerns, it was still chosen in the truncated regression analysis. Advanced econometric studies suggest that when researchers prioritize the significance of the model and the factors under analysis, multicollinearity issues can be disregarded. The absence of multicollinearity interference may amplify the significance of initially significant factors, rendering them more pronounced. Hence, population and region were not taken into further consideration due to the fact that the inclusion of these two factors would not have augmented the significance of the model or the analyzed factors. Consequently, the initial identification of factors influencing the DEA efficiency values encompassed seven variables: weather, age, dustfall, BL, TL, GDP, and UR.

6.3. Truncated Regression Analysis

From Section 6.2, the truncated regression model in this paper is shown in Equation (9):
θ i t = β 0 + β 1 w e a t h e r i t + β 2 a g e i t + β 3 d u s t f a l l i t + β 4 B L i t + β 5 T L i t + β 6 G D P i t + β 7 U R i t
where θ i t is the efficiency value of ith DMU in t year, β 0 is the interception, β 1   ~   β 7 are estimated coefficients, i = 1, 2, …, 23, and t = 2020, 2021, 2022.
Integrating the preliminarily identified uncontrollable factors into the truncated regression analysis, distinct truncated regression models were formulated with CRS and VRS efficiency values as dependent variables. The distribution of the efficiency values is shown in Figure 7; considering the minimum CRS efficiency value of 0.317837901 and the minimum VRS efficiency value of 0.412463752, truncated regression analyses were performed with left truncation at 0.3 and 0.4, respectively. The outcomes are detailed in Table 12.

6.3.1. Discussion of the Results in the Truncated Regression Analysis of θCRS

From Table 12, it is evident that the overall model had statistical significance, as indicated by Prob > χ 2 = 0.0351, which is less than 0.05. This signifies the overall importance of the model. Upon examining the specific factors and their p > |z| values, only the dustfall variable demonstrated statistical significance, with a p-value less than 0.05. The coefficient associated with dustfall was 0.238089, indicating a positive correlation. Therefore, it was concluded that dustfall significantly influences CRS efficiency values, with a positive correlation existing between dustfall and CRS efficiency values.
This positive correlation implies the importance that each DMU places on the daily cleaning of highways. Natural dustfall significantly increases the daily cleaning burden of facilities along highways, such as dust settling on guardrails and signs. Timely cleaning is essential, as failure to do so could not only affect the aesthetics and functionality of these facilities but also potentially compromise the visibility guidance performance for drivers, posing safety concerns.
Therefore, in regions with higher levels of dustfall, it can be understood that corresponding DMUs place a greater emphasis on the cleanliness and environmental friendliness of highways. The stronger the commitment of managers to maintaining the cleanliness and environmental friendliness of roads, the more comprehensive and effective the related management measures become. This aligns with the principles outlined in emphasizing the promotion of green maintenance, urging a focus on ecological priorities, efficient resource utilization, carbon emission reduction, and the promotion of sustainable green development in highway maintenance work.

6.3.2. Discussion of the Results in the Truncated Regression Analysis of θVRS

From Table 12, it is evident that the overall model had statistical significance, as indicated by Prob > χ 2 = 0.0061, which is less than 0.05, signifying the overall significance of the model. Examining the specific factors and their p > |z| values, TL, BL, dustfall, and UR all achieved statistical significance. All four indicators had a significant impact on the VRS efficiency values. Specifically, TL and dustfall exhibited positive correlations with VRS efficiency values, with correlation coefficients of 0.0051855 and 0.0255709, respectively. On the other hand, BL and UR showed negative correlations, with correlation coefficients of −0.0041227 and −0.012068, respectively.
  • Tunnel length. Table 12 illustrates a positive correlation between the VRS efficiency values and TL, indicating that an increase in TL promotes the HRMMP of each DMU. Highway tunnels play a crucial role in reducing the distances between locations. With the continuous improvement of the highway network, the transportation department imposes higher standards for tunnel construction and maintenance. In addition to reducing distances, tunnels also enhance road technical status, transport capacity, and accident reduction. Due to the semi-enclosed structure of tunnels, traffic accidents inside can lead to challenging-to-extinguish fires. Despite research on flame-retardant pavement materials, the spatial structure remains a significant challenge for rescue operations in fire events. For example, the Qinling–Zhongnan Mountain Tunnel, with the longest mileage in China, has emergency rescue centers near it. Therefore, maintenance and repairs, especially routine maintenance, are crucial. In recent years, the transportation department has consistently enhanced the highway emergency support system, with a particular focus on ensuring the safety of those involved. The cleanliness of tunnel walls and signs inside affects drivers’ visual judgment after entering. The reflective performance of the film at the tunnel entrance and the integrity of the drainage trench cover are crucial for driver safety. Therefore, maintenance measures like daily inspections are implemented to prevent accidents. The highway management agency pays particular attention to tunnel maintenance, especially for long tunnels within its jurisdiction. Thus, an increase in tunnel length promotes improvements in HRMMP to a certain extent.
  • Bridge length. Table 12 indicates a negative correlation between the VRS efficiency values and BL, that is, as the length of bridges managed by each DMU increases, HRMMP tends to decrease. In contrast to tunnels, subgrades, and pavements, bridges are subject to greater influence from natural environmental factors due to their suspended structures. Consequently, the requirements for both construction and maintenance are higher. For instance, expansion joints in bridges, affected by the natural environmental and geographical factors, coupled with the impact of vehicle loads, are prone to damage in components such as rubber seals, steel components, and concrete, requiring prompt repairs. The repair process involves challenges related to traffic disruption, safety precautions for maintenance workers, and time constraints. It is imperative that the drainage holes on the bridge deck and the drainage pipes on the bridge sides be cleared frequently to prevent blockages that could impede the drainage process. The most significant damage to bridges comes from water infiltration through expansion joints and cracks in the bridge deck surface, leading to the corrosion of steel reinforcements and damage to concrete. Therefore, regular and timely maintenance measures are required for bridge facilities. With an increase in the number and length of bridges, the difficulty of such routine maintenance also escalates. The results in this paper found that as the length of the bridges managed by each DMU increased, there was a slight downward trend in HRMMP.
  • Amount of natural dustfall. As shown in Table 12, there was a positive correlation between the VRS efficiency values and dustfall, indicating that an increase in dustfall had a certain promoting effect on the HRMMP of each DMU. This observation aligns with the positive correlation relationship between the CRS efficiency values and dustfall shown in Table 12.
  • Urbanization rate. As shown in Table 12, there was a negative correlation between the VRS efficiency values and UR, indicating that with an increase in UR, the HRMMP of each DMU gradually decreased. UR, as a key indicator measuring the level of urbanization in a region, is raised to promote the adjustment of the urban–rural economic structure and the healthy development of the national economy. In light of these considerations, the expansion of the urban population and the growth of the urban economy, driven by the rise in UR, have the effect of stimulating the development of secondary and tertiary industries. Consequently, highways become a critical bridge and link connecting urban and rural areas. From the perspective of individual residents, the increase in UR signifies a significant improvement in the standard of living. There is a continuous increase in per capita motor vehicle ownership and demand for outbound travel, contributing to the rise in transportation demand. From the logistics industry’s viewpoint, the upsurge in UR results in substantial demand for express delivery items. Meanwhile, industries like agricultural processing, planting, breeding, and tourism witness a continuous increase in the demand for materials and the flow of manufactured products. This illustrates that the development of urban and rural enterprises is inseparable from the crucial transportation channel provided by highways. The increase in UR simultaneously amplifies the transportation demand for highways, leading to a further increase in the difficulty of HRMM.
One noteworthy point from the analysis is the positive correlation between tunnel length and efficiency values, while there was a negative correlation between bridge length and efficiency values. The results may be attributed to the fact that bridges are typically structures that span bodies of water, valleys, or other features on roads, necessitating special attention being paid to stability and safety. Additionally, the structural complexity of bridges may require more frequent inspections and repairs, which can increase the difficulty of maintenance. Compared to bridges, tunnels are less affected by the external environment and are less susceptible to erosion and damage caused by natural factors. Moreover, the internal environment of tunnels is relatively closed, which facilitates the implementation of routine maintenance and the monitoring of its efficacy. Therefore, an increase in tunnel length may not have a significant negative impact on HRMMP.
To summarize, the HRMMP of each DMU was closely associated not only with its own input–output capacity but also with uncontrollable factors such as the amount of natural dustfall, urbanization rate, tunnel length, and bridge length managed by each DMU. When evaluating HRMMP, it is crucial to thoroughly consider these uncontrollable factors on the basis of performance ranking and identify reasonable solutions for performance improvement. When allocating maintenance resources, STHG (decision maker) should focus on DMUs with high dustfall, long bridges and tunnels, and high urbanization rates. For DMUs in a DRS state, it is necessary to implement appropriate resource reallocation and management optimization. For DMUs in an IRS state, it is possible to achieve higher outputs by increasing inputs in order to further improve productivity and performance.

7. Conclusions, Limitations, and Future Work

This study employed input-oriented DEA models to calculate HRMMP efficiency values for 23 maintenance management subsidiaries (23 DMUs) under STHG in 2022 and explored what should be considered in sustainable HRMM; the main contributions are as follows.
  • This study evaluated the HRMMP of highway management agencies from the perspective of routine maintenance, which fills the gap of less attention being paid in the area of routine maintenance. The evaluation results revealed variations in the maintenance performance of 23 DMUs. Specifically, five DMUs were in a CRS state, nine DMUs were in a DRS state, and nine DMUs were in an IRS state.
  • Most existing research on the performance evaluation of HMMP primarily focuses on outcomes, often overlooking uncontrollable factors. To explore the impact on sustainable HRMM, this study drew inspiration from uncontrollable factors impacting on HMMP in other research areas, utilizing the truncated regression analysis method to address the limitations of the Tobit model in previous studies. The data from 2020 to 2022 were utilized in the truncated regression analysis, with the dependent variables being the CRS and VRS efficiency values and the independent variables being various potential uncontrollable factors. The analysis identified the actual uncontrollable factors influencing HRMMP, including the amount of natural dustfall, urbanization rate, tunnel length, and bridge length managed by each DMU.
  • It is evident that HRMMP is not only related to inputs and outputs but also influenced by uncontrollable factors; HRMMP efficiency has a positive correlation with the amount of natural dustfall and tunnel length, while it has a negative correlation with bridge length and the urbanization rate. Therefore, in the performance evaluation process, relying solely on results is insufficient. Instead, one should comprehensively consider potential uncontrollable factors, objectively analyze evaluation results, and provide a scientifically sound approach for improvement.
  • According to the results of the evaluation of HRMMP and uncontrollable factors analysis, STHG (decision maker) should pay much attention to DMUs with high dustfall and urbanization rates and long bridges and tunnels when allocating maintenance resources so as to achieve sustainable HRMM. For DMUs in a DRS state, appropriate resource reallocation and management optimization should be carried out. For DMUs in an IRS state, higher outputs can be achieved by increasing inputs to further improve productivity and performance.
Considering the data limitations, this study did not incorporate factors such as maintenance history and traffic accidents. Future research can achieve a more comprehensive understanding of maintenance management by analyzing these aspects.

Author Contributions

Conceptualization, X.S. and Y.L.; data curation, X.S. and X.G.; formal analysis, X.S., X.G., and Y.L.; funding acquisition, X.S.; investigation, X.S. and Y.L.; methodology, X.S., X.G., Y.L., and X.W.; project administration, X.S.; resources, X.S. and Y.L.; software, X.G. and Y.L.; supervision, X.S. and X.W.; validation, X.S. and X.G.; visualization, X.G., Y.L., and X.W.; writing—original draft, X.S., X.G., and Y.L.; writing—review and editing, X.G. and X.W. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by the Natural Science Basic Research Program of Shaanxi Province, No.2022 JM-307, the China Scholarship Council (202206560047), and the China Scholarship Council (202306560107).

Institutional Review Board Statement

This study does not require ethical approval.

Informed Consent Statement

This study does not involve humans.

Data Availability Statement

Data are contained within the article.

Acknowledgments

The authors sincerely acknowledge the data support from Shaanxi Transportation Holding Group.

Conflicts of Interest

Author Yuhuan Li was employed by the company Xi’an Municipal Engineering Design & Research Institute Co., Ltd. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. Cao, L.; Tan, T.; Hou, X.; Dong, Z. Decision-Making Optimization Model for the Targeted Sustainable Maintenance of a Complex Road Network. J. Clean. Prod. 2024, 434, 139891. [Google Scholar] [CrossRef]
  2. Chen, Z.; Wang, D. Numerical Analysis of a Multi-Objective Maintenance Decision-Making Model for Sustainable Highway Networks: Integrating the GDE3 Method, LCA and LCCA. Energy Build. 2023, 290, 113096. [Google Scholar] [CrossRef]
  3. Xu, G.; Guo, F. Sustainability-Oriented Maintenance Management of Highway Bridge Networks Based on Q-Learning. Sustain. Cities Soc. 2022, 81, 103855. [Google Scholar] [CrossRef]
  4. Montoya-Alcaraz, M.; Mungaray-Moctezuma, A.; García, L. Sustainable Road Maintenance Planning in Developing Countries Based on Pavement Management Systems: Case Study in Baja California, México. Sustainability 2019, 12, 36. [Google Scholar] [CrossRef]
  5. Pan, Y.; Shang, Y.; Liu, G.; Xie, Y.; Zhang, C.; Zhao, Y. Cost-Effectiveness Evaluation of Pavement Maintenance Treatments Using Multiple Regression and Life-Cycle Cost Analysis. Constr. Build. Mater. 2021, 292, 123461. [Google Scholar] [CrossRef]
  6. Chen, L.-L.; Li, J.; Wang, Z.-F.; Wang, Y.-Q.; Li, J.-C.; Li, L. Sustainable Health State Assessment and More Productive Maintenance of Tunnel: A Case Study. J. Clean. Prod. 2023, 396, 136450. [Google Scholar] [CrossRef]
  7. Ma, L.; Cao, J.; Pan, Z.; Guo, L.; Zhang, H.; Ma, Y.; Yang, G.; Wang, H. Use of Condition-Based Valuation Approach to Evaluate the Maintenance Decision of Pavement Assets: A Case Study of Yunnan Province in China. Front. Energy Res. 2024, 11, 1346005. [Google Scholar] [CrossRef]
  8. Singh, R.; Sharma, R.; Vaseem Akram, S.; Gehlot, A.; Buddhi, D.; Malik, P.K.; Arya, R. Highway 4.0: Digitalization of Highways for Vulnerable Road Safety Development with Intelligent IoT Sensors and Machine Learning. Saf. Sci. 2021, 143, 105407. [Google Scholar] [CrossRef]
  9. Gong, F.; Cheng, X.; Chen, Y.; Liu, Y.; You, Z. 3D Printed Rubber Modified Asphalt as Sustainable Material in Pavement Maintenance. Constr. Build. Mater. 2022, 354, 129160. [Google Scholar] [CrossRef]
  10. Taticchi, P.; Tonelli, F.; Cagnazzo, L. Performance Measurement and Management: A Literature Review and a Research Agenda. Meas. Bus. Excell. 2010, 14, 4–18. [Google Scholar] [CrossRef]
  11. Kumar, U.; Galar, D.; Parida, A.; Stenström, C.; Berges, L. Maintenance Performance Metrics: A State-of-the-art Review. J. Qual. Maint. Eng. 2013, 19, 233–277. [Google Scholar] [CrossRef]
  12. Simões, J.M.; Gomes, C.F.; Yasin, M.M. A Literature Review of Maintenance Performance Measurement: A Conceptual Framework and Directions for Future Research. J. Qual. Maint. Eng. 2011, 17, 116–137. [Google Scholar] [CrossRef]
  13. GB/T 33172-2016; Asset Management—Overview, Principles and Terminology. SAC (Standardization Administration of the PRC): Beijing, China, 2016. Available online: https://www.55000.org.cn/overview-principles-terminology/ (accessed on 30 January 2024).
  14. GB/T 33173-2016; Asset Management—Management Systems—Requirements. SAC (Standardization Administration of the PRC): Beijing, China, 2016. Available online: https://www.55000.org.cn/asset-management-requirements/ (accessed on 30 January 2024).
  15. GB/T 33174-2016; Asset Management—Management Systems—Guidelines for the Application of GB/T 33173. SAC (Standardization Administration of the PRC): Beijing, China, 2016. Available online: https://www.55000.org.cn/2016-practice-guide/ (accessed on 30 January 2024).
  16. FTA (Federal Transit Administration) AASHTO Transportation Asset Management Guide. Available online: https://www.transit.dot.gov/regulations-and-programs/asset-management/aashto-transportation-asset-management-guide (accessed on 30 January 2024).
  17. Markow, M.J. Performance-Based Highway Maintenance and Operations Management; The National Academies Press: Washington, DC, USA, 2012. [Google Scholar]
  18. Adey, B.T.; García De Soto, B.; Senn, C. Evaluating the Operation and Routine Maintenance of Municipal Roads in Switzerland. Infrastruct. Asset Manag. 2017, 4, 96–108. [Google Scholar] [CrossRef]
  19. Patidar, V.; Labi, S.; Sinha, K.C.; Thompson, P.D.; Shirolé, A.; Hyman, W. Performance Measures for Enhanced Bridge Management. Transp. Res. Rec. J. Transp. Res. Board 2007, 1991, 43–53. [Google Scholar] [CrossRef]
  20. Qiu, L. Performance Measurement for Highway Winter Maintenance Operations. Ph.D. Thesis, University of Iowa, Iowa, IA, USA, 2008. [Google Scholar]
  21. Fu, X.; Li, Z.; Xu, G.; Cheng, Q. A Study on Evaluating lndex System of Highway Maintenance Modernization. Highway 2004, 49, 161–165. [Google Scholar]
  22. Fotova Čiković, K.; Martinčević, I.; Lozić, J. Application of Data Envelopment Analysis (DEA) in the Selection of Sustainable Suppliers: A Review and Bibliometric Analysis. Sustainability 2022, 14, 6672. [Google Scholar] [CrossRef]
  23. Jung, S.; Son, J.; Kim, C.; Chung, K. Efficiency Measurement Using Data Envelopment Analysis (DEA) in Public Healthcare: Research Trends from 2017 to 2022. Processes 2023, 11, 811. [Google Scholar] [CrossRef]
  24. Krmac, E.; Mansouri Kaleibar, M. A Comprehensive Review of Data Envelopment Analysis (DEA) Methodology in Port Efficiency Evaluation. Marit. Econ. Logist. 2023, 25, 817–881. [Google Scholar] [CrossRef]
  25. Pham Van, T.; Tran, T.; Trinh, T.; Phuong, T.; Hoang Ngoc, A.; Nghiem Thi, T.; La Phuong, T. Over Three Decades of Data Envelopment Analysis Applied to the Measurement of Efficiency in Higher Education: A Bibliometric Analysis. J. Effic. Responsib. Educ. Sci. 2022, 15, 251–265. [Google Scholar] [CrossRef]
  26. Rostamzadeh, R.; Akbarian, O.; Banaitis, A.; Soltani, Z. Application of DEA in Benchmarking: A Systematic Literature Review from 2003–2020. Technol. Econ. Dev. Econ. 2021, 27, 175–222. [Google Scholar] [CrossRef]
  27. Solana Ibáñez, J.; Caravaca Garratón, M.; Soto Meca, A. A Literature Review of DEA Efficiency Methodology in Defence Sector. Acad. Rev. Latinoam. Adm. 2020, 33, 381–403. [Google Scholar] [CrossRef]
  28. Fallah-Fini, S.; Triantis, K.P.; De La Garza, J.M. Performance Measurement of Highway Maintenance Operation Using Data Envelopment Analysis: Environmental Considerations. In Proceedings of the 2009 Industrial Engineering Research Conference, Miami, FL, USA, 1–3 June 2009; Host Publication: Miami, FL, USA, 2009. [Google Scholar]
  29. Lin, H.S.; Lin, J.D.; Chang, J.R. Performance of Maintenance and Management for Roads in HsinChu County, Taiwan. Adv. Mater. Res. 2013, 723, 861–868. [Google Scholar] [CrossRef]
  30. Ozbek, M.E.; De La Garza, J.M.; Triantis, K. Data and Modeling Issues Faced during the Efficiency Measurement of Road Maintenance Using Data Envelopment Analysis. J. Infrastruct. Syst. 2010, 16, 21–30. [Google Scholar] [CrossRef]
  31. Soemardi, B.W.; Fajri, A.R. Alternative Performance Measurement for Road Management Agencies Using Data Envelopment Analysis Method. J. Tek. Sipil 2013, 20, 161. [Google Scholar] [CrossRef]
  32. Wang, C. Discussion on the Construction of Performance Evaluation System for Highway Maintenance Management in Beijing. Highway 2007, 52, 123–128. [Google Scholar]
  33. Zhu, J.; Chen, Z.; Sun, L. Research of Performance Appraisal of Highway Maintenance Based on Assessment of the Assets Value. Highw. Eng. 2009, 34, 72–75. [Google Scholar]
  34. Ghahari, S.; Chen, S.; Labi, S. A Nonparametric Efficiency Methodology for Comparative Assessment of Infrastructure Agency Performance. Transp. Eng. 2021, 6, 100092. [Google Scholar] [CrossRef]
  35. Ozbek, M.E.; De La Garza, J.M.; Triantis, K. Efficiency Measurement of Bridge Maintenance Using Data Envelopment Analysis. J. Infrastruct. Syst. 2010, 16, 31–39. [Google Scholar] [CrossRef]
  36. Lad, V.H.; Patel, D.A.; Chauhan, K.A.; Patel, K.A. Data Envelopment Analysis for Efficiency Measurement of Bridge Resilience. Balt. J. Road Bridge Eng. 2022, 17, 189–212. [Google Scholar] [CrossRef]
  37. Zhang, Z.; Agbelie, B.R.; Labi, S. Efficiency Measurement of Bridge Management with Data Envelopment Analysis. Transp. Res. Rec. J. Transp. Res. Board 2015, 2481, 1–9. [Google Scholar] [CrossRef]
  38. Ravirala, V.; Grivas, D.A. State Increment Method of Life-Cycle Cost Analysis for Highway Management. J. Infrastruct. Syst. 1995, 1, 151–159. [Google Scholar] [CrossRef]
  39. Keoleian, G.; Kendall, A.; Chandler, R.; Helfand, G.; Lepech, M.; Li, V. Life-Cycle Cost Model for Evaluating the Sustainability of Bridge Decks. Available online: http://deepblue.lib.umich.edu/bitstream/2027.42/84802/1/KeoleianLCCApaperfinal.pdf (accessed on 7 April 2024).
  40. Zhu, J.; Chen, Z.; Sun, L. Construction of Index System of Performance Evaluation About Highway Maintenance. J. Tongji Univ. Sci. 2012, 40, 871–875. [Google Scholar]
  41. Du, J.; Wang, W.; Gao, X.; Hu, M.; Jiang, H. Sustainable Operations: A Systematic Operational Performance Evaluation Framework for Public–Private Partnership Transportation Infrastructure Projects. Sustainability 2023, 15, 7951. [Google Scholar] [CrossRef]
  42. Wang, L.-C.; Tsai, H.-Y. Evaluation of Highway Maintenance Performance Using Data Envelopment Analysis (DEA) in Taiwan. J. Mar. Sci. Technol. 2009, 17, 145–155. [Google Scholar] [CrossRef]
  43. Shakouri, R.; Salahi, M. Performance Measurement and Resource Sharing among Business Sub-Units in the Presence of Non-Discretionary Factors. J. Model. Manag. 2022, 17, 100–118. [Google Scholar] [CrossRef]
  44. Fallah-Fini, S.; Triantis, K.; Rahmandad, H.; De La Garza, J.M. Measuring Dynamic Efficiency of Highway Maintenance Operations. Omega 2015, 50, 18–28. [Google Scholar] [CrossRef]
  45. Ozbek, M.E. Development of a Comprehensive Framework for the Efficiency Measurement of Road Maintenance Strategies Using Data Envelopment Analysis. Ph.D. Thesis, Virginia Polytechnic Institute and State University, Blacksburg, VA, USA, 2007. [Google Scholar]
  46. Fallah-Fini, S.; Triantis, K.; De La Garza, J.M.; Seaver, W.L. Measuring the Efficiency of Highway Maintenance Contracting Strategies: A Bootstrapped Non-Parametric Meta-Frontier Approach. Eur. J. Oper. Res. 2012, 219, 134–145. [Google Scholar] [CrossRef]
  47. Banker, R.D.; Morey, R.C. Efficiency Analysis for Exogenously Fixed Inputs and Outputs. Oper. Res. 1986, 34, 513–521. [Google Scholar] [CrossRef]
  48. Muñiz, M.; Paradi, J.; Ruggiero, J.; Yang, Z. Evaluating Alternative DEA Models Used to Control for Non-Discretionary Inputs. Comput. Oper. Res. 2006, 33, 1173–1183. [Google Scholar] [CrossRef]
  49. Banker, R.D.; Morey, R.C. The Use of Categorical Variables in Data Envelopment Analysis. Manag. Sci. 1986, 32, 1613–1627. [Google Scholar] [CrossRef]
  50. Ruggiero, J. On the Measurement of Technical Efficiency in the Public Sector. Eur. J. Oper. Res. 1996, 90, 553–565. [Google Scholar] [CrossRef]
  51. Ray, S.C. Resource-Use Efficiency in Public Schools: A Study of Connecticut Data. Manag. Sci. 1991, 37, 1620–1628. [Google Scholar] [CrossRef]
  52. Ruggiero, J. Non-Discretionary Inputs in Data Envelopment Analysis. Eur. J. Oper. Res. 1998, 111, 461–469. [Google Scholar] [CrossRef]
  53. Xue, M.; Harker, P.T. Overcoming the Inherent Dependency of DEA Efficiency Scores A Bootstrap Approach. Available online: https://core.ac.uk/download/pdf/6649882.pdf (accessed on 7 April 2024).
  54. Greene, W. Econometric Analysis, 8th ed.; Pearson: New York, NY, USA, 2018; pp. 958–964. [Google Scholar]
  55. Chen, Q. Advanced Econometrics and Stata Applications; Higher Education Press: Beijing, China, 2014; pp. 211–213. [Google Scholar]
  56. Li, H.; Yan, G. Research on the Operation Efficiency and Influencing Factors of Basic Pension Insurance Fund for Urban Workers in China—Based on DEA-Tobit Model. Adv. Appl. Math. 2022, 11, 7574–7582. [Google Scholar] [CrossRef]
  57. Li, J. The Performance Evaluation of Listed Pharmaceutical Companies and the Influencing Factors: A Study Based on DEA-Malmquist-Tobit Model. Stat. Appl. 2023, 12, 985–997. [Google Scholar] [CrossRef]
  58. Li, J.; Ding, J. Analysis of Spatiotemporal Changes, Influencing Factors, and Coupling Coordination Degree of Urban Human Settlements Efficiency: A Case Study of Megacities and Supercities in China. J. Urban Plan. Dev. 2024, 150, 05023044. [Google Scholar] [CrossRef]
  59. Tian, Z.; Chen, X.; Yu, L. Does the Urban Rail Transit Line Type Affect the Operational Efficiency? A Study Based on the DEA-Tobit Method. In Proceedings of the 22nd COTA International Conference of Transportation Professionals, Changsha, China, 8–11 July 2022; American Society of Civil Engineers: Reston, VA, USA; pp. 1004–1012.
  60. Xue, L.; Zhao, S. Evaluating and Analyzing the Operation Efficiency of Urban Rail Transit Systems in China Using an Integrated Approach of DEA Model, Malmquist Productivity Index, and Tobit Regression Model. J. Transp. Eng. Part Syst. 2021, 147, 04021061. [Google Scholar] [CrossRef]
  61. Ananda, J. Evaluating the Performance of Urban Water Utilities: Robust Nonparametric Approach. J. Water Resour. Plan. Manag. 2014, 140, 04014021. [Google Scholar] [CrossRef]
  62. Chowdhury, H.; Zelenyuk, V. Performance of Hospital Services in Ontario: DEA with Truncated Regression Approach. Omega 2016, 63, 111–122. [Google Scholar] [CrossRef]
  63. Güngör-Demirci, G.; Lee, J.; Keck, J. Performance Assessment of a California Water Utility by Data Envelopment Analysis. In Proceedings of the World Environmental and Water Resources Congress 2017, Sacramento, CA, USA, 18 May 2017; American Society of Civil Engineers: Reston, VA, USA; pp. 549–561.
  64. Lin, C. Exploring Performance and Corporate Governance of the China’s Silicon Semiconductor Industry- a Two-Stage Meta-Frontier DEA and a Truncated Model. SSRN Electron. J. 2022. [Google Scholar] [CrossRef]
  65. Wu, X.; Shi, X.; Li, Y.; Gong, X. Estimation of Annual Routine Maintenance Cost for Highway Tunnels. Adv. Civ. Eng. 2022, 2022, 5374461. [Google Scholar] [CrossRef]
  66. Su, H.; Liu, A. A study on the efficiency and influencing factors of scientific research in inter-provincial universities under “Double First-Class” construction: Based on DEA-Tobit model. J. Chongqing Univ. Sci. Ed. 2020, 26, 107–118. [Google Scholar]
  67. Dalgaard, P. Introductory Statistics with R, 2nd ed.; Springer: New York, NY, USA, 2008. [Google Scholar]
Figure 1. Diagram of censored and truncated data (assuming a positive correlation between θ and variables): (a) censored data; (b) truncated data.
Figure 1. Diagram of censored and truncated data (assuming a positive correlation between θ and variables): (a) censored data; (b) truncated data.
Sustainability 16 04355 g001
Figure 2. Organizational structure and corresponding responsibilities of STHG.
Figure 2. Organizational structure and corresponding responsibilities of STHG.
Sustainability 16 04355 g002
Figure 3. Distribution of subsidiaries and regional divisions in Shaanxi Province.
Figure 3. Distribution of subsidiaries and regional divisions in Shaanxi Province.
Sustainability 16 04355 g003
Figure 4. Truncation effects under the standard normal distribution.
Figure 4. Truncation effects under the standard normal distribution.
Sustainability 16 04355 g004
Figure 5. Inverse Mills’s ratio (IMR).
Figure 5. Inverse Mills’s ratio (IMR).
Sustainability 16 04355 g005
Figure 6. Research frame.
Figure 6. Research frame.
Sustainability 16 04355 g006
Figure 7. The distribution of efficiency values: (a) CRS efficiency values; (b) VRS efficiency values.
Figure 7. The distribution of efficiency values: (a) CRS efficiency values; (b) VRS efficiency values.
Sustainability 16 04355 g007
Table 1. Review of performance evaluation of HMM.
Table 1. Review of performance evaluation of HMM.
ReferenceEvaluation SubjectEvaluation IndicatorsEvaluation Method
[38]Highway infrastructure maintenance optionsPavement states, controls, estimated transition times, treatment informationA state increment method of life-cycle cost analysis
[39]Bridge decksLife cycle inventory, agency costs, social costsAn integrated life-cycle assessment and cost model
[40]Highway management agencyBusiness indicators (i.e., highway maintenance quality), customer indicators (i.e., user satisfaction), internal management indicators (i.e., implantation of maintenance expenditures), learning and growth indicators (i.e., achievements in scientific research)Balance scorecard method
[41]Public–private partnership transportation infrastructure projectsFinancial ability (i.e., overall asset operating ability), multi-stakeholder satisfaction (i.e., government satisfaction), operation and maintenance management (i.e., Road traffic quality), sustainability (i.e., social sustainability impact)An improved balance scorecard method
[28]Highway maintenance operationsTotal area served, traffic, load, climate factors, maintenance expenditure, change in pavement conditionDEA
[31]Road maintenance agenciesBudget, number of staffs, value of asset, number of working units and sub-units, location factor, road improvement realization ratio, road maintenance realization ratio, budget realizationDEA
[42]Highway maintenance sectionsBudget, total manpower, quantity of maintenance machines, length of highway section, routine expenditure on maintenance, expense on salvage, revenue from helping digging and mending roadsDEA
[35]BridgesCost for maintaining the bridges, regional effect variable, total area served, change in overall bridge conditionDEA
[37]BridgesChange in area on various appraisal rating components of bridges, expenditures on interstate bridge replacement or rehabilitation, average daily traffic on interstate bridges per deck area, proportion of truck vehicle miles traveled on interstates, average age of bridges, annual freeze–thaw cycles, annual precipitationDEA
[36]Bridge resilienceAge, area, design high flood level, finish road level of the bridge, bridge resilience indexDEA
[43]Roadway maintenance crewsGovernment credits, specific consultant dollars spent, capital costs, pavement grading factor, length of road section managed, number of accident locations remade, volume of shoulder and middle repair and maintenance carried outDEA
[34]BridgesBridge condition rating, expenditure, traffic loading, climate severity, ageA nonparametric efficiency testing with a linear programming-based approach
[44]Road maintenance policiesPavement condition, traffic load, climate condition, maintenance expenditureA micro-level (road section) system
dynamics model
Table 2. Review of uncontrollable factors considered in performance evaluation of HMM.
Table 2. Review of uncontrollable factors considered in performance evaluation of HMM.
ReferenceUncontrollable Factors
[30]Factors that (1) affect the deterioration of bridges (i.e., climate, traffic, accidents damaging bridges, age of bridges, etc.) and (2) affect the maintenance efforts (i.e., type of paved lanes, location, terrain, total area served, etc.)
[46]Traffic, load, min temperature, max temperature, rainfall, snowfall, mountainous dummy
[37]traffic, and climate conditions across the states
[18]Base infrastructure information (i.e., extent of tunnels, extent of bridges, road surface, etc.), state of base infrastructure and additional infrastructure (i.e., age of road section, traffic signals, condition of road section, etc.), and weather (i.e., temperature, freeze–thaw cycles and precipation)
Table 3. Input-oriented DEA models.
Table 3. Input-oriented DEA models.
Objective Function θ * = min θ
DEA modelBCCCCR
Subject to j = 1 n λ j x i j θ x i o
j = 1 n λ j y r j y r o
j = 1 n λ j = 1
λ j 0
j = 1 n λ j x i j θ x i o
j = 1 n λ j y r j y r o
λ j 0
i = 1,2 , , m ; r = 1,2 , , s ; j = 1,2 , , n
Note: θ is a decision variable representing the efficiency value, x i o and y r o refer to the ith input and rth output of a particular DMUo to be evaluated, x i j and y r j refer to the ith input and rth output of jth DMU, λ j denotes the linear combination coefficient of jth DMU, m denotes the number of inputs, s denotes the number of outputs, and n denotes the number of DMUs.
Table 4. Potential evaluation indicators of HRMM.
Table 4. Potential evaluation indicators of HRMM.
TypePotential IndicatorsIndicator Explanation
InputMaintenance and management personnel (MP)Number of management and inspection personnel
Own maintenance equipment (ME)Number of routine maintenance equipment items other than contractors’ input
Maintenance and management cost (MC)Management cost + inspection cost + maintenance cost
Relative maintenance and management activity (MA)Number of activities implemented by each DMU such as road checking, road appearance improvement, and employee training
OutputMaintenance mileage (MM)Road section length under the jurisdiction of each DMU
Tollbooth and service area (TSA)Number of tollbooths and service area under the jurisdiction of each DMU
Maintenance quality indicator (MQI)Various technical condition indicators of highways
Traffic volumeThe annual throughput of each type of vehicle counted at each tollbooth converted to the annual average daily traffic (AADT) volume
Satisfaction of usersUsers’ subjective perception of the overall level of service, comfort, appearance, and safety on highways
Effectiveness of usersCost savings of transportation, reduction in number of traffic accidents, time savings of travel
Employment createdLocal employment generated by maintenance work
Table 5. Input and output indicators and maintenance data in the year 2022.
Table 5. Input and output indicators and maintenance data in the year 2022.
DMUInput IndicatorOutput Indicator
MPMC
(104 CNY)
MEMAMM (km)MQIAADTTSA
11022148.2361980.3594.68379,85915
242563.23417115.0094.8415,88110
3971138.2711183.0096.6594,105,62317
420820.4111018.0288.70495513
576782.9520135.7095.4426,19313
6636114.32318188.8794.3768,64913
742975.13123132.2995.7658,17110
847482303092.3196.4118,10610
9589140.51618122.2294.0123,15311
10566103.22913162.0096.00644314
1123336.310720.5897.2045,8104
1237757.7132594.5196.11159010
13413334.82114192.1896.8033,27413
14482100.5183256.9196.5432,4196
154124713523135.5096.9120,49512
1638882.7149118.8196.9217,56510
1721665.41411109.8596.2678875
1836352.591893.5597.7433,05110
1932459.41828116.3597.0710,86910
2035995.51916149.9698.8015,96310
2119740.261961.2097.9563285
2238475.51330122.6197.1118,57113
23584126.92410204.0295.7017,23011
Table 6. Results of Spearman’s rank correlation test for 2022 annual data.
Table 6. Results of Spearman’s rank correlation test for 2022 annual data.
IndicatorMMMQIAADTTSA
MP0.443 * (0.039)−0.598 ** (0.003)0.528 * (0.012)0.570 ** (0.006)
MC0.640 ** (0.001)−0.263 (0.238)0.427 * (0.047)0.558 ** (0.007)
ME0.344 (0.117)−0.318 (0.150)0.239 (0.284)0.311 (0.159)
MA−0.120 (0.595)0.095 (0.676)0.118 (0.600)0.002 (0.992)
Note 1: the numbers in parentheses represent the correlation coefficients, and the numbers outside the parentheses represent the significance level of the indicators. Note 2: * denotes significance at the 0.05 level, and ** denotes significance at the 0.01 level.
Table 7. Results of Spearman’s rank correlation test for 2020–2022 annual data.
Table 7. Results of Spearman’s rank correlation test for 2020–2022 annual data.
IndicatorMMAADTTSA
MP0.298 * (0.030)0.431 ** (0.001)0.616 ** (0.000)
MC0.592 ** (0.000)0.079 (0.572)0.363 ** (0.007)
ME0.057 (0.683)0.110 (0.432)0.098 (0.487)
MA−0.241 (0.082)0.250 (0.072)−0.079 (0.574)
Note 1: the numbers in parentheses represent the correlation coefficients, and the numbers outside the parentheses represent the significance level of the indicators. Note 2: * denotes significance at the 0.05 level, and ** denotes significance at the 0.01 level.
Table 8. Efficiency value and RTS of each DMU in the year 2022.
Table 8. Efficiency value and RTS of each DMU in the year 2022.
DMU No.θCCR (CRS State)ΣλθBCC (VRS State)SERTS
10.8018787411.2408570.9332714530.859212761DRS
20.82410613110.82410613IRS
30.951880341.56424610.95188034DRS
40.37094165510.8663594470.428161378IRS
50.8993052671.1684890.9516258150.94501983DRS
60.6015816451.6232920.6112273730.984219084DRS
70.3286851251.1370.3304052720.994793827DRS
80.5420821740.9509780.5652129750.959075957IRS
90.8567459061.4599570.879336920.974309036DRS
100.3420378321.3924750.4124637520.829255494DRS
1110.36334311CRS
120.8436004590.81535110.843600459IRS
130.67233141210.7894297140.851667223IRS
140.8056184460.6899070.8101257220.994436325IRS
150.9434557430.9230770.9604132850.982343496IRS
1611.18882711CRS
170.93326063510.9591806020.97297697IRS
180.8458640890.8072350.911360050.928133825IRS
191111CRS
2011.55784811CRS
2110.56687511CRS
220.8698930631.41035710.869893063DRS
230.8098713341.7908610.817558480.990597437DRS
Table 9. Potential uncontrollable factors of HRMM.
Table 9. Potential uncontrollable factors of HRMM.
Uncontrollable FactorsAcronymDescription
Extreme weatherWeatherDays of extreme weather (i.e., heavy rain days, snowy days, hazy days, etc.)
PopulationPopulationPopulation in the regions where each DMU is located (million)
Urbanization rateURUrban population/total population (%)
Amount of natural dustfallDustfallAmount of natural dustfall on road sections where each DMU manages (t/(km2·month))
GDPGDPGDP in the regions where each DMU is located (CNY)
Years of operationAgeService life of highway from the year of commissioning to the present (year)
RegionRegionShaanbei plateau (r1), Guanzhong plain (r2), and Shaannan mountains (r3)
Bridge lengthBLLength of bridges managed by each DMU (km)
Tunnel lengthTLLength of tunnels managed by each DMU (km)
Table 10. Potential uncontrollable factors data and efficiency values of each DMU.
Table 10. Potential uncontrollable factors data and efficiency values of each DMU.
DMU No.TimeθCRSθVRSWeatherPopulationURDustfallGDPAgeRegionBLTL
120200.78340.913841.02262.88746.75164.75731,4786r375.9758.17
120210.78430.913847.85263.50746.95068.496135,942.27r375.9758.17
120220.78280.918732.23263.88848.30458.966540,276.48r375.9758.17
220220.781125.62266.8948.610.0142,5444r321.9912.89
320220.89440.907429.57225.9462.3114.9968,9403r148.324.2
420210.40280.955733.5554.6256.12511.4759,7469r28.430
420220.3570.866431.5577.5556.95511.012562,054.510r28.430
520200.81090.838825.74338.256.35.4281,76412r13.780
520210.82720.856928.85340.3357.77.5697,81113r13.780
520220.83370.86428.37341.7858.948.65112,84514r13.780
620200.58120.643546.18566.6561.47898.991450,883.39r321.219.28
620210.5870.652144.43578.58159.946110.664556,46710r321.219.28
620220.58840.610925.53626.81860.83399.728560,398.411r321.219.28
720200.48160.579662883.2173.4313.4771,3577r233.310
720210.47650.579629905.6873.7213.0978,3468r233.310
720220.32450.5768301000.3774.0111.8685,1149r233.310
820200.51860.531835.36237.1749.044.3329,5749r345.3414.88
820210.64120.652246.28238.1345.618.1433,69510r345.3414.88
820220.51260.518927.28238.0247.127.5134,67411r345.3414.88
920200.86750.907236.3237.1749.044.3329,5748r337.8521.09
920210.85950.897848238.1345.618.1433,6959r337.8521.09
920220.8060.842424.7238.0247.127.5134,67410r337.8521.09
1020200.33080.427531.53338.256.35.4281,7646r121.288.04
1020210.3310.427525.47340.3357.77.5697,8117r121.288.04
1020220.31780.412528.59341.7858.948.65112,8458r121.288.04
1120221130238.0247.127.5134,67412r2018.02
1220210.81070.811633.69340.3357.77.5697,81111r146.649.25
1220220.77970.780425.99341.7858.948.65112,84512r146.649.25
1320201124.94506.35151.291815.13648,583.89r225.475.41
1320210.9955136.21446.96250.729210.973254,04210r225.475.41
1320220.6034129.67447.88551.724810.752654,982.911r225.475.41
1420200.80560.810147.61605.41362.94239.539853,390.35r356.1321.3
1420210.80560.810146.53618.63361.632710.961559,146.16r356.1321.3
1420220.80560.810125.86672.5662.44739.989563,424.87r356.1321.3
1520220.88710.8875301000.3774.0111.8685,1144r27.650
1620200.80330.829746.68458.24557.16067.472643,90710r238.337.47
1620210.78750.811641.99466.49655.25199.87149,024.711r238.337.47
1620220.83320.864328.16498.66356.33669.11452,217.112r238.337.47
1720220.85760.933.46436.6151.2710.7354,3685r217.862.83
1820200.66130.666222.03267.0658.057711.045960,681.714r122.53.31
1820210.63430.638431.23268.49759.646712.259871,524.315r122.53.31
1820220.65910.663933.06268.80161.063112.644285,184.916r122.53.31
1920220.9774131.32225.9462.3114.9968,9404r166.7928.94
2020221132.92225.9462.3114.9968,9406r144.737.53
2120201123.32225.2859.0914.3548,3007r136.6929.18
2120211130.72226.3160.7915.0256,0868r136.6929.18
2120221130.5225.9462.3114.9968,9409r136.6929.18
2220200.7934132.74338.256.35.4281,7648r110.720
2220210.764131.44340.3357.77.5697,8119r110.720
2220220.8088129.28341.7858.948.65112,84510r110.720
2320200.85970.888236.04338.256.35.4281,7645r132.8910.01
2320210.81010.831130.56340.3357.77.5697,8116r132.8910.01
2320220.75510.783528.09341.7858.948.65112,8457r132.8910.01
Table 11. Covariance diagnosis results of uncontrollable factors.
Table 11. Covariance diagnosis results of uncontrollable factors.
VariableVIF1/VIF
Population 21.950.045563
r216.720.059800
r315.580.064194
UR13.670.073133
GDP6.610.151257
TL4.400.227338
BL3.200.312632
Dustfall2.290.436760
Age1.410.710871
Weather1.360.734977
Mean VIF8.72
Table 12. Results of truncated regression analysis with θCRS and θVRS as the dependent variables.
Table 12. Results of truncated regression analysis with θCRS and θVRS as the dependent variables.
Number of Observations = 53CRSVRS
Limit: Lower = 0.3 Prob   >   χ 2 = 0.0351Limit: Lower = 0.4 Prob   >   χ 2 = 0.0016
CRSCoef.p > |z|[95% Conf. Interval]Coef.p > |z|[95% Conf. Interval]
GDP1.08 × 10−60.478−25.14.08 × 10−61.04 × 10−60.396−19.63.43 × 10−6
TL0.00585840.073−0.0005370.01225390.00518550.0490.00003340.0103376
BL−0.0020110.402−0.0067160.0026932−0.0041230.033−0.007902−0.000343
Dustfall0.02380890.0330.00189570.04572210.02557090.0040.00808640.0430553
Age−0.0046890.637−0.0241590.0147812−0.0122550.123−0.0278190.0033094
Weather−0.0006220.867−0.0079250.00668120.00046030.877−0.0053580.0062786
UR−0.0095850.12−0.0216710.0025018−0.0120680.014−0.021724−0.002412
β 0 1.0223780.0010.40654621.6382111.33869100.84632581.831056
σ 0.177993400.13949030.21649660.144617400.11491230.1743226
Note: σ denotes the standard deviation of truncated residuals; “Coef.” and “Conf.” are the abbreviations of “coefficient” and “confidence”, respectively.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Shi, X.; Gong, X.; Li, Y.; Wu, X. Uncontrollable Factors Analysis on Sustainable Highway Routine Maintenance Management: A Case Study of Shaanxi Province in China. Sustainability 2024, 16, 4355. https://doi.org/10.3390/su16114355

AMA Style

Shi X, Gong X, Li Y, Wu X. Uncontrollable Factors Analysis on Sustainable Highway Routine Maintenance Management: A Case Study of Shaanxi Province in China. Sustainability. 2024; 16(11):4355. https://doi.org/10.3390/su16114355

Chicago/Turabian Style

Shi, Xiaoli, Xiaotian Gong, Yuhuan Li, and Xuelian Wu. 2024. "Uncontrollable Factors Analysis on Sustainable Highway Routine Maintenance Management: A Case Study of Shaanxi Province in China" Sustainability 16, no. 11: 4355. https://doi.org/10.3390/su16114355

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop