Evaluation Method of Naturalistic Driving Behaviour for Shared-Electrical Car

: Evaluation of driving behaviour is helpful for policy development, and for designing infrastructure and an intelligent safety system for a car. This study focused on a quantitative evaluation method of driving behaviour based on the shared-electrical car. The data were obtained from the OBD interface via CAN bus and transferred to a server by 4G network. Eleven types of NDS data were selected as the indexes for driving behaviour evaluation. Kullback–Leibler divergence was calculated to conﬁrm the minimum data quantity and ensure the effectiveness of the analysis. The distribution of the main driving behaviour parameters was compared and the change trend of the parameters was analysed in conjunction with car speed to identify the threshold for recognition of aberrant driving behaviour. The weights of indexes were conﬁrmed by combining the analytic hierarchy process and entropy weight method. The scoring rule was conﬁrmed according to the distribution of the indexes. A score-based evaluation method was proposed and veriﬁed by the driving behaviour data collected from randomly chosen drivers.


Introduction
Road accidents kill approximately 1.24 million people every year and they are the eighth leading cause of death globally [1].Aberrant driving and violation of traffic rules cause 74% of traffic accidents [2].In addition, these behaviours also lead to excessive fuel consumption and vehicle emissions [3].Therefore, it is necessary to understand the influence of driving behaviour on road risks and vehicle performance.Additionally, quantitative methods of the aberrant driving behaviour should be proposed to improve the driving behaviour.
In former studies, driving behaviour data have been mainly obtained by the following methods: driver self-reported survey [4], driver behaviour questionnaires [5], driver simulators [6], field tests and Naturalistic Driving Studies (NDS) [7].The first two methods are subjective evaluation methods.For the driver simulators and field tests, the driving behaviour may be different due to the pre-arranged test environment and procedure.Naturalistic driving data were obtained with an unobtrusive data acquisition system during everyday driving.NDS can observe the driving behaviour in a natural driving condition without experimental control.Therefore, the method can accurately reflect driving habits [8].NDS can be categorized further into on-site study and individual driver study [9].For the on-site study, naturalistic driving data can be collected with video cameras or microwave and other equipment at a particular site.The individual driver study can obtain Energies 2022, 15, 4625 2 of 23 various driving behaviour data, such as vehicle speed, acceleration, location and vehicle clearance and so on.For the individual driver study, abundant driving behaviour data can provide multi-dimensional analysis for driving behaviour.
NDS data from the study of individual drivers can be obtained by Global Position System (GPS), video cameras, independent sensors, mobile phones and On-Board Diagnostics (OBD).GPS can provide vehicle location directly and vehicle speed can be estimated based on the location.The acceleration and deceleration behaviour of drivers were studied using GPS in [10,11].Video cameras were used to capture the drivers' facial expressions and eye movements to analyse the driving behaviour [12].Video cameras were also used to record drivers' body movements, such as feet movements, to evaluate the reaction time of the drivers [13].Independent sensors such as accelerometer [14], Radar sensor [15] and Inertial Measurement Unit (IMU) [16] were also used to obtain driving behaviour data.Nowadays, most mobile phones are equipped with GPS and an accelerometer.Driving behaviour such as acceleration, braking and speeding were studied using mobile phones in [17].OBD II interface was mandatory for vehicles and the system can collect variable vehicle information from the Electronic Control Units (ECU) of the vehicles via the Controller Area Network (CAN) bus.OBD II interface can collect vehicle status and operation information, including vehicle speed, acceleration, position of accelerator/ brake pedal, angle of steering wheel and fuel consumption and so on [18].Considering the abundant information and reliability of the OBD II, the data collected from OBD was used to analyse the driving behaviour [19].
Driving behaviour can be influenced by driver's driving ability, driver characteristics, driving duration and driver's distraction [20].Driving ability was influenced by the driver's experience, skill and knowledge.Compared with experienced drivers, young drivers had a higher rate of traffic accidents [21].Driver characteristics include age, gender, and education level and etc. Drivers' behaviour was influenced by the drivers' age.Young drivers had a higher probability of accidents than middle-aged and older drivers due to their higher tendency of speeding [22].Most studies showed that the drive behaviour of males was more aggressive that of than females and that males had higher risk of having an accident [23].The behaviour of drivers with a high education level was more compliant, such as less lane-changing [24].Driving duration had a significant influence on driving behaviour and there was more speeding for the drivers who had a longer driving distance [25].A driver can be distracted by the driving environment, their mobile phone, their co-passenger and so on [26].The distractions had adverse impacts on road safety, especially when the driver glanced away from the road.
Driving behaviour has a great influence on the road safety and vehicle performance.The evaluation of driving behaviour is helpful in providing positive feedback to drivers so they reduce the dangerous driving, thus avoiding traffic accidents and enhancing vehicle performance.According to the conclusion of the previous paragraph, driving behaviour is influenced by multiple factors.Considering the stochastic feature of the driving behaviour, it is better to extract the driving behaviour feature from a large sample, including the driver selection and driving route.Nowadays, shared-electrical cars are used in several cities in China, the driver and driving route are random for each trip, and the driving behaviour is purely naturalistic.The driving behaviour data contains drivers of different ages, genders and driving experiences.This makes it suitable for the evaluation of the driving behaviour.While there have been a few studies that have conducted an evaluation of the driving behaviour using data from shared-electrical cars, the statistical characteristics of NDS data with a large and stochastic sample is still unclear, and should be studied in more depth.
To bridge the knowledge gap, this paper was conducted using the data from sharedelectrical cars used in Shanghai and Tianjin cities of China.On this basis, a quantitative evaluation method of driving behaviour was proposed and verified.This paper was organized as follows.Firstly, the NDS data obtained from the OBD-II interface of the shared-electrical car was pre-treated to improve the data quality.Secondly, an estimation method was employed to confirm the appropriate amount of NDS data.Thirdly, the relationship between different driving behaviour parameters was studied.Finally, an evaluation of driving behaviour was proposed and verified in practical application.The study flow chart is shown in Figure 1.
Energies 2022, 15, x FOR PEER REVIEW 3 of 23 was organized as follows.Firstly, the NDS data obtained from the OBD-II interface of the shared-electrical car was pre-treated to improve the data quality.Secondly, an estimation method was employed to confirm the appropriate amount of NDS data.Thirdly, the relationship between different driving behaviour parameters was studied.Finally, an evaluation of driving behaviour was proposed and verified in practical application.The study flow chart is shown in Figure 1.

Data Acquisition
The NDS data were collected from 400 electrical cars, in which 305 cars were shared-electrical cars and others were online car-hiring cars.A data acquisition system was used to obtain the NDS data from the OBD-II interface via CAN bus.All the sampled data were sent to a server by a 4G network.The data were saved and treated thereafter for driving behaviour analysis.The data acquisition process is shown in Figure 2. The data were collected during a period of about four months.The total car mileage was about 1.2 million kilometres, with the total car travelling hours adding up to about 45000, and the sample points totaling about 1.28 × 10 .The data acquisition system can obtain more than 50 driving behaviour parameters, including vehicle operation, power battery status, motor operation, vehicle accessories status and vehicle alert.The primary data were shown in Table 1.All the data were collected at a rate of 10 Hz, which was adequate for transient process analysis, such as acceleration or deceleration.

Data Acquisition
The NDS data were collected from 400 electrical cars, in which 305 cars were sharedelectrical cars and others were online car-hiring cars.A data acquisition system was used to obtain the NDS data from the OBD-II interface via CAN bus.All the sampled data were sent to a server by a 4G network.The data were saved and treated thereafter for driving behaviour analysis.The data acquisition process is shown in Figure 2. The data were collected during a period of about four months.The total car mileage was about 1.2 million kilometres, with the total car travelling hours adding up to about 45,000, and the sample points totaling about 1.28 × 10 9 .
was organized as follows.Firstly, the NDS data obtained from the OBD-II interface of the shared-electrical car was pre-treated to improve the data quality.Secondly, an estimation method was employed to confirm the appropriate amount of NDS data.Thirdly, the relationship between different driving behaviour parameters was studied.Finally, an evaluation of driving behaviour was proposed and verified in practical application.The study flow chart is shown in Figure 1.

Data Acquisition
The NDS data were collected from 400 electrical cars, in which 305 cars were shared-electrical cars and others were online car-hiring cars.A data acquisition system was used to obtain the NDS data from the OBD-II interface via CAN bus.All the sampled data were sent to a server by a 4G network.The data were saved and treated thereafter for driving behaviour analysis.The data acquisition process is shown in Figure 2. The data were collected during a period of about four months.The total car mileage was about 1.2 million kilometres, with the total car travelling hours adding up to about 45000, and the sample points totaling about 1.28 × 10 .The data acquisition system can obtain more than 50 driving behaviour parameters, including vehicle operation, power battery status, motor operation, vehicle accessories status and vehicle alert.The primary data were shown in Table 1.All the data were collected at a rate of 10 Hz, which was adequate for transient process analysis, such as acceleration or deceleration.The data acquisition system can obtain more than 50 driving behaviour parameters, including vehicle operation, power battery status, motor operation, vehicle accessories status and vehicle alert.The primary data were shown in Table 1.All the data were collected at a rate of 10 Hz, which was adequate for transient process analysis, such as acceleration or deceleration.

Signal Type
The Primary Parameters

Vehicle operation
Vehicle speed, mileage, position of the acceleration and brake pedal, steering wheel angle.
Power battery status Total voltage and current of the battery pack, insulation resistance and temperature.
Motor operation Voltage, current, motor speed, motor torque and temperature.

Vehicle accessories status
Voltage and current of the air conditioner, Voltage and current of the DC-DC.
Vehicle alert Alert signal of power battery, motor and thermal management system.
It should be noted that the collected data mentioned above were obtained from the OBD-II interface, and do not include any personal information, such as GPS data.

Data Treatment
The vehicle data were collected in 'Charge', 'Standby' and 'Operation' phases.For the analysis of driving behaviour, the data collected in the 'Charge' and 'Standby' phases were neglected.A valid driving event was recognised by both the power-on status and the vehicle speed being greater than zero.When the vehicle speed was zero for less than 10 min with power-on status, it was considered in the same driving event.Figure 3 showed an example of the vehicle speed versus time in a complete driving event.
Energies 2022, 15, x FOR PEER REVIEW 4 of 23 Table 1.The primary parameters collected by the data acquisition system.

Signal Type The Primary Parameters
Vehicle operation Vehicle speed, mileage, position of the acceleration and brake pedal, steering wheel angle.
Power battery status Total voltage and current of the battery pack, insulation resistance and temperature.
Motor operation Voltage, current, motor speed, motor torque and temperature.

Vehicle accessories status
Voltage and current of the air conditioner, Voltage and current of the DC-DC.
Vehicle alert Alert signal of power battery, motor and thermal management system.
It should be noted that the collected data mentioned above were obtained from the OBD-II interface, and do not include any personal information, such as GPS data.

Data Treatment
The vehicle data were collected in 'Charge', 'Standby' and 'Operation' phases.For the analysis of driving behaviour, the data collected in the 'Charge' and 'Standby' phases were neglected.A valid driving event was recognised by both the power-on status and the vehicle speed being greater than zero.When the vehicle speed was zero for less than 10 min with power-on status, it was considered in the same driving event.Figure 3 showed an example of the vehicle speed versus time in a complete driving event.The data acquisition and transmission can be affected by occasional interferences, such as the voltage fluctuation in the vehicle start and stop phase, abnormal power failure of the data acquisition system, the interruption of the communication signal caused by tunnels or tall buildings and so on [27].The data received by the server include occasional flaws; therefore, a data quality control method must be used before processing.The sliding-window averaging filter was implemented to reduce the random noise.The filter can be expressed as follows: The data acquisition and transmission can be affected by occasional interferences, such as the voltage fluctuation in the vehicle start and stop phase, abnormal power failure of the data acquisition system, the interruption of the communication signal caused by tunnels or tall buildings and so on [27].The data received by the server include occasional flaws; therefore, a data quality control method must be used before processing.The slidingwindow averaging filter was implemented to reduce the random noise.The filter can be expressed as follows: Energies 2022, 15, 4625 5 of 23 where i is the number of the original data, x[k − i] is the original data, M is the length of the sliding-window averaging filter, which is set to five, and x[k] is the treated data.The vehicle data were obtained from the ECUs of the vehicles via CAN bus.Most of the data were deemed normal.To eliminate the occasional abnormal data, the box diagram method was used, which was introduced in the previous paper [28].The slidingwindow averaging filter and box diagram method were used to treat the original data.Figure 4a showed the treatment effect of the filter on vehicle velocity.It can be seen that the signal fluctuation was eliminated but the trend remained the same.Figure 4b showed the treatment effect of the box diagram method for the acceleration and the abnormal value can be eliminated effectively.
where  is the number of the original data,   −  is the original data,  is the length of the sliding-window averaging filter, which is set to five, and   is the treated data.The vehicle data were obtained from the ECUs of the vehicles via CAN bus.Most of the data were deemed normal.To eliminate the occasional abnormal data, the box diagram method was used, which was introduced in the previous paper [28].The sliding-window averaging filter and box diagram method were used to treat the original data.Figure 4a showed the treatment effect of the filter on vehicle velocity.It can be seen that the signal fluctuation was eliminated but the trend remained the same.Figure 4b showed the treatment effect of the box diagram method for the acceleration and the abnormal value can be eliminated effectively.

The Indexes for Driving Behaviour
There were multiple indexes to evaluate the driving behaviour.This study mainly focused on the indexes related to driving safety, including frequent adjustment of vehicle speed and steering wheel, rapid acceleration, sudden braking, rapid turning, fatigue driving and power consumption.The proposed evaluation method of driving behaviour was based on 11 indexes.The index, symbol, definition and unit are listed in Table 2.All values were calculated based on a complete driving event.

The Indexes for Driving Behaviour
There were multiple indexes to evaluate the driving behaviour.This study mainly focused on the indexes related to driving safety, including frequent adjustment of vehicle speed and steering wheel, rapid acceleration, sudden braking, rapid turning, fatigue driving and power consumption.The proposed evaluation method of driving behaviour was based on 11 indexes.The index, symbol, definition and unit are listed in Table 2.All values were calculated based on a complete driving event.
where i is the number of sample point, n is the total number of sample point in a complete driving event, v i is the vehicle speed of each sample point, v m is the average speed in a complete driving event, a + i is the acceleration of each sample point, a − i is the deceleration of each sample point, N a , N d , N t and N st are the number of occurrences of rapid acceleration, sudden braking, rapid turning and speeding during steering, respectively, in a complete driving event, D is the mileage in a complete driving event, and W is the power consumption in a complete driving event.

Quantity Estimation of Driving Behaviour Data
For an individual driver, the driving style is relatively stable after a certain period of driving experience and the statistical characteristics will be convergent [29].The evaluation accuracy of driving behaviour depends on the volume of the NDS dataset, which should cover as many of the driving behaviour characteristics as possible.From the statistical perspective, if the NDS data are adequate, the distribution density of the data will remain the same with additional sample data.In this case, the amount of NDS data can be considered suitable for driving behaviour analysis.To ensure the appropriate quantity of dataset, the amount of NDS data was estimated by Kullback-Leibler (KL) divergence [30].The quantity estimation of a given dataset x = {x i } n i=1 included the following two steps.Firstly, the distribution density ( f n (x)) of the dataset (x) was calculated with the kernel density method, which was a non-parametric method, and the equations are as follows.
where n is the length of the dataset, σ is standard deviation of the dataset.Secondly, the KL divergence was calculated to assess the difference in kernel density between the two datasets with the data length of n and n + m, respectively.Assuming the kernel densities of the two datasets are expressed as f n (x) and f m+n (x), the KL divergence of the two datasets can be expressed as Equation (5).If KL remains as a small value with the increase in m, it indicates that the kernel density is almost unchanged with the adjustment of the dataset and the quantity of the dataset is adequate.The variation value of KL can affect the data quantity, which was set as KL < 1 × 10 −5 in this study.
The KL divergence of different driving behaviour parameters was calculated and Figure 5 showed the changing trend of vehicle speed, acceleration, steering wheel angle and steering wheel speed.It can be seen that the KL of different parameters decreased with the increase in data quantity.Although the convergence rate of the parameters was different, the KL convergence of the four parameters all satisfied the requirement when the data quantity exceeded 231 × 10 5 .The similar calculation of KL was applied to other driving behaviour parameters.Based on this analysis, the quantity of the sampled data in this study was considered adequate.and steering wheel speed.It can be seen that the KL of different parameters decreased with the increase in data quantity.Although the convergence rate of the parameters was different, the KL convergence of the four parameters all satisfied the requirement when the data quantity exceeded 231 × 10 .The similar calculation of KL was applied to other driving behaviour parameters.Based on this analysis, the quantity of the sampled data in this study was considered adequate.

Statistical Characteristics of the Main Driving Behaviour Parameters
Vehicle speed, acceleration, deceleration, steering wheel angle and steering wheel speed contain abundant information reflecting driving behaviour.The statistics of these parameters were firstly calculated to understand the general characteristics of the driving behaviour.
According to Figure 5, the KL of vehicle speed converged when the data quantity exceeded 20 × 10 .The vehicle speed was selected randomly from the total dataset of shared-electrical vehicles to the quantity of 20 × 10 .The distribution characteristic of the vehicle speed is shown in Figure 6.Most of the vehicles' speeds were lower than 80 km/h and the average speed was 33.4 km/h.The relatively low speed was mainly attributed to the heavy urban traffic.The largest proportion of the speed was lower than 5 km/h, which reflected the frequent starting or parking mode due to red lights or traffic jams in urban traffic.

Study on the Relationship between Different Driving Behaviour Parameters 4.1. Statistical Characteristics of the Main Driving Behaviour Parameters
Vehicle speed, acceleration, deceleration, steering wheel angle and steering wheel speed contain abundant information reflecting driving behaviour.The statistics of these parameters were firstly calculated to understand the general characteristics of the driving behaviour.
According to Figure 5, the KL of vehicle speed converged when the data quantity exceeded 20 × 10 5 .The vehicle speed was selected randomly from the total dataset of shared-electrical vehicles to the quantity of 20 × 10 5 .The distribution characteristic of the vehicle speed is shown in Figure 6.Most of the vehicles' speeds were lower than 80 km/h and the average speed was 33.4 km/h.The relatively low speed was mainly attributed to the heavy urban traffic.The largest proportion of the speed was lower than 5 km/h, which reflected the frequent starting or parking mode due to red lights or traffic jams in urban traffic.According to Figure 5, the KL of acceleration and deceleration converged when the data quantity exceeded 163 × 10 .The corresponding data quantity of acceleration and deceleration were selected randomly from the total dataset of shared-electrical vehicle.The distribution characteristic was compared and shown in Figure 7.Over 90% of the According to Figure 5, the KL of acceleration and deceleration converged when the data quantity exceeded 163 × 10 5 .The corresponding data quantity of acceleration and deceleration were selected randomly from the total dataset of shared-electrical vehicle.The distribution characteristic was compared and shown in Figure 7.Over 90% of the acceleration and deceleration were lower than 1.5 m/s 2 .The average values of acceleration and deceleration were 2.05 and 2.72 m/s 2 , respectively.Compared to deceleration, acceleration was mainly located within the small value sections, which was mainly attributed to the heavy traffic.According to Figure 5, the KL of acceleration and deceleration converged when the data quantity exceeded 163 × 10 .The corresponding data quantity of acceleration and deceleration were selected randomly from the total dataset of shared-electrical vehicle.The distribution characteristic was compared and shown in Figure 7.Over 90% of the acceleration and deceleration were lower than 1.5 m/s 2 .The average values of acceleration and deceleration were 2.05 and 2.72 m/s 2 , respectively.Compared to deceleration, acceleration was mainly located within the small value sections, which was mainly attributed to the heavy traffic.The KL of steering wheel angle converged when the data quantity was more than 10 × 10 , and the corresponding quantity of steering wheel angle data was selected randomly.The distribution characteristic of steering wheel angle is shown in Figure 8.Over 60% of the steering wheel angle was lower than 25°, which meant that most of the angle change was attributed to the slight adjustment in driving direction.The percentage decreased with the increase in steering wheel angle until 300°, and these steering actions were mainly due to lane-changing or vehicle turning.There was also angle distribution around 550°, and this was mainly caused by vehicle U-turn or parking.The KL of steering wheel angle converged when the data quantity was more than 10 × 10 5 , and the corresponding quantity of steering wheel angle data was selected randomly.The distribution characteristic of steering wheel angle is shown in Figure 8.Over 60% of the steering wheel angle was lower than 25 • , which meant that most of the angle change was attributed to the slight adjustment in driving direction.The percentage decreased with the increase in steering wheel angle until 300 • , and these steering actions were mainly due to lane-changing or vehicle turning.There was also angle distribution around 550 • , and this was mainly caused by vehicle U-turn or parking.The KL of steering wheel speed converged when the data quantity was more than 231 × 10 .The same amount of steering wheel speed data was selected randomly and compared in Figure 9.According to the steering characteristic, the steering wheel speed  The KL of steering wheel speed converged when the data quantity was more than 231 × 10 5 .The same amount of steering wheel speed data was selected randomly and compared in Figure 9.According to the steering characteristic, the steering wheel speed can be classified to steering speed (positive values) and return speed (negative values).Comparison showed that the two speeds had a similar changing pattern.Most of the steering speeds and return speeds were lower than 25 • /s, which meant that the majority of the steering actions were careful.The averages of the steering speed and return speed were calculated, which were 38.11 • /s and 30.35 • /s, respectively.The steering speed was larger than the return speed, which corresponded to the normal driving habit.The KL of steering wheel speed converged when the data quantity was more than 231 × 10 .The same amount of steering wheel speed data was selected randomly and compared in Figure 9.According to the steering characteristic, the steering wheel speed can be classified to steering speed (positive values) and return speed (negative values).Comparison showed that the two speeds had a similar changing pattern.Most of the steering speeds and return speeds were lower than 25°/s, which meant that the majority of the steering actions were careful.The averages of the steering speed and return speed were calculated, which were 38.11°/s and 30.35°/s, respectively.The steering speed was larger than the return speed, which corresponded to the normal driving habit.

Statistical Characteristics of Parameters at Different Vehicle Speed
The acceleration, deceleration, steering wheel angle and steering wheel speed are affected by vehicle speed.To reveal the influence of speed on different driving parameters, the statistical characteristics of the parameters at different vehicle speeds were analysed.The analysis can provide guidance for threshold settings of driving behaviour evaluation.
Figure 10a showed the distribution characteristic of acceleration and deceleration versus vehicle speed.The acceleration decreased, along with the increase in vehicle

Statistical Characteristics of Parameters at Different Vehicle Speed
The acceleration, deceleration, steering wheel angle and steering wheel speed are affected by vehicle speed.To reveal the influence of speed on different driving parameters, the statistical characteristics of the parameters at different vehicle speeds were analysed.The analysis can provide guidance for threshold settings of driving behaviour evaluation.
Figure 10a showed the distribution characteristic of acceleration and deceleration versus vehicle speed.The acceleration decreased, along with the increase in vehicle speed.The deceleration firstly increased and then decreased with the increase in vehicle speed, and the inflection point was approximately 25 km/h.An explanation of this scenario is introduced in the following section.The overall change trend suggested that the acceleration and deceleration approached zero with the increase in vehicle speed.This can be explained by the fact that the higher vehicle speeds normally appeared during smooth traffic and the vehicle speed change will reduce accordingly in this situation.Additionally, the drivers tended to keep the speed stable to ensure safety at high vehicle speeds.Figure 10b showed the distribution comparison of acceleration and deceleration at different vehicle speeds.The acceleration distribution was relatively stable in a wide range of vehicle speeds from 0 to 60 km/h and the largest proportion of acceleration appeared around the speed of 20 km/h, which was the vehicle starting condition.The deceleration was mainly distributed in the lower speed condition and the largest proportion of deceleration appeared at speeds ranging from 0 to 5 km/h.speeds.Figure 10b showed the distribution comparison of acceleration and deceleration at different vehicle speeds.The acceleration distribution was relatively stable in a wide range of vehicle speeds from 0 to 60 km/h and the largest proportion of acceleration appeared around the speed of 20 km/h, which was the vehicle starting condition.The deceleration was mainly distributed in the lower speed condition and the largest proportion of deceleration appeared at speeds ranging from 0 to 5 km/h.Figure 11 showed the different quantile values of acceleration and deceleration at different vehicle speeds.It can be seen that the acceleration increased significantly during the speed from 0 to 5 km/h, which was attributed to the electric motors' high torque output at low speed.The quantile of the acceleration decreased with the increase in speed.This can be explained by the fact that the drivers tended to accelerate the vehicle more rapidly at lower speed conditions.The quantile of the deceleration firstly increased and then decreased.The reason for this is that the shared-electrical cars have braking energy recovery and the maximum braking torque appears at around 25 km/h, which led to this inflection point.The braking energy recovery in the deceleration phase was the main difference between the electrical vehicles and vehicles powered by Internal Combustion Engine (ICE).Figure 11 showed the different quantile values of acceleration and deceleration at different vehicle speeds.It can be seen that the acceleration increased significantly during the speed from 0 to 5 km/h, which was attributed to the electric motors' high torque output at low speed.The quantile of the acceleration decreased with the increase in speed.This can be explained by the fact that the drivers tended to accelerate the vehicle more rapidly at lower speed conditions.The quantile of the deceleration firstly increased and then decreased.The reason for this is that the shared-electrical cars have braking energy recovery and the maximum braking torque appears at around 25 km/h, which led to this inflection point.The braking energy recovery in the deceleration phase was the main difference between the electrical vehicles and vehicles powered by Internal Combustion Engine (ICE).To evaluate the abnormal acceleration or deceleration, some researchers employed the fixed threshold value.According to Figure 11, both the acceleration and deceleration tended to decrease with the increase in vehicle speed in general.Therefore, it was reasonable that the threshold of abnormal acceleration or deceleration changed with speed.To confirm the threshold, a linear fit was applied to the quantile of acceleration and deceleration during the speed range from 10 to 120 km/h.The linear fit of the acceleration is expressed as Equation ( 6).To evaluate the abnormal acceleration or deceleration, some researchers employed the fixed threshold value.According to Figure 11, both the acceleration and deceleration tended to decrease with the increase in vehicle speed in general.Therefore, it was reasonable that the threshold of abnormal acceleration or deceleration changed with speed.To confirm the threshold, a linear fit was applied to the quantile of acceleration and deceleration during the speed range from 10 to 120 km/h.The linear fit of the acceleration is expressed as Equation (6).
where x is vehicle speed and β 1 and β 2 are the coefficients of linear fit.The linear fit result is shown in Table 3, in which R 2 is the coefficient of determination.Similarly, the quantile of deceleration also had a linear fitted.Considering the piecewise characteristic of the deceleration, the piece-wise linear fit was employed, which is shown in Equation (7).
where x is vehicle speed and β 1 , β 2 , β 3 and β 4 are the coefficients of linear fit.The linear fit result is shown in Table 4.The linear fit result of the acceleration and deceleration were compared in Figure 12.Greater acceleration and deceleration can cause a feeling of discomfort and risk of traffic accidents.According to the quantile and distribution of acceleration and deceleration, the quantile value of 99% was arbitrarily employed to distinguish the abnormal acceleration and deceleration in the following evaluation of driving behaviour.
Vehicle speed has a great influence on driving safety and it is dangerous to steer heavily at high speeds.Figure 13 showed the comparison of distribution and quantile of steering wheel angle at different speeds.Most of the steering action occurred at the speed of 20 km/h, and the steering wheel angle decreased with the increase in speed.The trend corresponded to the driving habits that the steering demand was decreased with the increasing speed to ensure driving safety.The quantile value of the steering wheel angle was almost unchanged when the steering wheel angle was larger than 300 • .This indicated that drivers tended to decrease vehicle speed at high steering angle conditions to avoid traffic accidents.
The linear fit result of the acceleration and deceleration were compared in Figure 12.Greater acceleration and deceleration can cause a feeling of discomfort and risk of traffic accidents.According to the quantile and distribution of acceleration and deceleration, the quantile value of 99% was arbitrarily employed to distinguish the abnormal acceleration and deceleration in the following evaluation of driving behaviour.Vehicle speed has a great influence on driving safety and it is dangerous to steer heavily at high speeds.Figure 13 showed the comparison of distribution and quantile of steering wheel angle at different speeds.Most of the steering action occurred at the speed of 20 km/h, and the steering wheel angle decreased with the increase in speed.The trend corresponded to the driving habits that the steering demand was decreased with the increasing speed to ensure driving safety.The quantile value of the steering wheel angle was almost unchanged when the steering wheel angle was larger than 300°.This indicated that drivers tended to decrease vehicle speed at high steering angle conditions to avoid traffic accidents.Vehicle speed has a great influence on driving safety and it is dangerous to steer heavily at high speeds.Figure 13 showed the comparison of distribution and quantile of steering wheel angle at different speeds.Most of the steering action occurred at the speed of 20 km/h, and the steering wheel angle decreased with the increase in speed.The trend corresponded to the driving habits that the steering demand was decreased with the increasing speed to ensure driving safety.The quantile value of the steering wheel angle was almost unchanged when the steering wheel angle was larger than 300°.This indicated that drivers tended to decrease vehicle speed at high steering angle conditions to avoid traffic accidents.Rapid steering can reduce the lateral stability of vehicles.Steering wheel speed reflects the operation speed of the drivers on the steering wheels.A faster speed is usually associated with a higher risk of rollover and skid of the vehicle.Figure 14 showed the distribution of steering wheel speed versus vehicle speed.The maximum steering wheel speed can reach approximately 600 • /s.The high steering wheel speeds mainly occurred at vehicle speeds lower than 30 km/h, which suggested that drivers tended to turn the steering wheel rapidly at safe speeds.The trends of steering speed and return speed were similar.They both decreased with the increase in vehicle speed.Considering the similar trend, the quantiles of the steering speed was obtained.The comparison of the quantile showed that the steering speed was almost unchanged when the vehicle speed was higher than 60 km/h, which meant that most of the steering actions were gentle at high vehicle speeds to ensure driving safety.
steering wheel rapidly at safe speeds.The trends of steering speed and return speed were similar.They both decreased with the increase in vehicle speed.Considering the similar trend, the quantiles of the steering speed was obtained.The comparison of the quantile showed that the steering speed was almost unchanged when the vehicle speed was higher than 60 km/h, which meant that most of the steering actions were gentle at high vehicle speeds to ensure driving safety.The changing trend of the steering wheel speed was also exponentially fitted with vehicle speed to obtain the threshold of rapid turning.The exponential fitting equation is expressed as Equation ( 8).
where  is vehicle speed and ,  and  are the coefficients of exponential fit.The exponential fit result is shown in Table 5. Considering the influence of the speed on the safety of steering action, the evaluation of the rapid turning should consider the speed.According to the distribution and quantile of rapid turning, the quantile of 99% was selected as the threshold to distinguish the abnormal steering action, which is shown in Figure 15.The threshold of rapid turning decreased with the increase in vehicle and the setting method of the threshold can distinguish the rapid turning more effectively.The changing trend of the steering wheel speed was also exponentially fitted with vehicle speed to obtain the threshold of rapid turning.The exponential fitting equation is expressed as Equation (8).
where x is vehicle speed and a, b and c are the coefficients of exponential fit.The exponential fit result is shown in Table 5. Considering the influence of the speed on the safety of steering action, the evaluation of the rapid turning should consider the speed.According to the distribution and quantile of rapid turning, the quantile of 99% was selected as the threshold to distinguish the abnormal steering action, which is shown in Figure 15.The threshold of rapid turning decreased with the increase in vehicle and the setting method of the threshold can distinguish the rapid turning more effectively.
The previous analysis investigated the influence of vehicle speed on driving behaviours, such as acceleration, deceleration and steering action.According to the analysis, the threshold of aberrant driving behaviours were established to identify rapid acceleration, sudden braking, and rapid turning.In the next section, these thresholds were employed to calculate the number of occurrences for aberrant driving behaviour, which can be used to evaluate the driving behaviours.The previous analysis investigated the influence of vehicle speed on driving be haviours, such as acceleration, deceleration and steering action.According to the analy sis, the threshold of aberrant driving behaviours were established to identify rapid ac celeration, sudden braking, and rapid turning.In the next section, these thresholds wer employed to calculate the number of occurrences for aberrant driving behaviour, whic can be used to evaluate the driving behaviours.

Confirmation of Weight and Scoring Rule
According to the previous analysis, 11 indexes related to driving safety were utilize to evaluate driving behaviour.The evaluation result is influenced by the weight in dexes which can be confirmed by either the subjective or objective evaluation method Subjective evaluation confirms the weight according to experience.Objective evaluatio calculates the weight based on the relationship between the indexes.This study con firmed the weight of indexes by combining the subjective and objective evaluatio method.
The comprehensive multi-index evaluation system was composed of two hierar chies.The first layer was the criterion layer, which consisted of three indexes: drivin action, vehicle operation and fatigue driving/power consumption.The second layer wa the index layer that consisted of the 11 indexes.The detailed index structure is shown i Table 6.

Criterion Layer
Index Layer Symbol of the Index vehicle operation The number of rapid accelerations per 100 km

Confirmation of Weight and Scoring Rule
According to the previous analysis, 11 indexes related to driving safety were utilized to evaluate driving behaviour.The evaluation result is influenced by the weight of indexes which can be confirmed by either the subjective or objective evaluation method.Subjective evaluation confirms the weight according to experience.Objective evaluation calculates the weight based on the relationship between the indexes.This study confirmed the weight of indexes by combining the subjective and objective evaluation method.
The comprehensive multi-index evaluation system was composed of two hierarchies.The first layer was the criterion layer, which consisted of three indexes: driving action, vehicle operation and fatigue driving/power consumption.The second layer was the index layer that consisted of the 11 indexes.The detailed index structure is shown in Table 6.Firstly, the weights of the indexes were preliminarily determined with the Analytic Hierarchy Process (AHP) method, which was a subjective evaluation.According to the experience, the judgement matrix was confirmed and used to indicate the relative importance degree of the indexes in the same layer.Assuming the index number of criterion layer m and the number of index layer n, the weight of indexes for the criterion layer (AB i (i = 1, 2, . . ., m)) and index layer (AS j (j = 1, 2, . . ., n)) can be calculated by Equation (9).
where M i and N j are the product of value in every row of the judgement matrix.Secondly, the weight was further confirmed by the Entropy Weight Method (EWM), which was an objective evaluation.The EWM confirmed the weight of indexes according to the difference in the samples.Assuming the evaluation objectives are expressed as A i (i = 1, 2, . . ., m), the indexes are as follows: X j (i = 1, 2, . . ., n), AX ij is the original value of the jth index in the ith sample and AX ij is the treated value by the Equation (10).The weight of index (EW j ) can be calculated by EWM method using Equation (11).
where P ij is the weight of the j th index in the i th sample and this can be expressed as Equation (12).
Finally, the comprehensive index weight (τ j ) can be calculated from AS j and EW j using Equation (13).Then, the normalisation can be applied to index layer, which is expressed as Ω ij .The final weight (W j ) can be obtained from the product of Ω ij and AB i , as shown in Equation (14).
The judgement matrix was established based on the questionnaire introduced in previous studies [31][32][33], as shown in Table 7.The values in the matrix indicated the relative importance degree of the indexes.The final weights (W j ) were calculated by combining the AHP and EWM, which were shown in Table 8.It can be seen that the number of speeding occurrences during steering per 100 km had the maximum value of the weight and score.This suggests that the speeding during steering was the most dangerous behaviour among the selected indexes.Other indexes with higher weight or score were also risky in terms of causing traffic accidents.The number of rapid accelerations per 100 km 0.0858 9 The number of sudden brakings per 100 km 0.0677 7 The number of rapid turns per 100 km 0.1580 16 The number of speeding occurrences during steering per 100 km 0. After the confirmation of the index weight, the scoring rule for different indexes was set to accurately evaluate the driving behaviour.The distribution of the 11 indexes was analysed and compared in Figure 16. Figure 16a shows the distribution of the number of rapid accelerations per 100 km.It can be seen that the number gradually decreased and in over 90% of cases, it was lower than 50 times.According to the distribution and the weight of the index, the scoring rule was set with a cut-off point of 50.The other scoring rules of the indexes were confirmed with the similar treatment by combining the distribution and the weight, and the results are shown in Table 9.

Proposed Driving Behaviour Evaluation Method
Based on the previous analysis, a driving behaviour evaluation method was proposed.This method included driving behaviour data acquisition, data pre−processing, recognition of the aberrant driving behaviour by statistics, index value calculation and output of the score.The flow chart of the evaluation process is shown in Figure 17.
analysed and compared in Figure 16. Figure 16a shows the distribution of the number of rapid accelerations per 100 km.It can be seen that the number gradually decreased and in over 90% of cases, it was lower than 50 times.According to the distribution and the weight of the index, the scoring rule was set with a cut-off point of 50.The other scoring rules of the indexes were confirmed with the similar treatment by combining the distribution and the weight, and the results are shown in Table 9.The number of rapid acceleration per 100 km times/100 km 9 9 0.18 ;0 50 0; 50  To verify the effectiveness of the evaluation method, thirty drivers were selected from the online car−hiring.The driving behaviour data were selected in one month with 2227 driving events.The scoring result for each driving event was calculated and compared in Figure 18.Most of the scoring results were located from 70 to 100, which indicates that most of the driver behaviours were cautious.There were also some scoring results lower than 60, which can be considered as unsafe driving behaviours.To quantitatively evaluate the driving behaviour of a driver, the average score for every driver in a month was obtained by averaging the score of each driving event, which is shown in Figure 18b.The comparison result showed that the score difference was considerable for each driver.The evaluation result suggested that the scores of the driver number 2 and 14 were relatively low.
In order to investigate the reasons for the low scores of drivers 2 and 14, the score of the four indexes were compared in Figure 19.The four indexes were the number of rapid accelerations per 100 km, the number of sudden brakings per 100 km, the number of rapid turns per 100 km and the number of speeding occurrences during steering per 100 km, which were closely related with aberrant driving behaviour.The scores of drivers 2 and 14 were also compared with the average scores of the thirty drivers.It can be seen that the scores of the selected four indexes for drivers 2 and 14 were obviously lower than the average scores.Additionally, the score of driver number 14 was lower than that of driver number 2. A lower score meant more aberrant driving behaviour, which showed the effectiveness of the evaluation method.The scoring result can be an important reference for the passenger transport company to distinguish the driver with abnormal or dangerous driving behaviour.The driving behaviour scores can also be an important basis for evaluation for the insurance company to collect the premium.To verify the effectiveness of the evaluation method, thirty drivers were selected from the online car−hiring.The driving behaviour data were selected in one month with 2227 driving events.The scoring result for each driving event was calculated and compared in Figure 18.Most of the scoring results were located from 70 to 100, which indicates that most of the driver behaviours were cautious.There were also some scoring results lower than 60, which can be considered as unsafe driving behaviours.To quantitatively evaluate the driving behaviour of a driver, the average score for every driver in a month was obtained by averaging the score of each driving event, which is shown in Figure 18b.The comparison result showed that the score difference was considerable for each driver.The evaluation result suggested that the scores of the driver number 2 and 14 were relatively low.In order to investigate the reasons for the low scores of drivers 2 and 14, the score of the four indexes were compared in Figure 19.The four indexes were the number of rapid accelerations per 100 km, the number of sudden brakings per 100 km, the number of rapid turns per 100 km and the number of speeding occurrences during steering per 100  To verify the effectiveness of the evaluation method, thirty drivers were selected from the online car−hiring.The driving behaviour data were selected in one month with 2227 driving events.The scoring result for each driving event was calculated and compared in Figure 18.Most of the scoring results were located from 70 to 100, which indicates that most of the driver behaviours were cautious.There were also some scoring results lower than 60, which can be considered as unsafe driving behaviours.To quantitatively evaluate the driving behaviour of a driver, the average score for every driver in a month was obtained by averaging the score of each driving event, which is shown in Figure 18b.The comparison result showed that the score difference was considerable for each driver.The evaluation result suggested that the scores of the driver number 2 and 14 were relatively low.In order to investigate the reasons for the low scores of drivers 2 and 14, the score of the four indexes were compared in Figure 19.The four indexes were the number of rapid accelerations per 100 km, the number of sudden brakings per 100 km, the number of rapid turns per 100 km and the number of speeding occurrences during steering per 100 km, which were closely related with aberrant driving behaviour.The scores of drivers 2 and 14 were also compared with the average scores of the thirty drivers.It can be seen that the scores of the selected four indexes for drivers 2 and 14 were obviously lower than the average scores.Additionally, the score of driver number 14 was lower than that of driver number 2. A lower score meant more aberrant driving behaviour, which showed the effectiveness of the evaluation method.The scoring result can be an important reference for the passenger transport company to distinguish the driver with abnormal or dangerous driving behaviour.The driving behaviour scores can also be an important basis for evaluation for the insurance company to collect the premium.

Conclusions
This study proposed a quantitative evaluation method of driving behaviour based on NDS data collected from shared-electrical cars and online car-hiring services.Data acquisition, treatment method and data volume verification were analysed to ensure the effectiveness of the dataset.The distribution characteristics of the main driving behaviour

Conclusions
This study proposed a quantitative evaluation method of driving behaviour based on NDS data collected from shared-electrical cars and online car-hiring services.Data acquisition, treatment method and data volume verification were analysed to ensure the effectiveness of the dataset.The distribution characteristics of the main driving behaviour parameters were studied.On this basis, the evaluation method was proposed and verified.The main conclusions were shown as follows.The main differences between the electrical vehicles and vehicles powered by ICE were in the deceleration phase.There was braking energy recovery for the electrical vehicles.Therefore, the conclusion can be basically applied to the ICE vehicles.

1.
The NDS data were collected from the OBD−II interface via CAN bus with the rate of 10 Hz.This sampling frequency satisfies the requirement of transient process analysis.The sliding-window averaging filter and the box diagram method were used to improve the data quality.Eleven indexes were selected to evaluate the driving behaviour, including vehicle running data, driver operation data and power consumption of the vehicles.

2.
KL divergence was applied to confirm the appropriate data quantity for the driving behaviour analysis.The result showed that the minimum data quantity for vehicle speed, acceleration, steering wheel angle and steering wheel speed were 20 × 10 5 , 63 × 10 5 , 10 × 10 5 , 231 × 10 5 , respectively, with the variation value of KL lower than 1 × 10 5 .

3.
The changing trend of acceleration and deceleration, steering wheel angle and steering wheel speed versus vehicle speed were compared.Based on the distribution characteristics, the thresholds of aberrant driving were determined in correlation with vehicle speed to enhance the recognition accuracy of the aberrant driving behaviour.
The thresholds can be used to evaluate the aberrant driving behaviour.4.
The weights for the 11 indexes were obtained by combining the AHP and EWM methods.The scoring rules of the 11 indexes were confirmed based on the distribution of the indexes.An evaluation method of driving behaviour was proposed and verified according to the driving behaviour data of the car-hiring driver.
In future research, more parameters will be considered including, road slope, weather, driving experience and so on.Additionally, other useful sensors will be used to obtain more driving behaviour parameters.On this basis, the scoring rule will be further optimized and the accuracy of the evaluation method can be subsequently improved.

Figure 1 .
Figure 1.The main study flow chart.

Figure 2 .
Figure 2. The acquisition process of the NDS data.

Figure 1 .
Figure 1.The main study flow chart.

Figure 1 .
Figure 1.The main study flow chart.

Figure 2 .
Figure 2. The acquisition process of the NDS data.

Figure 2 .
Figure 2. The acquisition process of the NDS data.

Figure 3 .
Figure 3.The vehicle speed versus time in a complete driving event.

Figure 3 .
Figure 3.The vehicle speed versus time in a complete driving event.

Figure 4 .
Figure 4.The comparison of the signal with different treat method: (a) Sliding-window averaging filter; (b) The box diagram method.

Figure 4 .
Figure 4.The comparison of the signal with different treat method: (a) Sliding-window averaging filter; (b) The box diagram method.

Figure 5 .
Figure 5.The KL of different parameters versus data quantity.

Figure 5 .
Figure 5.The KL of different parameters versus data quantity.

23 Figure 6 .
Figure 6.The distribution characteristic of the vehicle speed.

Figure 6 .
Figure 6.The distribution characteristic of the vehicle speed.

Figure 6 .
Figure 6.The distribution characteristic of the vehicle speed.

Figure 7 .
Figure 7.The distribution characteristic of acceleration and deceleration.

Figure 7 .
Figure 7.The distribution characteristic of acceleration and deceleration.

Figure 8 .
Figure 8.The distribution characteristic of steering wheel angle.

Figure 8 .
Figure 8.The distribution characteristic of steering wheel angle.

Figure 9 .
Figure 9.The distribution characteristic of steering wheel speed.

Figure 9 .
Figure 9.The distribution characteristic of steering wheel speed.

Figure 10 .
Figure 10.The distribution characteristic of acceleration and deceleration versus vehicle speed: (a) Overall trend; (b) Comparison of distribution characteristic.

Figure 10 .
Figure 10.The distribution characteristic of acceleration and deceleration versus vehicle speed: (a) Overall trend; (b) Comparison of distribution characteristic.

Energies 2022 , 23 Figure 11 .
Figure 11.The comparison of different quantile value for acceleration and deceleration.

Figure 11 .
Figure 11.The comparison of different quantile value for acceleration and deceleration.

Figure 12 .
Figure 12.The linear result of quantile for acceleration and deceleration.

Figure 13 .
Figure 13.The comparison of distribution and quantile for steering wheel angle at different speeds.

Figure 12 .
Figure 12.The linear result of quantile for acceleration and deceleration.

Figure 12 .
Figure 12.The linear result of quantile for acceleration and deceleration.

Figure 13 .
Figure 13.The comparison of distribution and quantile for steering wheel angle at different speeds.

Figure 13 .
Figure 13.The comparison of distribution and quantile for steering wheel angle at different speeds.

Figure 14 .
Figure 14.The comparison of distribution and quantile for steering wheel speed at different speeds.

Figure 14 .
Figure 14.The comparison of distribution and quantile for steering wheel speed at different speeds.

Figure 15 .
Figure 15.The distribution of steering wheel speed and threshold of abnormal steering action.

11 u 12 u 13 u 21 uvalue of acceleration 22 uFigure 15 .
Figure 15.The distribution of steering wheel speed and threshold of abnormal steering action.

Figure 16 .
Figure 16.The distribution of different indexes: (a) The number of rapid accelerations per 100 km; (b) The number of sudden brakings per 100 km; (c) The number of rapid turns per 100 km; (d) The number of speeding occurences during steering per 100 km; (e) Standard deviation of vehicle speed; (f) Average value of acceleration; (g) Standard deviation of acceleration; (h) Average value of deceleration; (i) Standard deviation of deceleration; (j) Driving time per trip; (k) Power consumption.

Figure 18 .
Figure 18.The evaluation result of driving behaviour: (a) The score distribution of driving events; (b) The score for every driver.

Figure 17 .
Figure 17.The evaluation flow chart of driving behaviour.

Figure 17 .
Figure 17.The evaluation flow chart of driving behaviour.

Figure 18 .
Figure 18.The evaluation result of driving behaviour: (a) The score distribution of driving events; (b) The score for every driver.

Figure 18 .
Figure 18.The evaluation result of driving behaviour: (a) The score distribution of driving events; (b) The score for every driver.

Figure 19 .
Figure 19.The comparison of scores for four indexes (numbers from 1 to 4 represent the number of rapid accelerations per 100 km, the number of sudden brakings per 100 km, the number of rapid turns per 100 km and the number of speeding occurrences during steering per 100 km, respectively).

Figure 19 .
Figure 19.The comparison of scores for four indexes (numbers from 1 to 4 represent the number of rapid accelerations per 100 km, the number of sudden brakings per 100 km, the number of rapid turns per 100 km and the number of speeding occurrences during steering per 100 km, respectively).

Table 1 .
The primary parameters collected by the data acquisition system.

Table 2 .
The indexes used to evaluate the driving behaviour.

Table 2 .
The indexes used to evaluate the driving behaviour.

Table 3 .
The linear fit result of the acceleration.

Table 4 .
The linear fit result of the deceleration.

Table 5 .
The exponential fit result of the steering wheel speed.

Table 5 .
The exponential fit result of the steering wheel speed.

Table 6 .
The detailed index structure of driving behaviour evaluation.

Table 6 .
The detailed index structure of driving behaviour evaluation.

Table 7 .
The judgement matrix for evaluation of the driving behaviour.

Table 8 .
The final weight for different indexes.

Table 9 .
The scoring rule of different indexes.

Table 9 .
The scoring rule of different indexes.