Next Article in Journal
Portable Electrochemical DNA Sensors Based on Gene Amplification Reactions to Screen and Identify Pathogen and SNPs
Previous Article in Journal
Using Modified Technology Acceptance Model to Evaluate the Adoption of a Proposed IoT-Based Indoor Disaster Management Software Tool by Rescue Workers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Machine Vision-Based Method for Estimating Lateral Slope of Structured Roads

School of Automobile and Traffic Engineering, Wuhan University of Science and Technology, Wuhan 430065, China
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(5), 1867; https://doi.org/10.3390/s22051867
Submission received: 27 December 2021 / Revised: 14 February 2022 / Accepted: 16 February 2022 / Published: 26 February 2022

Abstract

:
Most of the studies on vehicle control and stability are based on cases of known-road lateral slope, while there are few studies on road lateral-slope estimation. In order to provide reliable information on slope parameters for subsequent studies, this paper provides a method of structured-road lateral-slope estimation based on machine vision. The relationship between the road lateral slope and the tangent slope of the lane line can be found out according to the image-perspective principle; then, the coordinates of the pre-scan point are obtained by the lane line, and the tangent slope of the lane line is used to obtain a more accurate estimation of the road lateral slope. In the implementation process, the lane-line feature information in front of the vehicle is obtained according to machine vision, the lane-line function is fitted according to an SCNN (Spatial CNN) algorithm, then the lateral slope is calculated by using the estimation formula mentioned above. Finally, the road model and vehicle model are established by Prescan software for off-line simulation. The simulation results verify the effectiveness and accuracy of the method.

1. Introduction

With the gradual development of vehicle intelligence, the control requirements for vehicles are becoming more and more refined. To achieve this, in addition to the need to obtain the vehicle’s own operating parameters and structural parameters, external environmental parameters are also necessary. The road slope is one of the most important parameters of the external environment, and the acquisition of this parameter is crucial for the control of the vehicle. At the same time, road curves tend to cause a high incidence of traffic accidents, and related reports indicate that the number of accidents and fatalities on curved road sections has increased year by year among traffic accidents that have occurred in recent years [1]. According to the Fatal Accident Reporting System (FARS) in the United States, the average number of roadside accidents accounts for more than 39% of fatal accidents each year. In China, about 50% of traffic accidents with more than three fatalities are roadside accidents. A European study also showed that about 20% of road traffic accidents each year are roadside accidents, while the roadside accident fatality rate is more than 35%. According to another study [2], about 1/3 of roadside accidents occur in curved sections, and small-radius curved sections are often considered as roadside-accident-prone areas [3,4]. There are many reasons for roadside accidents, such as poor road alignment design, inappropriate avoidance measures taken by drivers, inattention, or understeering of vehicles due to high speed through curved sections [5]. In order to ensure the smooth operation of vehicles on curved roads, the ultra-high transition section is often set. Generally speaking, in order to make the gradient section elevation easy to calculate and construct, road design often uses a linear gradient; however, for long, gentle curves and S-curved sections, the curve super-high-gradient way is used, which can improve road drainage performance and driving stability [6]. There are many studies on the ultra-high gradient method; the values of parameters such as the ultra-high transition method, ultra-high gradient rate, and the formula for calculating the length of the ultra-high transition section are specified in “Geometric Design of Highways and Urban Roads” and “Interpretation and Application of Japanese Highway Technical Standards”, edited by AASHTO, USA [7,8]. Jeong [9] investigated the effect of longitudinality on the drainage of ultra-high rainwater at a zero cross-section in the middle of a reverse curve for the poor characteristics of drainage. Jeong [10] established a two-dimensional finite volume diffusion model to simulate the flow field on a geometric surface, to explore the relationship between the pavement panel flow-distribution and the cross slope and longitudinal slope of the pavement, etc. Zhang [11] proposed a safe and reasonable superhigh gradient rate based on the safety boundary. Fitzpatrick [12] discussed methods concerning the determination of side-friction factors and transition lengths. Arslan [13] compared aesthetic transition curves with classical transition curves in terms of vehicle kinematics, and derived curvature and superelevation functions. The superelevation approach to highway design was evaluated considering the stability of large vehicles, focusing on the reassessment of the relationship between factors such as side-friction resistance, minimum radius and design speed. There is no unified standard for the design of the ultra-high transition section, while there is a more unified standard for the design of the ultra-high non-transition section, as shown in Equation (1):
i h + μ = V 2 127 R
where i h is the road superelevation; μ is the lateral force coefficient; V is the vehicle speed; and R is the road curvature. However, there are four different allocations of i h and μ [14], and different allocations are used for roads with different curvatures and different operating speeds, so a more accurate estimation of the superelevation cannot simply be made by the road curvature and the road grade.
Furthermore, there is relatively little research on lateral slope estimation [15], and most of the research on vehicle control and stability is based on cases wherein the lateral slope of the road is known, or the lateral slope is ignored. In the actual operation of a vehicle, the road conditions change according to the environment, and the lateral slope is not a constant value, which makes the actual control effect of the vehicle not optimal [16,17,18,19,20,21,22]; thus, the study of road lateral-slope estimation is necessary.
The research related to lateral-slope-angle estimation is currently divided into two main types: direct measurement with the help of sensors, and indirect measurement. The first method, affected by production cost and measurement accuracy, is still in the theoretical research stage and is not suitable for direct application to vehicles [23,24]. Therefore, most of the current studies belong to the second method, which are based on the existing sensors of the vehicle and design algorithms for slope estimation. Moreover, this method is mainly divided into two types based on kinetic estimation and kinematic estimation. Menhour [25] measured the lateral slope by designing a linear two-degree-of-freedom dynamics model with an unknown-parameter slip-film observer, but this method requires solving for cases wherein the pavement friction coefficient is known. To solve this problem, Tseng [26,27] proposed a lateral-slope-dynamics estimation method for cases of unknown pavement friction coefficient based on it; however, the method did not take into account the effect of vehicle side-inclination angle on slope estimation, thus limiting further application of the results. Therefore, Guan Xin [28] estimated the vehicle’s lateral-inclination angle based on Tseng H E using the vehicle droop position sensor information, thus decoupling the true value of the road lateral slope, but the estimation results of this method fluctuate greatly when the vehicle is driving in and out of the ramp. In order to make the model estimation performance stable and reduce the risk of model divergence, Jeong [29] designed a finite memory estimation model; however, it ignored the effect of vehicle lateral-inclination angle on slope estimation. Hyun [30] proposed a method combining Bayesian tracking and Kalman filtering to jointly estimate the road lateral-slope angle by measuring the vehicle lateral acceleration as well as the vehicle lateral-tilt angle, which can not only accurately solve the series of problems mentioned above, but also has high estimation accuracy in the case of large slope angles; however, the algorithm is complex and has high hardware requirements. The advent of machine vision has provided a new idea for road-slope estimation, and Ustunel [31] proposed a monocular camera-based method for road lateral-slope estimation with high accuracy; however, it has only been studied for curved roads with large radius of curvature. Nevertheless, ultra-high (i.e., lateral slope) is often designed to mitigate the effect of centrifugal forces on vehicle stability [14], so the estimation of lateral slope for small-curvature-radius roads is more practical in realistic situations.
In summary, there is a lack of a lateral-slope estimation methods for small-curvature-radius roads with high measurement accuracy and high efficiency. To address this problem, this paper firstly introduces a linear road as the research object for problem analysis, then finds out the method for estimating the lateral slope of a small-curvature-radius road. It finally verifies the accuracy of the algorithm by using a Prescan modeling simulation and analyzes the error of the experimental results.

2. Principle of Machine Vision-Based Road Lateral-Slope Estimation Algorithm

Because the direct selection of curved roads for research is relatively complex, in order to simplify the problem, this paper first selects a straight road as the object of study, through the analysis of the image projection principle, to obtain the solution formula for the lateral slope of the road; then, it introduces the curved road for problem analysis.

2.1. Straight Road Cross Slope Solution

Figure 1 shows the relationship between the camera coordinate system, image physical coordinate system, and image pixel coordinate system. Where the coordinate values of the image pixel coordinate system represent the columns and rows of the image array; the image physical coordinate system is proposed to solve the drawback that the image pixel coordinate system has no physical units, and the physical units are used to represent the position of the pixel points in the image; the camera coordinate system is a three-dimensional right-angle coordinate system established with the camera optical center as the coordinate origin [32].
The transformation relationship between the camera coordinate system and the image physical coordinate system (Equation (2)), and the transformation relationship between the image physical coordinate system and the image pixel coordinate system (Equation (3)) can be obtained based on the triangular similarity [32].
x = f X C Z C ;   y = f Y C Z C
u = x d x + c x ;   v = y d y + c y
Figure 1. Schematic diagram of the geometric relationship between coordinate systems.
Figure 1. Schematic diagram of the geometric relationship between coordinate systems.
Sensors 22 01867 g001
Where x, y are the two-dimensional coordinate values in the physical coordinate system of the dimensional image; u, v are the two-dimensional coordinate values in the pixel coordinate system of the image; f is the focal length of the camera; X C , Y C , Z C are the three-dimensional coordinate values in the coordinate system of the camera; d x , d y denote the distance between pixels and pixels in the x, y direction, respectively; and c x , c y are the point O in the pixel coordinate system of the image pixel coordinate system.
The estimation method of lateral slope is analyzed by selecting a wedge-shaped pavement as shown in Figure 2, which is a straight section of road without curves and has a lateral-slope angle α.
The figure shows the scene when the vehicle travels to the front of the ramp. The red line is the plane where the vehicle is located, and the white solid line is the plane where the wedge-shaped road surface is located. In the figure, P l 1 , P r 1 and P l 2 , P r 2 are the intersection points of the two-dimensional image pre-scanning lines, L 1 , L 2 , and the left and right lane lines, respectively, and L 1 , L 2 are the horizontal straight lines at 1/4 and 1/2 of the image, respectively. γ 1 , γ 2 are the angles of P l 1 P l 2 , P r 1 P r 2 on the image and the horizontal direction, respectively; α is the road cross-slope angle; P 0 P l , P 0 P r are the distances d l , d r from the vehicle to the left and right lane lines, respectively.
Therefore, the world coordinate value of the pre-sighting point is shown in Equation (4). This world coordinate system takes the camera optical center as the origin; the Z-axis is the same as the camera optical axis and the vehicle forward direction; the X-axis is the horizontal direction perpendicular to the direction of the vehicle; and the Y-axis is the vertical direction perpendicular to the forward direction of the vehicle.
P l 1   =   X l 1 , Y l 1 , Z l 1   =   d l cos α , d l sin α Y 0 , Z l 1 P l 2   =   X l 2 , Y l 2 , Z l 2   =   d l cos α , d l sin α Y 0 , Z l 2 P r 1   =   X r 1 , Y r 1 , Z r 1   =   d r cos α , d r sin α Y 0 , Z r 1 P r 2   =   X r 2 , Y r 2 , Z r 2   =   d r cos α , d r sin α Y 0 , Z r 2
where, Y 0 is the distance of the camera from where it is located to the horizontal ground; X j i ,   Y j i , Z j i   (j = l, r; i = 1, 2) are the three-dimensional coordinate values of the pre-sighting point under the world coordinate axis, respectively.
The physical coordinates of its projection in the two-dimensional image can be obtained by combining Equations (2) and (4) as:
p l 1   =   x l 1 , y l 1   =   f · X l 1 Z l 1 , f · Y l 1 Z l 1 p l 2   =   x l 2 , y l 2   =   f · X l 2 Z l 2 , f · Y l 2 Z l 2 p r 1   =   x r 1 , y r 1   =   f · X r 1 Z r 1 , f · Y r 1 Z r 1 p r 2   =   x r 2 , y r 2   =   f · X r 2 Z r 2 , f · Y r 2 Z r 2
where, x j i , , y j i (j = l, r; i = 1, 2) are the two-dimensional coordinate values of the pre-sighted points in the physical coordinate system, respectively.
The slopes K l and K r of P l 1 P l 2 and P r 1 P r 2 can be obtained from the association of Equation (4) with Equation (5) as:
K l = tan γ 1   =   y l 2 y l 1 x l 2 x l 1 Y l X l   =   Y 0 + d l sin α d l cos α
K r = tan γ 2   =   y r 2 y r 1 x r 2 x r 1 Y r X r = Y 0 + d r sin α d r cos α
Combining Equation (6) with Equation (7) and eliminating the focal length f and the Z-axis coordinate value, Equation (8) can be obtained:
α = arcsin Y 0 K l d l K r d r K l + K r d l d r

2.2. Curved Road Cross Slope Solution

After the analysis in the previous section, the solution formula (8) for the cross-slope of the straight road section is obtained. When the vehicle is in the curved road section as shown in Figure 3—if the pre-sighting point is selected as L 1 , L 2 and the intersection of the lane line P l 1 , P r 1 and P l 2 , P r 2 , to estimate the cross slope angle—it is obvious that the result obtained is not the cross-slope angle of the vehicle passing through the road section.
Assuming the inclination angles β 1 and β 2 of the lane-line tangents are T 1 and T 2 at P l 1 and P l 2 , then β 1 and β 2 are:
β 1 = π 2 β 1 β 2 = π 2 β 2
Figure 3. Overhead diagram of curved road section.
Figure 3. Overhead diagram of curved road section.
Sensors 22 01867 g003
Rotating L 1 and L 2 by β 1 and β 2 angles, the expressions for the functions L 1 and L 2 are obtained as follows:
L 1 : y = tan β 1 x + y 1 tan β 1 x 1 L 2 : y = tan β 2 x + y 2 tan β 2 x 2
Equation (10) and the lane-line function can be combined to obtain the coordinate values of the intersection point P r 1 , P r 2 of the rotated pre-sight line L 1 , L 2 , and the other side of the lane line, at this time. Coordinating the P l 1 , P l 2 and P r 1 , P r 2 values into Equations (6)–(8) can obtain the curved-road cross-slope angle. When the road is a right turn the principle is the same, and does not need to be repeated.

3. Estimation of the Position of the Vehicle Relative to the Lane Line and the Slope of the Lane Line Tangent

Through the above principle analysis, the relationship equation between road slope and d l , d r and the coordinates of auxiliary points is obtained. In practical application, it is also necessary to identify the lane lines based on vision and fit the lane lines to obtain the parameters of lane line function, d l , d r , and lane-line tangent slope. In general, structured roads have more obvious lane-marker lines, which are easy to identify and estimate. For this reason, this paper takes structured roads as an example to illustrate.

3.1. Lane Line Detection Algorithm

In this paper, the SCNN (Spatial CNN) lane-line detection algorithm [33] is selected to obtain the lane line fitting function. SCNN is a new neural network structure for extracting lane lines. Compared with the traditional neural network that convolves directly between the layers, the net convolves in a certain direction and order. This neural network algorithm has the advantages of higher computational efficiency and faster training speed. Figure 4 shows the effect of lane line detection in various environments.
The lane line fitting function can be obtained by extracting and fitting the lane lines by the above algorithm as shown in Equation (11):
B k , 1 ( u )   =   1 ,   u k u u k + 1 0 , other B k , d ( u ) = u u k u k + d 1 u k B k , d 1 ( u ) + u k + d u u k + d u k + 1 B k + 1 , d 1
where u is the control node; d is related to the number of functions, which is taken as four in this paper; and n is the number of control points.

3.2. Estimation of Vehicle Position Relative to the Lane Line

From Equation (8), we need to know d l , d r . According to the lane line fitting function obtained in the previous section, we can obtain the intersection of the left and right lane lines with the bottom of the image as p l = x l , y and p r = x r , y in Figure 5, respectively. Since the general lane deviation angle is not too large when the vehicle is in motion, p l p r can be regarded as the projection of the lane-line width on the image, leading to Equation (12):
d = Z min f p l p r
where d is the width of the lane line; Z m i n is where the camera can capture the nearest place and horizontal distance to the camera optical center; f is the focal length of the camera; and p l p r   p l and p r .
The projection of the lane line in the image captured by the camera is shown schematically in Figure 5.
Figure 5. Diagram of lane line projection.
Figure 5. Diagram of lane line projection.
Sensors 22 01867 g005
From the figure, as well as Equations (12) and (13) is obtained:
x l x r = d l d r ;   d l + d r = d

3.3. Estimation of Lane Line Tangent Slope

According to Equations (9) and (10), it is necessary to know the tangent slope of the curved lane, and due to the camera viewpoint, the 3D information such as the curvature of the lane line cannot be obtained directly from the original image, so this paper derives the method of lane-line tangent-slope estimation from the principle of inverse perspective.
A point in the world coordinate system is mapped onto the pixel plane, a process called perspective transformation [18], as shown in Equation (14):
Z C u v 1 = M 1 M 2 X W Y W Z W 1 = M X W
where Z C is the value of the Z-axis coordinates of the point in the camera coordinate system, which can be seen as a loss of dimensionality in the process of perspective. Inverse perspective will be taken as 1, where M 1 is only related to the structure of the camera, called the internal parameters of the camera (internal parameters); M 2 is only related to the position of the camera in the world coordinate system, called the external parameters of the camera (external parameters); and M is a 3 × 4 projection matrix.
Thus, the image coordinates can be transformed into world coordinates by using Equation (14), which allows:
Z C M 1 u v 1 = X W Y W Z W
In Figure 5, m 1 and m 2 are the midpoints of l l l r and p 1 p 2 , respectively. Then, their corresponding points, M 1 X 1 , Y 1 , M 2 X 2 , Y 2 , in world coordinates can be solved by Equation (15); the slope K of a line, M 1 M 2 ,   determined by these two points is:
K = X 1 X 2 Y 1 Y 2
For conventional roads, the curvature transformation is relatively gentle, so it can be assumed that the slope of the corresponding lane-line tangent at the midpoint of M 1 M 2 is K.

4. Simulation Experiment Verification and Analysis

The paper builds several road models with different slopes and curvatures using Prescan software, and places the vehicle on different points in the lane. By setting the camera sensor at 1.2 m above the vehicle from the ground, we can obtain the image of the structured road ahead and use it to conduct offline simulation experiments.

4.1. d l and d r Estimation Validation Experiments

In order to verify the accuracy of the vehicle’s relative-position-estimation algorithm, the vehicles are placed at seven points on the lane octant for estimation verification experiments. Figure 6 shows the modeling diagram of the simulation experiment, and Table 1 shows the experimental results.
The absolute value of the estimated error value is less than 0.1 m, and the estimated value is more accurate. The analysis of the experimental results shows that the cause of this error is due to visual bias. To further improve the accuracy of the estimated value, and consequently improve the accuracy of the subsequent estimation, an artificial parameter ε is introduced, which is obtained by fitting the function of the error value to the 2D image value x l / p l p r , so that the final estimated value D ¯ l and ε as shown in Equation (17):
x = x l p l p r ε = 1.264 x 3 + 2.059 x 2 1.102 x + 0.1923 D l ¯ = D l ε
After introducing the parameter ε, the vehicle is randomly placed at any position of the lane line, and the d l estimation results are shown in Figure 7.
From Figure 7, it can be seen that the error is controlled within 0.01 after introducing the artificial parameter ε, which satisfies the accuracy requirement of the subsequent algorithm for d l .

4.2. Verification Experiments of Lane Line Tangent Slope Estimation

To verify the accuracy of the lane line tangent slope estimation algorithm, circular curves with radii of curvature of 500, 600 and 700 m were established in Prescan, as shown in Figure 8. The vehicles were placed at three points in four equal parts of the lane for verification experiments, and the experimental results are shown in Figure 9.
Since it is not easy to find the exact data point on the pixel image, this will have an impact on the subsequent estimation. It can be seen from the above figure that the closer the vehicle is to the center of the lane line, the more accurate the estimated value of K. However, the error value of K is no more than 0.02, which satisfies the requirement of the subsequent algorithm for the accuracy of K-value estimation.

4.3. Road Lateral Slope Estimation Validation Experiment

To verify the accuracy of the lateral-slope estimation algorithm, straight roads with lateral slopes of 0°, 1°, 3° and 5°, and curved roads with a radius of curvature of 500 m as shown in Figure 10, were designed, respectively. The vehicles were placed at three points on the lane quadrature for estimation experiments. Figure 11 shows the results of the straight-road slope estimation and Figure 12 shows the results of the curved-road slope estimation.
By analyzing the experimental results, we can see that the estimation error of the lateral slope of the straight road is within 0.15°, while the estimation error of the lateral slope of the curved road is within 1°. Thus, obviously, the estimation of the straight road is much more accurate than that of the curved one.

4.4. Slope Estimation Error Analysis

In order to explain the reasons for the appearance of the above experimental results, this paper chooses to analyze from Equation (8). Taking a straight road with a lateral slope of 5° as an example, the left detection-fitted lane line is rotated by 1°. d l hardly changes during the lane line rotation, while the changes in K l , as well as the road-slope estimation during this process, are shown in Figure 13.
Furthermore, by analyzing Figure 13, it can be seen that when the lane-line detection fitting is slightly deviated, it has a greater impact on the K l value, and also leads to the error divergence of the estimated road slope; that is, the error value of the road-slope estimation is strongly correlated with the lane-line detection fitting effect.

5. Conclusions

(1) In this paper, a simple analytical formula for the lateral slope of the road is derived with the help of the image perspective principle, which is related to only a few parameters and greatly reduces the complexity of the algorithm. The estimation results of the algorithm are more accurate for structured roads.
(2) By analyzing the slope estimation principle and conducting experimental verification, it is concluded that the accuracy of the slope estimation algorithm is strongly correlated with the detection of lane lines. By enhancing the detection accuracy of lane lines, the estimation error can be effectively reduced.

Author Contributions

Conceptualization, Y.Y. and H.L.; methodology, H.L.; validation, Y.Y. and H.L.; formal analysis, H.L.; investigation, Y.Y.; resources, Y.Y.; writing—original draft preparation, H.L.; writing—review and editing, Y.Y.; supervision, Y.Y.; project administration, Y.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by (National Natural Science Foundation of China) grant number (51975428).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors would like to thank the National Natural Science Foundation of China (No.51975428) for their support.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Li, F. Research on Cause Mechanism of Major Road Traffic Accidents and Its Risk Behaviors; Changan University: Xi’an, China, 2014. [Google Scholar]
  2. Mclaughlin, S.B.; Hankey, J.M.; Klauer, S.G.; Dingus, T.A. Contributing Factors to Run-off-Road Accidents and Near-Accidents; National Highway Traffic Safety Administration (NHTSA): Washington, DC, USA, 2009.
  3. Hussein, M.; Sayed, T.; Ismail, K.; Van Espen, A. Calibrating road design guides using risk-based reliability analysis. J. Transp. Eng. 2014, 140, 36. [Google Scholar] [CrossRef]
  4. Liu, C.; Subramanian, R. Factors Related to Fatal Single-Vehicle Run-off-Road Accidents; National Center for Statistics and Analysis: Washington, DC, USA, 2009.
  5. Cheng, G.; Cheng, R.; Xu, L. Probabilistic prediction of roadside accidents in outer lane of small radius curve sections of highways. J. Harbin Inst. Technol. 2021, 53, 178–185. [Google Scholar]
  6. Qu, Q.; Li, X.; Wu, M.-X.; Pan, B.-H.; Wang, G.-S. Comparative Study on Expressway Super-elevation Transition Modes Based on Driving Stability. J. Highw. Transp. Res. Dev. 2021, 38, 15–24. [Google Scholar]
  7. Japan Road Association. Interpretation and Application of Japanese Highway Technical Standards; China Communications Press: Beijing, China, 1980. [Google Scholar]
  8. AASHTO. A Policy on Geometric Design of Highways and Streets; AASHTO: Washington, DC, USA, 2011. [Google Scholar]
  9. Jeong, J. A Hydrodynamic Diffusion Wave Model for Stormwater Runoff on Highway Surfaces at Superelevation Transitions; University of Texas at Austin: Austin, TX, USA, 2008. [Google Scholar]
  10. Jeong, J.; Charbeneau, R.J. Diffusion Wave Model for Simulating storm-water Runoff on Highway Pavement Surfaces at Superelevation Transition. J. Hydraul. Eng. 2010, 136, 770–778. [Google Scholar] [CrossRef]
  11. Zhang, Z.; Cheng, J. Safety Margin-based Analysis on Road Superelevation Rate Selection. In Proceedings of the 15th COTA International Conference of Transportation Professionals, Beijing, China, 25–27 July 2015. [Google Scholar]
  12. Fitzpatrick, K.; Kahl, K. A Historical and Literature Review of Horizontal Curve Design; Texas Department of Transportation: Austin, TX, USA, 1992.
  13. Arslan, A.; Tari, E.; Ziatdinov, R.; Nabiyev, R.I. Transition Curve Modling with Kinematical Properties: Research on Log-Aesthetic Curves. Comput.-Aided Des. Appl. 2014, 11, 509–517. [Google Scholar] [CrossRef] [Green Version]
  14. Xu, J. Highway Survey and Design, 4th ed.; China Communications Press: Beijing, China, 2016. [Google Scholar]
  15. Lin, N.; Shi, S.M.; Ma, L.; Kui, H.L. Road grade estimation with grade change rate information. J. Jilin Univ. 2016, 46, 1845–1850. [Google Scholar]
  16. Shen, Y.; Chen, L.; Yang, X.; Liu, Y.; Liu, C. A Research on the Enhancement of Vehicle Lateral Stability by Applying Inerter to Suspension. Automot. Eng. 2018, 40, 693–698. [Google Scholar]
  17. Huang, C.; Chen, L.; Yuan, C.; Jiang, H.; Chen, Y. Chaos study of vehicle lateral dynamics based on perturbation parameter. J. Southeast Univ. 2012, 42, 1111–1116. [Google Scholar]
  18. Sun, C.; Wu, C.Z.; Chu, D.F. Safety Evaluation of Driving on Curves Based on Analysis of Vehicle Lateral Stability. J. Transp. Inf. Saf. 2014, 32, 95–100. [Google Scholar]
  19. Chu, D.; Cui, J.; Deng, Z.; Tian, F.; Wu, C. Research on Vehicular Rollover Warning Based on Improved TTR Algorithm. China Mech. Eng. 2016, 27, 1557–1561. [Google Scholar]
  20. Zong, C.F.; Hu, D.; Yang, X.; Pan, Z.; Xu, Y. Vehicle driving state estimation based on extended Kalman filter. J. Jilin Univ. 2009, 39, 7–11. [Google Scholar]
  21. Hsu, L.Y.; Chen, T.L. Vehicle full-state estimation and prediction system using state observers. IEEE Trans. Veh. Technol. 2009, 58, 2651–2662. [Google Scholar]
  22. Antonov, S.; Fehn, A.; Kugi, A. Unscented Kalman filter for vehicle state estimation. Veh. Syst. Dyn. 2011, 49, 1497–1520. [Google Scholar] [CrossRef]
  23. Zhou, C. Road Slope Angle Measuring Device. Patent CN201320054259.5, 3 July 2013. [Google Scholar]
  24. You, R. The Utility Model Relates to a Road Slope Measuring Device. Patent CN201721405579.5, 11 May 2018. [Google Scholar]
  25. Menhour, L.; Lechner, D.; Charara, A. Design and experimental validation of linear and nonlinear vehicle steering control strategies. Veh. Syst. Dyn. 2012, 50, 903–938. [Google Scholar] [CrossRef]
  26. Tseng, H.E. Dynamic estimation of road bank angle. Veh. Syst. Dyn. 2001, 36, 307–328. [Google Scholar] [CrossRef]
  27. Tseng, H.E.; Ashrafi, B.; Madau, D.; Allen Brown, T.; Recker, D. The development of vehicle stability control at ford. IEEE ASME Trans. Mechatron. 1999, 4, 223–234. [Google Scholar] [CrossRef]
  28. Guan, X.; Jin, H.; Duan, C.; Lu, P.P. Estimation of lateral slope of vehicle driving road. J. Jilin Univ. 2019, 49, 1802–1809. [Google Scholar]
  29. Jeong, H.B.; Ahn, C.K.; You, S.H.; Sohn, K.M. Finite-Memory Estimation for Vehicle Roll and Road Bank Angles. IEEE Trans. Ind. Electron. 2019, 66, 5423–5432. [Google Scholar] [CrossRef]
  30. Hyun, M.; Cho, W. Estimation of Road Bank Angle and Vehicle Side Slip Angle Using Bayesian Tracking and Kalman Filter Approach. Int. J. Automot. Technol. 2018, 19, 993–1000. [Google Scholar] [CrossRef]
  31. Ustunel, E.; Masazade, E. Vision-based road slope estimation methods using road lines or local features from instant images. IET Intell. Transp. Syst. 2019, 13, 1590–1602. [Google Scholar] [CrossRef]
  32. Li, R. Theory and Application of Binocular Stereo Vision; Science Press: Beijing, China, 2020. [Google Scholar]
  33. Pan, X.; Shi, J.; Luo, P.; Wang, X.; Tang, X. Spatial as Deep: Spatial CNN for Traffic Scene Understanding. In Proceedings of the AAAI 2018, New Orleans, LA, USA, 2–7 February 2018. [Google Scholar]
Figure 2. Schematic diagram of wedge-shaped pavement.
Figure 2. Schematic diagram of wedge-shaped pavement.
Sensors 22 01867 g002
Figure 4. Effect of SCNN lane line detection algorithm.
Figure 4. Effect of SCNN lane line detection algorithm.
Sensors 22 01867 g004
Figure 6. Schematic diagram of the experimental part of PRESCAN d l and d r estimation.
Figure 6. Schematic diagram of the experimental part of PRESCAN d l and d r estimation.
Sensors 22 01867 g006
Figure 7. Plot of experimental results of d l   estimation.
Figure 7. Plot of experimental results of d l   estimation.
Sensors 22 01867 g007
Figure 8. Schematic diagram of the experimental part of Prescan lane-line tangent-slope estimation.
Figure 8. Schematic diagram of the experimental part of Prescan lane-line tangent-slope estimation.
Sensors 22 01867 g008
Figure 9. Graph of lane-line tangent-slope estimation results.
Figure 9. Graph of lane-line tangent-slope estimation results.
Sensors 22 01867 g009
Figure 10. Schematic diagram of the experimental part of Prescan slope estimation.
Figure 10. Schematic diagram of the experimental part of Prescan slope estimation.
Sensors 22 01867 g010
Figure 11. Graph of the results of estimating the lateral-slope angle of a straight road.
Figure 11. Graph of the results of estimating the lateral-slope angle of a straight road.
Sensors 22 01867 g011
Figure 12. Estimation results of lateral-slope angle of curved road.
Figure 12. Estimation results of lateral-slope angle of curved road.
Sensors 22 01867 g012
Figure 13. Error effect diagram of K l .
Figure 13. Error effect diagram of K l .
Sensors 22 01867 g013
Table 1. Experimental results of d l estimation.
Table 1. Experimental results of d l estimation.
True   Value   d l 0.43750.87501.31251.75002.18752.62503.0625
Estimated value D l 0.52480.89191.32121.75002.18672.61283.0225
Absolute error value0.08730.01690.00870.0000−0.0008−0.0122−0.0400
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yan, Y.; Li, H. Machine Vision-Based Method for Estimating Lateral Slope of Structured Roads. Sensors 2022, 22, 1867. https://doi.org/10.3390/s22051867

AMA Style

Yan Y, Li H. Machine Vision-Based Method for Estimating Lateral Slope of Structured Roads. Sensors. 2022; 22(5):1867. https://doi.org/10.3390/s22051867

Chicago/Turabian Style

Yan, Yunbing, and Haiwei Li. 2022. "Machine Vision-Based Method for Estimating Lateral Slope of Structured Roads" Sensors 22, no. 5: 1867. https://doi.org/10.3390/s22051867

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop