Next Article in Journal
LTCC Packaged Ring Oscillator Based Sensor for Evaluation of Cell Proliferation
Next Article in Special Issue
Dual-Bayes Localization Filter Extension for Safeguarding in the Case of Uncertain Direction Signals
Previous Article in Journal
BATS: Adaptive Ultra Low Power Sensor Network for Animal Tracking
Previous Article in Special Issue
Modeling and Performance of the IEEE 802.11p Broadcasting for Intra-Platoon Communication
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

IMU-Based Virtual Road Profile Sensor for Vehicle Localization

School of Mechanical Engineering, Pusan National University, Busan 46241, Korea
*
Author to whom correspondence should be addressed.
Sensors 2018, 18(10), 3344; https://doi.org/10.3390/s18103344
Submission received: 4 September 2018 / Revised: 28 September 2018 / Accepted: 1 October 2018 / Published: 7 October 2018
(This article belongs to the Special Issue Sensors Applications in Intelligent Vehicle)

Abstract

:
A road profile can be a good reference feature for vehicle localization when a Global Positioning System signal is unavailable. However, cost effective and compact devices measuring road profiles are not available for production vehicles. This paper presents a longitudinal road profile estimation method as a virtual sensor for vehicle localization without using bulky and expensive sensor systems. An inertial measurement unit installed in the vehicle provides filtered signals of the vehicle’s responses to the longitudinal road profile. A disturbance observer was designed to extract the characteristic features of the road profile from the signals measured by the inertial measurement unit. Design synthesis based on a Kalman filter was used for the observer design. A nonlinear damper is explicitly considered to improve the estimation accuracy. Virtual measurement signals are introduced for observability. The suggested methodology estimates the road profile that is sufficiently accurate for localization. Based on the estimated longitudinal road profile, we generated spectrogram plots as the features for localization. The localization is realized by matching the spectrogram plot with pre-indexed plots. The localization using the estimated road profile shows a few meters accuracy, suggesting a possible road profile estimation method as an alternative sensor for vehicle localization.

1. Introduction

Autonomous ground vehicles recognize the surrounding environment and autonomously generate driving commands. The possible benefits of autonomous vehicles in traffic are the reduction of traffic accidents, increased convenience for drivers, optimized traffic flow, and expeditious driving [1,2,3]. To enable autonomous driving, various techniques have been developed in the fields of advanced vehicle safety systems and intelligent transportation systems [4,5]. Among them, vehicle localization is one of the most important techniques for autonomous driving.
A typical method for vehicle localization involves using Global Positioning System (GPS) signals. GPS provides absolute position information with reliability within a few meters at a low cost. However, GPS requires a clear line of sight to satellites because GPS signals are vulnerable to visual obstacles and signal reflections [6,7]. Furthermore, the position accuracy of single-frequency GPS receivers is low (up to tens of meters) [8]. By using two-frequency GPS receivers, the accuracy can be improved to within meters, but the cost increases significantly [9,10,11,12].
GPS and other methods are fused to obtain accurate position information at an affordable price for production vehicles. For example, GPS is integrated with cameras [13], laser scanners [14], or inertial measurement units (IMUs) [15,16]. When GPS is available, additional sensors can be used to compensate for the GPS error [17,18], which is the main purpose of sensor fusion. If GPS is unavailable, the additional sensors are used as back-up sensors. Some back-up sensors can act as visual odometers, such as cameras and laser scanners, but they are vulnerable to weather and lighting conditions. When an IMU is used as a back-up sensor, dead reckoning is mainly used [19,20]. However, dead reckoning is only valid for a short time horizon because of error accumulation.
Nevertheless, an IMU has many advantages over other sensors. First, IMU signals are more robust against external interruptions than GPS and vision sensors because they are directly measured from the signal sources. In contrast, GPS or vision signals are measured through non-contact methods. Therefore, IMU signals are less affected by visual obstacles or weather conditions and well- reflect the response of the vehicle to excitations from the surrounding environment. Secondly, an IMU is cheap and readily mounted on most passenger vehicles for standard safety features such as electric stability control. Therefore, IMUs are available at a very low cost. If we can reduce the effect of error accumulation, an IMU can be an attractive back-up sensor for a localization system using GPS or a vision system when corresponding signals are interrupted or jammed.
Because of these advantages, we focus on an alternative IMU-based localization method that is not based on dead reckoning. Our approach is based on the fact that the road surface at a position has characteristic longitudinal profiles that are distinct from those of other positions. A heuristic analogy is guessing one’s own location by feeling the vibrations and motions of a vehicle when on a familiar road. Some researchers have presented IMU-based localization methods that use pitch rate signals [21,22]. The shapes of measured pitch rate signals from a ground vehicle are compared with the shapes of pre-indexed pitch rate signals to identify the position. This method is based on different road profiles generating different vehicle motions. The method works without error accumulation, but the localization accuracy is affected by measurement noise because the pre-indexed signals and measured signals are compared in the time domain. Furthermore, vehicle dynamics signals, such as the acceleration and angular velocities, are dependent on the vehicle speed, which also affects the estimation accuracy.
The proposed approach is error-accumulation-free IMU-based localization that is less dependent on vehicle speed variations and robust to signal noise. The basic concept for our approach is comparing the profile of the current position with a pre-indexed road profile database, which does not require the addition of a GPS signal. This method may work as a redundant sensor in the localization process when in conjunction with a GPS or be a backup sensor when GPS is unavailable, which both increase the reliability of the navigation system. The suggesting localization method consists of two main parts. One is estimating the longitudinal road profile of the current location, and the other is feature matching between the estimated profile and the profiles in the database in the spectrogram framework.
The dependency on the vehicle speed can be removed by using the estimated road profile, because the longitudinal road profile is time independent information. We estimate the road profiles with measured IMU signals because a cost-effective device for direct measurement of a road profile is unavailable. The estimation is based on a disturbance observer. However, estimating disturbance signals using only a body-attached IMU is impossible due to the lack of observability. Because of the observability issue, some researchers use additional sensors to estimate a longitudinal road profile without concerns on observability. Examples of such sensors are the suspension stroke sensor [23,24,25,26] and the velocity or acceleration sensors for the un-sprung mass [26,27,28], but this approach is not favored for production vehicles. Another approach found in the literature is that the sprung mass position is assumed to be the same as the road profile [29,30], but the assumption is not valid in general production vehicles. Our remedy is to introduce a virtual measurement that is based on a less stringent assumption than the assumption on the sprung mass position. The virtual measurement is an assumed value of the averaged road heights. The assumption is based on the hypothesis that the road surface variations in longer wavelengths than the vehicle wheelbase, such as the averaged road heights, are ignorable. Therefore, the virtual measurement is a low-pass-filtered road profile and set as 0. By introducing the virtual measurement, the observability conditions are satisfied without using additional sensors or a too stringent assumption.
The second part for localization is to match the road profiles between the estimated one and the pre-indexed one in the database. The immunity to noise is improved by a feature extraction method. We extract the features of a road profile in the frequency-distance domain. Characteristics are more clearly presented in the frequency domain than in the time domain, so we adopt a spectrogram technique for feature extraction [31]. A spectrogram is a two-dimensional plot in the time-frequency domain, so the characteristics of signals are displayed with richer information. Another benefit of a spectrogram is the easy rejection of measurement noise. In addition, by using the spectrogram, we can use image processing techniques for feature matching because the spectrogram is displayed in a two-dimensional domain.
The rest of the paper consists of the following. Section 2 presents the observer design for longitudinal road profile estimation. Section 3 presents the feature extraction and feature matching, and Section 4 shows the experimental validation. Section 5 presents the conclusions.

2. Observer Design for Road Profile Estimation

The pitch rate and vertical acceleration are the most representative signals obtained from road profiles. However, such signals are affected by many factors, such as the longitudinal acceleration, measurement noise, and vehicle velocity. Therefore, a localization method based on the measured pitch rate or vertical acceleration signals may not be robust. An input observer or a disturbance observer is used to achieve a signal that is only affected by the road profile.
Figure 1 shows the concept of the road profile estimation. For straight driving, the main excitations of the vehicle’s dynamic responses are the vertical displacement of the tire-road contact points and the longitudinal acceleration. This information is used to estimate a road profile using measured IMU signals.

2.1. Vehicle Vertical Model

To capture the vertical and pitch dynamics, we consider a typical half car model, as shown in Figure 2. The tire and the suspension are modeled as spring-damper systems, but the damper of the suspension is modeled as a non-linear system. The nonlinearity of the suspension damper is one of the most significant factors in the accuracy of the estimation results. Therefore, the nonlinearity of the suspension dampers is explicitly considered in the model design. The damping force model is shown in Figure 3.
The half car model with nonlinear dampers is expressed as a state space model:
x ˙ = f ( x ) + B 1 u + B 2 d , y = h ( x ) ,
where x is a state vector, u is a vector of known inputs, and d is a vector of unknown inputs. The variables are defined as follows:
x = [ s f s ˙ f s r s ˙ r z f z ˙ f z r z ˙ r ] T , u = a x , d = [ R f R ˙ f R r R ˙ r ] T , y = [ θ ˙ z ¨ ] T ,
where sf and sr are the front and rear suspension strokes, respectively; and Rf, Rr and their time-derivatives are unknown inputs to the vehicle dynamics. These unknown inputs are determined by the road profiles and the vehicle velocity, and they cannot be easily measured using conventional sensors. y is a vector of the measurement signals and is a tuple of the pitch rate and vertical acceleration signals from the IMU sensor.

2.2. Synthesis for Unknown Input Estimation

The states of a model can be estimated using conventional observers or Kalman filters. To estimate unknown inputs, Darouach proposed a modified Kalman filter for a linear system [32,33]. The summarized synthesis for a discrete linear system with unknown input dk is the following. In the following discrete system:
x k + 1 = F x k + G 1 u k + G 2 d k + w k , y k = H x k + v k ,
where xk is the state; uk is the known input; yk is the measurement; and wk and vk are zero mean Gaussian noise with covariance matrices of W and V, respectively. The state and unknown inputs are estimated from the modified Kalman filter:
x ¯ k / k = F x ^ k / k + G 1 u k , x ^ k + 1 / k + 1 = x ¯ k / k + G 2 d ^ k / k + 1 + K k + 1 x { y k + 1 H ( x ¯ k / k + G 2 d ^ k / k + 1 ) } , d ^ k / k + 1 = K k + 1 d ( y k + 1 H x ¯ k / k ) , K k + 1 x = ( P ¯ k / k 1 + H T V 1 H ) 1 H T V 1 , K k + 1 d = P k + 1 / k + 1 d x H T V 1 ,
where
P ¯ k / k = F x ^ k / k F T + W , P k + 1 / k + 1 d x = P k / k + 1 d G 2 T P ¯ k / k 1 ( P ¯ k / k 1 + H T V 1 H ) 1 , P k / k + 1 d = { G 2 T H T ( V + H P ¯ k / k H T ) 1 H G 2 } 1 , P k + 1 / k + 1 x = { P ¯ k / k 1 + H T V 1 H P ¯ k / k 1 G 2 ( G 2 T P ¯ k / k 1 G 2 ) 1 G 2 T P ¯ k / k 1 } 1 .

2.3. Linearization and Discretization of the Model

The synthesis can also be applied to a nonlinear system using the Jacobian matrices of the state transition and measurement functions. To design a disturbance observer, the nonlinear model (1) is linearized. At an operating point x0, the linearized model is:
δ x ˙ = A ( t ) δ x + B 1 δ u + B 2 δ d , δ y = C ( t ) δ x ,
where
A ( t ) = [ f ( x ) x ] x 0 , C ( t ) = [ h ( x ) x ] x 0 , B 1 = [ 0 a L m s I y h 0 b L m s I y h 0 0 0 0 ] T , B 2 = [ 0 k t f m t f 0 0 0 k t f m t f 0 0 0 c t f m t f 0 0 0 c t f m t f 0 0 0 0 0 k t r m t r 0 0 0 k t r m t r 0 0 0 c t r m t r 0 0 0 c t r m t r ] T .
Finally, the linearized model (4) is discretized as a linear time-varying system for the observer design as follows:
x k + 1 = F k x k + G 1 u k + G 2 d k , y k = H k x k .

2.4. Measurement Bias Model

The measurement signals include inevitable biases from the sensors or the installation error that usually occurs in a production vehicle. The measurement bias may cause accumulated errors in the estimation. If the sensor biases are not ignorable, the biases should be explicitly taken into account in the observer design. The biases are defined in the measurement vector ym:
y m = [ θ ˙ m z ¨ m ] = [ θ ˙ + b θ ˙ z ¨ + b z ¨ ] ,  
where θ ˙ m is the measured pitch rate, b θ ˙ is the bias of the pitch rate sensor, z ¨ m is the measured vertical acceleration, and b z ¨ is the bias of the vertical acceleration sensor. The biases are usually constant or change slowly. Therefore, the bias model is assumed to be constant:
b θ ˙ ( k + 1 ) = b θ ˙ ( k ) , b z ¨ ( k + 1 ) = b z ¨ ( k ) .

2.5. Virtual Measurement for Observability

When the bias model is added to the linearized discrete system (5), the system model becomes larger and thus has 10 states, four unknown inputs, one known input, and two measurement signals. Before the observer design synthesis is applied to the system, the observability is investigated. The observability of an input observer can be tested using the following two conditions [34]:
1. r a n k ( O ) = r a n k ( [ H _ k H _ k F _ k H _ k F _ k n 1 ] ) = n , 2. r a n k ( H _ k + 1 G d ) = r a n k ( G d ) = q ,
where n and q are the number of states and the number of unknown inputs, respectively. The states can be estimated if the observability matrix O has full column rank. The unknown inputs can be estimated if the matrices in the second condition have full column rank.
The second condition is not satisfied in our problem. A very easy resolution is to add additional measurement signals, but this requires additional cost. Therefore, we introduce a virtual measurement signal based on a reasonable assumption. The assumption is that the average road grade is zero in a distance horizon that is much longer than the vehicle wheel base. With this assumption, we introduce two virtual measurements, R ¯ f and R ¯ r , which are the low-pass-filtered vertical displacements of the contact patches of the front and rear tires, respectively. The two virtual measurement signals are expressed as follows:
R ¯ f ( k + 1 ) = α R f ( k ) + ( 1 α ) R ¯ f ( k ) , R ¯ r ( k + 1 ) = β R r ( k ) + ( 1 β ) R ¯ r ( k ) ,
where α and β are the filter parameters. The virtual measurements and ym are added to the final measurement vector:
y a u g = [ y m R ¯ f R ¯ r ] = [ y m 0 0 ] .  
The final model for the road profile estimation is completed by adding the bias model and the virtual measurement model to the discretized vertical model (5):
x a u g ( k + 1 ) = F a u g ( k ) x a u g ( k ) + G 1 , a u g u ( k ) + G 2 , a u g d ( k ) , y a u g ( k ) = H a u g ( k ) x a u g ( k ) ,
where
x a u g = [ x T , b θ ˙ , b z ¨ , R ¯ f , R ¯ r ] T , y a u g = [ θ ˙ m z ¨ m R ¯ f R ¯ r ] T , F a u g ( k ) = [ F k 0 10 × 4 F 21 F 22 ] , F 21 = [ 0 4 × 8 0 2 × 2 α 0 0 β ] , F 22 = [ 1 0 0 1 0 2 × 2 0 2 × 2 1 α 0 0 1 β ] , G 1 , a u g = [ G 1 0 4 × 1 ] , G 2 , a u g = [ G 2 0 4 × 2 ] , H a u g = [ H k 0 2 × 1 ] .
This system satisfies the observability conditions, and the disturbance observer can be designed.

2.6. Road Profile Estimation Validation

We verified the estimation algorithm with a simulation and experiments. The simulation was performed with the virtual measurements vehicle dynamics simulation software Carsim® (Mechanical Simulation Corporation, Ann Arbor, MI, USA). The vehicle was a full-sized sedan running at 25 km/h on a simple road profile, as shown in Figure 4. Figure 5 shows the road profile estimation results obtained using the system model with linear dampers and nonlinear dampers. The measurement signal does not have any noise or bias, so the error in the estimation mainly comes from the model error. Therefore, the result with nonlinear dampers shows a higher accuracy than the result with linear dampers.
The experimental validation was performed using a speed bump, as shown in Figure 6. A full-sized sedan was driven on the speed bump, and the profile of the speed bump was measured using the ad-hoc device shown in Figure 7. The estimated results are plotted in Figure 8. The black line presents the measured profile. The observer with the nonlinear damper model provided more accurate estimates, especially after the vehicle ran over the bump. This occurred because a linear damper model would show a significant discrepancy from a true damper when the suspension stroke velocity is high. A high suspension stroke velocity usually occurs at sudden road profile changes such as speed bumps or pot holes.

3. Localization Using Estimated Road Profile

3.1. Feature Extraction

Unique and robust features are required to identify a specific location. The spectrogram shows the features of road profiles as an image in the time-frequency domain. By transforming a road profile to a spectrogram, we can apply various image feature extraction methods. Furthermore, we can extract robust features even when there is noise because the spectrogram has two feature dimensions: time and frequency. However, the vehicle speed affects the road profile distribution if the estimated road profiles are expressed in time. Therefore, we transform the road profile indexed in time into one that is indexed by the accumulated distance. By generating a spectrogram in the distance-frequency domain, the time dependency is removed. Figure 9 shows a spectrogram with the estimated road profile result from Figure 5. This spectrogram was generated with a moving window with dimensions of 10 m × 1 round/m. The color changes in the figure represent the road profile changes.

3.2. Feature Matching

The feature matching involves determining the most corresponding index between a test sample and a portion of the database. We use an image comparison method based on normalized gray-level correlation. The database is a long image of a spectrogram that is obtained in advance. The test sample signal is transformed to a spectrogram and normalized to a gray level image. The similarity can be evaluated with the inner product operation:
r = a b | a | | b | = i = 1 M j = 1 N a ( i , j ) b ( i , j ) i = 1 M j = 1 N a ( i , j ) 2 i = 1 M j = 1 N b ( i , j ) 2 ,  
where a is the normalized database vector, and b is the normalized test sample vector. If the correlation coefficient r has a high value near 1, the test sample image is similar to a portion of the database image. Among the r values obtained from scanning the database, the index of the highest value should be the most likely current location. Figure 10 shows the conceptual process of the feature extraction and matching.

4. Experimental Validation

To verify the localization method, we drove two different cars on the same road: a full-sized sedan and a compact sedan, as shown in Figure 11. The vehicle velocities are shown in Figure 12. The full-sized sedan ran at about 24.4 km/h, and the compact sedan ran at about 16.7 km/h. Figure 13a–c show the pitch rate, vertical acceleration, and longitudinal acceleration signals measured through the IMU for both cases, respectively. The signals in Figure 13a,b are the output y, and the signal in Figure 13c is the known input u in the estimator for the road profile. Figure 13d shows the driving distance with respect to time for both vehicles.

4.1. Consistency of Road Profile Estimatioin

The road profile should be extracted consistently for any type of vehicle at any speed. Figure 14 shows the estimated longitudinal road profile. The estimated profiles from the two vehicles show consistent patterns, even though the exact values are not identical. These consistent road profile results can provide the features for the localization in the same location, regardless of the speed or type of vehicle. The spectrograms of the estimated profiles from 750 to 1000 m in Figure 15 show more similar patterns. This occurs because the spectrogram is more affected by the distance and the frequency of the specific signal shapes in the distance domain than their magnitudes.

4.2. Localization

The estimated road profile from the full-sized sedan was used as a pre-indexed database, and that from the compact sedan was used as the test signal. Figure 16 shows the spectrogram transformed from the estimated road profile obtained with database signals with a window size of 250 m for the spectrogram generation. Figure 17 presents the spectrogram of the test runs obtained with this window. The localization was implemented by scanning the database spectrogram for the spectrogram of test signals. For example, for the spectrogram image obtained from the test vehicle shown in Figure 17a, the current position is about 400 m in the database index. In the same way, Figure 17b shows the image for 1450 m, and Figure 17c shows the image for 2200 m in the database index. The localization results for the total test signals are plotted in Figure 18.
Each graph in Figure 18 presents the localization result for when the lengths of the image moving window are 100, 200, 250, and 500 m. When the window size is larger, the estimated result is more accurate because the lager window includes more features. If the numbers and variety of features in the window are sufficient for localization, the localization accuracy increases, as shown in the case of the 500 m window. Notably, the localization results do not have accumulating error problems for any window sizes.
Figure 19 shows the error between the true position and the estimated positions with the measured signals from different environments when the window size is 500 m. The estimated localization results have under 5 m error without error accumulation.
Kuutti recently surveyed the state-of-the-art localization techniques [35]. He summarized that the localization techniques based on only one on-board sensor as a standalone offer a low accuracy and robustness for autonomous vehicles. The only GPS-based localization has under a 10 m accuracy [35], the only radar-based technique has an average accuracy of 10.5 m [36], and even the only camera-based localization has up to 20.5 m cumulative error [37]. The fusion techniques with vision sensors have under a meter accuracy; however, these techniques are vulnerable to illumination, the observation angle, the weather condition, and dynamic environments. The integrated GPS and IMU sensor localization technique has a relatively low accuracy of 7.2 m and error accumulation problem [38]. Another error-accumulation-free IMU-based localization method [21] has about a 5~10 m accuracy and estimation error deviations are large due to the signal noise. On the other hand, the suggested localization method has under 5 m error without an error accumulation problem using only an IMU sensor. Therefore, the suggested method can be applied as an alternative localization technique.
We conducted the localization process with pitch rate signals to confirm the effect of the longitudinal road profile estimation in the localization process. The same methodology was used for localization, but the base signal is the pitch rate signal and not the road profile. Because the magnitude and frequency of the pitch rate signals are affected by the vehicle speed, the accuracy is much lower than the result with the estimated road profile, even with a larger window size, as shown in Figure 20.

5. Conclusions

This paper presented a non-dead-reckoning-based localization method using an IMU sensor without the concern of error accumulation. The localization concept matches the obtained signals with a chunk of the pre-indexed database. This method consists of two parts: (1) transforming the IMU signals in the time domain to the road profile in the distance domain through the disturbance observer; and (2) extracting and matching features in the spectrogram of the estimated road profile. The road profile estimation is implemented with the modified Kalman filter framework for unknown input estimation. The observer deals with the nonlinearity of the suspension for accurate estimation and introduces the virtual measurement to satisfy the observability condition without using additional sensors. The features for localization are in a distance-frequency spectrogram and the current position is identified using an image matching technique. The test results showed the validity of the suggested method with a few meters accuracy and repeatability without error accumulation, which are similar to or superior than those of only one-sensor based localization techniques without any sensor fusion.
The suggested method has some advantages: (1) no error accumulation in the virtue of the time-independent road profile based localization; (2) a robust performance against vehicle speed variations; (3) richer features in a distance-frequency spectrogram than in the time-signal domain; (4) easy noise separation because of the road profiles transformed to the frequency domain; and (5) a higher possibility of implementation than other single sensor-based localization methods because of the low cost IMU. Therefore, the suggested method can be applied as a redundant sensor of GPS to improve the reliability of the navigation system or even applied as a back-up sensor when GPS is unavailable.

Author Contributions

Writing-Original Draft Preparation, J.G.; Writing-Review & Editing, C.A.

Funding

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (2016R1C1B1006540).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Autonomous Vehicle Implementation Predictions: Implications for Transport Planning. Available online: http://orfe.princeton.edu/~alaink/SmartDrivingCars/Reports&Speaches_External/Litman_AutonomousVehicleImplementationPredictions.pdf (accessed on 3 October 2018).
  2. Autonomous Vehicles: Drivers for Change. Available online: https://www.roadsbridges.com/autonomous-vehicles-drivers-change (accessed on 3 October 2018).
  3. Effects of Next-Generation Vehicles on Travel Demand and Highway Capacity. Available online: http://orfe.princeton.edu/~alaink/Papers/FP_NextGenVehicleWhitePaper012414.pdf (accessed on 3 October 2018).
  4. Tao, Z.; Bonnifait, P.; Fremont, V.; Ibanez-Guzman, J. Mapping and localization using GPS, lane markings and proprioceptive sensors. In Proceedings of the International Conference on Intelligent Robots and Systems, Tokyo, Japan, 3–7 November 2013; pp. 406–412. [Google Scholar]
  5. Lu, M.; Wevers, K.; Van Der Heijden, R. Technical feasibility of advanced driver assistance systems (ADAS) for road traffic safety. Transp. Plan. Technol. 2005, 28, 167–187. [Google Scholar] [CrossRef]
  6. Kleusberg, A.; Langley, R.B. The limitations of GPS. GPS World 1990, 1, 50–52. [Google Scholar]
  7. Skone, S.; Knudsen, K.; de Jong, M. Limitations in GPS receiver tracking performance under ionospheric scintillation conditions. Phys. Chem. Earth Part A Solid Earth Geod. 2001, 26, 613–621. [Google Scholar] [CrossRef]
  8. Drawil, N.M.; Amar, H.M.; Basir, O.A. GPS localization accuracy classification: A context-based approach. IEEE Trans. Intell. Transp. Syst. 2013, 14, 262–273. [Google Scholar] [CrossRef]
  9. Blomenhofer, H.; Hein, G.W.; Taveira Blomenhofer, E.; Werner, W. Development of a real-time DGPS system in the centimeter range. In Proceedings of the Position Location and Navigation Symposium, Las Vegas, NV, USA, 11–15 April 1994; pp. 532–539. [Google Scholar]
  10. Farrell, J.; Givargis, T. Differential GPS reference station algorithm-design and analysis. IEEE Trans. Control Syst. Technol. 2000, 8, 519–531. [Google Scholar] [CrossRef] [Green Version]
  11. Cannon, M.E. High-accuracy GPS semikinematic positioning: Modeling and results. J. Inst. Navig. 1990, 37, 53–64. [Google Scholar] [CrossRef]
  12. Jie, D.; Masters, J.; Barth, M. Lane-level positioning for in-vehicle navigation and automated vehicle location (AVL) systems. In Proceedings of the International IEEE Conference on Intelligent Transportation Systems, Washington, WA, USA, 3–6 October 2004; pp. 35–40. [Google Scholar]
  13. Meguro, J.-I.; Murata, T.; Takiguchi, J.-I.; Amano, Y.; Hashizume, T. GPS accuracy improvement by satellite selection using omnidirectional infrared camera. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice, France, 22–26 September 2008; pp. 1804–1810. [Google Scholar]
  14. Parra Alonso, I.; Fernandez Llorca, D.; Gavilan, M.; Alvarez Pardo, S.; Garcia-Garrido, M.A.; Vlacic, L.; Sotelo, M.A. Accurate global localization using visual odometry and digital maps on urban environments. IEEE Trans. Intell. Transp. Syst. 2012, 13, 1535–1545. [Google Scholar] [CrossRef]
  15. Redmill, K.A.; Kitajima, T.; Ozguner, U. DGPS/INS integrated positioning for control of automated vehicle. In Proceedings of the Intelligent Transportation Systems, Oakland, CA, USA, 25–29 August 2001; pp. 172–178. [Google Scholar]
  16. Farrell, J.A.; Givargis, T.D.; Barth, M.J. Real-time differential carrier phase GPS-aided INS. IEEE Trans. Control Syst. Technol. 2000, 8, 709–721. [Google Scholar] [CrossRef] [Green Version]
  17. Wang, J.; Garratt, M.; Lambert, A.; Wang, J.J.; Hana, S.; Sinclair, D. Integration of GPS/INS/vision sensors to navigate unmanned aerial vehicles. In Proceedings of the The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Beijing, China, 3–11 July 2008; pp. 963–970. [Google Scholar]
  18. Skog, I.; Handel, P. In-Car positioning and navigation technologies-A survey. IEEE Trans. Intell. Transp. Syst. 2009, 10, 4–21. [Google Scholar] [CrossRef]
  19. Wei-Wen, K. Integration of GPS and dead-reckoning navigation systems. In Proceedings of the Vehicle Navigation and Information Systems Conference, Troy, MI, USA, 20–23 Octorber 1991; pp. 635–643. [Google Scholar]
  20. Krakiwsky, E.J.; Harris, C.B.; Wong, R.V. A Kalman filter for integrating dead reckoning, map matching and GPS positioning. In Proceedings of the Position Location and Navigation Symposium, Orlando, FL, USA, 29 November–2 December 1988; pp. 39–46. [Google Scholar]
  21. Laftchiev, E.I.; Lagoa, C.M.; Brennan, S.N. Vehicle localization using in-vehicle pitch data and dynamical models. IEEE Trans. Intell. Transp. Syst. 2015, 16, 206–220. [Google Scholar] [CrossRef]
  22. Dean, A.; Martini, R.; Brennan, S. Terrain-based road vehicle localization using particle filters. Veh. Syst. Dyn. 2011, 49, 1209–1223. [Google Scholar] [CrossRef]
  23. Imine, H.; Delanne, Y.; M’Sirdi, N.K. Road profile input estimation in vehicle dynamics simulation. Veh. Syst. Dyn. 2006, 44, 285–303. [Google Scholar] [CrossRef]
  24. Doumiati, M.; Victorino, A.; Charara, A.; Lechner, D. Estimation of road profile for vehicle dynamics motion: Experimental validation. In Proceedings of the American Control Conference, San Francisco, CA, USA, 29 June–1 July 2011; pp. 5237–5242. [Google Scholar]
  25. Yu, W.; Zhang, X.; Guo, K.; Karimi, H.R.; Ma, F.; Zheng, F. Adaptive real-time estimation on road disturbances properties considering load variation via vehicle vertical dynamics. Math. Probl. Eng. 2013, 2013, 9. [Google Scholar] [CrossRef]
  26. Tudón-Martínez, J.C.; Fergani, S.; Sename, O.; Morales-Menendez, R.; Dugard, L. Online road profile estimation in automotive vehicles. In Proceedings of the European Control Conference, Strasbourg, France, 24–27 June 2014; pp. 2370–2375. [Google Scholar]
  27. Rath, J.J.; Veluvolu, K.C.; Defoort, M. Adaptive Super-Twisting observer for estimation of random road excitation profile in automotive suspension systems. Sci. World J. 2014, 2014, 1–8. [Google Scholar] [CrossRef] [PubMed]
  28. Rath, J.J.; Veluvolu, K.C.; Defoort, M. Estimation of road profile for suspension systems using adaptive super-twisting observer. In Proceedings of the European Control Conference, Strasbourg, France, 24–27 June 2014; pp. 1675–1680. [Google Scholar]
  29. Tudón-Martínez, J.C.; Fergani, S.; Sename, O.; Martinez, J.J.; Morales-Menendez, R.; Dugard, L. Adaptive road profile estimation in semiactive car suspensions. IEEE Trans. Control Syst. Technol. 2015, 23, 2293–2305. [Google Scholar] [CrossRef]
  30. Doumiati, M.; Martinez, J.; Sename, O.; Dugard, L.; Lechner, D. Road profile estimation using an adaptive Youla–Kučera parametric observer: Comparison to real profilers. Control Eng. Pract. 2017, 61, 270–278. [Google Scholar] [CrossRef] [Green Version]
  31. Chassande-Mottin, É.; Auger, F.; Flandrin, P. Reassignment. In Time-Frequency Analysis: Concepts and Methods; Hlawatsch, F., Auger, F., Eds.; ISTE/John Wiley and Sons: London, UK, 2010; pp. 249–277. ISBN 9781848210332. [Google Scholar]
  32. Zasadzinski, M.; Mehdi, D.; Darouach, M. Recursive state estimation for singular systems. In Proceedings of the American Control Conference, Boston, MA, USA, 26–28 June 1991; pp. 2850–2851. [Google Scholar]
  33. Darouach, M.; Zasadzinski, M.; Onana, A.B.; Nowakowski, S. Kalman filtering with unknown inputs via optimal state estimation of singular systems. Int. J. Syst. Sci. 1995, 26, 2015–2028. [Google Scholar] [CrossRef]
  34. Gillijns, S.; De Moor, B. Unbiased minimum-variance input and state estimation for linear discrete-time systems with direct feedthrough. Automatica 2007, 43, 934–937. [Google Scholar] [CrossRef]
  35. Kuutti, S.; Fallah, S.; Katsaros, K.; Dianati, M.; Mccullough, F.; Mouzakitis, A. A survey of the state-of-the-art localization techniques and their potentials for autonomous vehicle applications. IEEE Internet Things J. 2018, 5, 829–846. [Google Scholar] [CrossRef]
  36. Vivet, D.; Gérossier, F.; Checchin, P.; Trassoudaine, L.; Chapuis, R. Mobile Ground-Based Radar Sensor for Localization and Mapping: An Evaluation of two Approaches. Int. J. Adv. Robot. Syst. 2013, 10, 307–319. [Google Scholar] [CrossRef]
  37. Parra, I.; Sotelo, M.A.; Llorca, D.F.; Oca, M. Robust visual odometry for vehicle localization in urban environments. Robotica 2010, 28, 441–452. [Google Scholar] [CrossRef]
  38. Zhang, F.; Stähle, H.; Chen, G.; Simon, C.C.C.; Buckl, C.; Knoll, A. A sensor fusion approach for localization with cumulative error elimination. In Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Hamburg, Germany, 13–15 September 2012; pp. 1–6. [Google Scholar]
Figure 1. Concept of road profile estimation.
Figure 1. Concept of road profile estimation.
Sensors 18 03344 g001
Figure 2. Half car model for vertical dynamics.
Figure 2. Half car model for vertical dynamics.
Sensors 18 03344 g002
Figure 3. Damper model.
Figure 3. Damper model.
Sensors 18 03344 g003
Figure 4. Simulation environment.
Figure 4. Simulation environment.
Sensors 18 03344 g004
Figure 5. Estimated vertical displacement of front-tire contact patch.
Figure 5. Estimated vertical displacement of front-tire contact patch.
Sensors 18 03344 g005
Figure 6. Experimental test of longitudinal road profile estimation.
Figure 6. Experimental test of longitudinal road profile estimation.
Sensors 18 03344 g006
Figure 7. Road profile measurement device.
Figure 7. Road profile measurement device.
Sensors 18 03344 g007
Figure 8. Estimated longitudinal road profile.
Figure 8. Estimated longitudinal road profile.
Sensors 18 03344 g008
Figure 9. Spectrogram of the estimated road profile.
Figure 9. Spectrogram of the estimated road profile.
Sensors 18 03344 g009
Figure 10. Normalized gray-level correlation process.
Figure 10. Normalized gray-level correlation process.
Sensors 18 03344 g010
Figure 11. Test location for vehicle localization.
Figure 11. Test location for vehicle localization.
Sensors 18 03344 g011
Figure 12. Vehicle velocities for localization tests.
Figure 12. Vehicle velocities for localization tests.
Sensors 18 03344 g012
Figure 13. Measured signals from IMU sensor: (a) Pitch rate signals; (b) Vertical acceleration signals; (c) Longitudinal acceleration signals; (d) Location with respect to time.
Figure 13. Measured signals from IMU sensor: (a) Pitch rate signals; (b) Vertical acceleration signals; (c) Longitudinal acceleration signals; (d) Location with respect to time.
Sensors 18 03344 g013
Figure 14. Estimated longitudinal road profile.
Figure 14. Estimated longitudinal road profile.
Sensors 18 03344 g014
Figure 15. Spectrogram at 750–1000 m: (a) Full-sized sedan; (b) Compact-sized sedan.
Figure 15. Spectrogram at 750–1000 m: (a) Full-sized sedan; (b) Compact-sized sedan.
Sensors 18 03344 g015
Figure 16. Reference spectrogram (pre-indexed database).
Figure 16. Reference spectrogram (pre-indexed database).
Sensors 18 03344 g016
Figure 17. Spectrogram at three positions of test vehicles.
Figure 17. Spectrogram at three positions of test vehicles.
Sensors 18 03344 g017
Figure 18. Localization result: (a) Window size = 100 m; (b) Window size = 200 m; (c) Window size = 250 m; (d) Window size = 500 m.
Figure 18. Localization result: (a) Window size = 100 m; (b) Window size = 200 m; (c) Window size = 250 m; (d) Window size = 500 m.
Sensors 18 03344 g018
Figure 19. Estimation errors (window size = 500 m).
Figure 19. Estimation errors (window size = 500 m).
Sensors 18 03344 g019
Figure 20. Localization result without road profile estimation (window size = 250 m).
Figure 20. Localization result without road profile estimation (window size = 250 m).
Sensors 18 03344 g020

Share and Cite

MDPI and ACS Style

Gim, J.; Ahn, C. IMU-Based Virtual Road Profile Sensor for Vehicle Localization. Sensors 2018, 18, 3344. https://doi.org/10.3390/s18103344

AMA Style

Gim J, Ahn C. IMU-Based Virtual Road Profile Sensor for Vehicle Localization. Sensors. 2018; 18(10):3344. https://doi.org/10.3390/s18103344

Chicago/Turabian Style

Gim, Juhui, and Changsun Ahn. 2018. "IMU-Based Virtual Road Profile Sensor for Vehicle Localization" Sensors 18, no. 10: 3344. https://doi.org/10.3390/s18103344

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop