Next Article in Journal
Novel Image Processing Method for Detecting Strep Throat (Streptococcal Pharyngitis) Using Smartphone
Next Article in Special Issue
Real-Time Photometric Calibrated Monocular Direct Visual SLAM
Previous Article in Journal
Asymmetry Analysis of the Resonance Curve in Resonant Integrated Optical Gyroscopes
Previous Article in Special Issue
Vehicle Driver Monitoring through the Statistical Process Control
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Sensor Fault Detection and Signal Restoration in Intelligent Vehicles

Korea Railroad Research Institute, 176, Cheoldobangmulgwan-ro, Uiwang, Gyeonggi-do 16105, Korea
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(15), 3306; https://doi.org/10.3390/s19153306
Submission received: 5 June 2019 / Revised: 23 July 2019 / Accepted: 24 July 2019 / Published: 27 July 2019
(This article belongs to the Special Issue Intelligent Vehicles)

Abstract

:
This paper presents fault diagnosis logic and signal restoration algorithms for vehicle motion sensors. Because various sensors are equipped to realize automatic operation of the vehicle, defects in these sensors lead to severe safety issues. Therefore, an effective and reliable fault detection and recovery system should be developed. The primary idea of the proposed fault detection system is the conversion of measured wheel speeds into vehicle central axis information and the selection of a reference central axis speed based on this information. Thus, the obtained results are employed to estimate the speed for all wheel sides, which are compared with measured values to identify fault and recover the fault signal. For fault diagnosis logic, a conditional expression is derived with only two variables to distinguish between normal and fault; further, an analytical redundancy structure and a simple diagnostic logic structure are presented. Finally, an off-line test is conducted using test vehicle information to validate the proposed method; it demonstrates that the proposed fault detection and signal restoration algorithm can satisfy the control performance required for each sensor failure.

1. Introduction

The desire for convenient and safe passenger transportation has increased the need for automated and intelligent automobiles. Consequently, the function of autonomous navigation has been introduced for passenger safety and convenience, and various in-vehicle devices such as ultrasonic sensors, radars, cameras, and actuators have been installed to detect the surrounding environment, recognize information, and control the motions of the vehicle. In addition, speed sensors, steering angle sensors, gyroscopes, and acceleration sensors can be installed to measure the vehicle operation state and movement and to use the gathered information for control. If faults occur in these sensors or actuators during automatic running, the vehicle may deflect from its route or fail to conduct the precise operation required for control, which may lead to an accident. To prevent accidents caused by these faults, technologies applying the soft computing method in fault detection (FDI) and fault tolerant control (FTC) of vehicles are garnering attention in academia and industry. In conjunction with these developments, various ideas and techniques for FDI/FTC methods, including neural network and fuzzy approaches, are presented [1,2,3]. To this end, the main purpose is to prevent or mitigate deterioration of the control performance of the system caused by a failure. In the field of fault diagnosis, various studies have been conducted to compensate or detect the fault sensor information by combining it with information of various sensors [4,5,6]. In a system in which a vehicle is driven by an electric motor, a frequency domain analysis technique may be applied in the fault diagnosis of the electric motor, whereas a frequency component analysis usually deals with the diagnosis of physical faults in rotating machinery [7].
Although studies on fault detection are particularly important for the aircraft sector [8,9,10,11,12,13], as even minor aircraft faults can lead to serious accidents, the increasing interest in autonomous vehicles has inspired numerous investigations of fault detection in the automotive sector [14,15,16,17,18,19,20,21,22,23]. Na et al. [24] applied residual sensitivity as a threshold for predicting the occurrence of vehicle sensor failure, while Emirler et al. [25] employed a virtual sensor featuring a velocity-scheduled Kalman filter to characterize vehicle kinematics and estimate the yaw rate. Huang and Su [26] devised a model-based fault detection and isolation scheme considering disturbance and noise to diagnose single sensor faults in intelligent navigation systems, while analytical redundancy and nonlinear transformation were also used to generate residual values used to detect embedded sensors in intelligent vehicles [27].
In these fault-related studies, when a fault is detected, the fault signal has been largely recovered using either direct or analytical redundancy [28]. In practical environments, analytical redundancy methods are studied and used because of the low cost or installation space required. This analytical fault detection method can be divided into a data-based method and signal model, a model-based method, and knowledge-based method [13]. The data-based method and signal model are applied to compare and analyze the characteristics of data [29]. The model-based method is based on the mathematical model of the target system [30]. Knowledge-based methods are implemented using expert systems or fuzzy logic [31]. Among these methods, the model-based method that is acknowledged in this paper is classified into parity equations [32,33], parameter estimation methods [34], and observer-based methods [35,36]. In addition, this study focuses on fault detection and signal restoration for sensors detecting vehicle motion (e.g., speed, steering angle, and rotational angular velocity sensors), assuming that only one sensor can fail at a given instant, such that the sensor fault detection and restoration algorithm can be applied. In this regard, real-time fault diagnosis and signal estimation of major sensors have been extensively researched [37,38,39,40,41,42,43,44,45,46]; major methods and research trends for fault detection have been introduced and investigated by Miljkovic [47]. When attempting to diagnose the case where several sensors are mounted on a vehicle, residuals are generated for the diagnosis from each sensor and threshold is applied to each diagnosis; here, the number of thresholds is equal to the number of sensors to be diagnosed [18,24,26]. Therefore, each of the corresponding threshold values must be carefully set for the appropriate fault diagnosis of each sensor; otherwise, the result may affect the fault identification of other sensors. In the proposed method, it is possible to identify six sensor faults with only two threshold values and conditional expressions. As a result, the possibility of diagnostic error due to the threshold setting can be considerably reduced.
To prepare for unexpected sensor failure, this study develops a method for signal duplication using the analytical redundancy method based on the information provided by sensors installed in the vehicle and a mathematical vehicle model. Moreover, the analytical redundancy method is employed to realize fault detection and signal restoration.
It is difficult to apply existing research results to other vehicles because existing study have a complex logic structure with different types and numbers of sensors applied to the target vehicle. In addition, existing studies have difficulty in practical application because they have a multi-variable structure in which the judgment logic of failure is complex. These results do not demonstrate the effect of the actual running on the failure of each sensor. Furthermore, their research results do not demonstrate the effectiveness of their performance by applying a restored signal for each fault.
This study aims to detect main sensor faults in real time to guarantee occupants’ safety in a vehicle automatically following a designated route without a driver. A vehicle model-based fault detection and signal restoration method is proposed, and the information provided by the failed sensor is restored to create a time margin in which the vehicle control system can conduct normal safety control procedures. To judge the fault of each vehicle sensor, one first needs to identify a suitable comparison standard. Therefore, the velocity and direction components in the central vehicle axis are defined as the central information on vehicle motion. In the absence of abnormalities in each sensor, the central axis speeds estimated by each vehicle sensor should have the same value. Moreover, if the center speed is correct, it can be used to estimate individual wheel speeds, and the calculated values should match actual wheel speeds if each sensor is normal. A kinematic model is designed to convert the speed of each wheel into the central axis speed. In this process, relationships for estimating the central axis speed using a steering angle or a gyroscope are defined, and fault classification conditions obtained by applying these are derived.
To validate the proposed method, defects are simulated independently for each normal sensor signal. The signal of the normal sensor is compared with the restored signal, and the resulting error is presented. Additionally, it is confirmed that when the fault signal is restored and applied to the position estimation of the autonomous vehicle, the results of path tracking error are within the valid range.
In summary, the contribution of this study is as follows:
  • By conducting studies on fault diagnosis and restoration based on the major motion sensors that are installed in most vehicles, the possibility that this study can be used in several vehicles has increased.
  • A vehicle kinematic model based on the central axis of the vehicle, which is used to detect faults and restore fault signals using a structure in which the failure of each sensor does not affect each other, is proposed.
  • In the logic for fault detection, finally, a simple diagnostic logic structure is presented; this structure helps discriminate between normal and fault and distinguishes a specific fault using a conditional expression of only two variables.

2. Fault Detection and Recovery

2.1. Configuration of the Autonomous Vehicle

The target vehicle has four speed sensors, one steering angle sensor, and one gyroscope for vehicle control (Figure 1) [48]. It is assumed that two or more sensors are not defective at the same time, i.e., only one fault is assumed to occur at any moment.

2.2. Influence of Sensor Fault

The sensor mounted on the vehicle strongly influences the safety of automatic operation. First, the vehicle controller determines the vehicle position during driving in automatic mode and controls the speed and steering angle to reach the destination based on the fusion of various sensors. The positional information of the vehicle is important for driving control and can be estimated by fusing landmark information, GPS information, and vehicle motion sensor information. The vehicle control system selects a certain point in the vehicle and controls the speed and position of this point to match the desired reference. For example, when the central axis of rear wheels is used as the control reference point in a straight-running vehicle, the calculated speed becomes half of the actual speed if the simple average of the left and right rear wheel speeds is used and one of the corresponding sensors fails. Moreover, when this information is used for position estimation, the calculated position deviates from the actual position. If the gyroscope fails in a curved path, and the information provided by this device is used for position estimation, the vehicle running direction is not calculated correctly, and the resulting position error causes a deviation in route guidance control. Finally, depending on the failure situation, a fault of the steering angle sensor may cause a path-following error or deviation from the traveling path.

2.3. Architecture of Fault Detection

The main idea behind sensor fault detection and signal restoration process is the conversion of the speed of each wheel to the central axis speed of the vehicle. If all sensors are normal, all calculated central axis speeds should be identical, whereas different values should be obtained in the case when any sensor fails. Thus, this difference can be used as a sensor fault indicator. Moreover, once a fault is found, the speed of each wheel can be estimated from the center axis speed determined as normal, and the faulty signal is recovered by replacing the speed of the defective wheel with the estimated speed. In this case, steering angle information is used to convert the speed of each wheel to the central axis speed. If there is an error in the steering angle sensor, the calculated value is also erroneous, which highlights the importance of knowing whether the steering angle sensor is normal or not. Therefore, two methods are used to calculate the central axis speed. Specifically, the input variables are divided into the cases of steering angle usage and usage of gyroscope-provided information on rotational angular speed. This strategy allows one to detect speed sensor, steering angle sensor, and gyroscope faults and to restore the affected signals even if either the steering angle sensor or the gyro sensor is abnormal. The employed procedure is illustrated in Figure 2.

2.4. Vehicle Geometry for Kinematic Estimation

Figure 3 depicts the situation in which the central axis of the vehicle moves around the center of rotation (o) to define the kinematic motion of the vehicle and associated parameters.
In the above figure, β is the side slip angle, δf is the front wheel steering angle, δfl is the front left wheel steering angle, δfr is the front right wheel steering angle, lf is the distance from the front axle to the vehicle central axis, lr is distance from the rear axle to the central axis, lx is the distance from the front axle to the rear axle, ly is front or rear axle width, lb is the half-width of ly, νc is the speed at the central axis, ω is the yaw rate, R is the instant radius at central axis, νfl, νfr, νrl, and νrr are speeds of the front left, the front right, the rear left, and the rear right wheels, respectively.

2.5. Virtual Redundancy of Sensors and Errors

Formulas to convert the vehicle wheel speed to the central axis speed are proposed. The velocity and direction of the central axis are obtained based on the steering angle or gyroscope information.

2.5.1. Central Axis Speed Estimation Based on Steering Angle

When the steering angle information and gyroscope information are fused together in the fault detection formula, it becomes difficult to distinguish between each of the corresponding faults. Therefore, to differentiate the steering angle fault from the gyroscope fault, the vehicle central axis speed is calculated from the wheel speed, the steering angle, and vehicle parameters excluding the gyroscope information. First, the side slip angle and curvature are obtained from Equations (1) and (2), respectively, using the front wheel steering angle and vehicle parameters.
β = tan 1 ( l r tan ( δ f ) l f + l r ) ,
C = 1 R = cos ( β ) tan ( δ f ) l f + l r .
The central axis speed can be obtained from Equation (3) to Equation (6) using individual wheel speeds and Equations (1) and (2).
v c , f l = v f l ( cos ( β ) cos ( δ f ) ) 2 + l b 2 C 2 2 l b C cos ( β ) ,
v c , f r = v f r ( cos ( β ) cos ( δ f ) ) 2 + l b 2 C 2 + 2 l b C cos ( β ) ,
v c , r l = v r l ( cos ( β ) ) 2 + l b 2 C 2 2 l b C cos ( β ) ,
v c , r r = v r r ( cos ( β ) ) 2 + l b 2 C 2 + 2 l b C cos ( β ) ,
where C is the curvature at the central axis, and νc,ij is the central axis speed calculated based on individual vehicle wheel data. In a straight section, the speed of each wheel is the same, whereas in a curved section, the speed inside the curvature radius is lower than that on the outside, as shown in Figure 4.
The central axis speed satisfies the condition of Equation (7) when all wheel speed and steering angle sensors are normal and hence afford almost identical speed values, as shown in Figure 5. In practice, small differences may occur depending on road conditions and vehicle characteristics, as indicated by the maximum error in Figure 5. Here, maximum error refers to the maximum value of Equation (9). In the vehicle test under normal conditions, the maximum error was measured to be within 0.1 m/s.
v c , f l = v c , f r = v c , r l = v c , r r .
Therefore, if the central axis speed error exceeds a predetermined threshold value, the sensor or another part are considered to be abnormal, i.e., such an error may be indicative of an abnormal pressure difference between wheel tires, wheel slippage, wheel encoder abnormality, steering angle error, or communication abnormality.
The steering angle information is included in Equation (1) to Equation (6), i.e., if the steering angle information is defective, all calculated central axis speeds may be erroneous. Therefore, if the steering angle information is assumed to be normal and there is a defect in the speed sensor information, the following procedure is followed to select two judged-to-be-normal speeds from the four calculated central axis speeds. The two most closely matched central axis speeds are selected using Equations (8) and (9).
( v c i , min , v c j , min ) = min ( E v ) , i { f l , f r , r l } , j { f r , r l , r r } , i j ,
with
E v = [ e v 12 e v 13 e v 14 e v 23 e v 24 e v 34 ] , e v 12 = | v c , f l v c , f r | ,   e v 13 = | v c , f l v c , r l | ,   e v 14 = | v c , f l v c , r r | , e v 23 = | v c , f r v c , r l | , e v 24 = | v c , f r v c , r r | , e v 34 = | v c , r l v c , r r | .
The selected two central axis speeds are averaged (Equation (10)) as
v c r = ( v c i , min + v c j , min ) / 2 .
Next, the obtained average is used to estimate the speed of each wheel (Equation (11) to Equation (14)):
v ^ f l s = v c r ( cos ( β ) cos ( δ f ) ) 2 + l b 2 C 2 2 l b C cos ( β ) ,
v ^ f r s = v c r ( cos ( β ) cos ( δ f ) ) 2 + l b 2 C 2 + 2 l b C cos ( β ) ,
v ^ r l s = v c r ( cos ( β ) ) 2 + l b 2 C 2 2 l b C cos ( β ) ,
v ^ r r s = v c r ( cos ( β ) ) 2 + l b 2 C 2 + 2 l b C cos ( β ) .
The thus obtained estimated speed of each wheel should match the measured speed of the wheel if there is no fault in each sensor. For the purpose of fault detection, the error between the estimated and the measured wheel speed is calculated as in Equation (16), and the largest among these errors (defined as in Equation (15)) is used as a condition variable value for detecting sensor defects.
a s max = max ( E v s ) ,
with
E v s = [ e v f l e v f r e v r l e v r r ] , e v f l = | v ^ f l s v f l | e v f r = | v ^ f r s v f r | e v r l = | v ^ r l s v r l | e v r r = | v ^ r r s v r r |

2.5.2. Central Axis Speed Estimation Using the Gyroscope

To distinguish between steering angle and gyro faults, gyro information is used instead of steering angle information in the calculation of the central axis speed. For this purpose, the steering angle is estimated from the gyroscope information, wheel speed, and vehicle parameters, and the central steering angle is estimated using Equation (17) to Equation (20).
δ ^ f 1 = cot 1 ( cot ( δ ^ f l 1 ) + l b l x ) ,   w i t h   δ ^ f l 1 = sin 1 ( ω l x v f l ) ,
δ ^ f 2 = cot 1 ( cot ( δ ^ f r 1 ) l b l x ) ,   w i t h   δ ^ f r 1 = sin 1 ( ω l x v f r ) ,
δ ^ f 3 = cot 1 ( cot ( δ ^ f l 2 ) + l b l x ) ,   w i t h   δ ^ f l 2 = tan 1 ( ω l x v r l ) ,
δ ^ f 4 = cot 1 ( cot ( δ ^ f r 2 ) l b l x ) ,   w i t h   δ ^ f r 2 = tan 1 ( ω l x v r r ) ,
where ω is the rotational angular velocity measured by the gyroscope. The estimated front-center steering angles should be equal to each other as shown in Equation (21) if there are no faults in the speed sensor and gyroscope.
δ ^ f 1 = δ ^ f 2 = δ ^ f 3 = δ ^ f 4 = δ f .
If the gyroscope is fault-free, a fault of the speed sensor should result in a difference between some estimated steering values. Therefore, to select the steering angle with the smallest error due to the defect, two estimated steering angles with the smallest error among the estimated steering angles ( δ ^ f 1 ,   δ ^ f 2 ,   δ ^ f 3 ,   δ ^ f 4 ) are determined using Equations (22) and (23).
( δ ^ f i , min , δ ^ f j , min ) = min ( E δ k ) , i { 1 , 2 , 3 } , j { 2 , 3 , 4 } , i j , i j ,
with
E δ k = [ e δ 12 e δ 13 e δ 14 e δ 23 e δ 24 e δ 34 ] , e δ 12 = | δ ^ f 1 δ ^ f 2 | , e δ 13 = | δ ^ f 1 δ ^ f 3 | , e δ 14 = | δ ^ f 1 δ ^ f 4 | e δ 23 = | δ ^ f 2 δ ^ f 3 | , e δ 24 = | δ ^ f 2 δ ^ f 4 | , e δ 34 = | δ ^ f 3 δ ^ f 4 |
The selected estimated steering angles are averaged (Equation (24)), and the obtained value is used as the estimated front wheel steering angle.
δ ^ f = ( δ ^ f i , min + δ ^ f j , min ) / 2 .
If the front steering angle is estimated using the gyroscope information, a process identical to that used for central axis speed estimation, as described in the previous section, is applied. The speed at each vehicle center is calculated using the speed of each wheel and the estimated steering angle. Next, the side slip angle and curvature are obtained as in Equations (25) and (26), respectively, using the estimated steering angle and vehicle parameters.
β = tan 1 ( l r tan ( δ ^ f ) l f + l r ) ,
C = 1 R = cos ( β ) tan ( δ ^ f ) l f + l r .
The central axis speed can be obtained using Equation (27) to Equation (30) by considering individual wheel speeds, Equations (25) and (26).
v c , f l = v f l ( cos ( β ) cos ( δ ^ f ) ) 2 + l b 2 C 2 2 l b C cos ( β ) ,
v c , f r = v f r ( cos ( β ) cos ( δ ^ f ) ) 2 + l b 2 C 2 + 2 l b C cos ( β ) ,
v c , r l = v r l ( cos ( β ) ) 2 + l b 2 C 2 2 l b C cos ( β ) ,
v c , r r = v r r ( cos ( β ) ) 2 + l b 2 C 2 + 2 l b C cos ( β ) .
If each wheel speed and the gyroscope are normal, the calculated central axis speeds should be equal to each other as shown in Equation (31) (Figure 6).
v c , f l = v c , f r = v c , r l = v c , r r .
As in the previous case, two speeds with the smallest error selected based on the error between the central axis speed of the two combinations are averaged (Equation (32)).
v c g = ( v c i , min + v c j , min ) / 2 .
The thus obtained value is used to estimate the speed of each wheel using Equation (33) to Equation (36).
v ^ f l g = v c g ( cos ( β ) cos ( δ ^ f ) ) 2 + l b 2 C 2 2 l b C cos ( β ) ,
v ^ f r g = v c g ( cos ( β ) cos ( δ ^ f ) ) 2 + l b 2 C 2 + 2 l b C cos ( β ) ,
v ^ r l g = v c g ( cos ( β ) ) 2 + l b 2 C 2 2 l b C cos ( β ) ,
v ^ r r g = v c g ( cos ( β ) ) 2 + l b 2 C 2 + 2 l b C cos ( β ) .
The thus estimated speeds of each wheel should match the measured values if there is no defect in each sensor. For the purpose of fault detection, the error between each estimated wheel speed and the measured wheel speed is obtained as in Equation (38), and the largest among these errors (defined as in Equation (37)) is used as a condition variable value for detecting sensor faults.
a g max = max ( E v g ) ,
with
E v g = [ e v f l e v f r e v r l e v r r ] , e v f l = | v ^ f l g v f l | e v f r = | v ^ f r g v f r | e v r l = | v ^ r l g v r l | e v r r = | v ^ r r g v r r | .

2.6. Fault Detection, Identification, and Signal Recovery

To identify sensor faults, Equations (15) and (37), which describe the calculation of maximum estimated speed and the measured speed error, are used for judgment. The maximum values of each error (asmax, agmax) and the corresponding limit values (aslimit, aglimit) are used to determine whether the sensor is faulty.

2.6.1. Fault-Free Sensor Judgment Condition

If the maximum error (asmax, agmax) between the estimated speed and the measured speed is small, all sensors applied to the relational expression can be viewed as not defective. The maximum allowable error limit (aslimit, aglimit), which is the defect judgment boundary, is determined based on the observed results under the condition that all sensors are normal. Herein, limit values of aslimit = aglimit = 0.025 were selected for the running test of the test vehicle. Therefore, if the maximum error (asmax, agmax) is smaller than the above values, all sensors are normal, and if not, a fault is concluded to be present. This condition is expressed in Equation (39).
i f ( a s max a s limit ) ( a g max a g limit ) T R U E : N o r m a l e l s e F A L S E : O t h e r f a u l t e n d

2.6.2. Fault Detection and Signal Restoration for Steering Angle Information

If the maximum value (agmax) of the error calculated using gyroscope information is smaller than the limit value (aglimit), the gyroscope and speed sensor are both viewed as normal. If the maximum value (asmax) of the error calculated using steering angle information is larger than the limit value (aslimit), the steering angle sensor is viewed as defective, as there is no defect of the speed sensor under the preceding condition. This condition is expressed in Equation (40).
i f ( a s max a s limit ) ( a g max a g limit ) T R U E : S t e e r i n g s e n s o r f a u l t e n d
If a steering angle fault is identified according to the condition of Equation (40), the measured steering angle sensor information is replaced with the estimated steering angle information calculated using Equation (24).

2.6.3. Gyroscope Fault Detection and Signal Restoration

If the maximum value (asmax) of the error calculated using steering angle information is smaller than the limit value (aslimit), both the steering angle sensor and the speed sensor are viewed as normal. In this case, if the maximum value (agmax) of the error calculated using the gyroscope information is larger than the limit value (aglimit), one can judge that only the gyroscope is defective, as it follows from the above that the speed sensor is not defective.
i f ( a s max a s limit ) ( a g max a g limit ) T R U E : G y r o s c o p e f a u l t e n d
If a gyroscope fault is identified according to the condition of Equation (41), rotational angular velocity is estimated from Equation (42) by applying Equations (13) and (14), which describe the estimation of rear wheel speeds based on steering angle information.
ω ^ = v ^ r r s v ^ r l s 2 l b .

2.6.4. Fault Detection of the Speed Sensor and Signal Restoration

Under the condition that the gyroscope and the steering angle sensor do not fail simultaneously, the speed sensor is viewed as defective if (i) the maximum value (asmax) of the error calculated based on steering angle information is greater than the limit value (aslimit), and (ii) the maximum value (agmax) of the error calculated based on the gyroscope information is greater than the limit value (aglimit) [the error of the speed sensor affects both sides]. In this case, when the speed error is larger than the limit value, fault identification of each speed sensor can be performed as follows.
i f ( a s max a s limit ) ( a g max a g limit ) T R U E : S p e e d e n c o d e r f a u l t i f ( e v f l a s limit )    T R U E : F r o n t l e f t s p e e d e n c o d e r f a u l t e n d i f ( e v f r a s limit )    T R U E : F r o n t r i g h t s p e e d e n c o d e r f a u l t e n d i f ( e v r l a s limit )    T R U E : R e a r l e f t s p e e d e n c o d e r f a u l t e n d i f ( e v r r a s limit )    T R U E : R e a r r i g h t s p e e d e n c o d e r f a u l t e n d e n d
If a speed sensor fault is identified according to the condition of Equation (43), the value provided by the defective sensor is replaced with the value estimated using Equation (11) to Equation (14).

3. Results and Discussion

To verify the validity of the proposed algorithm, we performed an off-line test using the sensor data collected from the test vehicle [48]. The vehicle was set up to run in loop guided 235-m test tracks in automatic path guided mode, and sensor information was collected during driving. The vehicle control system collected the signal of magnetic markers embedded in the road and combined it with vehicle motion sensor information to determine real-time vehicle location/orientation and perform automatic guidance control. Faults, failures, and malfunctions observed during driving (e.g., those of the speed sensor, the steering angle sensor, and the rotational angular velocity sensor) may result in erroneous normal position estimation, guidance control errors, or deviation from the suggested path. The results of the off-line test showed how each sensor fault affects vehicle control. In addition, the validity of the proposed method was verified by identifying the defective sensor and replacing the corresponding signal with the estimated value to show whether one can maintain the normal traveling orbit within the effective error range.

3.1. Speed Sensor Fault Test

One of the four wheels simulated the fault of one rear right wheel speed sensor from 20 to 80 s. A zero was injected during this time instead of the normal signal to simulate a failure. Therefore, the actual speed was known. The faulted signal, the normal signal, and the signal estimated using Equation (13) are shown in Figure 7, which compares the estimated signal and the normal signal to show that the sensor signal can be well estimated even if it changes to zero because of failure simulation, i.e., the normal signal is well restored by the estimator. In this case, the error between the normal value and the estimated value was within 0.05 m/s. For simulated faults, the rear right wheel speed signal decreased to 70% of value of the normal signal during the same time interval. Figure 8 compares the estimated signal with the normal signal for the case in which the measured signal decreased from normal to 70% when tire pressure loss or puncture was assumed.

3.2. Steering Angle Sensor Fault

Only the case where the steering sensor is faulty was considered, and the fault was chosen to occur between 20 and 80 s. During this period, the steering angle information was changed to zero, and the signal was estimated using the proposed algorithm and compared with the normal sensor signal (Figure 9). Because of the fault, the steering angle sensor value was fixed at a constant value for the same time period. The estimated steering angle information was found to be in good agreement with the normal steering angle information (Figure 10).

3.3. Gyroscope Fault

Only the case where the gyroscope is faulty was considered, and the fault was chosen to occur between 20 and 80 s. During this period, the signal was estimated using the proposed algorithm and compared with the normal sensor signal. Notably, the proposed method allowed for good recovery of the normal signal. Figure 11 shows the result of estimation based on Equation (42). We also tested the scenario of a fault when the signal decreased to 50% of the normal signal over the same time interval. In this case, good signal estimation results were also observed (Figure 12).

3.4. Influence of Defects in Automatic Running

This test aimed to check the effect of sensor faults on automatic running and to determine whether the proposed fault detection and signal restoration method is valid. In the case of a running vehicle, the sensor was configured so that only one fault occurs at the same time.

3.4.1. Fault-Free Driving

The estimated position and tracking control state of the vehicle were checked in the case where all sensors were normal, and the observed performance was compared to that in the case of sensor fault. Figure 13 shows the driving trajectory of a vehicle that automatically ran the designed path with that of the fault-free vehicle.

3.4.2. Effect of Rear Left-Wheel Speed Sensor Defect during Automatic Driving

The case when only the rear left wheel speed sensor of the vehicle is defective was considered. When the average of the left- and right wheel speed is used as the center speed, the calculated travel distance is half of the actual travel distance when one of the speed sensors fails during vehicle operation, which results in erroneous position calculation and deviation from the traveling path (Figure 14). As shown in Figure 14, when the speed sensor error occurred before the curve was entered, the vehicle trajectory gradually deviated toward the inside of the reference path.

3.4.3. Effect of Gyroscope Defect during Automatic Driving

When a gyroscope fault occurs during vehicle operation, an error is generated in the calculation of the running direction, which increases the error in the calculation of vehicle position. As a result, the vehicle deviates from the traveling path. As shown in Figure 15, the vehicle was not able to follow the travel route because the state of the rotational angular velocity sensor was “zero” before the curve was entered, and a straight line trajectory was generated.
Figure 16 shows path-following errors of the vehicle under the fault condition of each sensor. The upper and lower thick solid lines in this figure are the maximum allowable travel error boundaries on normal driving, equaling 15 cm on the straight line portion and increasing along the curved portion. Until 40 s before entering the curved section, the vehicle followed the trajectory with an error within 15 cm, but after 40 s, it deviated from the set error margin according to the fault of each sensor.
Figure 17 shows the travel path follow-up error for fault signal restoration under each fault condition. Fault detection and signal restoration were performed 40 s after each sensor fault to afford a running result within the allowable limit error for the normal running of the vehicle. Consequently, the effectiveness of fault detection and the recovery method was successfully verified.

4. Conclusions

In this paper, fault diagnosis logic and signal restoration algorithms for vehicle motion sensors are presented. To this end, a central axis kinematic model is applied to each wheel speed of the vehicle. Both steering angle and gyroscope information are considered to distinguish failure effects. For fault diagnosis logic, we derive a conditional expression with only two variables to distinguish between normal and fault, and an analytical redundancy structure and a simple diagnostic logic structure are presented to distinguish specific faults. This study further assumes that only one sensor can fail at any given instant, which may limit the current scope of application of the proposed fault diagnosis scheme.
To verify the validity of this method, vehicle sensor data are collected under normal driving conditions, and the algorithm used in the actual vehicle is applied to estimate the vehicle position and orientation in an off-line test. The risk of automatic driving according to each failure is examined through the addition of faults to normal sensor information. It is shown that the autonomous vehicle can satisfy the valid normal driving conditions when the proposed fault detection and signal restoration method is applied under fault conditions. To improve vehicle safety, the authors plan to investigate diagnostic methods for multiple sensor faults.

Author Contributions

Conceptualization, Y.B.; Methodology, Y.B.; Software, Y.B.; Validation, Y.B., B.K. and R.J.; Writing—Original Draft Preparation, Y.B.; Writing—Review and Editing, B.K.; Supervision, R.J.

Funding

Financial support for this research was provided by a grant from the R&D Program of the Korea Railroad Research Institute (KRRI) of the Republic of Korea.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Karimi, H.; Chadli, M.; Shi, P. Fault detection, isolation, and tolerant control of vehicles using soft computing methods. IET Control Theory Appl. 2014, 8, 655–657. [Google Scholar] [CrossRef]
  2. Aouaouda, S.; Chadli, M.; Boukhnifer, M. Speed sensor fault tolerant controller design for induction motor drive in EV. Neurocomputing 2016, 214, 32–43. [Google Scholar] [CrossRef]
  3. Oudghiri, M.; Chadli, M.; El Hajjaji, A. Robust observer-based fault tolerant control for vehicle lateral dynamics. IJVD 2008, 48, 173–189. [Google Scholar] [CrossRef]
  4. Realpe, M.; Vintimilla, B.; Vlacic, L. Sensor fault detection and diagnosis for autonomous vehicles. Proc. MATEC Web Conf. 2015, 30, 04003. [Google Scholar] [CrossRef]
  5. Abid, A.; Tahir-khan, M.; De-silva, C.W. Fault detection in mobile robots using sensor fusion. In Proceedings of the 10th ICCSE, Cambridge, UK, 22–24 July 2015; pp. 8–13. [Google Scholar]
  6. Agogino, A.; Alag, S.; Goebel, K. A framework for intelligent sensor validation, sensor fusion, and supervisory control of automated vehicles in IVHS, Intelligent Transportation: Serving the User through Deployment. In Proceedings of the 1995 Annual Meeting of ITS America, Washington, DC, USA, 15–17 March 1995; pp. 77–87. [Google Scholar]
  7. Nembhard, A.D.; Sinha, J.K.; Yunusa-Kaltungo, A. Development of a generic rotating machinery fault diagnosis approach insensitive to machine speed and support type. JSV 2015, 337, 321–341. [Google Scholar] [CrossRef]
  8. Napolitano, M.; An, Y.; Seanor, B.; Pispistos, S.; Martinelli, D. Application of a neural sensor validation scheme to actual Boeing B737 flight data. In Proceedings of the ’99 AIAA Guidance, Navigation and Control Conference, Portland, OR, USA, 9–11 August 1999. [Google Scholar]
  9. Napolitano, M.; An, Y.; Seanor, B. A fault tolerant flight control system for sensor and actuator failures using neural networks. Aircr. Des. 2000, 3, 103–128. [Google Scholar] [CrossRef]
  10. Napolitano, M.; Windon, D.; Casanova, J.; Innocenti, M.; Silvestri, G. Kalman filters and neural-network schemes for sensor validation in flight control systems. IEEE Trans. Control Syst. Technol. 1998, 6, 596–611. [Google Scholar] [CrossRef]
  11. Rago, C.; Prasanth, R.; Mehra, R.K.; Fortenbaugh, R. Failure Detection and Identification and Fault Tolerant Control Using the IMMKF with Applications to the Eagle-Eye UAV. In Proceedings of the 37th Conference on Decision and Control, Tampa, FL, USA, 18 December 1998. [Google Scholar]
  12. Heredia, G.; Remuß, V.; Ollero, A.; Mahtani, R.; Musial, M. Actuator Fault Detection in Autonomous Helicopters. In Proceedings of the 5th IFAC/EURON Symposium on Intelligent Autonomous Vehicles, Lisbon, Portugal, 5–7 July 2004. [Google Scholar]
  13. Heredia, G.; Ollero, A.; Mahtani, R.; Béjar, M.; Remuss, V.; Musial, M. Detection of Sensor Faults in Autonomous Helicopters. In Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, Spain, 18–22 April 2005; pp. 2229–2234. [Google Scholar]
  14. Garg, V. Fault Detection in Nonlinear Systems: An Application to Automated Highway Systems. Ph.D. Thesis, University of California, Berkeley, CA, USA, July 1995. [Google Scholar]
  15. Agogino, A.; Chao, S.; Goebel, K.; Alag, S.; Cammon, B.; Wang, J. Intelligent Diagnosis Based on Validated and Fused Data for Reliability and Safety Enhancement of Automated Vehicles in an IVHS; PATH Research Report UCB-ITS-P RR-98-17; University of California: Berkeley, CA, USA, 1998. [Google Scholar]
  16. Isermann, R. Diagnosis methods for electronic controlled vehicles. Veh. Syst. Dyn. 2001, 36, 77–117. [Google Scholar] [CrossRef]
  17. Yi, J.; Howell, A.; Horowitz, R.; Hedrick, K.; Alvarez, L. Fault Detection and Handling for Longitudinal Control; California PATH Research Report UCB-ITS-P RR-2001-21; University of California: Berkeley, CA, USA, 2001. [Google Scholar]
  18. Rajamani, R.; Howell, A.S.; Chen, C.; Hedrick, J.K.; Tomizuka, M. A complete fault diagnostic system for automated vehicles operating in a platoon. IEEE Trans. Control Syst. Technol. 2001, 9, 553–564. [Google Scholar] [CrossRef]
  19. Howell, A. Nonlinear Observer Design and Fault Diagnostics for Automated Longitudinal Vehicle Control. Ph.D. Thesis, University of California, Berkeley, CA, USA, July 2002. [Google Scholar]
  20. Chen, R.H.; Ng, H.K.; Speyer, J.L.; Mingori, D.L. Testing and Evaluation of Robust Fault Detection and Identification for a Fault Tolerant Automated Highway System; UC Berkeley, California Partners for Advanced Transportation Technology: Berkeley, CA, USA, 2002; Available online: https://escholarship.org/uc/item/2bw4f9fw (accessed on 25 July 2019).
  21. Okatan, A.; Hajiyev, C.; Hajiyeva, U. Fault detection in sensor information fusion Kalman filter. AEU Int. J. Electron. Commun. 2009, 63, 762–768. [Google Scholar] [CrossRef]
  22. Rodger, J.A. Toward reducing failure risk in an integrated vehicle health maintenance system: A fuzzy multi-sensor data fusion Kalman filter approach for IVHMS. Expert Syst. Appl. 2012, 39, 9821–9836. [Google Scholar] [CrossRef]
  23. Arogeti, S.A.; Wang, D.; Low, C.B.; Yu, M. Fault detection isolation and estimation in a vehicle steering system. IEEE Trans. Ind. Electron. 2012, 59, 4810–4820. [Google Scholar] [CrossRef]
  24. Na, W.; Park, C.; Lee, S.; Yu, S.; Lee, H. Sensitivity-based fault detection and isolation algorithm for road vehicle chassis sensors. Sensors 2018, 18, 2720. [Google Scholar] [CrossRef] [PubMed]
  25. Emirler, M.T.; Kahraman, K.; Sentürk, M.; Güvenç, B.A.; Güvenç, L.; Efendioglu, B. Vehicle yaw rate estimation using a virtual sensor. Int. J. Veh. Technol. 2013, 2013, 582691. [Google Scholar] [CrossRef]
  26. Huang, W.; Su, X. Design of a fault detection and isolation system for intelligent vehicle navigation system. IJNO 2015, 2015, 279086. [Google Scholar] [CrossRef]
  27. Pous, N.; Gingras, D.; Gruyer, D. Intelligent vehicle embedded sensors fault detection and isolation using analytical redundancy and nonlinear transformations. J. Control Sci. Eng. 2017, 2017, 1763934. [Google Scholar] [CrossRef]
  28. Aldridge, H.A. Robot position sensor fault tolerance. Ph.D. Thesis, Carnegie Mellon University, Pennsylvania, PA, USA, June 1996. [Google Scholar]
  29. Klancar, G. Fault detection and isolation by means of principal component analysis. In Proceedings of the Cybernetics & Informatics Eurodays Workshop, Prague, Czech Republic, 26–30 September 2000; pp. 26–30. [Google Scholar]
  30. Isermann, R. Model-based fault-detection and diagnosis status and applications. Annu. Rev. Control. 2005, 29, 71–85. [Google Scholar] [CrossRef]
  31. Duan, F.; Wang, H.; Zhang, L. Study on fault-tolerant filter algorithm for integrated navigation system. In Proceedings of the 2007 International Conference on Mechatronics and Automation, Harbin, China, 5–8 August 2007; pp. 2419–2423. [Google Scholar]
  32. Chan, C.W.; Hua, S.; Hong, Y.Z. Application of fully decoupled parity equation in fault detection and identification of DC motors. IEEE Trans. Ind. Electron. 2006, 53, 1277–1284. [Google Scholar] [CrossRef]
  33. Muenchhof, M. Comparison of change detection methods for a residual of a hydraulic servo-axis. FAC Proc. Vol. 2005, 38, 317–322. [Google Scholar] [CrossRef]
  34. Escobet, T.; Trave-Massuyes, L. Parameter estimation methods for fault detection and isolation. Bridge Workshop Notes 2001, 40, 1–11. [Google Scholar]
  35. Hilbert, M.; Kuch, C.M.; Nienhaus, K. Observer based condition monitoring of the generator temperature integrated in the wind turbine controller. In EWEA 2013 Scientific Proceedings; EWEA: Vienna, Austria, 2013; pp. 189–193. [Google Scholar]
  36. Heredia, G.; Ollero, A. Sensor fault detection in small autonomous helicopters using observer/Kalman filter identification. In Proceedings of the 2009 IEEE International Conference on Mechatronics, Malaga, Spain, 14–17 April 2009; pp. 1–6. [Google Scholar]
  37. Garcia, E.A.; Frank, P.M. Deterministic nonlinear observer-based approaches to fault diagnosis: A survey. Control Eng. Pract. 1997, 5, 663–670. [Google Scholar] [CrossRef]
  38. Patton, R.J.; Chen, J. Observer-based fault detection and isolation: Robustness and applications. Control Eng. Pract. 1997, 5, 671–682. [Google Scholar] [CrossRef]
  39. Zhou, D.H.; Frank, P.M. Fault diagnostics and fault tolerant control. IEEE Trans. Aerosp. Electron. Syst. 1998, 34, 420–427. [Google Scholar] [CrossRef]
  40. Frank, P.M. Fault diagnosis in dynamic systems using analytical and knowledge-based redundancy. A survey and some new results. Automatica 1990, 26, 459–474. [Google Scholar] [CrossRef]
  41. Jayaram, S. A new fast converging Kalman filter for sensor fault detection and isolation. Sens. Rev. 2010, 30, 219–224. [Google Scholar] [CrossRef]
  42. Hwang, I.; Kim, S.; Kim, Y.; Seah, C.E. A survey of fault detection, isolation, and reconfiguration methods. IEEE Trans. Control Syst. Technol. 2010, 18, 636–653. [Google Scholar] [CrossRef]
  43. Gertler, J. Fault detection and isolation using parity relations. Control Eng. Pract. 1997, 5, 653–661. [Google Scholar] [CrossRef]
  44. Isermann, R. Process fault detection based on modelling and estimation methods-a survey. Automatica 1984, 20, 387–404. [Google Scholar] [CrossRef]
  45. Patton, R.J.; Uppal, F.J.; Lopez-Toribio, C.J. Soft Computing Approaches to Fault Diagnosis for Dynamic Systems: A Survey. In Proceedings of the 4th IFAC Symposium on Fault Detection Supervision and Safety for Technical Processes, Budapest, Hungary, 14–16 June 2000; pp. 298–311. [Google Scholar]
  46. Isermann, R.; Ballé, P. Trends in the application of model based fault detection and diagnosis of technical processes. Control Eng. Pract. 1997, 5, 709–719. [Google Scholar] [CrossRef]
  47. Miljkovic, D. Fault Detection Methods: A Literature Survey. In Proceedings of the 34th International Convention on Information and Communication Technology Electronics and Microelectronics, Opatija, Croatia, 23–27 May 2011; pp. 750–755. [Google Scholar]
  48. Byun, Y.S.; Jeong, R.G.; Kang, S.W. Vehicle position estimation based on magnetic markers: Enhanced accuracy by compensation of time delays. Sensors 2015, 15, 28807–28825. [Google Scholar] [CrossRef]
Figure 1. Vehicle sensor configuration.
Figure 1. Vehicle sensor configuration.
Sensors 19 03306 g001
Figure 2. Diagnostic sequence flowchart.
Figure 2. Diagnostic sequence flowchart.
Sensors 19 03306 g002
Figure 3. Vehicle geometry for kinematic estimation.
Figure 3. Vehicle geometry for kinematic estimation.
Sensors 19 03306 g003
Figure 4. Speeds of the four wheels as functions of time.
Figure 4. Speeds of the four wheels as functions of time.
Sensors 19 03306 g004
Figure 5. Central axis speeds as functions of time.
Figure 5. Central axis speeds as functions of time.
Sensors 19 03306 g005
Figure 6. Time-dependent central axis speeds.
Figure 6. Time-dependent central axis speeds.
Sensors 19 03306 g006
Figure 7. Type 1: Rear left wheel speed sensor fault and estimation.
Figure 7. Type 1: Rear left wheel speed sensor fault and estimation.
Sensors 19 03306 g007
Figure 8. Type 2: Rear right wheel speed sensor fault and estimation.
Figure 8. Type 2: Rear right wheel speed sensor fault and estimation.
Sensors 19 03306 g008
Figure 9. Type 1: Front steering angle sensor fault and estimation.
Figure 9. Type 1: Front steering angle sensor fault and estimation.
Sensors 19 03306 g009
Figure 10. Type 2: Front steering angle sensor fault and estimation.
Figure 10. Type 2: Front steering angle sensor fault and estimation.
Sensors 19 03306 g010
Figure 11. Type 1: Gyroscope fault and estimation.
Figure 11. Type 1: Gyroscope fault and estimation.
Sensors 19 03306 g011
Figure 12. Type 2: Gyroscope fault and estimation.
Figure 12. Type 2: Gyroscope fault and estimation.
Sensors 19 03306 g012
Figure 13. Normal automatic path tracking.
Figure 13. Normal automatic path tracking.
Sensors 19 03306 g013
Figure 14. Test result for a wheel speed sensor fault.
Figure 14. Test result for a wheel speed sensor fault.
Sensors 19 03306 g014
Figure 15. Test result for a gyroscope fault.
Figure 15. Test result for a gyroscope fault.
Sensors 19 03306 g015
Figure 16. Path tracking errors for each sensor fault.
Figure 16. Path tracking errors for each sensor fault.
Sensors 19 03306 g016
Figure 17. Path tracking errors for each sensor fault recovery.
Figure 17. Path tracking errors for each sensor fault recovery.
Sensors 19 03306 g017

Share and Cite

MDPI and ACS Style

Byun, Y.-S.; Kim, B.-H.; Jeong, R.-G. Sensor Fault Detection and Signal Restoration in Intelligent Vehicles. Sensors 2019, 19, 3306. https://doi.org/10.3390/s19153306

AMA Style

Byun Y-S, Kim B-H, Jeong R-G. Sensor Fault Detection and Signal Restoration in Intelligent Vehicles. Sensors. 2019; 19(15):3306. https://doi.org/10.3390/s19153306

Chicago/Turabian Style

Byun, Yeun-Sub, Baek-Hyun Kim, and Rag-Gyo Jeong. 2019. "Sensor Fault Detection and Signal Restoration in Intelligent Vehicles" Sensors 19, no. 15: 3306. https://doi.org/10.3390/s19153306

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop