Next Article in Journal / Special Issue
Cardinality Balanced Multi-Target Multi-Bernoulli Filter with Error Compensation
Previous Article in Journal
A Simple BODIPY-Based Viscosity Probe for Imaging of Cellular Viscosity in Live Cells
Previous Article in Special Issue
A Matrix-Based Proactive Data Relay Algorithm for Large Distributed Sensor Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Sensor Fusion Method Based on an Integrated Neural Network and Kalman Filter for Vehicle Roll Angle Estimation

by
Leandro Vargas-Meléndez
1,
Beatriz L. Boada
1,*,†,
María Jesús L. Boada
1,†,
Antonio Gauchía
2,† and
Vicente Díaz
1,†
1
Mechanical Engineering Department, Universidad Carlos III de Madrid, Avda. de la Universidad 30, Madrid 28911, Spain
2
Mechanical Engineering-Engineering Mechanics Department, Michigan Tech University, 1400 Townsend Drive, Houghton 49931, Michigan, MI, USA
*
Author to whom correspondence should be addressed.
Sensors 2016, 16(9), 1400; https://doi.org/10.3390/s16091400
Submission received: 11 July 2016 / Revised: 16 August 2016 / Accepted: 22 August 2016 / Published: 31 August 2016
(This article belongs to the Special Issue Advances in Multi-Sensor Information Fusion: Theory and Applications)

Abstract

:
This article presents a novel estimator based on sensor fusion, which combines the Neural Network (NN) with a Kalman filter in order to estimate the vehicle roll angle. The NN estimates a “pseudo-roll angle” through variables that are easily measured from Inertial Measurement Unit (IMU) sensors. An IMU is a device that is commonly used for vehicle motion detection, and its cost has decreased during recent years. The pseudo-roll angle is introduced in the Kalman filter in order to filter noise and minimize the variance of the norm and maximum errors’ estimation. The NN has been trained for J-turn maneuvers, double lane change maneuvers and lane change maneuvers at different speeds and road friction coefficients. The proposed method takes into account the vehicle non-linearities, thus yielding good roll angle estimation. Finally, the proposed estimator has been compared with one that uses the suspension deflections to obtain the pseudo-roll angle. Experimental results show the effectiveness of the proposed NN and Kalman filter-based estimator.

1. Introduction

Recent developments in vehicle technology have steered the industry towards an increase in vehicle safety, and it is now considered to be one of the key features of a vehicle, even at the initial design stages. One of the main causes of traffic accidents in which heavy vehicles are involved is the loss of lateral stability. Heavy vehicles are prone to roll over since the ratio of the height of the center of gravity to the wheel track is high. The loss of lateral stability is caused when the tire-road contact force on one of the wheels becomes zero under lateral acceleration.
Nowadays, vehicles are equipped with control systems in order to improve their handling and stability. Systems, such as Roll Stability Control (RSC) and Electronic Stability Control (ESC), need to know in advance the expected vehicle behavior during different maneuvers in order to adequately actuate on the vehicle systems [1,2].
RSC systems are based on lateral load transfer, which is directly related to the vehicle roll angle [3]. Therefore, to improve the performance of these systems, an accurate measurement of the vehicle roll angle is needed [4]. The roll angle can be obtained from a dual-antenna GPS, but this is a very expensive technique. For this reason, roll angle has to be estimated [5,6,7]. There are mainly two techniques used for its estimation: integration of information from sensor measurements (sensor fusion) and the usage of a physical vehicle model [8]. Sensor fusion technologies are widely used; they operate by integrating low-cost sensors in many vehicle applications. In principle, the fusion of multisensor data provides significant advantages over single source data. The use of multiple types of sensors may increase the accuracy with which a quantity can be observed and characterized [9]. Doumiati et al. [10] proposed a method to estimate the roll angle using measurements from potentially integrable sensors, such as accelerometers and suspension deflection sensors. If the pitch dynamic effects on roll motion are neglected, the roll angle can be calculated as:
θ = Δ 11 - Δ 12 + Δ 21 - Δ 22 2 e f - m v a y m h k t
where Δ i j is the suspension deflection, a y m is the lateral acceleration, k t is the roll stiffness resulting from tire stiffness and m v is the vehicle weight. Nevertheless, suspension deflection sensors are expensive, so real-time measurement of the roll angle is typically not available for vehicles [11].
For this reason, different algorithms based on the fusion of other types of sensors are proposed. Low-cost GPS and onboard vehicle sensors are also employed [12,13]; however, satellite visibility might be poor in urban and forested driving environments, yielding inaccurate estimations [14].
Rajamani et al. [11] propose a dynamic observer that utilizes the information provided by only a lateral accelerometer and a gyroscope. Nevertheless, the estimation of roll angle has a significant error in transient response. In this algorithm, neither measurements noise nor model noise are considered. Other authors propose several sensor fusion techniques in combination with Kalman filters. A Kalman filter is frequently used for sensor fusion applications because it is an optimal estimator, is straightforward to implement and can be adapted to multiple sensor scenarios [15] and take into account the measurements and model noises. Common applications include vehicle localization [16], estimation of sideslip [17] and roll vehicle angle estimation [14,18].
In this paper, we propose a novel estimator based on a Neural Network (NN) combined with a Kalman filter in order to estimate the vehicle roll angle (see Figure 1). Previous work has combined AI-based techniques with a Kalman filter for estimation; however, in our case the IA-based algorithm is based on the improvement of filter performance through the adaptive estimation of the filter statistical information (covariance matrices) [19,20,21]. A difficulty is that uncertainty learning is a difficult and complex process. In this research, we not only estimate the filter statistical information, but also a “pseudo-parameter”, a pseudo-roll angle, which is introduced in the Kalman filter. The NN system estimates a pseudo-roll angle through variables that are easily measured by an IMU, a device that has recently become less expensive. The pseudo-roll angle is introduced in the Kalman filter in order to filter out noise and minimize the variance of the estimated norm and maximum errors.
The rest of the paper is organized as follows. In Section 2, a description of the estimator architecture is given. The estimator architecture is formed by two modules: the NN module and the Kalman module. The former estimates a pseudo-roll angle, and the latter filters the noise and minimizes the norm and maximum errors. Section 3 presents the estimator results, both with simulated and experimental scenarios. A discussion of these results is presented. Finally, Section 4 concludes this paper.

2. Vehicle Roll Angle Estimator Architecture

The architecture of the proposed estimator is given in Figure 1. The architecture is formed by two modules: the NN module and the Kalman module. The NN module estimates a pseudo-roll angle through data, such as the lateral accelerometer signal, a y m , the longitudinal accelerometer signal, a x m , the yaw rate sensor signal, ψ ˙ m , and the roll rate sensor signal, ϕ ˙ m . These signals are easily measured by an IMU, the cost of which has decreased in recent years. The pseudo-roll angle is fed into the Kalman module in order to filter noise and minimize the maximum and norm errors.
The proposed method has the advantage of taking into account the vehicle non-linearities, thus yielding a good roll angle estimation.

2.1. NN Module

The NN module uses artificial neural networks to estimate roll angle. The preliminary reconstruction of the roll angle from an NN-observer is used as a “pseudo-measurement” in the Kalman filter. The proposed model employs a Back-Propagation (BP) algorithm, which is one of the most widely-used methods for training a neural network. The architecture of the BP neural network is shown in Figure 2. The NN has a single hidden layer with 15 neurons, four inputs (the lateral accelerometer signal, a y m , the longitudinal accelerometer signal, a x m , the yaw rate sensor signal, ψ ˙ m , and the roll rate sensor signal, ϕ ˙ m ) and one output (the vehicle roll angle, ϕ ).
The network parameters, synaptic weights and bias, are adjusted with the error signal. The error signal, e, is defined as the difference between the desired response, ϕ d , and the estimated response of the network, ϕ N N . The learning process is maintained on an epoch-by-epoch (an epoch is one complete presentation of the entire training set during the training process) basis, until the synaptic weights and bias levels of the network stabilize and the average squared error over the entire training set converges to some minimum value [22].
The sequential mode of training is divided in into five stages. The first stage, called initialization, employs random and small values close to zero for the weights and biases in both the hidden and the output layer. In the second stage, the training patterns ( ( x ( 1 ) , d ( 1 ) ) , , ( x ( n ) , d ( n ) ) are presented to the NN. The vector x ( n ) = x 1 ( n ) , x 2 ( n ) , x 3 ( n ) , x 4 ( n ) represents the input vector, and d ( n ) represents the desired response, respectively, at iteration n. In the third stage, each hidden layer neuron calculates the sum of the weight inputs; it applies an activation function φ h j and sends their results to the output layer. The output of the j-th hidden layer neuron at iteration n is calculated as follows:
y j ( n ) = φ h j ( v j ( n ) )
where v j ( n ) is the weighted sum of the inputs of the network in the j-th hidden layer neuron:
v j ( n ) = i = 1 4 w j i ( n ) x i ( n ) + b j ( n )
where b j is the bias.
These signals are transmitted to the output layer. The output is calculated as follows:
ϕ N N ( n ) = φ o ( v ( n ) )
where v ( n ) is the weighted sum of the inputs of the hidden layer in the output layer neuron:
v ( n ) = i = 1 p w 1 i ( n ) y i ( n ) + c ( n )
where p is the total number of hidden layer neurons, c is the bias and φ o is the activation function in the output layer. Next, the error signal is calculated. When the average squared error achieves a stopping criterion, the training is completed. This third stage is referred to as the forward pass computation. It is worth highlighting that in the forward pass computation, the weights and bias remain unaltered throughout the network. If the stopping criterion is not reached, the network training will continue to the next stage called the backward pass computation. This stage begins at the output layer by passing the error signals leftward through the network layer-by-layer and recursively computing the local gradient for each neuron as:
δ j ( l ) ( n ) = e j ( L ) ( n ) δ j ( v j ( L ) ( n ) ) for neuron j in output layer L δ j ( v j ( L ) ( n ) ) k δ k ( l + 1 ) ( n ) w k j ( l + 1 ) ( n ) for neuron j in hidden layer l
where δ j ( · ) denotes differentiation with respect to the argument. The synaptic weights and biases of the network in layer l according to the generalized delta rule are adjusted as:
w j i ( l ) ( n + 1 ) = w j i ( l ) ( n ) + α w j i ( l ) ( n - 1 ) + η δ j ( l ) y i l - 1 ( n )
where η is the learning-rate parameter and α is the momentum constant.
The fifth stage is the iteration. This stage presents new epochs of training patterns to iterate the forward and backward computations until the stopping criterion is met.

Training Patterns

The selection of the training patterns is a crucial process. The training patterns must contain data of the vehicle representative maneuvers, so as to characterize non-linear vehicle behavior.
As is mentioned in the previous section, the training pattern is formed by the input vector ( x = a y m , a x m , ϕ ˙ m , ψ ˙ m ) and the output ( d = ϕ d ). Each of the training patterns has been obtained from an experimentally-validated TruckSim vehicle model (see Section 3.2).
The maneuvers that have been conducted are a Double Lane Change (DLC) and Lane Change (LC) maneuvers (from 30 to 140 km/h), as well as J-turn maneuvers (from 20 to 45 km/h). All maneuvers have been simulated considering road friction coefficients of 0.3, 0.5 and 1. For DLC and LC maneuvers with a road friction coefficient of 0 . 3 , the maximum speed had to be limited to 80 km/h. Higher speeds than 80 km/h caused the rollover of the vehicle. A summary of the training datasets is shown in Table 1.

2.2. Kalman Module

The Kalman module employs a discrete stochastic state-space form. The purpose of this module is to estimate the internal state of a linear dynamic system by means of a Kalman filter. The Kalman filter is a mathematical tool that is used for stochastic estimation from noisy sensor measurements. The real vehicle measurements include a substantial quantity of noise, as well as unobserved states in the system, which must be estimated. In this research, the unobserved state is the roll angle. The preliminary reconstruction of the roll angle obtained from the NN-based observer is used as a “pseudo-measurement” input to the Kalman filter. This previous calculation presents the advantage of considering the system non-linearities, thus providing good estimations, even though a linear vehicle model, represented as a state-space model, is used.

2.2.1. State-Space Vehicle Model

The dynamic vehicle model used in the Kalman filter algorithm is a linear model. When the vehicle model and measurement model equations are linear, the Kalman filter estimates the state vector recursively. An advantage of using linear systems is that they are easy to implement allowing the usage of the Kalman filter estimators in real time. For this reason, the dynamic model detailed in the estimation process is a 1-DOF vehicle model, which only represents vehicle roll motion. In Figure 3, the vehicle roll model is shown. The motion is described using a coordinate system (x, y, z) fixed in the vehicle. The vehicle roll angle, ϕ , is referenced from the vehicle’s vertical z-axis. It is assumed that the vehicle sprung mass rotates around the roll center of the vehicle. A detailed description of this model can be found in [10]. The differential equation obtained from the vehicle’s lateral dynamics can be written as:
I x x ϕ ¨ + C R ϕ ˙ + K R ϕ = m s a y h c r + m s h c r g sin ( ϕ )
where I x x is the moment of inertia of the sprung mass m s with respect to the roll axis, C R and K R denote respectively the total torsional damping and stiffness coefficients of the roll motion of the vehicle, h c r is the height of the sprung mass about the roll axis, g is the gravitational constant and a y is the lateral acceleration.
The lateral load transfer function can be obtained assuming that roll acceleration ϕ ¨ and velocity ϕ ˙ are equal to zero. The steady-state equation for lateral load transfer applied to the left-hand side of the vehicle is given by:
Δ F z l = - 2 k f e f + k r e r ϕ - 2 m s a y l l r h f e f + l f h r e r
where h f and h r are the heights of the front and rear roll centers, respectively; k f and k r are the front and rear roll stiffnesses, respectively; e f and e r are the front and rear vehicle tracks, respectively; and l f and l r are the distance from the COG (Center Of Gravity) to the front and rear axles, respectively. It must be noted that the lateral acceleration, a y , used in Equations (8) and (9), is an inertial acceleration generated at the COG. Since the IMU provides a measurement of the acceleration due to the vehicle’s motion ( a y m ) and due to gravitational acceleration ( g ) , the lateral acceleration ( a y ) can be computed as:
a y m = a y cos ( ϕ ) + g sin ( ϕ )
Assuming that the small roll angle approximation (i.e., sin ( ϕ ) ϕ and cos ( ϕ ) 1 ) is valid, the measured lateral acceleration, a y m , can be expressed as:
a y m = a y + g ϕ
In addition, assuming that the pitching and the bounding motion of sprung mass are neglected and the road bank angle is small, the vehicle roll rate can be expressed as:
ϕ ˙ ϕ ˙ m
The vehicle model is represented as a continuous time state-space system as follows:
x ˙ s = A x s + w y = H x s + v
where x s represents the state vector [ Δ F z l , a y , a ˙ y , ϕ , ϕ ˙ ] T ; A is the state evolution matrix; y is the measurement vector; [ a y m , ϕ , ϕ ˙ m , Δ F z l ] T ; H is the observation matrix; and w and v are the state disturbance and the observation noise vectors, respectively, that are assumed to be Gaussian, uncorrelated and zero mean:
w N ( 0 , Q ) v N ( 0 , R )
where Q and R are the covariance matrices describing the second-order properties of state and measurement noise:
Q = 1000 ( N ) 0 0 0 0 0 0.1 ( m / s - 2 ) 0 0 0 0 0 0.1 ( m / s - 3 ) 0 0 0 0 0 0.1 ( r a d ) 0 0 0 0 0 0.1 ( r a d / s - 2 )
R = 0.01 ( m / s - 2 ) 0 0 0 0 0.01 ( r a d ) 0 0 0 0 0.01 ( r a d / s - 2 ) 0 0 0 0 100 ( N )
R depends on sensor quality (the yaw and roll rates) and the lateral load transfer and pseudo-roll angle estimator quality. Q is often unknown and is tuned depending the developed model. Q and R are assumed time invariant and diagonal for simplicity reason.
According to the chosen state-space vector and measurements, the matrices A and H are defined as:
A = 0 0 - 2 m s l l r h f e f + l f h r e r 0 - 2 k f e f + k r e r 0 0 1 0 0 0 0 0 0 0 0 0 0 0 1 0 m s h c r I x x 0 m s g h c r - K R I x x - C R I x x H = 0 1 0 g 0 0 0 0 1 0 0 0 0 0 1 1 0 0 0 0
In order to operate with the sensor data, the discrete state-space system is obtained using the first order approximation of Euler x ˙ k - 1 = x k - x k - 1 T s , where T s is the sampling time. Therefore, the discrete system can be expressed as:
x s , k = A d x s , k - 1 + w k y k = H x s , k + v k
where x s , k = Δ F z l , k , a y , k , a ˙ y , k , ϕ , and the matrix A d can be expressed as:
A d = 1 0 - 2 T s m s l l r h f e f + l f h r e r 0 - 2 T s k f e f + k r e r 0 1 1 0 0 0 0 1 0 0 0 0 0 1 T s 0 T s m s h c r I x x 0 T s m s g h c r - K R I x x 1 + T s C R I x x

2.2.2. Kalman Filter Algorithm

In this work, a Linear Kalman Filter (LKF) algorithm was used to estimate the vehicle state. The LKF is summarized in the following recursive equations:
  • Time update
    • Prediction of state and covariance:
      x ¯ s , k | k - 1 = A d x ¯ s , k - 1 | k - 1
      P s , k | k - 1 = A d P s , k - 1 | k - 1 A d T + Q s
  • Measurement update:
    • Kalman gain:
      K s , k = P s , k | k - 1 H T [ H P s , k | k - 1 H T + R s ] - 1
    • State and covariance estimation:
      x ¯ s , k | k = x ¯ s , k | k - 1 + K s , k [ y m e a s u r e d - H x ¯ s , k | k - 1 ]
      P s , k | k = [ I - K s , k H ] P s , k | k - 1
The vector y m e a s u r e d = [ a y m , ϕ , ϕ ˙ , Δ F z l ] T contains sensor data, such as the lateral acceleration, a y m , and the roll rate, ϕ ˙ , and pseudo-measurements, such as the lateral load transfer, Δ F z l , calculated by Equation (9), and roll angle, ϕ . In order to prove the effectiveness of the proposed method, the pseudo-roll angle is computed in two different ways: (1) considering the suspension deflection, Equation (1); (2) considering the proposed NN estimator.

3. Results and Discussion

In this section, firstly, simulation results are presented to prove the effectiveness of the estimator proposed for different severe maneuvers and road conditions. Secondly, the proposed estimator is validated by means of experimental results using a real vehicle.

3.1. Experimental Vehicle Setup

The vehicle used for this research was a Mercedes Sprinter, as shown in Figure 4. The vehicle was equipped with a steering angle sensor MSW 250 Nm from Kistler, a Vbox 3i dual antenna data logger, an IMU and two GPS antennas from Racelogic. The IMU was mounted on the vehicle base, close to its COG. The two antennas were mounted at 90 ° to the true heading of the vehicle and on the roof, in order to accurately measure the roll angle. The roll angle value was used to validate the proposed estimator. Suspension deflection was experimentally measured by means of two linear potentiometers, Type SA-LP075 from 2D-Data, recording data from for the front suspension, and two sensors, Type LVDT MTN from Monitran, for the rear suspension.
The installed sensors provided measurements of the steering wheel, δ, the lateral acceleration, a y m , the longitudinal acceleration, a x , the vehicle longitudinal speed, V x , the yaw rate, ψ ˙ , the roll rate, ϕ ˙ , the roll angle, ϕ , the front left suspension deflection, Δ 11 , the front right suspension deflection, Δ 12 , the rear left suspension deflection, Δ 21 , and the rear right suspension deflection, Δ 22 .

3.2. Experimental Adjustment of Vehicle Model Parameters

The TruckSim simulation vehicle model was validated using experimental results from the real vehicle. TruckSim software [23] is a widely-used simulation software in the automotive industry that combines traditional and modern multi-body vehicle dynamics based on parametric modeling. One of the main advantages of using a simulated vehicle model is the ability to perform different types of vehicle maneuvers that attempt to avoid possible accidents under different road conditions. In addition, simulation models guarantee test reproducibility.
The schema for the vehicle model validation is shown in Figure 5. The lateral acceleration ( a y m , t ), the roll rate ( ϕ ˙ t ), the roll angle ( ϕ t ) and the yaw rate ( ψ ˙ t ) obtained from the simulated model were compared with experimental data. The model parameters were adjusted by trial and error according to the differences between the experimental and simulation data.
The performance of the vehicle model was proven in both the DLC and LC maneuvers with vehicle speeds of 50 and 70 km/h on dry pavement. Figure 6 shows the comparative results for the TruckSim simulation vehicle model using the experimental data obtained during a DLC maneuver for the real vehicle traveling at 70 km/h. The figure indicates excellent agreement between the simulation and the experimental results.
In addition to the graphical evidence of the effectiveness of the proposed simulation model, a quantitative analysis that took into consideration the error of the different maneuvers was computed. The following equation was used to represent the norm error as a function of time [24]:
E t = ε t σ t
where:
ε t = 0 T λ E x p - λ T r u c k s i m 2 σ t = 0 T λ E x p - μ E x p 2
where λ E x p and λ T r u c k s i m represent the measured and simulated lateral acceleration, yaw and roll rates and roll angle, respectively, and μ E x p is the mean value of the lateral acceleration, yaw rate and roll angle obtained from the real vehicle during time T.
For the DLC at 70 km/h (see Figure 6), the norm error of the lateral acceleration, the yaw and roll rates and the roll angle were 0.221, 0.210, 0.792 and 0.522, respectively. The norm and maximum errors are provided in Table 2 for DLC at 50 km/h and LC at 50 and 70 km/h. From the results, we can conclude that the created vehicle model accurately represents the real vehicle.
Table 3 shows the adjusted parameters for the state-space vehicle model.

3.3. Simulated Validation

To prove the effectiveness of the proposed roll angle estimator based on NN and the Kalman filter, two severe maneuvers, such as the sine sweep and slalom, were conducted. The former was performed at 50 and 70 km/h on a road surface with friction coefficients of 0.7 and 0.3, respectively. The latter was conducted at 35 km/h for the same friction coefficients. In order to analyze the effect of the sensor measurement’s noise on the estimation of the roll angle, Gaussian noises with zero mean and variances of 0.01 m/s 2 , 0.01 m/s 2 , 0.01 ° /s and 0.01 ° /s were added to a y m (lateral acceleration), a x (longitudinal acceleration), ϕ ˙ (roll rate) and ψ ˙ (yaw rate), respectively.
Figure 7 shows the comparative results of the Deflection + LKF-based observer (DEF + LKF) and NN + LKF-based observer for a slalom maneuver at 35 km/h with a friction coefficient of 0.3. Figure 8 shows the comparative results of the DEF + LKF-based observer and NN + LKF-based observer for a sine sweep maneuver at 70 km/h with a friction coefficient of 0.3. These figures demonstrate that the proposed observer based on NN yields a better behavior than the observer based on the suspension deflection.
The norm and maximum errors are provided in Table 4. The norm errors for the NN + LKF-based estimator are smaller than those from DEF + LKF-based estimator. The differences in maximum errors are higher in the cases for which the friction coefficient is 0.3. However, the maximum difference is 0.086 ° , which is negligible.
The proposed method provides better results in 100% of the analyzed simulated cases (four cases) for the norm error; whereas, a 50% success rate is obtained for the maximum error compared with the DEF + LKF method.

3.4. Experimental Validation

The performance of the proposed estimator was verified for a real vehicle traveling at different speeds on dry pavement under different maneuvers.
Figure 9 shows the results for DLC and LC maneuvers for a real vehicle traveling at 70 km/h. Table 5 shows the norm and maximum errors for DLC and LC at speeds of 50 and 70 km/h. In all cases, the norm error of the proposed estimator is smaller than the estimator based on suspension deflection. However, when the vehicle is traveling at 50 km/h, the maximum error of the NN + LKF-based observer is greater for both maneuvers. Nevertheless, the maximum difference is 0.2 ° , which is acceptable taking into account that the maximum measured roll angle at 50 km/h is about 2 ° . In order to prove the necessity of incorporating a LKF in the NN estimator, the results for a single NN estimator are also shown. In the majority of cases (three out of four cases), the NN + LKF-based estimator improves the roll angle estimation.
Additionally, the proposed estimator was evaluated when the vehicle is traveling at about 45 km/h under a slalom maneuver. The results are depicted in Figure 10. The norm and maximum errors of the NN + LKF estimator are 0.921 and 2.070 ° , respectively; whereas, the norm and maximum errors for the NN-based and DEF + LKF-based estimators are [1.040; 2.232 ° ] and [1.181; 2.081 ° ], respectively. In this case, the proposed estimator yields lower errors.
Finally, two tests were performed with a combination of different maneuvers, as depicted in Figure 11 and Figure 12. These figures show the real environment and the vehicle trajectory, the steering wheel angle profile, the longitudinal vehicle speed profile and the real and estimated roll angle.
The first test corresponds to a real vehicle traveling on dry pavement under a J-turn and slalom maneuvers and the second one to the same vehicle under a J-turn and DLC. Figure 11a shows a J-turn and slalom maneuvers, while Figure 12a depicts a J-turn and DLC maneuvers. Table 6 and Table 7 show the norm and maximum errors. The proposed NN + LKF-based estimator proves to be better than the suspension deflection and single NN estimators, for both the norm and maximum errors.
The proposed method provides better results in 100% of the analyzed experimental cases (10 cases) for the norm error; whereas, an 80% success rate is obtained for the maximum error compared with the DEF + LKF method. In the worst case, the maximum difference between the DEF + LKF and NN + LKF is 0.197 ° , which is negligible.

4. Conclusions

This article presents a novel estimator based on sensor fusion, which combines NN and LKF in order to estimate the vehicle roll angle. The proposed vehicle roll angle estimator architecture is formed by two modules: the NN module and the Kalman module. The NN module estimates a pseudo-roll angle through data, such as the lateral and longitudinal accelerations, the yaw and roll rates. The pseudo-roll angle is passed on to the Kalman module in order to filter noise and minimize the norm and maximum errors. The proposed NN + LKF-based estimator takes into account the vehicle motion nonlinearities. The main advantages of the proposed method are that only a single IMU is needed, and no additional suspension deflection sensors are required.
The NN + LKF-based estimator was validated with simulated and experimental results. The simulation analysis has proven the effectiveness of the proposed estimator in severe maneuvers with low and medium friction coefficients (0.3 and 0.7). In addition, experimental tests, such as, slalom, J-turn and DLC maneuvers, were conducted on dry pavement. For the overall analyzed tests, simulated and experimental ones, the proposed method yielded better results in 100% for the norm error compared with the DEF + LKF method; whereas, a 71% success rate was obtained for the maximum error, reaching an 80% success rate for experimental tests. In the worst case, the maximum difference between the DEF + LKF and NN + LKF is 0.197 ° , which is negligible.
Experimental results also show the necessity of including the LKF in the NN estimator in order to filter noise and, therefore, to improve the roll angle estimation.

Acknowledgments

This work was possible thanks to the funds provided by the Spanish Government through the CICYTProject TRA2013-48030-C2-1-R.

Author Contributions

Leandro Vargas-Meléndez, Beatriz L. Boada, María Jesús L. Boada, Antonio Gauchía and Vicente Díaz conceived and designed the simulations and the experiments; Leandro Vargas-Meléndez and Beatriz L. Boada performed the experiments; Leandro Vargas-Meléndez, Beatriz L. Boada, María Jesús L. Boada, Antonio Gauchía and Vicente Díaz analyzed the data; Leandro Vargas-Meléndez, Beatriz L. Boada and María Jesús L. Boada contributed with mathematical algorithms; and finally Leandro Vargas-Meléndez, Beatriz L. Boada, María Jesús L. Boada, Antonio Gauchía and Vicente Díaz wrote the paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Boada, M.J.L.; Boada, B.L.; Muñoz, A.; Díaz, V. Integrated control of front-wheel steering and front braking forces on the basis of fuzzy logic. J. Automob. Eng. 2006, 220, 253–267. [Google Scholar] [CrossRef]
  2. Hickman, J.S.; Guo, F.; Camden, M.C.; Hanowski, R.J.; Medina, A.; Mabry, J.E. Efficacy of roll stability control and lane departure warning systems using carrier-collected data. J. Saf. Res. 2015, 52, 59–63. [Google Scholar] [CrossRef] [PubMed]
  3. Boada, M.J.L.; Gauchía, A.; Calvo, J.A.; Díaz, V. Active roll control using reinforcement learning for a single unit heavy vehicle. Int. J. Heavy Veh. Syst. 2009, 16, 412–430. [Google Scholar] [CrossRef]
  4. Sampson, D.J.; Cebon, D. Active Roll Control of Single Unit Heavy Road Vehicles. Veh. Syst. Dyn. 2003, 40, 229–270. [Google Scholar] [CrossRef]
  5. Rajamani, R.; Piyabongkarn, D.; Tsourapas, V.; Lew, J. Real-time estimation of roll angle and CG height for active rollover prevention applications. In Proceedings of the 2009 American Control Conference, St. Louis, MO, USA, 10–12 June 2009.
  6. Tafner, R.; Reichhartinger, M.; Horn, M. Robust online roll dynamics identification of a vehicle using sliding mode concepts. Control Eng. Pract. 2014, 29, 235–246. [Google Scholar] [CrossRef]
  7. Tseng, H.E.; Xu, L.; Hrovat, D. Estimation of land vehicle roll and pitch angles. Veh. Syst. Dyn. 2007, 45, 433–443. [Google Scholar] [CrossRef]
  8. Ryu, J.; Rossetter, E.; Gerdes, J. Vehicle sideslip and roll parameter estimation using GPS. In Proceedings of the International Symposium on Advanced Vehicle Control (AVEC), Hiroshima, Japan, 9–13 September 2002.
  9. Hall, D.L.D.L.; Member, S.; Llinas, J. An introduction to multisensor data fusion. IEEE Proc. 1997, 85, 6–23. [Google Scholar]
  10. Doumiati, M.; Baffet, G.; Lechner, D.; Victorino, A.; Charara, A. Embedded Estimation of the Tire/Road Forces and Validation in a Laboratory Vehicle. In Proceedings of 9th International Symposium on Advanced Vehicle Control, Kobe, Japan, 6–9 October 2008.
  11. Rajamani, R.; Piyabongkarn, D.; Tsourapas, V.; Lew, J.Y. Parameter and State Estimation in Vehicle Roll Dynamics. IEEE Trans. Intell. Transp. Syst. 2011, 12, 1558–1567. [Google Scholar] [CrossRef]
  12. Jo, K.; Chu, K.; Sunwoo, M. Interacting multiple model filter-based sensor fusion of GPS with in-vehicle sensors for real-time vehicle positioning. IEEE Trans. Intell. Transp. Syst. 2012, 13, 329–343. [Google Scholar] [CrossRef]
  13. Bevly, D.M.; Ryu, J.; Gerdes, J.C. Integrating INS sensors with GPS measurements for continuous estimation of vehicle sideslip, roll, and tire cornering stiffness. IEEE Trans. Intell. Transp. Syst. 2006, 7, 483–493. [Google Scholar] [CrossRef]
  14. Nam, K.; Oh, S.; Fujimoto, H.; Hori, Y. Estimation of Sideslip and Roll Angles of Electric Vehicles Using Lateral Tire Force Sensors Through RLS and Kalman Filter Approaches. IEEE Trans. Ind. Electron. 2013, 60, 988–1000. [Google Scholar] [CrossRef]
  15. Chun, D.; Stol, K. Vehicle Motion Estimation using Low-Cost Optical Flow and Sensor Fusion 2012. In Proceedings of the 2012 19th International Conference on Mechatronics and Machine Vision in Practice (M2VIP), Auckland, New Zealand, 28–30 November 2012; pp. 28–30.
  16. Yoon, S.W.; Park, S.B.; Kim, J.S. Kalman Filter Sensor Fusion for Mecanum Wheeled Automated Guided Vehicle Localization. J. Sens. 2015, 2015, 1–7. [Google Scholar] [CrossRef]
  17. Boada, B.L.; Boada, M.J.L.; Diaz, V. Vehicle sideslip angle measurement based on sensor data fusion using an integrated ANFIS and an Unscented Kalman Filter algorithm. Mech. Syst. Signal Process. 2016, 72–73, 832–845. [Google Scholar] [CrossRef]
  18. Zhang, S.; Yu, S.; Liu, C.; Yuan, X.; Liu, S. A Dual-Linear Kalman Filter for Real-Time Orientation Determination System Using Low-Cost MEMS Sensors. Sensors 2016, 16. [Google Scholar] [CrossRef] [PubMed]
  19. Loebis, D.; Sutton, R.; Chudley, J.; Naeem, W. Adaptive tuning of a Kalman filter via fuzzy logic for an intelligent AUV navigation system. Control Eng. Pract. 2004, 12, 1531–1539. [Google Scholar] [CrossRef]
  20. Chatterjee, A. Differential evolution tuned fuzzy supervisor adapted extended Kalman filtering for SLAM problems in mobile robots. Robotica 2009, 27. [Google Scholar] [CrossRef]
  21. Korniyenko, O.V.; Sharawi, M.S.; Aloi, D.N. Neural network based approach for tuning Kalman filter. In Proceedings of the IEEE International Conference on Electro Information Technology, Lincoln, NE, USA, 22–25 May 2005.
  22. Simon, H. Neural Networks: A Comprehensive Foundation, 2nd ed.; Publisher: Prentice Hall PTR, Upper Saddle River, NJ, USA, 1999. [Google Scholar]
  23. TruckSim. Available online: https://www.carsim.com/products/trucksim/ (accessed on 27 July 2016).
  24. Boada, M.J.L.; Calvo, J.A.; Boada, B.L.; Díaz, V. Modeling of a magnetorheological damper by recursive lazy learning. Int. J. Non Linear Mech. 2011, 46, 479–485. [Google Scholar] [CrossRef]
Figure 1. Estimator architecture.
Figure 1. Estimator architecture.
Sensors 16 01400 g001
Figure 2. Neural network architecture.
Figure 2. Neural network architecture.
Sensors 16 01400 g002
Figure 3. Schematic of the vehicle roll motion.
Figure 3. Schematic of the vehicle roll motion.
Sensors 16 01400 g003
Figure 4. Experimental setup on a test vehicle. (1) Mercedes Sprinter. (2) Steering angle sensor MSW 250 Nm. (3) Vbox 3i dual antenna data logger. (4) GPS antennas. (5) LVDT MNT potentiometer. (6) SA-LP075 potentiometer.
Figure 4. Experimental setup on a test vehicle. (1) Mercedes Sprinter. (2) Steering angle sensor MSW 250 Nm. (3) Vbox 3i dual antenna data logger. (4) GPS antennas. (5) LVDT MNT potentiometer. (6) SA-LP075 potentiometer.
Sensors 16 01400 g004
Figure 5. Scheme of the vehicle model design.
Figure 5. Scheme of the vehicle model design.
Sensors 16 01400 g005
Figure 6. DLC maneuvers at 70 km/h for the experimental adjustment of vehicle model parameters (solid line: TruckSim; dashed line: measured): (a) lateral acceleration, (b) yaw rate, (c) roll rate and (d) roll angle.
Figure 6. DLC maneuvers at 70 km/h for the experimental adjustment of vehicle model parameters (solid line: TruckSim; dashed line: measured): (a) lateral acceleration, (b) yaw rate, (c) roll rate and (d) roll angle.
Sensors 16 01400 g006
Figure 7. Simulation results for a slalom maneuver at 35 km/h with a friction coefficient of 0.3 (red points: measured; blue points: Deflection (DEF) + Linear Kalman Filter (LKF); cyan points: NN + LKF).
Figure 7. Simulation results for a slalom maneuver at 35 km/h with a friction coefficient of 0.3 (red points: measured; blue points: Deflection (DEF) + Linear Kalman Filter (LKF); cyan points: NN + LKF).
Sensors 16 01400 g007
Figure 8. Simulation results for a sine sweep maneuver at 70 km/h with a friction coefficient of 0.3 (red points: measured; blue points: DEF + LKF; cyan points: NN + LKF).
Figure 8. Simulation results for a sine sweep maneuver at 70 km/h with a friction coefficient of 0.3 (red points: measured; blue points: DEF + LKF; cyan points: NN + LKF).
Sensors 16 01400 g008
Figure 9. Experimental results for a vehicle traveling at 70 km/h on dry pavement. (red points: measured; blue points: DEF + LKF; green points: NN; cyan points: NN + LKF): (a) DLC maneuver and (b) LC maneuver.
Figure 9. Experimental results for a vehicle traveling at 70 km/h on dry pavement. (red points: measured; blue points: DEF + LKF; green points: NN; cyan points: NN + LKF): (a) DLC maneuver and (b) LC maneuver.
Sensors 16 01400 g009
Figure 10. Experimental results for slalom maneuver (red points: measured; blue points: DEF + LKF; green points: NN; cyan points: NN + LKF).
Figure 10. Experimental results for slalom maneuver (red points: measured; blue points: DEF + LKF; green points: NN; cyan points: NN + LKF).
Sensors 16 01400 g010
Figure 11. Experimental results for J-turn and slalom maneuvers (red points: measured; blue points: DEF + LKF; green points: NN; cyan points: NN + LKF): (a) the real environment and the vehicle trajectory, (b) the steering wheel angle profile, (c) the longitudinal vehicle speed profile and (d) the real and estimated roll angle.
Figure 11. Experimental results for J-turn and slalom maneuvers (red points: measured; blue points: DEF + LKF; green points: NN; cyan points: NN + LKF): (a) the real environment and the vehicle trajectory, (b) the steering wheel angle profile, (c) the longitudinal vehicle speed profile and (d) the real and estimated roll angle.
Sensors 16 01400 g011
Figure 12. Experimental results for J-turn and DLC maneuvers (red points: measured; blue points: DEF + LKF; green points: NN; cyan points: NN + LKF): (a) the real environment and the vehicle trajectory, (b) the steering wheel angle profile, (c) the longitudinal vehicle speed profile and (d) the real and estimated roll angle.
Figure 12. Experimental results for J-turn and DLC maneuvers (red points: measured; blue points: DEF + LKF; green points: NN; cyan points: NN + LKF): (a) the real environment and the vehicle trajectory, (b) the steering wheel angle profile, (c) the longitudinal vehicle speed profile and (d) the real and estimated roll angle.
Sensors 16 01400 g012
Table 1. Training datasets for NN, DLC, Double Lane Change, LC, Lane Change.
Table 1. Training datasets for NN, DLC, Double Lane Change, LC, Lane Change.
Road Friction CoefficientsManeuversSpeeds (km/h)
0.5–1DLC30, 40, 50, 60, 70, 80, 90, 100, 110, 120, 130, 140
LC
0.3DLC30, 40, 50, 60, 70, 80
LC
0.3–0.5–1J-turn20, 25, 30, 35, 40, 45
Table 2. Norm and maximum errors for the DLC and LC maneuvers.
Table 2. Norm and maximum errors for the DLC and LC maneuvers.
DLC at 50 km/hDLC at 70 km/hLC at 50 km/hLC at 70 km/h
E t E max E t E max E t E max E t E max
a y m ( g s )0.1300.0800.2210.1380.1380.0350.4180.050
ψ ˙ ( ° / s )0.1141.7480.2102.7910.1091.3650.1760.827
ϕ ˙ ( ° / s )0.6964.0230.7928.2400.5873.3221.1345.115
ϕ ( ° )0.6782.2060.5222.0680.6210.6751.2790.273
Table 3. State-space vehicle model parameters, COG, Center Of Gravity.
Table 3. State-space vehicle model parameters, COG, Center Of Gravity.
SymbolDescriptionValueUnit
C R Total torsional damping of the suspension54,447.87Nms/rad
e f Front vehicle track1.638m
e r Rear vehicle track1.630m
h c r Height of the sprung mass about the roll axis0.980m
h f Height of the front roll center0.348m
h r Height of the rear roll center0.348m
I x x Roll inertia500kg·m 2
k f Front roll stiffness371,530.334Nm/rad
k r Rear roll stiffness371,530.334Nm/rad
K R Total torsional stiffness of the suspension743,060.669Nm/rad
l f Distance from front tire to COG1.51m
l r Distance from rear tire to COG2.04m
m s sprung mass1700kg
Table 4. Norm and maximum errors for roll angle estimators for sine sweep and slalom maneuvers.
Table 4. Norm and maximum errors for roll angle estimators for sine sweep and slalom maneuvers.
SLA-35-0.7SLA-35-0.3SS-50-0.7SS-70-0.3
E t E max E t E max E t E max E t E max
( - ) ( ° ) ( - ) ( ° ) ( - ) ( ° ) ( - ) ( ° )
DEF + LKF0.2210.1580.2500.2790.1220.3020.1290.295
NN + LKF (*)0.0930.1520.2300.3650.0780.2820.0990.349
(*) Proposed; SLA-35-0.7: Slalom at 35 km/h and friction coefficient 0.7; SLA-35-0.3: Slalom at 35 km/h and friction coefficient 0.3; SS-50-0.7: Sine sweep at 50 km/h and friction coefficient 0.7; SS-70-0.3: Sine sweep at 70 km/h and friction coefficient 0.3.
Table 5. Norm and maximum errors for roll angle estimators for the DLC and LC maneuvers.
Table 5. Norm and maximum errors for roll angle estimators for the DLC and LC maneuvers.
DLC at 50 km/hDLC at 70 km/hLC at 50 km/hLC at 70 km/h
E t E max E t E max E t E max E t E max
( - ) ( ° ) ( - ) ( ° ) ( - ) ( ° ) ( - ) ( ° )
DEF + LKF0.9121.5261.0382.7861.2060.9032.0870.477
NN0.8062.6020.6921.6200.7260.9630.8490.962
NN + LKF (*)0.5471.7230.4461.8410.4780.9610.9640.276
(*) Proposed.
Table 6. Norm and maximum errors for roll angle estimators for J-turn and slalom maneuvers.
Table 6. Norm and maximum errors for roll angle estimators for J-turn and slalom maneuvers.
Total SectorJ-Turn SectorSlalom Sector
E t E max E t E max E t E max
( - ) ( ° ) ( - ) ( ° ) ( - ) ( ° )
NN0.7572.0711.1741.7991.0261.664
DEF + LKF1.0812.4951.5712.2201.0731.980
NN + LKF0.6551.6890.9691.6890.8791.591
Table 7. Norm and maximum errors for roll angle estimators for J-turn and DLC maneuvers.
Table 7. Norm and maximum errors for roll angle estimators for J-turn and DLC maneuvers.
Total SectorJ-Turn SectorDLC Sector
E t E max E t E max E t E max
( - ) ( ° ) ( - ) ( ° ) ( - ) ( ° )
NN1.3473.6801.5471.5720.8362.811
DEF + LKF1.6874.1961.6462.6631.4613.752
NN + LKF1.3232.3071.4401.5010.7532.093

Share and Cite

MDPI and ACS Style

Vargas-Meléndez, L.; Boada, B.L.; Boada, M.J.L.; Gauchía, A.; Díaz, V. A Sensor Fusion Method Based on an Integrated Neural Network and Kalman Filter for Vehicle Roll Angle Estimation. Sensors 2016, 16, 1400. https://doi.org/10.3390/s16091400

AMA Style

Vargas-Meléndez L, Boada BL, Boada MJL, Gauchía A, Díaz V. A Sensor Fusion Method Based on an Integrated Neural Network and Kalman Filter for Vehicle Roll Angle Estimation. Sensors. 2016; 16(9):1400. https://doi.org/10.3390/s16091400

Chicago/Turabian Style

Vargas-Meléndez, Leandro, Beatriz L. Boada, María Jesús L. Boada, Antonio Gauchía, and Vicente Díaz. 2016. "A Sensor Fusion Method Based on an Integrated Neural Network and Kalman Filter for Vehicle Roll Angle Estimation" Sensors 16, no. 9: 1400. https://doi.org/10.3390/s16091400

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop