Next Article in Journal
Evaluation of a New Simplified Inertial Sensor Method against Electrogoniometer for Measuring Wrist Motion in Occupational Studies
Previous Article in Journal
Experimental Investigation of Vibration Analysis on Implant Stability for a Novel Implant Design
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Machine Learning Approach for an Improved Inertial Navigation System Solution

Electrical Engineering Branch, Military Technical College, Kobry El-Kobba, Cairo 11766, Egypt
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(4), 1687; https://doi.org/10.3390/s22041687
Submission received: 21 December 2021 / Revised: 31 January 2022 / Accepted: 16 February 2022 / Published: 21 February 2022
(This article belongs to the Section Navigation and Positioning)

Abstract

:
The inertial navigation system (INS) is a basic component to obtain a continuous navigation solution in various applications. The INS suffers from a growing error over time. In particular, its navigation solution depends mainly on the quality and grade of the inertial measurement unit (IMU), which provides the INS with both accelerations and angular rates. However, low-cost small micro-electro-mechanical systems (MEMSs) suffer from huge error sources such as bias, the scale factor, scale factor instability, and highly non-linear noise. Therefore, MEMS-IMU measurements lead to drifts in the solutions when used as a control input to the INS. Accordingly, several approaches have been introduced to model and mitigate the errors associated with the IMU. In this paper, a machine-learning-based adaptive neuro-fuzzy inference system (ML-based-ANFIS) is proposed to leverage the performance of low-grade IMUs in two phases. The first phase was training 50% of the low-grade IMU measurements with a high-end IMU to generate a suitable error model. The second phase involved testing the developed model on the remaining low-grade IMU measurements. A real road trajectory was used to evaluate the performance of the proposed algorithm. The results showed the effectiveness of utilizing the proposed ML-ANFIS algorithm to remove the errors and improve the INS solution compared to the traditional one. An improvement of 70% in the 2D positioning and of 92% in the 2D velocity of the INS solution were attained when the proposed algorithm was applied compared to the traditional INS solution.

1. Introduction

With the advantages of being a self-contained system and providing an uninterrupted navigation solution, the inertial navigation system (INS) has become an essential component to obtain a robust navigation solution in several fields such as aircraft applications, autonomous navigation, and vehicle dynamic control [1]. Despite the advantage of the INS having a high short-term accuracy, it suffers from the drift accumulation of the biases over time. The accuracy of the INS’s navigation solution and the ability to reduce the errors accumulated over time depend on the type of inertial measurement unit (IMU) [2,3]. Recently, the utilization of micro-electro-mechanical systems (MEMSs) has been introduced for inertial sensor systems with the advantages of low cost, small size, and low power consumption [4]. On the other hand, the disadvantage of the high error accumulation rate of MEMSs has raised the challenge of modeling these errors to improve the accuracy of the navigation solution [5].
The difficulty of modeling these errors is due to the existence of non-linear errors. These errors cannot be modeled by the traditional techniques such as the Kalman filter (KF), the extended KF (EKF), the unscented Kalman filter (UKF), or even the particle filter (PF) [3,6,7]. Accordingly, there is a great need to find an alternative to traditional methods that does not have the difficulty and complexity of error modeling. Therefore, researchers have taken advantage of the availability of a large amount of data extracted from the INS and added machine learning (ML) techniques to the navigation algorithms [6,8,9,10].
ML techniques are utilized as estimators/predictors or classifiers of the navigation parameters. These techniques are utilized to smooth the choice of the sensors as an alternative to the KF in a plug-and-play manner [6,8]. This leads to the selection of the integration process and the raw measurements. Consequently, training the ML model helps produce a robust predictive model for the INS errors during GNSS outages. In addition, it can be used to improve visual positioning, mitigating the non-line-of-sight (NLOS) effects such as the multipath effect, spoofing, and jamming [11].
There is growing interest in utilizing ML techniques to improve the INS navigation solution. An approach utilizing an artificial neural network (ANN) to overcome the limitations of the KF to bridge the GPS outages during the GPS/INS integration process was introduced in [12,13,14,15]. The proposed methodology was accomplished in two phases. In the first phase, the ANN was trained to predict the INS position error and remove it from the corresponding INS position without having the initial position of the INS. Furthermore, the work in [16,17] utilized the ANN and ANFIS after the GPS/INS integration to enhance the INS navigation solution. In contrast, the work in [18] introduced a non-linear autoregressive neural network with external inputs (NARX) combined with the UKF to enhance the position and velocity accuracy of the INS/GNSS integration. Furthermore, the work in [3] proposed a fast orthogonal search (FOS) model to reduce and compensate the unmodeled residual non-linear errors of a mag/radar/RISS/GPS integration system to improve the navigation solution during GPS outages. The work in [19] utilized the FOS model as a GPS swept anti-jamming technique to discriminate between the authentic GPS signal and the interference from the chirp frequency jammer. In [20], two approaches were introduced to overcome the drift during GNSS outages using parallel cascaded mechanization for non-linear error estimation of the INS solution. The results showed a slight improvement during the parts of the trajectory that had maneuvers such as turns, while the parts with few maneuvers had a significant improvement. The work in [21] proposed a random forest (RF) method for standstill recognition. The proposed method depends on the generated features from the IMU signals that represent the standstill state as an input for the classifier.
In comparison, the work in [22] introduced a supervised machine learning technique for spoof detection. The work in [23] introduced an adaptive fuzzy extended Kalman filter (AFEKF) to enhance the prediction level of the position and velocity errors of the INS. In [6,8], the authors introduced a sensor fusion technique based on fuzzy clustering to fuse the Doppler speed from an FMCW radar and the speedometer data to improve the input speed of an RISS model. The results showed the enhancement of the navigation solution in some portions of the trajectory. On the other hand, the lack of sensor fault detection and a false reading algorithm caused a drift in some portions that had wheel slippage. The work in [24] proposed a fuzzy cluster means (FCMs) technique to fuse multiple IMUs to produce a robust measurement, which was utilized in INS mechanization integrated with GPS. The results in this work showed significant improvement when using FCMs with a multi-IMU structure compared to using only one. Furthermore, the work in [25] utilized the ANFIS model to predict the dual-mass MEMS gyroscope’s output drift caused by temperature. The work in [26] utilized the ANFIS model to enhance the navigation solution of the INS by training the ANFIS model on a differential GPS dataset as a reference position and evaluated the model on a raw public dataset (KITTI) with a trajectory that lasted from (140–300) s. Furthermore, the work in [27] utilized the ANFIS model as a solution for the navigation problem of a mobile robot.
The work in [28] utilized empirical mode decomposition threshold filtering (EMDTF) and a long short-term memory (LSTM) neural network. The EMDTF disposes of the noise generated in the INS’s sensors, while the LSTM is used to predict the pseudo-GPS position during GPS outages. The presented EMDTF scheme improved the accuracy of east velocity, north velocity, longitude, and latitude by 9.12%, 15.14%, 13.78%, and 10.72%, respectively, while the LSTM scheme reduced the RMSE by 21.79%, 14.85%, 55.03%, and 19.66% over the traditional artificial neural networks. Moreover, the work in [29] overcame the dilemma of poor navigation accuracy in challenging environments by proposing a fusion scheme utilizing machine learning techniques. The proposed scheme utilizes the support vector regression-based adaptive Kalman filter (SVR-AKF) to regulate the covariance parameters of the KF. In addition, the adaptive neuro-fuzzy inference system (ANFIS) was used to predict the navigation solution errors of the INS during GNSS outages. The proposed scheme was compared to the traditional schemes using the KF and EKF over two real trajectories. The results showed an improvement in the position error of about 58.8% against the KF over Trajectory 1and 48% to 67.5% against the KF and 34.2% to 57.6% against the EKF over Trajectory 2. Another approach using the FIS to adapt the fuzzy covariance matrix for the online calibration of multiple LiDAR systems was presented in [30]. The aim of this work was enhancing the performance of low-cost laser sensors, and a minimum error for distance of 2.8 cm and a rotation of 1.2 degrees were obtained.
A recent survey of ML techniques and how they can be involved in all the fundamental steps of inertial sensing applications to improve the navigation solution obtained from the INS was provided in [31], stating the advantages and the challenges. The authors mentioned several challenges that the use of ML faces with regard to inertial sensors such as the nonexistence of hardware combinations of inertial sensors and ML and the lack of work on the sensor measurements’ improvement using ML. In addition, the authors mentioned that the use of ML along with the sensor measurements is a promising field of research, as most of the work conducted on ML has only been on the INS navigation solution.
From the discussion of the previous related work, we noticed that most of the presented research utilized ML techniques for the INS solution, but neglected the inertial sensors’ measurements. Therefore, in this paper, we propose an ANFIS algorithm to be applied to the raw measurements of a commercial IMU to leverage its performance. This process was carried out using a high-end IMU as a reference to provide a suitable model for the low-end IMU in the ML structure. The model was generated in the training phase using both IMUs, then applied only to the low-end IMU in the testing phase. The proposed ML algorithm was evaluated on a real road trajectory. The results showed a significant improvement of the commercial IMU measurements, as well as the INS navigation solution compared to the traditional INS solution. The contributions of this research paper are summarized as follows:
  • The development of an ML-based ANFIS algorithm as an ML technique to leverage a low-grade IMU;
  • Comparing the low-grade IMU measurements before and after applying the proposed algorithm to the reference IMU;
  • The validation of the proposed algorithm by applying the tested IMU data to the INS mechanization.
This paper is organized into six sections. In Section 1, the introduction, related work, and paper contributions are discussed. Section 2 gives the background of the INS and the ANFIS algorithm. The methodology is explained in Section 3. The experimental setup and the utilized units are detailed in Section 4. The results are discussed in Section 5. Finally, the paper is concluded in Section 6.

2. Background

2.1. Inertial Navigation Systems

The traditional inertial navigation system is composed of an IMU and a navigation processor. The IMU is composed of three accelerometers providing the specific forces and three gyroscopes providing the angular rates [1,32,33,34,35,36], as shown in Figure 1.
The INS depends on the knowledge of the target’s initial states (position, velocity, and attitude ( P V A )) and updates its current states accordingly, as shown in Equations (1)–(3).
The mechanization process of the INS can be summarized in three main steps. First, we obtained the angular rates ( ω x , ω y , ω z ) from the gyroscopes, the accelerations ( f x , f y , f z ) from the accelerometers, and the attitude angles of the pitch, roll, and yaw ( p , r , y ) from the angular rates after calculating the transformation matrix. Second, with the assistance of the rotation matrix, the forces in the navigation frame from the body frame can be obtained and then transformed to the local-level frame ( L L F ). Finally, the velocity was obtained by integrating the transformed forces, and the position was obtained by integrating the calculated velocity [1,37].
P = φ λ h T
where P is the position, φ is the latitude, λ is the longitude, and h is the altitude.
V = V N V E V D T
where V is the velocity, V N is the north velocity, V E is the east velocity, and V D is the down velocity.
The attitude is determined by Equation (3) [35].
A = q 0 q 1 q 2 q 3
where A is the quaternion representation of the attitude and the quaternions q 0 , q 1 , q 2 , and q 3 are the parameters of the rotation matrix.
The attitude rates are calculated as Equation (4).
q 0 ˙ q 1 ˙ q 2 ˙ q 3 ˙ = 0.5 0 ω x ω y ω z ω x 0 ω z ω y ω y ω z 0 ω x ω z ω y ω x 0 q 0 q 1 q 2 q 3
where ω x , ω y , and ω z are the gyroscopes’ angular rates in the x, y, and z directions, respectively.
Furthermore, the quaternion attitude can be transferred to the Euler angles of the roll, pitch, and yaw, respectively, as in Equation (5).
ϕ θ ψ = a t a n 2 2 q 2 q 3 + 2 q 1 q 0 ) , q 3 2 + q 0 2 q 1 2 q 2 2 a s i n 2 q 1 q 3 2 q 2 q 0 a t a n 2 ( 2 q 1 q 2 + 2 q 0 q 3 ) , q 0 2 + q 1 2 q 2 2 q 3 2
where ϕ is the roll angle in radians, θ is the pitch angle in radians, ψ is the yaw angle in radians.
Equation (6) shows the transformation matrix from the body frame to the L L F using quaternion states [38].
C b n = q 1 2 + q 0 2 q 2 2 q 3 2 2 ( q 1 q 2 q 3 q 0 ) 2 ( q 2 q 3 + q 2 q 0 ) 2 ( q 1 q 2 + q 3 q 0 ) q 2 2 + q 0 2 q 1 2 q 3 2 2 ( q 2 q 3 q 1 q 0 ) 2 ( q 1 q 3 q 2 q 0 ) 2 ( q 2 q 3 + q 1 q 0 ) q 3 2 + q 0 2 q 1 2 q 2 2
The specific forces can be transformed into the L L F using the transformation matrix C b n and are obtained with Equation (7).
F N F E F D = C b n f x f y f z
where F N , F E , and F D are the transformed specific forces in the north, east, and down frame, respectively.
The velocity rates can be obtained with Equation (8).
V ˙ N V ˙ E V ˙ D = 1 0 0 0 λ ˙ + 2 w e s i n φ φ ˙ 0 0 1 0 λ ˙ + 2 w e s i n φ 0 λ ˙ + 2 w e c o s φ 0 0 0 1 φ ˙ λ ˙ + 2 w e c o s φ 0 1 F N F E F D V N V E V D g
where λ ˙ and φ ˙ are the longitude and latitude rates, respectively, w e = 7.2921158 × 10 5 rad/s is the magnitude of the rotation rate of the Earth, and g is the acceleration due to gravity, which can be obtained with Equation (9).
g = g W G S 0 1 + g W G S 1 s i n ( φ ) [ 1 E 2 s i n 2 ( φ ) ] 1 2 [ 3.0877 × 10 6 0.0044 × 10 6 s i n 2 ( φ ) ] h + 0.072 × 10 12
where g W G S 0 = 9.78032677 m/s 2 is the gravity at the Equator, g W G S 1 = 0.00193185138639 m/s 2 is the gravity formula constant, and E = 0.0818191908426 is the first eccentricity [1,2].
The position rates are obtained with Equation (10).
φ ˙ λ ˙ h ˙ = V N R M + h V E R N + h c o s φ V D
where R M and R N are the meridian radius and normal radius of the Earth’s ellipsoid model, respectively.
Unfortunately, the INS suffers from error growth over time because of the two-times integration process of the target’s acceleration. The errors in the INS can be categorized and divided into deterministic and stochastic errors. The deterministic errors include the bias offset, scale factor, and axis misalignment errors. In contrast, the stochastic errors include bias drift, bias stability, scale factor stability, noise, and axis misalignment errors. The deterministic errors can be reduced or compensated if the sensors are properly calibrated, especially high-end sensors, while the stochastic errors were modeled randomly to reduce their effect [30]. Therefore, the gyroscope measurement model is represented by Equation (11).
ω ˜ i b b = ω i b b + b g + S ω i b b + N ω i b b + ε g
where ω ˜ i b b is the gyroscope measurement vector, ω i b b is the true angular rate velocity vector, b g is the gyroscope instrument bias vector, S g is a matrix representing the gyro scale factor, N g is a matrix representing the non-orthogonality of the gyro triad, and ε g is the vector representing the gyro sensor noise.
Furthermore, the accelerometers’ measurement model is represented by Equation (12).
f ˜ b = f b + b a + S 1 f + S 2 f 2 + N a f + δ g + η g
where f ˜ b is the accelerometer measurement vector, f b is the true specific force vector, b a is the accelerometer instrument bias vector, S 1 is a matrix of the linear scale factor error, S 2 is a matrix of the non-linear scale factor error, N a is a matrix representing the non-orthogonality of the accelerometer’s triad, δ g is the anomalous gravity vector, and η g is a vector representing the accelerometer sensor noise.
The classification of the INS depends on the IMU’s accuracy and its ability to reduce the error growth over time. Therefore, to compensate the low-cost commercial IMU’s errors, either traditional techniques or ML techniques are applied to enhance the INS’s navigation solution.

2.2. Adaptive Neuro-Fuzzy Inference System

The adaptive neuro-fuzzy inference system (ANFIS) is a fusion technique between the artificial neural network (ANN) and the fuzzy inference system (FIS). Subsequently, it provides the advantages of both techniques and compensates their disadvantages. It drives the system to adapt through the self-organizing and self-learning process [39].
The main structure of the FIS is shown in Figure 2. The FIS is based on the fuzzy conditional statements (if–then rules), which are responsible for making the decisions in an uncertain environment and its influencing factors [40]. The structure of the FIS is composed of five main blocks. The fuzzification process switches the crisp inputs into datasets by applying the membership function (MF). The base rule contains the fuzzy if–then rules, and the database comprises the MF utilized in the fuzzy rules. The decision-making unit executes the inference operation on the fuzzy rules. The defuzzification process turns the fuzzy results into a crisp output [41,42,43].
Similarly, ANFIS’s functionality is equivalent to the FIS, as shown in Figure 3 [44]. The ANFIS structure is composed of five layers. In the first layer, each node assigns the crisp inputs after applying the MF. The output of this layer clarifies how well the input matchesthe linguistic label, as given by Equation (13) [40,42].
O i 1 = μ A i x
where μ A i is the MF, X is the input to node i, and A i is the linguistic label for input X.
The second layer multiplies the input signals at each node to obtain the rules’ weights (firing strength), as given in Equation (14).
W i = μ A i x × μ B i y
where x , y are the two inputs, A i is the linguistic label for input X, and B i is the linguistic label for input y. The third layer normalizes the weights of each rule by computing the ratio of the weight of each rule to the sum of all the rules’ weights, as given in Equation (15).
W ˜ = W i W
In the fourth layer, the normalized weights of each rule are multiplied by the output of the second layer, as given in Equation (16).
O i 4 = W i ˜ f i = W i ˜ ( p i x + q i y + r i )
where W i ˜ is the normalized weight obtained from the third layer and p i , q i , and r i are called the consequent parameters.
Finally, the fifth layer sums all the incoming signals to compute the overall output O f , as given in Equation (17).
O f = i W ˜ f i = i W i f i i W i

3. Methodology

As mentioned in the previous section, the accuracy of the INS’s navigation solution depends on the quality/grade of the IMU sensor and the ability to compensate its errors. In this paper, we exploited the capability of the ML-ANFIS technique to estimate the inertial sensors’ errors by training a low-grade IMU with a high-end one. This work aimed to boost the low-grade IMU’s performance.
The proposed ML technique is composed of two phases, the training phase and the testing phase. The training phase block diagram is shown in Figure 4. In this phase, the training dataset consisted of the low-grade IMU’s sensor measurements as the input and the high-grade IMU as the output. This phase was carried out using half of the trajectory data. The triangular and Gaussian MFs were utilized. In this paper, six triangular MFs were utilized as the ANFIS input layer for each IMU measurement. The triangular MF is simpler and faster to implement compared to other MFs such as the Gaussian MF [45,46]. Subsequently, the rule base contains one rule for every input MF combination. The clustering method utilized was the “grid partition”, in which every input variable is equally distributed over the input MF and generates a single-output “Sugeno fuzzy system”. The output ANFIS layer utilizes linear MFs in which the output of every rule is linearly related to the input variables and scaled by the previous result’s value. Finally, a thousand iterations were used to produce the model, which was applied later to the IMU measurements for the testing phase.
The testing phase is shown in Figure 5. The ML model generates its predicted IMU measurements (six sensor measurements) to obtain the position, velocity, and attitude (PVA). Then, the navigation solution of the ML model is compared to the navigation solution of the reference to obtain the Δ P V A M L of the ML model. Similarly, the navigation solution of the low-grade IMU is compared to the navigation solution of the reference to obtain the Δ P V A of the low-grade IMU. The differences in the errors in the navigation solution between the ML model and the low-grade IMU were calculated to compute the influence of the ML model in enhancing the navigation solution of the low-grade IMU’s sensor measurements, which is shown in the upcoming sections.
The overall algorithm is explained in Algorithm 1 in pseudo-code form.
Algorithm 1 INS Solution Improvement Using ML
InputIMU’s sensor measurements of three gyroscopes and three accelerometers ( ω x , ω y , ω z , a x , a x , a x )
for the MEMS-IMU and the reference IMU, initial PVA states L a t 0 , L o n g 0 , A t t 0 , V 0 N , V 0 E , V 0 D , p 0 , r 0 , y 0 ,
and the navigation solution of the reference IMU ( p o s _ r e f , v e l _ r e f , a t t _ r e f ).
Step 1Prepare and tune the ML-ANFIS options (input data, output data, type of clustering,
MF type, number of Ms, F and epochs/iterations).
Step 2Apply the ML-ANFIS on 50 % of the input data (training phase).
Step 3Generate the ML-ANFIS.
Step 4Evaluate and apply the ML-ANFIS on the remaining data (testing phase).
Step 5Evaluate the ML-ANFIS’s output (improved IMU sensor measurements ( ω x , ω y , ω z , a x , a y , a z ) .
Step 6Compare the MEMS IMU’s sensor measurements and the ML-ANFIS IMU’s sensor measurements to the reference IMU’s sensor measurements to compute the percentage of improvement caused by the ML-ANFIS (RMSE).
R M S E = 1 n n X n , R e f X n , M L 2
where X n , R e f and X n , M L are the reference IMU and trained IMU measurements, respectively.
Step 7Compute the ML-ANFIS’s navigation solution (PVA) by using the output of the ML-ANFIS as the input to the INS.
Step 8Compare the MEMS IMU (PVA) and the ML-ANFIS (PVA) to the reference IMU (PVA) to compute the percentage of improvement of the ML-ANFIS (PVA) using the RMSE metric.
OutputThe INS solution (PVA) of the MEMS-IMU and the ML model compared to the output using the reference IMU.

4. Experimental Setup

The experimental work was carried out to verify the effectiveness of the ML model through a real road test trajectory with no pre-processing steps. The IMUs utilized in the experimental work were set up inside the test van as shown in Figure 6. The testbed was installed inside the van, coinciding with its axes. Furthermore, utilizing a standard seat chassis, the testbed was rigidly and firmly settled in the rear seat location. The low-grade IMU sensor utilized in this research was the Crossbow MEMS-grade XBOW IMU300CC, and the high-grade IMU utilized as a reference was the IMU-CPT, which includes three MEMS accelerometers and three fiber-optic gyroscopes (FOGs). The specifications of the two IMU units can be found in Table 1.

5. Results and Discussion

A real road trajectory was used to test the proposed ML technique’s performance in the downtown area of Kingston, ON, Canada. The reference trajectory was the INS solution that utilized the IMU-CPT sensor measurements as a control input to the IMS mechanization. Moreover, the trajectory lasted for 2300 s (almost 44 min) and contained various maneuvers at different speeds.
The application of the ML-based-ANFIS to the XBOW IMU measurements was carried out in two stages. The first stage was the training stage, in which the IMU-CPT was utilized as a learning source. This stage was applied with 50% of the data to generate the ML-based-ANFIS model. Three gyroscopes and three accelerometers were trained in this stage to produce a suitable model. The ML-based-ANFIS utilized six membership functions with an adaptive step size. In the results shown in Figure 7, Figure 8, Figure 9, Figure 10, Figure 11, Figure 12, Figure 13, Figure 14 and Figure 15, the reference is designated by red color, the XBOW-IMU in blue, and the proposed ML-based-ANFIS in green for both raw measurements and INS solution comparisons.
The 3D gyroscope and accelerometer measurements in the training stage are shown in Figure 7 and Figure 8, respectively.
The generated ML-based-ANFIS model was then applied to the remaining XBOW-IMU measurements. This step was the testing stage where the generated model was applied and its performance measured.
Figure 9 shows a comparison between the raw XBOW-IMU gyroscope measurements in three directions (x, y, and z) and those with the applied ML model compared to the reference angular rates from the IMU-CPT. A zoomed-in view for a portion of the testing data is shown in Figure 10. The results in Figure 10 show that the biases and scale factor and a significant part of the associated noise were removed when applying the proposed ML technique to the low-grade IMU gyro measurements.
The accelerations’ comparison for the testing part is shown in Figure 11. Additionally, a zoomed-in view for the accelerations in this stage is shown in Figure 12. The results showed the proposed ML technique’s ability to estimate and remove the errors associated with the low-grade IMU measurements. Furthermore, not only was the noise mostly removed, but both the bias and scale factor errors were also reduced significantly. Therefore, the produced IMU measurements from the proposed ML technique provided a more robust input to the INS mechanization, which led to a more accurate navigation solution.
To validate the resulting measurements, a comparison of the raw XBOW-IMU measurements before and after applying the proposed ML technique is shown in Table 2 using the RMSE for each measurement. The results showed a significant improvement of the IMU measurements when using the ML-based-ANFIS.
The output of this process was new IMU measurements that were ready to be applied to the INS algorithm. Consequently, to verify the performance of the proposed ML-based-ANFIS, the modified and unmodified measurements were applied to the INS algorithm to produce the navigation information PVA. The output PVA was then compared to the reference PVA to check the improvement and the worthiness of using ML in training on the raw MEMS-IMU measurements by a high-end IMU.
The results showed the INS solution produced from the XBOW IMU (low-grade) and the corresponding modified measurements (ML-based-ANFIS) when using the proposed ML technique compared to the reference solution from the IMU-CPT.
The position components’ (latitude in radians, longitude in radians, and altitude in meters) comparison is shown in Figure 13. The results showed that the position components when using the proposed ML technique were closer to the reference position components compared to the ones when using the raw XBOW IMU measurements. Therefore, the utilization of ML to improve the IMU measurements leveraged the position solution of the unit.
The comparison of the velocity components in the navigation frame ( V N , V E , and V D ) are shown in Figure 14.
The results showed that there was a significant improvement in all the velocity components when using the proposed ML technique. A comparison of the attitude components’ (roll, pitch, and yaw) angle is shown in Figure 15, illustrating the significant improvement of the attitude components’ solution.
The overall trajectory comparison is shown in Figure 16. The trajectory shows the 2D position information obtained by applying the reference high-end IMU-CPT, the ow-end XBOW IMU, and the ML-based-ANFIS XBOW IMU to the INS mechanization in red, blue, and green, respectively. Furthermore, arrows show the start point and the direction of motion. The trajectory from the low-end XBOW IMU severely drifted over time compared to the one generated from the proposed ML-based-ANFIS XBOW. The result of the proposed method showed the effectiveness of using the ML-based-ANFIS technique in improving the performance of the INS navigation solution. Moreover, the proposed method trajectory followed the reference even during maneuvers with a smaller shift compared to the original XBOW one. This result came from the great enhancement of the XBOW IMU measurements after applying the proposed ML technique.
A statistical analysis of the INS solution position, velocity, and attitude components in the LLF from the testing part of the trajectory (24 min) is shown in Table 3.
A 70% overall improvement of the 2D position and 92% improvement of the 2D velocity were achieved when using the proposed ML-based-ANFIS technique. Moreover, the attitude components had a great improvement. The roll angle RMSE was reduced from 55.6 degrees to 6 degrees with an improvement of 89.2%; the pitch angle RMSE was reduced from 42.6 degrees to 6.5 degrees with an improvement of 84.7%; the yaw angle was reduced from 86.3 degrees to 79.3 degrees with an improvement of 8%. The yaw angle’s improvement percentage was less than other attitude components due to the proximity of the raw w z to the reference w z , as shown in Figure 9 and Figure 10. The results showed the superiority of applying ML to leverage the low-grade IMU, which significantly enhanced the INS navigation solution compared to the traditional solution using the raw measurements of the low-grade IMU.

6. Conclusions and Future Work

This paper discussed the utilization of the ML-based-ANFIS to improve the raw MEMS-grade IMU measurements. The proposed ML algorithm was applied to real data collected with a low-cost IMU. The proposed ML technique was applied to 50% of the collected data and tested on the remaining data. The output of this process was then applied to a strap-down INS to produce a navigation solution PVA. The produced navigation solution achieved a 2D position improvement of 70% and a 2D velocity improvement of 92%. Furthermore, an improvement of 89.2%, 84.7%, and 8% of the attitude components of the roll, pitch, and yaw, respectively, was achieved. The work in this paper showed that using ML to boost a low-grade IMU had a significant impact on the inertial sensors’ performance. Moreover, it had a great impact by producing a more accurate and robust INS navigation solution. As a future step, this work can be combined with either another ML technique or the EKF to bridge GNSS outages in challenging GNSS environments.

Author Contributions

A.E.M. proposed the algorithm, performed the experiments, and wrote the manuscript; A.A. (Ahmed Azouz) reviewed the manuscript and provided important suggestions to improve the algorithm; A.E.A. revised the manuscript; A.A. (Ashraf Abosekeen) participated in preparing the algorithm, the experimental work, and the results’ analysis and wrote and revised the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Noureldin, A.; Karamat, T.B.; Georgy, J. Fundamentals of Inertial Navigation, Satellite-Based Positioning and their Integration; Springer: Berlin/Heidelberg, Germany, 2013; Volume 1, p. 313. [Google Scholar] [CrossRef]
  2. Titterton, D.; Weston, J. Strapdown Inertial Navigation Technology; Institution of Engineering and Technology: London, UK, 2004. [Google Scholar] [CrossRef]
  3. Abosekeen, A.; Iqbal, U.; Noureldin, A.; Korenberg, M.J. A Novel Multi-Level Integrated Navigation System for Challenging GNSS Environments. IEEE Trans. Intell. Transp. Syst. 2021, 22, 4838–4852. [Google Scholar] [CrossRef]
  4. Li, Y.; Chen, R.; Niu, X.; Zhuang, Y.; Gao, Z.; Hu, X.; El-Sheimy, N. Inertial Sensing Meets Artificial Intelligence: Opportunity or Challenge? arXiv 2020, arXiv:2007.06727. [Google Scholar]
  5. Abosekeen, A.; Noureldin, A.; Karamat, T.; Korenberg, M.J. Comparative Analysis of Magnetic-Based RISS using Different MEMS-Based Sensors. In Proceedings of the 30th International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+ 2017), Portland, OR, USA, 25–29 September 2017; pp. 2944–2959. [Google Scholar] [CrossRef]
  6. Abosekeen, A.; Iqbal, U.; Noureldin, A. Improved Navigation Through GNSS Outages: Fusing Automotive Radar and OBD-II Speed Measurements with Fuzzy Logic. GPS World 2021, 32, 36–41. [Google Scholar]
  7. Nam, D.V.; Gon-Woo, K. Robust Stereo Visual Inertial Navigation System Based on Multi-Stage Outlier Removal in Dynamic Environments. Sensors 2020, 20, 2922. [Google Scholar] [CrossRef] [PubMed]
  8. Abosekeen, A.; Iqbal, U.; Noureldin, A. Enhanced Land Vehicles Navigation by Fusing Automotive Radar and Speedometer Data. In Proceedings of the 33rd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+ 2020), St. Louise, MO, USA, 21–25 September 2020; pp. 2206–2219. [Google Scholar] [CrossRef]
  9. Abosekeen, A.; Abdalla, A. Fusion of Low-Cost MEMS IMU/GPS Integrated Navigation System. In Proceedings of the 8th International Conference on Electrical Engineering, Cairo, Egypt, 29–31 May 2012; Volume 8, pp. 1–23. [Google Scholar] [CrossRef]
  10. Rashed, M.A.; Abosekeen, A.; Ragab, H.; Noureldin, A.; Korenberg, M.J. Leveraging FMCW-radar for autonomous positioning systems: Methodology and application in downtown Toronto. In Proceedings of the 32nd International Technical Meeting of the Satellite Division of the Institute of Navigation, ION GNSS+ 2019, Miami, FL, USA, 16–20 September 2019; pp. 2659–2669. [Google Scholar] [CrossRef]
  11. Hsu, L.T. What are the roles of artificial intelligence and machine learning in GNSS positioning? Inside GNSS 2020, 1–8. [Google Scholar]
  12. Sharaf, R.; Noureldin, A.; Osman, A.; El-Sheimy, N. Online INS/GPS Integration with a Radial Basis Function Neural Network. IEEE Aerosp. Electron. Syst. Mag. 2005, 20, 8–14. [Google Scholar] [CrossRef]
  13. Semeniuk, L.; Noureldin, A. Bridging GPS outages using neural network estimates of INS position and velocity errors. Meas. Sci. Technol. 2006, 17, 2783–2798. [Google Scholar] [CrossRef]
  14. Sharaf, R.; Noureldin, A. Sensor Integration for Satellite-Based Vehicular Navigation Using Neural Networks. IEEE Trans. Neural Netw. 2007, 18, 589–594. [Google Scholar] [CrossRef]
  15. Ragab, M.M.; Ragab, H.; Givigi, S.; Noureldin, A. Performance evaluation of neural-network-based integration of vision and motion sensors for vehicular navigation. In Autonomous Systems: Sensors, Processing, and Security for Vehicles and Infrastructure 2019; Dudzik, M.C., Ricklin, J.C., Eds.; International Society for Optics and Photonics: Baltimore, MD, USA, 2019; Volume 11009, pp. 140–151. [Google Scholar] [CrossRef]
  16. Jaradat, M.A.; Abdel-Hafez, M.F.; Saadeddin, K.; Jarrah, M.A. Intelligent fault detection and fusion for INS/GPS navigation system. In Proceedings of the 2013 9th International Symposium on Mechatronics and its Applications (ISMA), Amman, Jordan, 9–11 April 2013; pp. 1–5. [Google Scholar] [CrossRef]
  17. Du, S.; Gan, X.; Zhang, R.; Zhou, Z. The Integration of Rotary MEMS INS and GNSS with Artificial Neural Networks. Math. Probl. Eng. 2021, 2021, 1–10. [Google Scholar] [CrossRef]
  18. Al Bitar, N.; Gavrilov, A. A new method for compensating the errors of integrated navigation systems using artificial neural networks. Measurement 2021, 168, 108391. [Google Scholar] [CrossRef]
  19. Tamazin, M.; Korenberg, M.J.; Elghamrawy, H.; Noureldin, A. GPS Swept Anti-Jamming Technique Based on Fast Orthogonal Search (FOS). Sensors 2021, 21, 3706. [Google Scholar] [CrossRef] [PubMed]
  20. Iqbal, U.; Abosekeen, A.; Georgy, J.; Umar, A.; Noureldin, A.; Korenberg, M.J. Implementation of Parallel Cascade Identification at Various Phases for Integrated Navigation System. Future Internet 2021, 13, 191. [Google Scholar] [CrossRef]
  21. Sánchez Morales, E.; Dauth, J.; Huber, B.; García Higuera, A.; Botsch, M. High Precision Outdoor and Indoor Reference State Estimation for Testing Autonomous Vehicles. Sensors 2021, 21, 1131. [Google Scholar] [CrossRef] [PubMed]
  22. Semanjski, S.; Semanjski, I.; De Wilde, W.; Muls, A. Use of Supervised Machine Learning for GNSS Signal Spoofing Detection with Validation on Real-World Meaconing and Spoofing Data—Part I. Sensors 2020, 20, 1171. [Google Scholar] [CrossRef] [Green Version]
  23. Sabzevari, D.; Chatraei, A. INS/GPS Sensor Fusion based on Adaptive Fuzzy EKF with Sensitivity to Disturbances. IET Radar Sonar Navig. 2021, 15, 1535–1549. [Google Scholar] [CrossRef]
  24. Abosekeen, A.; Abdalla, A. Improving the Navigation System of a UAV Using Multi-Sensor Data Fusion Based on Fuzzy C-Means Clustering. Int. Conf. Aerosp. Sci. Aviat. Technol. 2011, 14, 1–12. [Google Scholar] [CrossRef]
  25. Cao, H.; Wei, W.; Liu, L.; Ma, T.; Zhang, Z.; Zhang, W.; Shen, C.; Duan, X. A Temperature Compensation Approach for Dual-Mass MEMS Gyroscope Based on PE-LCD and ANFIS. IEEE Access 2021, 9, 95180–95193. [Google Scholar] [CrossRef]
  26. Duan, Y.; Li, H.; Wu, S.; Zhang, K. INS Error Estimation Based on an ANFIS and Its Application in Complex and Covert Surroundings. ISPRS Int. J. Geo-Inf. 2021, 10, 388. [Google Scholar] [CrossRef]
  27. Aouf, A.; Boussaid, L.; Sakly, A. TLBO-Based Adaptive Neurofuzzy Controller for Mobile Robot Navigation in a Strange Environment. Comput. Intell. Neurosci. 2018, 2018, 1–8. [Google Scholar] [CrossRef]
  28. Zhang, Y. A Fusion Methodology to Bridge GPS Outages for INS/GPS Integrated Navigation System. IEEE Access 2019, 7, 61296–61306. [Google Scholar] [CrossRef]
  29. Yue, S.; Cong, L.; Qin, H.; Li, B.; Yao, J. A Robust Fusion Methodology for MEMS-Based Land Vehicle Navigation in GNSS-Challenged Environments. IEEE Access 2020, 8, 44087–44099. [Google Scholar] [CrossRef]
  30. Nam, D.V.; Kim, G.W. Online Self-Calibration of Multiple 2D LiDARs Using Line Features with Fuzzy Adaptive Covariance. IEEE Sens. J. 2021, 21, 13714–13726. [Google Scholar] [CrossRef]
  31. Li, Y.; Chen, R.; Niu, X.; Zhuang, Y.; Gao, Z.; Hu, X.; El-Sheimy, N. Inertial Sensing Meets Machine Learning: Opportunity or Challenge? IEEE Trans. Intell. Transp. Syst. 2021, 1–17. [Google Scholar] [CrossRef]
  32. Groves, P.D. Principles of GNSS, Inertial, and Multisensor Integrated Navigation Systems, 2nd ed.; Artech House: Boston, MA, USA; London, UK, 2008; p. 505. [Google Scholar]
  33. Savage, P.G. Strapdown Inertial Navigation Integration Algorithm Design Part 2: Velocity and Position Algorithms. J. Guid. Control Dyn. 1998, 21, 208–221. [Google Scholar] [CrossRef]
  34. Abosekeen, A. Multi-Sensor Integration and Fusion in Navigation Systems. Master’s Thesis, Military Technical College, Cairo, Egypt, 2012. [Google Scholar] [CrossRef]
  35. Corke, P.; Lobo, J.; Dias, J. An Introduction to Inertial and Visual Sensing. Int. J. Robot. Res. 2007, 26, 519–535. [Google Scholar] [CrossRef]
  36. Huang, G. Visual-Inertial Navigation: A Concise Review. In Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada, 20–24 May 2019; pp. 9572–9582. [Google Scholar] [CrossRef] [Green Version]
  37. Abosekeen, A.; Noureldin, A.; Korenberg, M.J. Improving the RISS/GNSS Land-Vehicles Integrated Navigation System Using Magnetic Azimuth Updates. IEEE Trans. Intell. Transp. Syst. 2020, 21, 1250–1263. [Google Scholar] [CrossRef]
  38. Diebel, J. Representing attitude: Euler angles, unit quaternions, and rotation vectors. Matrix 2006, 58, 1–35. [Google Scholar]
  39. Zhang, L.; Liu, J.; Lai, J.; Xiong, Z. Performance analysis of adaptive neuro fuzzy inference system control for mems navigation system. Math. Probl. Eng. 2014, 2014, 1–7. [Google Scholar] [CrossRef] [Green Version]
  40. Al-Hmouz, A.; Shen, J.; Al-Hmouz, R.; Yan, J. Modeling and Simulation of an Adaptive Neuro-Fuzzy Inference System (ANFIS) for Mobile Learning. IEEE Trans. Learn. Technol. 2012, 5, 226–237. [Google Scholar] [CrossRef]
  41. Bhattacharyya, S.; Dutta, P. Fuzzy Logic: Concepts, System Design, and Applications to Industrial Informatics. In Handbook of Research on Industrial Informatics and Manufacturing Intelligence: Innovations and Solutions; Khan, M.A., Ansari, A.Q., Eds.; IGI Global: Hershey, PA, USA, 2012; Chapter 3; pp. 33–71. [Google Scholar] [CrossRef] [Green Version]
  42. Sivakumar, R.; Sahana, C.; Savitha, P. Design of ANFIS based Estimation and Control for MIMO Systems. Int. J. Eng. 2012, 2, 2803–2809. [Google Scholar]
  43. Erdem, H. Application of Neuro-Fuzzy Controller for Sumo Robot control. Expert Syst. Appl. 2011, 38, 9752–9760. [Google Scholar] [CrossRef]
  44. Jang, J.S. ANFIS: Adaptive-network-based fuzzy inference system. IEEE Trans. Syst. Man Cybern. 1993, 23, 665–685. [Google Scholar] [CrossRef]
  45. Jin, Z.; Bose, B. Evaluation of membership functions for fuzzy logic controlled induction motor drive. In Proceedings of the IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02, Seville, Spain, 5–8 November 2002; Volume 1, pp. 229–234. [Google Scholar] [CrossRef]
  46. Prajapati, S.; Fernandez, E. Performance Evaluation of Membership Function on Fuzzy Logic Model for Solar PV array. In Proceedings of the 2020 IEEE International Conference on Computing, Power and Communication Technologies (GUCON), Greater Noida, India, 2–4 October 2020; pp. 609–613. [Google Scholar] [CrossRef]
Figure 1. Strap down INS block diagram.
Figure 1. Strap down INS block diagram.
Sensors 22 01687 g001
Figure 2. The structure of the fuzzy inference system.
Figure 2. The structure of the fuzzy inference system.
Sensors 22 01687 g002
Figure 3. The ANFIS’s structure [44].
Figure 3. The ANFIS’s structure [44].
Sensors 22 01687 g003
Figure 4. The block diagram of the training phase of the ML-based-ANFIS showing the model generation process.
Figure 4. The block diagram of the training phase of the ML-based-ANFIS showing the model generation process.
Sensors 22 01687 g004
Figure 5. The block diagram of the testing phase of the ML-based-ANFIS showing the application of the generated model to the XBOW-IMU and comparing the produced PVA with the reference IMU.
Figure 5. The block diagram of the testing phase of the ML-based-ANFIS showing the application of the generated model to the XBOW-IMU and comparing the produced PVA with the reference IMU.
Sensors 22 01687 g005
Figure 6. The utilized IMUs mounted on the testbed showing their placement and orientation inside the van.
Figure 6. The utilized IMUs mounted on the testbed showing their placement and orientation inside the van.
Sensors 22 01687 g006
Figure 7. The 3D gyroscope angular rates with the ML–based–ANFIS (training stage).
Figure 7. The 3D gyroscope angular rates with the ML–based–ANFIS (training stage).
Sensors 22 01687 g007
Figure 8. The 3D accelerometers with the ML–based–ANFIS (training stage).
Figure 8. The 3D accelerometers with the ML–based–ANFIS (training stage).
Sensors 22 01687 g008
Figure 9. The 3D gyroscope angular rates after applying the ML–based–ANFIS (testing stage).
Figure 9. The 3D gyroscope angular rates after applying the ML–based–ANFIS (testing stage).
Sensors 22 01687 g009
Figure 10. A zoomed–in part of the IMU gyroscope measurements.
Figure 10. A zoomed–in part of the IMU gyroscope measurements.
Sensors 22 01687 g010
Figure 11. The 3D accelerometers with the ML–based–ANFIS (testing stage).
Figure 11. The 3D accelerometers with the ML–based–ANFIS (testing stage).
Sensors 22 01687 g011
Figure 12. A zoomed–in part of the IMU accelerometers.
Figure 12. A zoomed–in part of the IMU accelerometers.
Sensors 22 01687 g012
Figure 13. Position (Lat, Long, and Alt) components’ comparison.
Figure 13. Position (Lat, Long, and Alt) components’ comparison.
Sensors 22 01687 g013
Figure 14. Velocity ( V N , V E , and V D ) components’ comparison.
Figure 14. Velocity ( V N , V E , and V D ) components’ comparison.
Sensors 22 01687 g014
Figure 15. Attitude (roll, pitch, and yaw) angles’ comparison.
Figure 15. Attitude (roll, pitch, and yaw) angles’ comparison.
Sensors 22 01687 g015
Figure 16. Overall trajectory comparison.
Figure 16. Overall trajectory comparison.
Sensors 22 01687 g016
Table 1. Utilized IMUs’ performance characteristics.
Table 1. Utilized IMUs’ performance characteristics.
IMUsIMU300CC(XBOW)IMU-CPT
(100 HZ)(100 Hz)
Size (cm 3 )7.62 × 9.53 × 3.215.2 × 16.8 × 8.9
Weight0.59 Kg2.28 Kg
Max data rate200 Hz100 Hz
Start-up time<1 s<5 s
Accelerometer
Range±2 g±10 g
Bias instability±30 mg±0.75 mg
Scale factor<1%, 1 σ 300 ppm, 1 σ
Gyroscope
Range±100 /s±375 /s
Bias instability<±2.0 /s±1.0 /h
Scale factor<1%, 1 σ 1500 ppm, 1 σ
Table 2. IMU raw measurements’ RMSE comparison.
Table 2. IMU raw measurements’ RMSE comparison.
RMSE ω x ω y ω z a x a y a z
XBOW0.01580.02130.00640.19021.26290.3542
ML-XBOW0.00840.00690.00260.10840.07570.2873
Table 3. Results’ analysis of the testing part of the trajectory (24 min).
Table 3. Results’ analysis of the testing part of the trajectory (24 min).
UnitsXBOWML-XBOW
Position RMSE (m)North311,899.4222,857.2
East732,549.283,613.3
Down967,706.2291,313.6
2D Pos796,184.3238,026.2
3D Pos1,253,141.9376,191.6
Velocity RMSE (m/s)VN2730.5360.5
VE5879.4338.9
VD2242.8655.2
2D Vel6482.5494.8
3D Vel6859.5821
Attitude RMSE (Deg)Roll55.66.09
Pitch42.66.5
Yaw86.379.3
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Mahdi, A.E.; Azouz, A.; Abdalla, A.E.; Abosekeen, A. A Machine Learning Approach for an Improved Inertial Navigation System Solution. Sensors 2022, 22, 1687. https://doi.org/10.3390/s22041687

AMA Style

Mahdi AE, Azouz A, Abdalla AE, Abosekeen A. A Machine Learning Approach for an Improved Inertial Navigation System Solution. Sensors. 2022; 22(4):1687. https://doi.org/10.3390/s22041687

Chicago/Turabian Style

Mahdi, Ahmed E., Ahmed Azouz, Ahmed E. Abdalla, and Ashraf Abosekeen. 2022. "A Machine Learning Approach for an Improved Inertial Navigation System Solution" Sensors 22, no. 4: 1687. https://doi.org/10.3390/s22041687

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop