Modares Mechanical Engineering

Modares Mechanical Engineering

A Performance-Based Hybrid PSO-GA Framework for Optimal Process Noise Covariance Tuning in INS/GNSS Integration

Document Type : Original Article

Authors
1 Mechanical Engineering Department, Sharif University of Technology, Tehran, Iran
2 Mechanical Engineering Department, Sharif University of Technology, Tehran, Iran.
10.48311/mme.2025.117363.82879
Abstract
Accurate state estimation in INS/GNSS integrated navigation is critical, and its most common implementation, the Extended Kalman Filter (EKF), is highly dependent on the tuning of its process noise covariance matrix (Q). Conventional tuning methods, such as those based on stationary Allan-variance (AV) analysis, often fail to capture sensor behavior under real-world dynamic conditions, leading to filter inconsistency, sub-optimal accuracy, and poor dynamic response, such as overshoot upon GNSS re-acquisition. This paper proposes a novel, data-driven offline framework to optimize Q. Our approach parameterizes the continuous-time covariance (Qc) using four physically meaningful scalars and tunes them using a hybrid Particle Swarm Optimization and Genetic Algorithm (PSO-GA). The optimization minimizes a performance-based objective function: the mean trajectory-wide Root Mean Square Error (RMSE) evaluated over a comprehensive set of sliding, pure-INS windows. Experimental validation on a real-world dataset demonstrates that the proposed tuning framework significantly outperforms conventional Allan-variance based tuning. Specifically, it reduces the mean terminal position and attitude errors by 52% and 84%, respectively, while simultaneously tightening the estimated error bounds by 59% and 82%, indicating superior filter consistency and robustness. Critically, in a simulated GNSS outage-and-recovery scenario, the proposed filter exhibited rapid, stable convergence without any overshoot, a significant improvement over the AV-tuned filter which suffered from severe overshoots. By directly linking the Q matrix parameters to observed navigation performance, this work provides a practical and robust methodology for EKF tuning.
Keywords
Subjects

[1] A. J. A. Tavares Jr and N. M. F. Oliveira, “A Novel Approach for Kalman Filter Tuning for Direct and Indirect Inertial Navigation System/Global Navigation Satellite System Integration,” Sensors, vol. 24, no. 22, p. 7331, 2024. doi: 10.3390/s24227331
[2] D. Wang and H. Zhang, “A multi-step pseudo-measurement adaptive Kalman filter based on filtering performance evaluation and its application in the ins/gnss navigation system,” Remote Sens (Basel), vol. 16, no. 5, p. 926, 2024. doi: 10.3390/rs16050926
[3] Y. Cheng, S. Zhang, X. Wang, H. Wang, and H. Yang, “Kalman Filter with Adaptive Covariance Estimation for Carrier tracking under weak signals and dynamic conditions,” Electronics (Basel), vol. 13, no. 7, p. 1288, 2024. doi: 10.3390/electronics13071288.
[4] Y. Yuan, F. Li, J. Chen, Y. Wang, and K. Liu, “An improved Kalman filter algorithm for tightly GNSS/INS integrated navigation system,” Math. Biosci. Eng, vol. 21, pp. 963–983, 2024. doi:10.3934/mbe.2024040.
[5] Z. Liang et al., “An Enhanced Adaptive Ensemble Kalman Filter for Autonomous Underwater Vehicle Integrated Navigation,” Drones, vol. 8, no. 12, p. 711, 2024. doi: 10.3390/drones8120711.
[6] Y. Pandey, R. Bhattacharyya, and Y. N. Singh, “Adaptive Invariant Extended Kalman Filter with Noise Covariance Tuning for Attitude Estimation,” ArXiv, 2024. doi: 10.48550/arXiv.2410.01958.
[7] V. Suvorkin, M. Garcia-Fernandez, G. González-Casado, M. Li, and A. Rovira-Garcia, “Assessment of noise of mems imu sensors of different grades for gnss/imu navigation,” Sensors, vol. 24, no. 6, p. 1953, 2024. doi: 10.3390/s24061953.
[8] A. Shahrawy et al., “Breaking Through GNSS Outage: Advanced Stochastic Model for MEMS IMU in Navigation,” IEEE J Sel Top Appl Earth Obs Remote Sens, 2025. doi: 10.1109/JSTARS.2025.3581379.
[9] S. F. G. Ehlers, P. Sourkounis, Z. Ziaukas, J.-P. Kobler, and H.-G. Jacob, “Optimized Tuning of an EKF for State and Parameter Estimation in a Semitrailer,” 2024. doi: 10.15488/17784.
[10] M. Theiler, D. Schneider, and C. Endisch, “Kalman filter tuning using multi-objective genetic algorithm for state and parameter estimation of lithium-ion cells,” Batteries, vol. 8, no. 9, p. 104, 2022. doi: 10.3390/batteries8090104.
[11] X. Lu, M. Chen, and Y. Tian, “Accurate state-of-charge estimation of LiFePO4 battery: An adaptive extended kalman filter approach using particle swarm optimization,” Energy Reports, vol. 14, pp. 1169–1178, 2025. doi: 10.1016/j.egyr.2025.07.023.
[12] N. Nernchad, K. Buakham, P. Janthirat, M. Janchuen, and U. Prasatsap, “A modified artificial hummingbird algorithm tuning optimal process noise covariance and measurement noise covariance for the Kalman filter in the noise reduction analysis of steering angle sensors in small electric vehicle,” Measurement, p. 117984, 2025. doi: 10.1016/j.measurement.2025.117984.
[13] E. Mohajeri, S. H. Pourtakdoust, and F. Pazooki, “A neural-metaheuristic kalman filter for moving microburst wind shear identification,” J Franklin Inst, vol. 362, no. 1, p. 107390, 2025. doi: 10.1016/j.jfranklin.2024.107390.
[14] M. R. Bonyadi and Z. Michalewicz, “Particle swarm optimization for single objective continuous space problems: a review,” Evol Comput, vol. 25, no. 1, pp. 1–54, 2017. doi: 10.1162/EVCO_r_00180.
[15] S. Katoch, S. S. Chauhan, and V. Kumar, “A review on genetic algorithm: past, present, and future,” Multimed Tools Appl, vol. 80, no. 5, pp. 8091–8126, 2021. doi: 10.1007/s11042-020-10139-6.
[16] W. Wen, T. Pfeifer, X. Bai, and L.-T. Hsu, “Factor graph optimization for GNSS/INS integration: A comparison with the extended Kalman filter,” NAVIGATION: Journal of the Institute of Navigation, vol. 68, no. 2, pp. 315–331, 2021. doi: 10.1002/navi.421.
[17] S. Xin, X. Wang, J. Zhang, K. Zhou, and Y. Chen, “A comparative study of factor graph optimization-based and extended Kalman filter-based PPP-B2b/INS integrated navigation,” Remote Sens (Basel), vol. 15, no. 21, p. 5144, 2023. doi: 10.3390/rs15215144.
[18] B. Ning, F. Zhao, H. Luo, D. Luo, and W. Shao, “Robust GNSS/INS Tightly Coupled Positioning Using Factor Graph Optimization with P-Spline and Dynamic Prediction,” Remote Sens (Basel), vol. 17, no. 10, p. 1792, 2025. doi: 10.3390/rs17101792.
[19] Y. Hu, H. Li, and W. Liu, “Robust factor graph optimisation method for shipborne GNSS/INS integrated navigation system,” IET Radar, Sonar & Navigation, vol. 18, no. 5, pp. 782–798, 2024. doi: 10.1049/rsn2.12521.
[20] Z. Yang, X. Ding, Y. Yang, and Q. Wang, “OiSAM-FGO: an efficient factor graph optimization algorithm for GNSS/INS integrated navigation system,” Satellite Navigation, vol. 6, no. 1, p. 23, 2025. doi: 10.1186/s43020-025-00173-w.
[21] C. Taylor and J. Gross, “Factor graphs for navigation applications: A tutorial,” NAVIGATION: Journal of the Institute of Navigation, vol. 71, no. 3, 2024. doi: 10.33012/navi.653.
[22] J. R. Carpenter and C. N. D’Souza, “Navigation filter best practices,” 2025.
[23] P. Aggarwal, Z. Syed, and N. El-Sheimy, MEMS-based integrated navigation. Artech House, 2010.
[24] P. Groves, Principles of GNSS, Inertial, and Multisensor Integrated Navigation Systems, Second Edition. 2013.
[25] D. Simon, Optimal state estimation: Kalman, H infinity, and nonlinear approaches. John Wiley & Sons, 2006.
[26] D. Engelsman, Y. Stolero, and I. Klein, “Parametric and state estimation of stationary MEMS-IMUs: A tutorial,” arXiv:2307.08571, 2023. doi: 10.1109/ACCESS.2024.3476145.
[27] A. Shahrawy et al., “Breaking Through GNSS Outage: Advanced Stochastic Model for MEMS IMU in Navigation,” IEEE J Sel Top Appl Earth Obs Remote Sens, 2025. doi: 10.1109/JSTARS.2025.3581379.
[28] N. El-Sheimy, H. Hou, and X. Niu, “Analysis and modeling of inertial sensors using Allan variance,” IEEE Trans Instrum Meas, vol. 57, no. 1, pp. 140–149, 2008. doi: 10.1109/TIM.2007.908635.
[29] M. Ruiz et al., “Acceleration of an algorithm based on the maximum likelihood bolometric tomography for the determination of uncertainties in the radiation emission on jet using heterogeneous platforms,” Applied Sciences, vol. 12, no. 13, p. 6798, 2022. doi: 10.3390/app12136798.
[30] X. Ai, G. Mania, H. M. Gray, M. Kuhn, and N. Styles, “A GPU-based Kalman Filter for track fitting,” Comput Softw Big Sci, vol. 5, no. 1, p. 20, 2021, doi: 10.1007/s41781-021-00065-z. doi: 10.1007/s41781-021-00065-z.