Open Journal Systems

Navigating the future: A comprehensive survey of localization systems in autonomous vehicles

Xiaowen Tao, Pengxiang Meng, Bing Zhu, Jian Zhao

Article ID: 2627
Vol 5, Issue 1, 2024

DOI: https://doi.org/10.54517/m.v5i1.2627
VIEWS - 64 (Abstract)

Abstract

This survey paper provides an in-depth analysis of localization systems for autonomous vehicles (AVs), a cornerstone technology crucial for the safe and efficient operation of AVs. The paper encompasses a comprehensive examination of various localization technologies, their comparative analysis, the challenges they face, and the emerging trends shaping their future. We begin by exploring the principal technologies employed in AV localization: GPS, LiDAR, radar, cameras, and ultrasonic sensors. Each technology is scrutinized to understand its strengths, weaknesses, and applicability in different environmental contexts. GPS offers broad geographical positioning but struggles with precision in dense urban areas. LiDAR provides high-resolution mapping but is hindered by adverse weather conditions. Radar ensures reliability in poor visibility but lacks the finer details provided by optical systems. Cameras offer rich visual data but are dependent on lighting conditions, and ultrasonic sensors, while effective for close-range detection, are limited to low-speed applications. The paper then presents a comparative analysis of these technologies against key performance metrics such as accuracy, reliability, latency, scalability, and cost-effectiveness. This analysis is critical in understanding the suitability of each technology for various driving scenarios, from congested urban streets to open highways and in diverse weather conditions. Challenges in AV localization are multifaceted, encompassing technological, environmental, and system integration issues. Technological challenges include sensor limitations and computational constraints, while environmental factors like weather and urban infrastructure significantly impact localization accuracy. System integration poses another significant challenge, necessitating seamless interaction between localization systems and other vehicle control systems for real-time decision-making. Emerging trends and potential solutions to these challenges are discussed, highlighting advancements in sensor technology, AI, machine learning, and 5G communications. These developments promise to overcome existing limitations and enhance the accuracy and reliability of AV localization. The integration of localization systems with smart city infrastructures and the implementation of collaborative technologies like V2X communication are speculated to further augment AV capabilities. In conclusion, the paper emphasizes that the future of AV localization is intrinsically linked to the continuous evolution of technologies and their integration. Addressing current challenges and harnessing emerging trends are pivotal for the advancement of AVs, steering us toward a future of autonomous transportation characterized by increased safety, efficiency, and reliability.

Keywords

autonomous vehicles; localization systems; GPS; LiDAR; radar; cameras; ultrasonic sensors; sensor fusion; machine learning; 5G communications; smart cities; autonomous transportation

Full Text:

PDF

References

1. Zhu B, Tao X, Zhao J, et al. An Integrated GNSS/UWB/DR/VMM Positioning Strategy for Intelligent Vehicles. IEEE Transactions on Vehicular Technology. 2020, 69(10): 10842-10853. doi: 10.1109/tvt.2020.3014516

2. Zhu B, Zhang P, Zhao J, et al. Hazardous Scenario Enhanced Generation for Automated Vehicle Testing Based on Optimization Searching Method. IEEE Transactions on Intelligent Transportation Systems. 2022, 23(7): 7321-7331. doi: 10.1109/tits.2021.3068784

3. Li X, Tao X, Zhu B, et al. Research on a Simulation Method of the Millimeter Wave Radar Virtual Test Environment for Intelligent Driving. Sensors. 2020, 20(7): 1929. doi: 10.3390/s20071929

4. Tao X, Zhu B, Xuan S, et al. A Multi-Sensor Fusion Positioning Strategy for Intelligent Vehicles Using Global Pose Graph Optimization. IEEE Transactions on Vehicular Technology. 2022, 71(3): 2614-2627. doi: 10.1109/tvt.2021.3139006

5. Zhu B, Tao X, Jian Z, et al. Two-stage UWB positioning algorithm of intelligent vehicle. Journal of Traffic Engineering, 2021, 21(2): 256-266.

6. Zhang Z. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2000, 22(11): 1330-1334. doi: 10.1109/34.888718

7. Heikkila J, Silvén O. A four-step camera calibration procedure with implicit image correction. Proceedings of IEEE computer society conference on computer vision and pattern recognition. IEEE, 1997: 1106-1112.

8. Salvi J, Armangué X, Batlle J. A comparative review of camera calibrating methods with accuracy evaluation. Pattern Recognition. 2002, 35(7): 1617-1635. doi: 10.1016/s0031-3203(01)00126-1

9. Zhang Z, Scaramuzza D. A Tutorial on Quantitative Trajectory Evaluation for Visual(-Inertial) Odometry. 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Published online October 2018. doi: 10.1109/iros.2018.8593941

10. Brink K, Soloviev A. Filter-based calibration for an IMU and multi-camera system. Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium. Published online April 2012. doi: 10.1109/plans.2012.6236950

11. Sünderhauf N. An Outlook on Robust Optimization for Sensor Fusion and Calibration. Switchable Constraints for Robust Simultaneous Localization and Mapping and Satellite-Based Localization. Published online 2023: 167-170. doi: 10.1007/978-3-031-24017-1_9

12. Tao X, Meng P, Zhu B, et al. A fast and accurate camera-IMU calibration method for localization system. Insight - Automatic Control. 2023, 6(1): 578. doi: 10.18282/iac.v6i1.578

13. Zhao J, Du J, Zhu B, et al. Indirect tire pressure monitoring method based on the fusion of time and frequency domain analysis. Measurement. 2023, 220: 113282. doi: 10.1016/j.measurement.2023.113282

14. Reid TGR, Houts SE, Cammarata R, et al. Localization Requirements for Autonomous Vehicles. SAE International Journal of Connected and Automated Vehicles. 2019, 2(3). doi: 10.4271/12-02-03-0012

15. Laconte J, Kasmi A, Aufrère R, et al. A Survey of Localization Methods for Autonomous Vehicles in Highway Scenarios. Sensors. 2021, 22(1): 247. doi: 10.3390/s22010247

16. Levinson J, Askeland J, Dolson J, et al. Traffic light mapping, localization, and state detection for autonomous vehicles. 2011 IEEE International Conference on Robotics and Automation. Published online May 2011. doi: 10.1109/icra.2011.5979714

17. Spangenberg R, Goehring D, Rojas R. Pole-based localization for autonomous vehicles in urban scenarios. 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Published online October 2016. doi: 10.1109/iros.2016.7759339

18. Wang L, Zhang Y, Wang J. Map-Based Localization Method for Autonomous Vehicles Using 3D-LIDAR * *This work is supported in part by the National Natural Science Foundation of China under Grant No. 61473209. IFAC-PapersOnLine. 2017, 50(1): 276-281. doi: 10.1016/j.ifacol.2017.08.046

19. Kuutti S, Fallah S, Katsaros K, et al. A Survey of the State-of-the-Art Localization Techniques and Their Potentials for Autonomous Vehicle Applications. IEEE Internet of Things Journal. 2018, 5(2): 829-846. doi: 10.1109/jiot.2018.2812300

20. Bounini F, Gingras D, Pollart H, et al. Real time cooperative localization for autonomous vehicles. 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC). Published online November 2016. doi: 10.1109/itsc.2016.7795707

21. Héry E, Xu P, Bonnifait P. Consistent decentralized cooperative localization for autonomous vehicles using LiDAR, GNSS, and HD maps. Journal of Field Robotics. 2021, 38(4): 552-571. doi: 10.1002/rob.22004

22. Burki M, Schaupp L, Dymczyk M, et al. VIZARD: Reliable Visual Localization for Autonomous Vehicles in Urban Outdoor Environments. 2019 IEEE Intelligent Vehicles Symposium (IV). Published online June 2019. doi: 10.1109/ivs.2019.8814017

23. Meng X, Wang H, Liu B. A Robust Vehicle Localization Approach Based on GNSS/IMU/DMI/LiDAR Sensor Fusion for Autonomous Vehicles. Sensors. 2017, 17(9): 2140. doi: 10.3390/s17092140

24. de Miguel MÁ, García F, Armingol JM. Improved LiDAR Probabilistic Localization for Autonomous Vehicles Using GNSS. Sensors. 2020, 20(11): 3145. doi: 10.3390/s20113145

25. Elhousni M, Huang X. A Survey on 3D LiDAR Localization for Autonomous Vehicles. 2020 IEEE Intelligent Vehicles Symposium (IV). Published online October 19, 2020. doi: 10.1109/iv47402.2020.9304812

26. Li Q, Queralta JP, Gia TN, et al. Multi-Sensor Fusion for Navigation and Mapping in Autonomous Vehicles: Accurate Localization in Urban Environments. Unmanned Systems. 2020, 08(03): 229-237. doi: 10.1142/s2301385020500168

27. Jo K, Chu K, Sunwoo M. GPS-bias correction for precise localization of autonomous vehicles. 2013 IEEE Intelligent Vehicles Symposium (IV). Published online June 2013. doi: 10.1109/ivs.2013.6629538

28. Lee SC, Stojmenova K, Sodnik J, et al. Localization vs. internationalization. Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings. Published online September 21, 2019. doi: 10.1145/3349263.3350760

29. Durrant-Whyte H, Rye D, Nebot E. Localization of autonomous guided vehicles. Robotics Research: The Seventh International Symposium. Springer London; 1996. pp. 613-625.

30. Das S, Kumari R, Deepak Kumar S. A Review on Applications of Simultaneous Localization and Mapping Method in Autonomous Vehicles. Advances in Interdisciplinary Engineering. Published online 2021: 367-375. doi: 10.1007/978-981-15-9956-9_37

31. Lee BH, Song JH, Im JH, et al. GPS/DR Error Estimation for Autonomous Vehicle Localization. Sensors. 2015, 15(8): 20779-20798. doi: 10.3390/s150820779

32. Mseddi WS, Sedrine MA, Attia R. YOLOv5 based visual localization for autonomous vehicles. 2021 29th European Signal Processing Conference (EUSIPCO). IEEE, 2021: 746-750.

33. Suganuma N, Yamamto D, Yoneda K. Localization for autonomous vehicle on urban roads. Journal of Advanced Control, Automation and Robotics. 2015, 1(1): 47-53.

34. Kato S, Takeuchi E, Ishiguro Y, et al. An Open Approach to Autonomous Vehicles. IEEE Micro. 2015, 35(6): 60-68. doi: 10.1109/mm.2015.133

35. Steinke N, Ritter CN, Goehring D, et al. Robust LiDAR Feature Localization for Autonomous Vehicles Using Geometric Fingerprinting on Open Datasets. IEEE Robotics and Automation Letters. 2021, 6(2): 2761-2767. doi: 10.1109/lra.2021.3062354

36. Levinson JS. Automatic laser calibration, mapping, and localization for autonomous vehicles. Stanford University; 2011.

37. Zhang Z, Zhao J, Huang C, et al. Learning Visual Semantic Map-Matching for Loosely Multi-Sensor Fusion Localization of Autonomous Vehicles. IEEE Transactions on Intelligent Vehicles. 2023, 8(1): 358-367. doi: 10.1109/tiv.2022.3173662

38. Luo Q, Cao Y, Liu J, et al. Localization and Navigation in Autonomous Driving: Threats and Countermeasures. IEEE Wireless Communications. 2019, 26(4): 38-45. doi: 10.1109/mwc.2019.1800533

39. Aggarwal AK. GPS-Based Localization of Autonomous Vehicles. Autonomous Driving and Advanced Driver-Assistance Systems (ADAS). Published online November 12, 2021: 437-448. doi: 10.1201/9781003048381-24

40. Ren R, Fu H, Xue H, et al. LiDAR‐based robust localization for field autonomous vehicles in off‐road environments. Journal of Field Robotics. 2021, 38(8): 1059-1077. doi: 10.1002/rob.22031

41. Jalal F, Nasir F. Underwater Navigation, Localization and Path Planning for Autonomous Vehicles: A Review. 2021 International Bhurban Conference on Applied Sciences and Technologies (IBCAST). Published online January 12, 2021. doi: 10.1109/ibcast51254.2021.9393315

42. Piperigkos N, Lalos AS, Berberidis K, et al. Cooperative Multi-Modal Localization in Connected and Autonomous Vehicles. 2020 IEEE 3rd Connected and Automated Vehicles Symposium (CAVS). Published online November 2020. doi: 10.1109/cavs51000.2020.9334558