SLAMB&MAI: a comprehensive methodology for SLAM benchmark and map accuracy improvement

Liu, Shengshu; Sun, Erhui; Dong, Xin

Abstract

SLAM Benchmark plays a pivotal role in the field by providing a common ground for performance evaluation. In this paper, a novel methodology of simultaneous localization and mapping benchmark and map accuracy improvement (SLAMB&MAI) is introduced. It can objectively evaluate errors of localization and mapping, and further improve map accuracy by utilizing evaluation results as feedback. The proposed benchmark transforms all elements into a global frame and measures the errors between them. The comprehensiveness consists in the benchmark of both localization and mapping, and the objectivity consists in the consideration of the correlation between localization and mapping by the preservation of the original pose relations between all reference frames. The map accuracy improvement is realized by first obtaining the optimization that minimizes the errors between the estimated trajectory and ground truth trajectory and then applying it to the estimated map. The experimental results showed that the map accuracy can be improved by an average of 15%. The optimization that yields minimal localization errors is obtained by the proposed Centre Point Registration-Iterative Closest Point (CPR-ICP). This proposed Iterative Closest Point (ICP) variant pre-aligns two point clouds by their centroids and least square planes and then uses traditional ICP to minimize the error between them. The experimental results showed that CPR-ICP outperformed traditional ICP, especially in cases involving large-scale environments. To the extent of our knowledge, this is the first work that can not only objectively benchmark both localization and mapping but also revise the estimated map and increase its accuracy, which provides insights into the acquisition of ground truth map and robot navigation.

Citation

Liu, S., Sun, E., & Dong, X. (2024). SLAMB&MAI: a comprehensive methodology for SLAM benchmark and map accuracy improvement. Robotica, https://doi.org/10.1017/S0263574724000079

• Journal Article Type: Article
• Acceptance Date: Dec 11, 2023
• Online Publication Date: Jan 30, 2024
• Publication Date: Jan 30, 2024
• Deposit Date: Feb 16, 2024
• Journal: Robotica
• Print ISSN: 0263-5747
• Electronic ISSN: 1469-8668
• Publisher: Cambridge University Press
• Peer Reviewed: Peer Reviewed
• DOI: https://doi.org/10.1017/S0263574724000079
• Keywords: Comprehensive and objective SLAM benchmark; map ground truth; map error correction; map accuracy improvement; ground truth acquisition
• Public URL: https://nottingham-repository.worktribe.com/output/31452910
• Publisher URL: https://www.cambridge.org/core/journals/robotica/article/abs/slambmai-a-comprehensive-methodology-for-slam-benchmark-and-map-accuracy-improvement/AB336F5E891E365235148BD2DCBBFB40