Relative geometry-aware siamese neural network for 6DOF camera relocalization

Li, Qing; Zhu, Jiasong; Cao, Rui; Sun, Ke; Garibaldi, Jonathan M.; Li, Qingquan; Liu, Bozhi; Qiu, Guoping

Abstract

6DOF camera relocalization is an important component of autonomous driving and navigation. Deep learning has recently emerged as a promising technique to tackle this problem. In this paper, we present a novel relative geometry-aware Siamese neural network to enhance the performance of deep learning-based methods through explicitly exploiting the relative geometry constraints between images. We perform multi-task learning and predict the absolute and relative poses simultaneously. We regularize the shared-weight twin networks in both the pose and feature domains to ensure that the estimated poses are globally as well as locally correct. We employ metric learning and design a novel adaptive metric distance loss to learn a feature that is capable of distinguishing poses of visually similar images from different locations.We evaluate the proposed method on public indoor and outdoor benchmarks and the experimental results demonstrate that our method can significantly improve localization performance. Furthermore, extensive ablation evaluations are conducted to demonstrate the effectiveness of different terms of the loss function.

Citation

Li, Q., Zhu, J., Cao, R., Sun, K., Garibaldi, J. M., Li, Q., Liu, B., & Qiu, G. (2021). Relative geometry-aware siamese neural network for 6DOF camera relocalization. Neurocomputing, 426, 134-146. https://doi.org/10.1016/j.neucom.2020.09.071

• Journal Article Type: Article
• Acceptance Date: Sep 8, 2020
• Online Publication Date: Oct 24, 2020
• Publication Date: Feb 22, 2021
• Deposit Date: Feb 13, 2025
• Journal: Neurocomputing
• Print ISSN: 0925-2312
• Electronic ISSN: 1872-8286
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 426
• Pages: 134-146
• DOI: https://doi.org/10.1016/j.neucom.2020.09.071
• Public URL: https://nottingham-repository.worktribe.com/output/45311210
• Publisher URL: https://www.sciencedirect.com/science/article/abs/pii/S0925231220316040?via%3Dihub
• Other Repo URL: https://doi.org/10.48550/arXiv.1901.01049