Combining visual natural markers and IMU for improved AR based indoor navigation

Neges, Matthias; Koch, Christian; K�nig, Markus; Abramovici, Michael

Abstract

The operation and maintenance phase is the longest and most expensive life-cycle period of buildings and facilities. Operators need to carry out activities to maintain equipment to prevent functionality failures. Although some software tools have already been introduced, research studies have concluded that (1) facility handover data is still predominantly dispersed, unformatted and paper-based and (2) hence operators still spend 50% of their on-site work on target localization and navigation. To improve these procedures, the authors previously presented a natural marker-based Augmented Reality (AR) framework that digitally supports facility maintenance operators when navigating indoors. Although previous results showed the practical potential, this framework fails if no visual marker is available, if identical markers are at multiple locations, and if markers are light emitting signs. To overcome these shortcomings, this paper presents an improved method that combines an Inertial Measurement Unit (IMU) based step counter and visual live video feed for AR based indoor navigation support. In addition, the AR based marker detection procedure is improved by learning camera exposure times in case of light emitting markers. A case study and experimental results in a controlled environment reveal the improvements and advantages of the enhanced framework.

Citation

Neges, M., Koch, C., König, M., & Abramovici, M. (2017). Combining visual natural markers and IMU for improved AR based indoor navigation. Advanced Engineering Informatics, 31, 18-31. https://doi.org/10.1016/j.aei.2015.10.005

• Journal Article Type: Article
• Acceptance Date: Oct 12, 2015
• Online Publication Date: Nov 15, 2015
• Publication Date: 2017-01
• Deposit Date: Feb 26, 2016
• Journal: Advanced Engineering Informatics
• Print ISSN: 1474-0346
• Electronic ISSN: 1474-0346
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 31
• Pages: 18-31
• DOI: https://doi.org/10.1016/j.aei.2015.10.005
• Keywords: Indoor Navigation, Augmented Reality, Facility Maintenance, Natural Markers, Inertial Measurement Unit
• Public URL: https://nottingham-repository.worktribe.com/output/767153
• Publisher URL: http://www.sciencedirect.com/science/article/pii/S1474034615001081
• Additional Information: This article is maintained by: Elsevier; Article Title: Combining visual natural markers and IMU for improved AR based indoor navigation; Journal Title: Advanced Engineering Informatics; CrossRef DOI link to publisher maintained version: https://doi.org/10.1016/j.aei.2015.10.005; Content Type: article; Copyright: © 2015 Elsevier Ltd. All rights reserved.