Inertial-visual pose tracking using optical flow-aided particle filtering

Moemeni, Armaghan; Tatham, Eric

Abstract

This paper proposes an algorithm for visual-inertial camera pose tracking, using adaptive recursive particle filtering. The method benefits from the agility of inertial-based and robustness of vision-based tracking. A proposal distribution has been developed for the selection of the particles, which takes into account the characteristics of the Inertial Measurement Unit (IMU) and the motion kinematics of the moving camera. A set of state-space equations are formulated, particles are selected and then evaluated using the corresponding features tracked by optical flow. The system state is estimated using the weighted particles through an iterative sequential importance resampling algorithm. For the particle assessment, epipolar geometry, and the characteristics of focus of expansion (FoE) are considered. In the proposed system the computational cost is reduced by excluding the rotation matrix from the process of recursive state estimations. This system implements an intelligent decision making process, which decides on the best source of tracking whether IMU only, hybrid only or hybrid with past state correction. The results show a stable tracking performance with an average location error of a few centimeters in 3D space.

Citation

Moemeni, A., & Tatham, E. (2014, December). Inertial-visual pose tracking using optical flow-aided particle filtering. Presented at 2014 IEEE Symposium on Computational Intelligence for Multimedia, Signal and Vision Processing (CIMSIVP), Orlando, FL, USA

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 2014 IEEE Symposium on Computational Intelligence for Multimedia, Signal and Vision Processing (CIMSIVP)
• Start Date: Dec 9, 2014
• End Date: Dec 12, 2014
• Acceptance Date: Sep 1, 2014
• Online Publication Date: Feb 9, 2015
• Publication Date: 2014-12
• Deposit Date: Jul 21, 2020
• Publisher: Institute of Electrical and Electronics Engineers
• Book Title: 2014 IEEE Symposium on Computational Intelligence for Multimedia, Signal and Vision Processing (CIMSIVP)
• ISBN: 9781479945030
• DOI: https://doi.org/10.1109/cimsivp.2014.7013296
• Keywords: motion tracking, camera pose tracking, 6DOF, Inertial, IMU, particle filtering, optical flow, focus of expansion, SLAM, PTAM,
• Public URL: https://nottingham-repository.worktribe.com/output/4780235
• Publisher URL: https://ieeexplore.ieee.org/document/7013296