Online learning and fusion of orientation appearance models for robust rigid object tracking

Marras, Ioannis; Medina, Joan Alabort; Tzimiropoulos, Georgios; Zafeiriou, Stefanos; Pantic, Maja

Abstract

We present a robust framework for learning and fusing different modalities for rigid object tracking. Our method fuses data obtained from a standard visual camera and dense depth maps obtained by low-cost consumer depths cameras such as the Kinect. To combine these two completely different modalities, we propose to use features that do not depend on the data representation: angles. More specifically, our method combines image gradient orientations as extracted from intensity images with the directions of surface normal computed from dense depth fields provided by the Kinect. To incorporate these features in a learning framework, we use a robust kernel based on the Euler representation of angles. This kernel enables us to cope with gross measurement errors, missing data as well as typical problems in visual tracking such as illumination changes and occlusions. Additionally, the employed kernel can be efficiently implemented online. Finally, we propose to capture the correlations between the obtained orientation appearance models using a fusion approach motivated by the original AAM. Thus the proposed learning and fusing framework is robust, exact, computationally efficient and does not require off-line training. By combining the proposed models with a particle filter, the proposed tracking framework achieved robust performance in very difficult tracking scenarios including extreme pose variations.

• Start Date: Apr 22, 2013
• Publication Date: Jul 15, 2013
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Book Title: 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
• ISBN: 978-1-4673-5545-2
• APA6 Citation: Marras, I., Medina, J. A., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013). Online learning and fusion of orientation appearance models for robust rigid object tracking. In 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)doi:10.1109/FG.2013.6553798
• DOI: https://doi.org/10.1109/FG.2013.6553798
• Publisher URL: http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6553798
• Copyright Statement: Copyright information regarding this work can be found at the following address: http://eprints.nottingh.../end_user_agreement.pdf
• Additional Information: © 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.