Crowd-sourcing applied to photograph-based automatic habitat classification

Torres Torres, Mercedes; Qiu, Guoping

Abstract

Habitat classification is a crucial activity for monitoring environmental biodiversity. To date, manual methods, which are laborious, time-consuming and expensive, remain the most successful alternative. Most automatic methods use remote-sensed imagery but remotely sensed images lack the necessary level of detail. Previous studies have treated automatic habitat classification as an image-annotation problem and have developed a framework that uses ground-taken photographs, feature extraction and a random-forest-based classifier to automatically annotate unseen photographs with their habitats. This paper builds on this previous framework with two new contributions that explore the benefits of applying crowd-sourcing methodologies to automatically collect, annotate and classify habitats. First, we use Geograph, a crowd-sourcing photograph website, to collect a larger geo-referenced ground-taken photograph database, with over 3,000 photographs and 11,000 habitats. We tested the original framework on this much larger database and show that it maintains its success rate. Second, we use a crowd-sourcing mechanism to obtain higher-level semantic features, designed to improve the limitations that visual features have for Fine-Grained Visual Categorization (FGVC) problems, such as habitat classification. Results show that the inclusion of these features improves the performance of a previous framework, particularly in terms of precision.

Citation

Torres Torres, M., & Qiu, G. (2014, November). Crowd-sourcing applied to photograph-based automatic habitat classification. Presented at MAED 2014 - Proceedings of the 3rd ACM International Regular and Data Challenge Workshop on Multimedia Analysis for Ecological Data, Orlando Florida USA

• Presentation Conference Type: Edited Proceedings
• Conference Name: MAED 2014 - Proceedings of the 3rd ACM International Regular and Data Challenge Workshop on Multimedia Analysis for Ecological Data
• Start Date: Nov 7, 2014
• End Date: Nov 7, 2014
• Acceptance Date: Jun 1, 2014
• Publication Date: Nov 7, 2014
• Deposit Date: Sep 13, 2017
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• Pages: 19-24
• Book Title: MAED '14: Proceedings of the 3rd ACM International Workshop on Multimedia Analysis for Ecological Data
• ISBN: 9781450331234
• DOI: https://doi.org/10.1145/2661821.2661824
• Public URL: https://nottingham-repository.worktribe.com/output/1125137
• Publisher URL: https://dl.acm.org/citation.cfm?doid=2661821.2661824