Skip to main content

Research Repository

See what's under the surface

Advanced Search

Comparing experts and novices in Martian surface feature change detection and identification

Wardlaw, Jessica; Sprinks, James; Houghton, Robert; Muller, Jan-Peter; Sidiropoulos, Panagiotis; Bamford, Steven; Marsh, Stuart

Authors

Jessica Wardlaw

James Sprinks

Robert Houghton

Jan-Peter Muller

Panagiotis Sidiropoulos

Steven Bamford

Stuart Marsh



Abstract

Change detection in satellite images is a key concern of the Earth Observation field for environmental and climate change monitoring. Satellite images also provide important clues to both the past and present surface conditions of other planets, which cannot be validated on the ground. With the volume of satellite imagery continuing to grow, the inadequacy of computerised solutions to manage and process imagery to the required professional standard is of critical concern. Whilst studies find the crowd sourcing approach suitable for the counting of impact craters in single images, images of higher resolution contain a much wider range of features, and the performance of novices in identifying more complex features and detecting change, remains unknown.

This paper presents a first step towards understanding whether novices can identify and annotate changes in different geomorphological features. A website was developed to enable visitors to flick between two images of the same location on Mars taken at different times and classify 1) if a surface feature changed and if so, 2) what feature had changed from a pre-defined list of six. Planetary scientists provided “expert” data against which classifications made by novices could be compared when the project subsequently went public.

Whilst no significant difference was found in images identified with surface changes by expert and novices, results exhibited differences in consensus within and between experts and novices when asked to classify the type of change. Experts demonstrated higher levels of agreement in classification of changes as dust devil tracks, slope streaks and impact craters than other features, whilst the consensus of novices was consistent across feature types; furthermore, the level of consensus amongst regardless of feature type. These trends are secondary to the low levels of consensus found, regardless of feature type or classifier expertise. These findings demand the attention of researchers who want to use crowd-sourcing for similar scientific purposes, particularly for the supervised training of computer algorithms, and inform the scope and design of future projects.

Journal Article Type Article
Journal International Journal of Applied Earth Observation and Geoinformation
Print ISSN 0303-2434
Electronic ISSN 0303-2434
Publisher Elsevier
Peer Reviewed Peer Reviewed
APA6 Citation Wardlaw, J., Sprinks, J., Houghton, R., Muller, J., Sidiropoulos, P., Bamford, S., & Marsh, S. (in press). Comparing experts and novices in Martian surface feature change detection and identification. International Journal of Applied Earth Observation and Geoinformation, doi:10.1016/j.jag.2017.05.014
DOI https://doi.org/10.1016/j.jag.2017.05.014
Keywords Crowd sourcing; Citizen science; Volunteered geographic information; Planetary science; Change detection; Image analysis
Publisher URL http://www.sciencedirect.com/science/article/pii/S030324341730123X
Copyright Statement Copyright information regarding this work can be found at the following address: http://creativecommons.org/licenses/by-nc-nd/4.0

Files

Wardlaw_et_al_2017_acceptedManuscript.pdf (943 Kb)
PDF

Copyright Statement
Copyright information regarding this work can be found at the following address: http://creativecommons.org/licenses/by-nc-nd/4.0





You might also like



Downloadable Citations

;