Skip to main content

Research Repository

See what's under the surface

Advanced Search

Task workflow design and its impact on performance and volunteers’ subjective preference in virtual citizen science

Sprinks, James; Wardlaw, Jessica; Houghton, Robert J.; Bamford, Steven; Morley, Jeremy

Authors

James Sprinks psxjs6@exmail.nottingham.ac.uk

Jessica Wardlaw Jessica.Wardlaw@nottingham.ac.uk

Robert J. Houghton robert.houghton@nottingham.ac.uk

Steven Bamford steven.bamford@nottingham.ac.uk

Jeremy Morley Jeremy.Morley@os.uk



Abstract

Virtual citizen science platforms allow non-scientists to take part in scientific research across a range of disciplines. What they ask of volunteers varies considerably in terms of task type, variety, user judgement required and user freedom, which has received little direct investigation. A study was performed with the Planet Four: Craters project to investigate the effect of task workflow design on both volunteer experience and the scientific results they produce. Participants’ feedback through questionnaire responses indicated a preference for interfaces providing greater autonomy and variety, with free-text responses suggesting that autonomy was the more important. This did not translate into improved performance however, with the most autonomous interface not resulting in significantly better performance in data volume, agreement or accuracy compared to other less autonomous interfaces. The interface with the least number of task types, variety and autonomy resulted in the greatest data coverage. Agreement, both between participants and with the expert equivalent, was significantly improved when the interface most directly afforded tasks that captured the required underlying data (i.e. crater position or diameter). The implications for the designers of virtual citizen science platforms is that they have a balancing act to perform, weighing up the importance of user satisfaction, the data needs of the science case and the resources that can be committed both in terms of time and data reduction.

Journal Article Type Article
Journal International Journal of Human-Computer Studies
Electronic ISSN 1071-5819
Publisher Elsevier
Peer Reviewed Peer Reviewed
APA6 Citation Sprinks, J., Wardlaw, J., Houghton, R. J., Bamford, S., & Morley, J. (in press). Task workflow design and its impact on performance and volunteers’ subjective preference in virtual citizen science. International Journal of Human-Computer Studies, doi:10.1016/j.ijhcs.2017.03.003
DOI https://doi.org/10.1016/j.ijhcs.2017.03.003
Keywords Citizen Science, Engagement Task workflow, Interface design
Publisher URL http://www.sciencedirect.com/science/article/pii/S1071581917300332
Related Public URLs https://www.journals.elsevier.com/international-journal-of-human-computer-studies/
Copyright Statement Copyright information regarding this work can be found at the following address: http://creativecommons.org/licenses/by/4.0
Additional Information James Sprinks, Robert Houghton, Steven Bamford and Jeremy Morley were supported by the Horizon Centre for Doctoral Training at the University of Nottingham (RCUK Grant No. EP/G037574/1) and the RCUK’s Horizon Digital Economy Research Institute (RCUK Grant No. EP/G065802/1). The research leading to these results has received funding from the European Union’s Seventh Framework Programme (FP7/2007-2013) under iMars grant agreement no. 607379. Special thanks to Brian Carstensen, web developer and Michael Parrish, software developer based at the Adler Planetarium, Chicago for their support in developing the Planet Four interfaces. Special thanks also to Jenny Taylor,
planetary seismologist at the University of Bristol, for developing the crater counting science case and identifying the required imagery.

Files

IJHCS Manuscript.pdf (1.5 Mb)
PDF

Copyright Statement
Copyright information regarding this work can be found at the following address: http://creativecommons.org/licenses/by/4.0





You might also like



Downloadable Citations

;