Deep learning for multi-task plant phenotyping

Pound, Michael P.; Atkinson, Jonathan A.; Wells, Darren M.; Pridmore, Tony P.; French, Andrew P.

Abstract

Plant phenotyping has continued to pose a challenge to computer vision for many years. There is a particular demand to accurately quantify images of crops, and the natural variability and structure of these plants presents unique difficulties. Recently, machine learning approaches have shown impressive results in many areas of computer vision, but these rely on large datasets that are at present not available for crops. We present a new dataset, called ACID, that provides hundreds of accurately annotated images of wheat spikes and spikelets, along with image level class annotation. We then present a deep learning approach capable of accurately localising wheat spikes and spikelets, despite the varied nature of this dataset. As well as locating features, our network offers near perfect counting accuracy for spikes (95.91%) and spikelets (99.66%). We also extend the network to perform simultaneous classification of images, demonstrating the power of multi-task deep architectures for plant phenotyping. We hope that our dataset will be useful to researchers in continued improvement of plant and crop phenotyping. With this in mind, alongside the dataset we will make all code and trained models available online.

Citation

Pound, M. P., Atkinson, J. A., Wells, D. M., Pridmore, T. P., & French, A. P. (2017). Deep learning for multi-task plant phenotyping. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017 (2055-2063). https://doi.org/10.1109/ICCVW.2017.241

• Conference Name: ICCV 2017 International Conference on Computer Vision
• Conference Location: Venice, Italy
• End Date: Oct 29, 2017
• Acceptance Date: Aug 12, 2017
• Publication Date: Oct 22, 2017
• Deposit Date: Oct 27, 2017
• Publicly Available Date: Oct 27, 2017
• Peer Reviewed: Peer Reviewed
• Pages: 2055-2063
• Book Title: Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017
• DOI: https://doi.org/10.1109/ICCVW.2017.241
• Public URL: https://nottingham-repository.worktribe.com/output/889149
• Publisher URL: http://openaccess.thecvf.com/content_ICCV_2017_workshops/w29/html/Pound_Deep_Learning_for_ICCV_2017_paper.html