Good practices for estimating area and assessing accuracy of land change

Olofsson, Pontus; Foody, Giles M.; Herold, Martin; Stehman, Stephen V.; Woodcock, Curtis E.; Wulder, Michael A.

Abstract

The remote sensing science and application communities have developed increasingly reliable, consistent, and robust approaches for capturing land dynamics to meet a range of information needs. Statistically robust and transparent approaches for assessing accuracy and estimating area of change are critical to ensure the integrity of land change information. We provide practitioners with a set of “good practice” recommendations for designing and implementing an accuracy assessment of a change map and estimating area based on the reference sample data. The good practice recommendations address the three major components: sampling design, response design and analysis. The primary good practice recommendations for assessing accuracy and estimating area are: (i) implement a probability sampling design that is chosen to achieve the priority objectives of accuracy and area estimation while also satisfying practical constraints such as cost and available sources of reference data; (ii) implement a response design protocol that is based on reference data sources that provide sufficient spatial and temporal representation to accurately label each unit in the sample (i.e., the “reference classification” will be considerably more accurate than the map classification being evaluated); (iii) implement an analysis that is consistent with the sampling design and response design protocols; (iv) summarize the accuracy assessment by reporting the estimated error matrix in terms of proportion of area and estimates of overall accuracy, user's accuracy (or commission error), and producer's accuracy (or omission error); (v) estimate area of classes (e.g., types of change such as wetland loss or types of persistence such as stable forest) based on the reference classification of the sample units; (vi) quantify uncertainty by reporting confidence intervals for accuracy and area parameters; (vii) evaluate variability and potential error in the reference classification; and (viii) document deviations from good practice that may substantially affect the results. An example application is provided to illustrate the recommended process.

Citation

Olofsson, P., Foody, G. M., Herold, M., Stehman, S. V., Woodcock, C. E., & Wulder, M. A. (2014). Good practices for estimating area and assessing accuracy of land change. Remote Sensing of Environment, 148, 42-57. https://doi.org/10.1016/j.rse.2014.02.015

• Journal Article Type: Article
• Acceptance Date: Feb 22, 2014
• Online Publication Date: Apr 12, 2014
• Publication Date: May 25, 2014
• Deposit Date: Aug 11, 2017
• Publicly Available Date: Aug 11, 2017
• Journal: Remote Sensing of Environment
• Print ISSN: 0034-4257
• Electronic ISSN: 1879-0704
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 148
• Pages: 42-57
• DOI: https://doi.org/10.1016/j.rse.2014.02.015
• Keywords: Accuracy assessment; Sampling design; Response design; Area estimation; Land change; Remote sensing
• Public URL: https://nottingham-repository.worktribe.com/output/728216
• Publisher URL: http://www.sciencedirect.com/science/article/pii/S0034425714000704
• Additional Information: This article is maintained by: Elsevier; Article Title: Good practices for estimating area and assessing accuracy of land change; Journal Title: Remote Sensing of Environment; CrossRef DOI link to publisher maintained version: https://doi.org/10.1016/j.rse.2014.02.015; Content Type: article; Copyright: Copyright © 2014 Elsevier Inc. All rights reserved.
• Contract Date: Aug 11, 2017