Classification accuracy comparison: hypothesis tests and the use of confidence intervals in evaluations of difference, equivalence and non-inferiority

Foody, Giles M.

Abstract

The comparison of classification accuracy statements has generally been based upon tests of difference or inequality when other scenarios and approaches may be more appropriate. Procedures for evaluating two scenarios with interest focused on the similarity in accuracy values, non-inferiority and equivalence, are outlined following a discussion of tests of difference (inequality). It is also suggested that the confidence interval of the difference in classification accuracy may be used as well as or instead of conventional hypothesis testing to reveal more information about the disparity in the classification accuracy values compared.

Citation

Foody, G. M. Classification accuracy comparison: hypothesis tests and the use of confidence intervals in evaluations of difference, equivalence and non-inferiority. Remote Sensing of Environment, 113(8), https://doi.org/10.1016/j.rse.2009.03.014

• Journal Article Type: Article
• Deposit Date: Jan 29, 2013
• Journal: Remote Sensing of Environment
• Print ISSN: 0034-4257
• Electronic ISSN: 1879-0704
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 113
• Issue: 8
• DOI: https://doi.org/10.1016/j.rse.2009.03.014
• Public URL: https://nottingham-repository.worktribe.com/output/1014397
• Publisher URL: http://dx.doi.org/10.1016/j.rse.2009.03.014
• Additional Information: NOTICE: this is the author’s version of a work that was accepted for publication in Remote Sensing of Environment. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Remote Sensing of Environment, 113,8 (2009) doi: 10.1016/j.rse.2009.03.014