On the Relationship between Similarity Measures and Thresholds of Statistical Significance in the Context of Comparing Fuzzy Sets

McCulloch, Josie; Ellerby, Zack; Wagner, Christian

Abstract

Comparing fuzzy sets by computing their similarity is common, with a large set of measures of similarity available. However, while commonplace in the computational intelligence community, the application and results of similarity measures are less common in the wider scientific context, where statistical approaches are the standard for comparing distributions. This is challenging, as it means that developments around similarity measures arising from the fuzzy community are inaccessible to the wider scientific community; and that the fuzzy community fails to take advantage of a strong statistical understanding which may be applicable to comparing (fuzzy membership) functions. In this paper, we commence a body of work on systematically relating the outputs of similarity measures to the notion of statistically significant difference; that is, how (dis)similar do two fuzzy sets need to be for them to be statistically different? We explain that in this context it is useful to initially focus on dis-similarity, rather than similarity, as the former aligns directly with the widely used concept of statistical difference. We propose two methods of applying statistical tests to the outputs of fuzzy dissimilarity measures to determine significant difference. We show how the proposed work provides deeper insight into the behaviour and possible interpretation of degrees of dis-similarity and, consequently, similarity, and how the interpretation differs in respect to context (e.g., the complexity of the fuzzy sets).

Citation

McCulloch, J., Ellerby, Z., & Wagner, C. (2019). On the Relationship between Similarity Measures and Thresholds of Statistical Significance in the Context of Comparing Fuzzy Sets. IEEE Transactions on Fuzzy Systems, https://doi.org/10.1109/tfuzz.2019.2922161

• Journal Article Type: Article
• Acceptance Date: May 31, 2019
• Online Publication Date: Jun 11, 2019
• Publication Date: Jun 11, 2019
• Deposit Date: Jun 12, 2019
• Publicly Available Date: Jun 12, 2019
• Journal: IEEE Transactions on Fuzzy Systems
• Print ISSN: 1063-6706
• Electronic ISSN: 1941-0034
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• DOI: https://doi.org/10.1109/tfuzz.2019.2922161
• Keywords: Fuzzy sets; Standards; Testing; Significance
• Public URL: https://nottingham-repository.worktribe.com/output/2178864
• Publisher URL: https://ieeexplore.ieee.org/document/8734767
• Additional Information: © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.