Comparison of fuzzy integral-fuzzy measure based ensemble algorithms with the state-of-the-art ensemble algorithms

Agrawal, Utkarsh; Pinar, Anthony J.; Wagner, Christian; Havens, Timothy C.; Soria, Daniele; Garibaldi, Jonathan M.

Abstract

The Fuzzy Integral (FI) is a non-linear aggregation operator which enables the fusion of information from multiple sources in respect to a Fuzzy Measure (FM) which captures the worth of both the individual sources and all their possible combinations. Based on the expected potential of non-linear aggregation offered by the FI, its application to decision-level fusion in ensemble classifiers, i.e. to fuse multiple classifiers outputs towards one superior decision level output, has recently been explored. A key example of such a FI-FM ensemble classification method is the Decision-level Fuzzy Integral Multiple Kernel Learning (DeFIMKL) algorithm, which aggregates the outputs of kernel based classifiers through the use of the Choquet FI with respect to a FM learned through a regularised quadratic programming approach. While the approach has been validated against a number of classifiers based on multiple kernel learning, it has thus far not been compared to the state-of-the-art in ensemble classification. Thus, this paper puts forward a detailed comparison of FI-FM based ensemble methods, specifically the DeFIMKL algorithm, with state-of-the art ensemble methods including Adaboost, Bagging, Random Forest and Majority Voting over 20 public datasets from the UCI machine learning repository. The results on the selected datasets suggest that the FI based ensemble classifier performs both well and efficiently, indicating that it is a viable alternative when selecting ensemble classifiers and indicating that the non-linear fusion of decision level outputs offered by the FI provides expected potential and warrants further study.

Citation

Agrawal, U., Pinar, A. J., Wagner, C., Havens, T. C., Soria, D., & Garibaldi, J. M. (2018, June). Comparison of fuzzy integral-fuzzy measure based ensemble algorithms with the state-of-the-art ensemble algorithms. Presented at 17th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU 2018), Cadiz, Spain

• Presentation Conference Type: Edited Proceedings
• Conference Name: 17th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU 2018)
• Start Date: Jun 11, 2018
• End Date: Jun 15, 2018
• Acceptance Date: May 18, 2018
• Online Publication Date: Jun 11, 2018
• Publication Date: Jun 11, 2018
• Deposit Date: May 31, 2018
• Publicly Available Date: Jun 11, 2018
• Peer Reviewed: Peer Reviewed
• Keywords: Ensemble Classification Comparison, Fuzzy Measures, Fuzzy Integrals, Adaboost, Bagging, Majority Voting and Random Forest
• Public URL: https://nottingham-repository.worktribe.com/output/937130
• Contract Date: May 31, 2018