Instance reduction for one-class classification

Krawczyk, Bartosz; Triguero, Isaac; García, Salvador; Woźniak, Michał; Herrera, Francisco

Abstract

Instance reduction techniques are data preprocessing methods originally developed to enhance the nearest neighbor rule for standard classification. They reduce the training data by selecting or generating representative examples of a given problem. These algorithms have been designed and widely analyzed in multi-class problems providing very competitive results. However, this issue was rarely addressed in the context of one-class classification. In this specific domain a reduction of the training set may not only decrease the classification time and classifier’s complexity, but also allows us to handle internal noisy data and simplify the data description boundary. We propose two methods for achieving this goal. The first one is a flexible framework that adjusts any instance reduction method to one-class scenario by introduction of meaningful artificial outliers. The second one is a novel modification of evolutionary instance reduction technique that is based on differential evolution and uses consistency measure for model evaluation in filter or wrapper modes. It is a powerful native one-class solution that does not require an access to counterexamples. Both of the proposed algorithms can be applied to any type of one-class classifier. On the basis of extensive computational experiments, we show that the proposed methods are highly efficient techniques to reduce the complexity and improve the classification performance in one-class scenarios.

Citation

Krawczyk, B., Triguero, I., García, S., Woźniak, M., & Herrera, F. (in press). Instance reduction for one-class classification. Knowledge and Information Systems, https://doi.org/10.1007/s10115-018-1220-z

• Journal Article Type: Article
• Acceptance Date: Apr 27, 2018
• Online Publication Date: May 21, 2018
• Deposit Date: May 29, 2018
• Publicly Available Date: May 22, 2019
• Journal: Knowledge and Information Systems
• Print ISSN: 0219-1377
• Electronic ISSN: 0219-1377
• Publisher: Springer Verlag
• Peer Reviewed: Peer Reviewed
• DOI: https://doi.org/10.1007/s10115-018-1220-z
• Keywords: Machine learning ; One-class classification ; Instance reduction ; Training set selection ; Evolutionary computing
• Public URL: https://nottingham-repository.worktribe.com/output/933485
• Publisher URL: https://link.springer.com/article/10.1007%2Fs10115-018-1220-z
• Additional Information: This is a pre-print of an article published in Knowledge and Information Systems. The final authenticated version is available online at: https://doi.org/10.1007/s10115-018-1220-z