Skip to main content

Research Repository

Advanced Search

A preliminary study on Hybrid Spill-Tree Fuzzy k-Nearest Neighbors for big data classification

Maillo, Jesus; Luengo, Julián; Garcia, Salvador; Herrera, Francisco; Triguero, Isaac

A preliminary study on Hybrid Spill-Tree Fuzzy k-Nearest Neighbors for big data classification Thumbnail


Authors

Jesus Maillo

Julián Luengo

Salvador Garcia

Francisco Herrera



Abstract

The Fuzzy k Nearest Neighbor (Fuzzy kNN) classifier is well known for its effectiveness in supervised learning problems. kNN classifies by comparing new incoming examples with a similarity function using the samples of the training set. The fuzzy version of the kNN accounts for the underlying uncertainty in the class labels, and it is composed of two different stages. The first one is responsible for calculating the fuzzy membership degree for each sample of the problem in order to obtain smoother boundaries between classes. The second stage classifies similarly to the standard kNN algorithm but uses the previously calculated class membership degree. To deal with very large datasets, distributed versions of the Fuzzy kNN algorithm have been proposed. However, existing approaches remain not fully scalable as they aim to replicate the exact behavior of the Fuzzy kNN. In this work, we present an approximate and distributed Fuzzy kNN approach based on Hybrid Spill-Tree implemented under Apache Spark. The aim of this model is to alleviate the scalability problems and to deal with big datasets maintaining high accuracy. In our experiments, we compare in precision and runtime with the Fuzzy kNN for big data problems existing in the literature, running with datasets of up to 11 million instances. The results show an improvement in the runtime and accuracy with respect to the previous exact model.

Citation

Maillo, J., Luengo, J., Garcia, S., Herrera, F., & Triguero, I. (2018). A preliminary study on Hybrid Spill-Tree Fuzzy k-Nearest Neighbors for big data classification. In 2018 IEEE International Conference on Fuzzy Systems (FUXX-IEEE) (1-8). https://doi.org/10.1109/FUZZ-IEEE.2018.8491595

Conference Name 2018 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE)
Conference Location Rio de Janeiro, Brazil
Start Date Jul 8, 2018
End Date Jul 13, 2018
Acceptance Date Mar 15, 2018
Online Publication Date Oct 15, 2018
Publication Date Oct 12, 2018
Deposit Date Oct 18, 2018
Publicly Available Date Mar 29, 2024
Publisher Institute of Electrical and Electronics Engineers
Pages 1-8
Book Title 2018 IEEE International Conference on Fuzzy Systems (FUXX-IEEE)
Chapter Number N/a
ISBN 978-1-5090-6021-4
DOI https://doi.org/10.1109/FUZZ-IEEE.2018.8491595
Public URL https://nottingham-repository.worktribe.com/output/1175103
Publisher URL https://ieeexplore.ieee.org/document/8491595
Additional Information © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Files




You might also like



Downloadable Citations