Skip to main content

Research Repository

Advanced Search

MRPR: a MapReduce solution for prototype reduction in big data classification

Triguero, Isaac; Peralta, Daniel; Bacardit, Jaume; García, Salvador; Herrera, Francisco

Authors

Daniel Peralta

Jaume Bacardit

Salvador García

Francisco Herrera



Abstract

In the era of big data, analyzing and extracting knowledge from large-scale data sets is a very interesting and challenging task. The application of standard data mining tools in such data sets is not straightforward. Hence, a new class of scalable mining method that embraces the huge storage and processing capacity of cloud platforms is required. In this work, we propose a novel distributed partitioning methodology for prototype reduction techniques in nearest neighbor classification. These methods aim at representing original training data sets as a reduced number of instances. Their main purposes are to speed up the classification process and reduce the storage requirements and sensitivity to noise of the nearest neighbor rule. However, the standard prototype reduction methods cannot cope with very large data sets. To overcome this limitation, we develop a MapReduce-based framework to distribute the functioning of these algorithms through a cluster of computing elements, proposing several algorithmic strategies to integrate multiple partial solutions (reduced sets of prototypes) into a single one. The proposed model enables prototype reduction algorithms to be applied over big data classification problems without significant accuracy loss. We test the speeding up capabilities of our model with data sets up to 5.7 millions of instances. The results show that this model is a suitable tool to enhance the performance of the nearest neighbor classifier with big data.

Journal Article Type Article
Publication Date Feb 20, 2015
Journal Neurocomputing
Print ISSN 0925-2312
Electronic ISSN 0925-2312
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 150
Issue A
APA6 Citation Triguero, I., Peralta, D., Bacardit, J., GarcĂ­a, S., & Herrera, F. (2015). MRPR: a MapReduce solution for prototype reduction in big data classification. Neurocomputing, 150(A), https://doi.org/10.1016/j.neucom.2014.04.078
DOI https://doi.org/10.1016/j.neucom.2014.04.078
Keywords Big data, Mahout, Hadoop, Prototype reduction, Prototype generation, Nearest neighbor classification
Publisher URL http://www.sciencedirect.com/science/article/pii/S0925231214013009?via%3Dihub
Copyright Statement Copyright information regarding this work can be found at the following address: http://creativecommons.org/licenses/by-nc-nd/4.0

Files

triguero-peralta-bacardit-garcia-herrera-HadoopPG.pdf (443 Kb)
PDF

Copyright Statement
Copyright information regarding this work can be found at the following address: http://creativecommons.org/licenses/by-nc-nd/4.0





You might also like



Downloadable Citations

;