Skip to main content

Research Repository

Advanced Search

A "non-parametric" version of the naive Bayes classifier

Soria, Daniele; Garibaldi, Jonathan M.; Ambrogi, Federico; Biganzoli, Elia M.; Ellis, Ian O.

Authors

Daniele Soria

Jonathan M. Garibaldi

Federico Ambrogi

Elia M. Biganzoli

Ian O. Ellis



Abstract

Many algorithms have been proposed for the machine learning task of classication. One of the simplest methods, the naive Bayes classifyer, has often been found to give good performance despite the fact that its underlying assumptions (of independence and a Normal distribution of the variables) are perhaps violated. In previous work, we applied naive Bayes and other standard algorithms to a breast cancer database from Nottingham City Hospital in which the variables are highly non-Normal and found that the algorithm performed well when predicting a class that had been derived from the same data. However, when we then applied naive Bayes to predict an alternative clinical variable, it performed much worse than other techniques. This motivated us to propose an alternative method, based on naive Bayes, which removes the requirement for the variables to be Normally distributed, but retains the essential structure and other underlying assumptions of the method. We tested our novel algorithm on our breast cancer data and on three UCI datasets which also exhibited strong violations of Normality. We found our algorithm outperformed naive Bayes in all four cases and outperformed multinomial logistic regression (MLR) in two cases. We conclude that our method offers a competitive alternative to MLR and naive Bayes when dealing with data sets in which non-Normal distributions are observed.

Citation

Soria, D., Garibaldi, J. M., Ambrogi, F., Biganzoli, E. M., & Ellis, I. O. (2011). A "non-parametric" version of the naive Bayes classifier. Knowledge-Based Systems, 24(6), doi:10.1016/j.knosys.2011.02.014

Journal Article Type Article
Publication Date Aug 1, 2011
Deposit Date Jan 30, 2015
Publicly Available Date Jan 30, 2015
Journal Knowledge-Based Systems
Print ISSN 0950-7051
Electronic ISSN 0950-7051
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 24
Issue 6
DOI https://doi.org/10.1016/j.knosys.2011.02.014
Public URL http://eprints.nottingham.ac.uk/id/eprint/28135
Publisher URL http://www.sciencedirect.com/science/article/pii/S0950705111000414
Copyright Statement Copyright information regarding this work can be found at the following address: http://eprints.nottingham.ac.uk/end_user_agreement.pdf
Additional Information This is the author’s version of a work that was accepted for publication in Knowledge-Based Systems. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Knowledge-Based Systems, 24(6), 2011. doi:10.1016/j.knosys.2011.02.014.

Files


soria2011a.pdf (1 Mb)
PDF

Copyright Statement
Copyright information regarding this work can be found at the following address: http://eprints.nottingham.ac.uk/end_user_agreement.pdf





You might also like



Downloadable Citations