Skip to main content

Research Repository

See what's under the surface

Combining clustering and classification ensembles: A novel pipeline to identify breast cancer profiles

Agrawal, Utkarsh; Soria, Daniele; Wagner, Christian; Garibaldi, Jonathan; Ellis, Ian O.; Bartlett, John M. S.; Cameron, David; Rakha, Emad A.; Green, Andrew R.


Cyber Security Threat Data Analyst -Ktp Associate

Daniele Soria

Christian Wagner

Jonathan Garibaldi

John M. S. Bartlett

David Cameron

Emad A. Rakha

Andrew R. Green


Breast Cancer is one of the most common causes of cancer death in women, representing a very complex disease with varied molecular alterations. To assist breast cancer prognosis, the classification of patients into biological groups is of great significance for treatment strategies. Recent studies have used an ensemble of multiple clustering algorithms to elucidate the most characteristic biological groups of breast cancer. However, the combination of various clustering methods resulted in a number of patients remaining unclustered. Therefore, a framework still needs to be developed which can assign as many unclustered (i.e. biologically diverse) patients to one of the identified groups in order to improve classification. Therefore, in this paper we develop a novel classification framework which introduces a new ensemble classification stage after the ensemble clustering stage to target the unclustered patients. Thus, a step-by-step pipeline is introduced which couples ensemble clustering with ensemble classification for the identification of core groups, data distribution in them and improvement in final classification results by targeting the unclustered data. The proposed pipeline is employed on a novel real world breast cancer dataset and subsequently its robustness and stability are examined by testing it on standard datasets. The results show that by using the presented framework, an improved classification is obtained. Finally, the results have been verified using statistical tests, visualisation techniques, cluster quality assessment and interpretation from clinical experts.

Journal Article Type Article
Publication Date 2019-06
Print ISSN 0933-3657
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 97
Pages 27-37
APA6 Citation Agrawal, U., Soria, D., Wagner, C., Garibaldi, J., Ellis, I. O., Bartlett, J. M. S., …Green, A. R. (2019). Combining clustering and classification ensembles: A novel pipeline to identify breast cancer profiles. Artificial Intelligence in Medicine, 97, 27-37.
Keywords Ensemble Clustering; Ensemble Classification; Class level fusion; Refining cluster results; Breast Cancer; Pipeline
Publisher URL