Overlap-Based Undersampling Method for Classification of Imbalanced Medical Datasets - Artificial Intelligence Applications and Innovations Access content directly
Conference Papers Year : 2020

Overlap-Based Undersampling Method for Classification of Imbalanced Medical Datasets

Pattaramon Vuttipittayamongkol
  • Function : Author
  • PersonId : 1245260
Eyad Elyan
  • Function : Author
  • PersonId : 1245261

Abstract

Early diagnosis of some life-threatening diseases such as cancers and heart is crucial for effective treatments. Supervised machine learning has proved to be a very useful tool to serve this purpose. Historical data of patients including clinical and demographic information is used for training learning algorithms. This builds predictive models that provide initial diagnoses. However, in the medical domain, it is common to have the positive class under-represented in a dataset. In such a scenario, a typical learning algorithm tends to be biased towards the negative class, which is the majority class, and misclassify positive cases. This is known as the class imbalance problem. In this paper, a framework for predictive diagnostics of diseases with imbalanced records is presented. To reduce the classification bias, we propose the usage of an overlap-based undersampling method to improve the visibility of minority class samples in the region where the two classes overlap. This is achieved by detecting and removing negative class instances from the overlapping region. This will improve class separability in the data space. Experimental results show achievement of high accuracy in the positive class, which is highly preferable in the medical domain, while good trade-offs between sensitivity and specificity were obtained. Results also show that the method often outperformed other state-of-the-art and well-established techniques.
Fichier principal
Vignette du fichier
500087_1_En_30_Chapter.pdf (517.16 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04060675 , version 1 (06-04-2023)

Licence

Attribution

Identifiers

Cite

Pattaramon Vuttipittayamongkol, Eyad Elyan. Overlap-Based Undersampling Method for Classification of Imbalanced Medical Datasets. 16th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2020, Neos Marmaras, Greece. pp.358-369, ⟨10.1007/978-3-030-49186-4_30⟩. ⟨hal-04060675⟩
10 View
4 Download

Altmetric

Share

Gmail Facebook X LinkedIn More