An Empirical Study on Anomaly Detection Algorithms for Extremely Imbalanced Datasets - Artificial Intelligence Applications and Innovations
Conference Papers Year : 2022

An Empirical Study on Anomaly Detection Algorithms for Extremely Imbalanced Datasets

Gonçalo Fontes
  • Function : Author
  • PersonId : 1318704
Arthur Matta
  • Function : Author
  • PersonId : 1318706
André Pilastri
  • Function : Author
  • PersonId : 1105405

Abstract

Anomaly detection attempts to identify abnormal events that deviate from normality. Since such events are often rare, data related to this domain is usually imbalanced. In this paper, we compare diverse preprocessing and Machine Learning (ML) state-of-the-art algorithms that can be adopted within this anomaly detection context. These include two unsupervised learning algorithms, namely Isolation Forests (IF) and deep dense AutoEncoders (AE), and two supervised learning approaches, namely Random Forest and an Automated ML (AutoML) method. Several empirical experiments were conducted by adopting seven extremely imbalanced public domain datasets. Overall, the IF and AE unsupervised methods obtained competitive anomaly detection results, which also have the advantage of not requiring labeled data.
Embargoed file
Embargoed file
0 0 28
Year Month Jours
Avant la publication
Wednesday, January 1, 2025
Embargoed file
Wednesday, January 1, 2025
Please log in to request access to the document

Dates and versions

hal-04317169 , version 1 (01-12-2023)

Licence

Identifiers

Cite

Gonçalo Fontes, Luís Miguel Matos, Arthur Matta, André Pilastri, Paulo Cortez. An Empirical Study on Anomaly Detection Algorithms for Extremely Imbalanced Datasets. 18th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2022, Hersonissos, Greece. pp.85-95, ⟨10.1007/978-3-031-08333-4_7⟩. ⟨hal-04317169⟩
24 View
1 Download

Altmetric

Share

More