Conference Papers Year : 2024

Machine Learning Metrics for Network Datasets Evaluation

Dominik Soukup
  • Function : Author
  • PersonId : 1509108
Daniel Uhříček
  • Function : Author
  • PersonId : 1509109
Daniel Vašata
  • Function : Author
  • PersonId : 1509110
Tomáš Čejka
  • Function : Author
  • PersonId : 995399

Abstract

High-quality datasets are an essential requirement for leveraging machine learning (ML) in data processing and recently in network security as well. However, the quality of datasets is overlooked or underestimated very often. Having reliable metrics to measure and describe the input dataset enables the feasibility assessment of a dataset. Imperfect datasets may require optimization or updating, e.g., by including more data and merging class labels. Applying ML algorithms will not bring practical value if a dataset does not contain enough information. This work addresses the neglected topics of dataset evaluation and missing metrics. We propose three novel metrics to estimate the quality of an input dataset and help with its improvement or building a new dataset. This paper describes experiments performed on public datasets to show the benefits of the proposed metrics and theoretical definitions for more straightforward interpretation. Additionally, we have implemented and published Python code so that the metrics can be adopted by the worldwide scientific community.
Embargoed file
Embargoed file
1 10 10
Year Month Jours
Avant la publication
Friday, January 1, 2027
Embargoed file
Friday, January 1, 2027
Please log in to request access to the document

Dates and versions

hal-04953436 , version 1 (18-02-2025)

Licence

Identifiers

Cite

Dominik Soukup, Daniel Uhříček, Daniel Vašata, Tomáš Čejka. Machine Learning Metrics for Network Datasets Evaluation. 38th IFIP International Conference on ICT Systems Security and Privacy Protection (SEC), Jun 2023, Poznan, Poland. pp.307-320, ⟨10.1007/978-3-031-56326-3_22⟩. ⟨hal-04953436⟩
0 View
0 Download

Altmetric

Share

More