Bias in Face Image Classification Machine Learning Models: The Impact of Annotator’s Gender and Race - Artificial Intelligence Applications and Innovations Access content directly
Conference Papers Year : 2022

Bias in Face Image Classification Machine Learning Models: The Impact of Annotator’s Gender and Race

Andreas Kafkalias
  • Function : Author
  • PersonId : 1406758
Stylianos Herodotou
  • Function : Author
  • PersonId : 1406759
Zenonas Theodosiou
  • Function : Author
  • PersonId : 1406760
Andreas Lanitis
  • Function : Author
  • PersonId : 992473

Abstract

An important factor that ensures the correct operation of Machine Learning models is the quality of data used during the model training process. Quite often, training data is annotated by humans, and as a result, annotation bias may be introduced. In this study, we focus on face image classification and aim to quantify the effect of annotation bias introduced by different groups of annotators, allowing in that way the understanding of the problems that arise due to annotation bias. The results of the experiments indicate that the performance of Machine Learning models in several face image interpretation tasks is correlated to the self-reported demographic characteristics of the annotators. In particular, we found significant correlation to annotator race, while correlation to gender is less profound. Furthermore, experimental results show that it is possible to determine the group of annotators involved in the annotation process by considering the annotation data provided by previously unseen annotators. The results emphasize the risks of annotation bias in Machine Learning models.
Embargoed file
Embargoed file
0 4 6
Year Month Jours
Avant la publication
Wednesday, January 1, 2025
Embargoed file
Wednesday, January 1, 2025
Please log in to request access to the document

Dates and versions

hal-04668664 , version 1 (07-08-2024)

Licence

Identifiers

Cite

Andreas Kafkalias, Stylianos Herodotou, Zenonas Theodosiou, Andreas Lanitis. Bias in Face Image Classification Machine Learning Models: The Impact of Annotator’s Gender and Race. 18th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2022, Hersonissos, Greece. pp.89-100, ⟨10.1007/978-3-031-08337-2_8⟩. ⟨hal-04668664⟩
0 View
0 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More