Stop Ordering Machine Learning Algorithms by Their Explainability! An Empirical Investigation of the Tradeoff Between Performance and Explainability - Responsible AI and Analytics for an Ethical and Inclusive Digitized Society Access content directly
Conference Papers Year : 2021

Stop Ordering Machine Learning Algorithms by Their Explainability! An Empirical Investigation of the Tradeoff Between Performance and Explainability

Abstract

Numerous machine learning algorithms have been developed and applied in the field. Their application indicates that there seems to be a tradeoff between their model performance and explainability. That is, machine learning models with higher performance are often based on more complex algorithms and therefore lack interpretability or explainability and vice versa. The true extent of this tradeoff remains unclear while some theoretical assumptions exist. With our research, we aim to explore this gap empirically with a user study. Using four distinct datasets, we measured the tradeoff for five common machine learning algorithms. Our two-factor factorial design considers low-stake and high-stake applications as well as classification and regression problems. Our results differ from the widespread linear assumption and indicate that the tradeoff between model performance and model explainability is much less gradual when considering end user perception. Further, we found it to be situational. Hence, theory-based recommendations cannot be generalized across applications.
Fichier principal
Vignette du fichier
512902_1_En_22_Chapter.pdf (443.62 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03648118 , version 1 (21-04-2022)

Licence

Attribution

Identifiers

Cite

Jonas Wanner, Lukas-Valentin Herm, Kai Heinrich, Christian Janiesch. Stop Ordering Machine Learning Algorithms by Their Explainability! An Empirical Investigation of the Tradeoff Between Performance and Explainability. 20th Conference on e-Business, e-Services and e-Society (I3E), Sep 2021, Galway, Ireland. pp.245-258, ⟨10.1007/978-3-030-85447-8_22⟩. ⟨hal-03648118⟩
25 View
3 Download

Altmetric

Share

Gmail Facebook X LinkedIn More