A Novel Human-Centred Evaluation Approach and an Argument-Based Method for Explainable Artificial Intelligence - Artificial Intelligence Applications and Innovations
Conference Papers Year : 2022

A Novel Human-Centred Evaluation Approach and an Argument-Based Method for Explainable Artificial Intelligence

Giulia Vilone
  • Function : Author
  • PersonId : 1318689
Luca Longo
  • Function : Author
  • PersonId : 1115845

Abstract

One of the aim of Explainable Artificial Intelligence (XAI) is to equip data-driven, machine-learned models with a high degree of explainability for humans. Understanding and explaining the inferences of a model can be seen as a defeasible reasoning process. This process is likely to be non-monotonic: a conclusion, linked to a set of premises, can be retracted when new information becomes available. In formal logic, computational argumentation is a method, within Artificial Intelligence (AI), focused on modeling defeasible reasoning. This research study focuses on the automatic formation of an argument-based representation for a machine-learned model in order to enhance its degree of explainability, by employing principles and techniques from computational argumentation. It also contributes to the body of knowledge by introducing a novel quantitative human-centred technique to evaluate such a novel representation, and potentially other XAI methods, in the form of a questionnaire for explainability. An experiment have been conducted with two groups of human participants, one interacting with the argument-based representation, and one with a decision trees, a representation deemed naturally transparent and comprehensible. Findings demonstrate that the explainability of the original argument-based representation is statistically similar to that associated to the decision-trees, as reported by humans via the novel questionnaire.
Embargoed file
Embargoed file
0 0 28
Year Month Jours
Avant la publication
Wednesday, January 1, 2025
Embargoed file
Wednesday, January 1, 2025
Please log in to request access to the document

Dates and versions

hal-04317159 , version 1 (01-12-2023)

Licence

Identifiers

Cite

Giulia Vilone, Luca Longo. A Novel Human-Centred Evaluation Approach and an Argument-Based Method for Explainable Artificial Intelligence. 18th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2022, Hersonissos, Greece. pp.447-460, ⟨10.1007/978-3-031-08333-4_36⟩. ⟨hal-04317159⟩
34 View
4 Download

Altmetric

Share

More