Objective Evaluation of Subjective Metrics for Interactive Decision-Making Tasks by Non-experts - Human-Computer Interaction – INTERACT 2021 Access content directly
Conference Papers Year : 2021

Objective Evaluation of Subjective Metrics for Interactive Decision-Making Tasks by Non-experts

Abstract

This work addresses the evaluation of interaction techniques for decision-making tasks performed by non-experts in the context of multi-objective optimization problems. Such tasks require making trade-offs between antagonistic criteria, according to individual subjective preferences. Evaluating such techniques is made difficult by the subjective nature of such tasks, as well as by a lack of rigorous methods for assessment. Our primary contributions to this problem are two-fold: (1) a set of subjective metrics including decision accuracy, choice satisfaction, and incentives to explore; (2) the use of a pragmatic approach to map these subjective metrics onto objective quantitative measures. To illustrate how this subjective-objective mapping can be performed in a pragmatic manner, we have conducted an experiment involving 177 participants to objectively measure and compare two multi-slider interaction techniques for decision-making tasks performed by non-experts in the context of domestic energy management. The results of this evaluation constitute a secondary contribution.
Fichier principal
Vignette du fichier
CI-2021-Interact-final-v2-Sliders4DM.pdf (753.99 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03356425 , version 1 (20-10-2022)

Licence

Attribution

Identifiers

Cite

Yann Laurillau, Joëlle Coutaz, van Bao Nguyen, Gaëlle Calvary, Daniel Llerena. Objective Evaluation of Subjective Metrics for Interactive Decision-Making Tasks by Non-experts. 18th IFIP Conference on Human-Computer Interaction (INTERACT), Aug 2021, Bari, Italy. pp.384-403, ⟨10.1007/978-3-030-85613-7_27⟩. ⟨hal-03356425⟩
82 View
125 Download

Altmetric

Share

Gmail Facebook X LinkedIn More