Machine Learning Informed Decision-Making with Interpreted Model's Outputs

A Field Intervention

Conference paper (2021)

Authors

Leid Zejnilović Nova School of Business and Economics, Universidade Nova de Lisboa
Susana Lavado Nova School of Business and Economics, Universidade Nova de Lisboa
Carlos Soares Universidade do Porto
I. Martinez de Rituerto de Troya Nova School of Business and Economics, Universidade Nova de Lisboa
Andrew Bell Nova School of Business and Economics, Universidade Nova de Lisboa
Rayid Ghani Carnegie Mellon University
Affiliation
External organisation
More Info
expand_more

Published Date

2021

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Affiliation

External organisation

Abstract

Despite having set the theoretical ground for explainable systems decades ago, the information system scholars have given little attention to new developments in the decision-making with humans-in-the-loop in real-world problems. We take the sociotechnical system lenses and employ mixed-method analysis of a field intervention to study the machine-learning informed decision-making with interpreted models' outputs. Contrary to theory, our results suggest a small positive effect of explanations on confidence in the final decision, and a negligible effect on the decisions' quality. We uncover complex dynamic interactions between humans and algorithms, and the interplay of algorithmic aversion, trust, experts' heuristic, and changing uncertainty-resolving condititions.