Increasing interpretability in XAI: Addressing the design principles for interactive XUIs to increase interpretability in XAI for end-users

Master thesis (2024)

Authors

Y. Ren Technology, Policy and Management

Contributors

Aaron Yi Ding (mentor)
J. Zatarain Salazar Policy Analysis - TPM (graduation committee member)
M. Westberg (coach)
Faculty
Technology, Policy and Management, Technology, Policy and Management
More Info
expand_more

Published Date

17-05-2024

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Technology, Policy and Management

Abstract

Recent advancements in artificial intelligence (AI), particularly in deep learning, have significantly enhanced AI capabilities but have also led to more complex and less interpretable algorithms. This research addresses the challenge of Explainable AI (XAI) by focusing on enhancing the interpretability of AI decisions through the use of Explainable User Interfaces (XUI). The study identifies two primary knowledge gaps: the predominance of XAI research targeting technically skilled users, neglecting the end-user who often lacks technical expertise, and the insufficient exploration of user-centric design principles in real-world XUI applications.

The research adopts the Design Science Research Method (DSRM) to develop an XUI tailored for the FOKUS project, which uses Electrocardiogram (ECG) data to detect myocardial infarctions. The study emphasises the strategic application of interactive design principles such as complementary naturalness, flexibility in explanation methods, and responsiveness through progressive disclosure to improve the system’s interpretability. Notably, sensitivity to context and mind, though not initially implemented, emerged as a critical design principle from the analysis and was subsequently positioned at the pinnacle of a restructured pyramid model of design principles.

Key findings highlight the effectiveness of the selected design principles in enhancing interpretability and underscore the importance of involving stakeholders early in the development process to align the XAI and XUI with end-user needs. The research proposes a structured design approach framework for XUI, involving sequential phases from pre-XAI to XUI design, to systematically integrate user feedback and improve the design iteratively. The proposed framework restructured pyramid model of the design principles aim to guide future developments in XAI and XUI, enhancing their practical application and effectiveness in various contexts.