Evaluating the Accuracy of User Values Elicited through a Textual Interface

Abstract

This research paper focuses on the accuracy and limitations of user values elicited through a textual interface with questions asked in isolation. The primary objective was to conduct a user study using a textual interface that uses questions in isolation to assess the effectiveness and accuracy of this interface type and questioning style. The study involved exploring various scenarios and associated user values, as well as comparing the textual interface with graphical and audio interfaces tested in four related studies. The user study consisted of 15 participants who interacted with the textual interface. Afterwards, they were tasked with judging and adapting their behaviour models while also evaluating the interface's usability. The findings indicate that while the textual interface demonstrates decent usability, participants did not perceive a strong need for the current system and that compared to other interface types, the textual interface does not yield the most accurate results. This research provides insights into the usability and limitations of a textual interface for eliciting user values. It emphasizes the need for further exploration and development of alternative interface types to enhance accuracy and user engagement.