Evaluating the Believability of the Lilobot Conversational Agent

A Bachelor Thesis

Bachelor thesis (2023)

Authors

V. Makarov Electrical Engineering, Mathematics and Computer Science

Contributors

M. Al Owayyed Interactive Intelligence - EEMCS (mentor)
W.P. Brinkman Interactive Intelligence - EEMCS (mentor)
E. Eisemann Computer Graphics and Visualisation - EEMCS (graduation committee member)
Faculty
Electrical Engineering, Mathematics and Computer Science, Electrical Engineering, Mathematics and Computer Science
Copyright: © 2023 Vlad Makarov
More Info
expand_more

Published Date

03-07-2023

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Abstract

The aim of this research is to evaluate the believability of Lilobot, a conversational agent meant to act as a virtual child for training helpline workers. Numerous aspects of believability are explored by means of a user study involving a questionnaire and interview with 10 participants. Questionnaire results indicate that improvement to the chatbot's believability is likely necessary.
The findings from the interviews are that the use of emoticons and acknowledging the context of the application raise believability, while unresponsiveness and repeated utterances lower it. While Lilobot did express valid and real emotions, study participants suggested improving the appropriateness of its reactions and expanding its vocabulary.