Chatterbox

Conversational Interfaces for Microtask Crowdsourcing

Conference paper (2019)

Authors

P. Mavridis Web Information Systems - EEMCS
Owen Huang Student
S. Qiu Web Information Systems - EEMCS
Ujwal Gadiraju Leibniz Universität
A. Bozzon Human-Centred Artificial Intelligence - IDE , Web Information Systems - EEMCS
Research Group
Web Information Systems (EEMCS) (TU Delft)
Copyright: © 2019 P. Mavridis, Owen Huang, S. Qiu, Ujwal Gadiraju, A. Bozzon
DOI: https://doi.org/10.1145/3320435.3320439
More Info
expand_more

Published Date

2019

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Department

Software Technology

Research Group

Web Information Systems

Abstract

Conversational interfaces can facilitate human-computer interactions. Whether or not conversational interfaces can improve worker experience and work quality in crowdsourcing marketplaces has remained unanswered. We investigate the suitability of text-based conversational interfaces for microtask crowdsourcing. We designed a rigorous experimental campaign aimed at gauging the interest and acceptance by crowdworkers for this type of work interface. We compared Web and conversational interfaces for five common microtask types and measured the execution time, quality of work, and the perceived satisfaction of 316 workers recruited from the FigureEight platform. We show that conversational interfaces can be used effectively for crowdsourcing microtasks, resulting in a high satisfaction from workers, and without having a negative impact on task execution time or work quality.

Files

Chatterbox_preprint.pdf
(pdf | 2.1 Mb)
Unknown license

Download not available

3320435.3320439.pdf
(pdf | 2.57 Mb)
- Embargo expired in 23-03-2023
Unknown license