CLEF NewsREEL 2016

Kille, B; Lommatzsch, A; Hopfgartner, Frank; Larson, M.A.; Seiler, J; Malagoli, Davide; Sereny, A; Brodt, T

CLEF NewsREEL 2016

Comparing Multi-Dimensional Offline and Online Evaluation of News Recommender Systems

Conference paper (2016)

Authors

B Kille Technical University of Berlin

A Lommatzsch Technical University of Berlin

Frank Hopfgartner University of Glasgow

M.A. Larson

J Seiler Plista GmbH

Davide Malagoli ContentWise R&D

A Sereny ContentWise R&D

T Brodt Plista GmbH

Recommender systems News Living lab Multi-dimensional evaluation Stream-based recommender

To reference this document use:

http://resolver.tudelft.nl/uuid:0247afec-b474-4b7e-9135-892b817b85ee

More Info

expand_more

Published Date

2016

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Running in its third year at CLEF, NewsREEL challenged participantsto develop news recommendation algorithms and have them benchmarked inan online (Task 1) and offline setting (Task 2), respectively. This paper providesan overview of the NewsREEL scenario, outlines this year’s campaign, presentsresults of both tasks, and discusses the approaches of participating teams. Moreover,it overviews ideas on living lab evaluation that have been presented as partof a “New Ideas” track at the conference in Portugal. Presented results illustratepotentials for multi-dimensional evaluation of recommendation algorithms ina living lab and simulation based evaluation setting.