Java Unit Testing Tool Competition - Eighth Round

Conference paper (2020)

Authors

Xavier Devroey Software Engineering - EEMCS
Sebastiano Panichella Zurich University of Applied Science (ZHAW)
Alessio Gambi University of Passau
Research Group
Software Engineering (EEMCS) (TU Delft)
Copyright: © 2020 Xavier Devroey, Sebastiano Panichella, Alessio Gambi
DOI: https://doi.org/10.1145/3387940.3392265
More Info
expand_more

Published Date

2020

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Department

Software Technology

Research Group

Software Engineering

Abstract

We report on the results of the eighth edition of the Java unit testing tool competition. This year, two tools, EvoSuite and Randoop, were executed on a benchmark with (i) new classes under test, selected from open-source software projects, and (ii) the set of classes from one project considered in the previous edition. We relied on an updated infrastructure for the execution of the different tools and the subsequent coverage and mutation analysis based on Docker containers. We considered two different time budgets for test case generation: one an three minutes. This paper describes our method- ology and statistical analysis of the results, presents the results achieved by the contestant tools and highlights the challenges we faced during the competition.

Files

Author_version.pdf
(pdf | 0.503 Mb)
Unknown license
3387940.3392265.pdf
(pdf | 0.193 Mb)
Unknown license

Download not available