Onward! 2014
Mon 20 - Fri 24 October 2014 Portland, Oregon, United States
co-located with SPLASH 2014
Thu 23 Oct 2014 13:30 - 14:15 at Salon A - Session 2 Chair(s): Bernd Bruegge

Everyone wants to know one thing about a test suite: will it detect enough bugs? Unfortunately, in most settings that matter, answering this question directly is impractical or impossible. Software engineers and researchers therefore tend to rely on various measures of code coverage (where mutation testing is considered as a form of syntactic coverage). A long line of academic research efforts have attempted to determine whether relying on coverage as a substitute for fault detection is a reasonable solution to the problems of test suite evaluation. This essay argues that the profusion of coverage-related literature is in part a sign of an underlying uncertainty as to what exactly it is that measuring coverage should achieve, and how we would know if it can, in fact, achieve it. We propose some solutions, but the primary focus is to clarify the state of current confusions regarding this key problem for effective software testing.

Thu 23 Oct

Displayed time zone: Tijuana, Baja California change

13:30 - 15:00
Session 2Onward! Essays at Salon A
Chair(s): Bernd Bruegge Technische Universität München
13:30
45m
Talk
Coverage and Its Discontents
Onward! Essays
Alex Groce Oregon State University, Amin Alipour Oregon State University, Rahul Gopinath Oregon State University
14:15
45m
Talk
Getting to Flow in Software Development
Onward! Essays
Gail Murphy University of British Columbia