University of Minnesota
Software Engineering Center

You are here

Moving the Goalposts: Coverage Satisfaction is Not Enough

Date of Publication: 
June 2014
Associated Research Groups: 
Publication Files: 
Structural coverage criteria have been proposed to measure the adequacy of testing efforts. Indeed, in some domains—e.g., critical systems areas—structural coverage criteria must be satisfied to achieve certification. The advent of powerful search-based test generation tools has given us the ability to generate test inputs to satisfy these structural coverage criteria. While tempting, recent empirical evidence indicates these tools should be used with caution, as merely achieving high structural coverage is not necessarily indicative of high fault detection ability. In this report, we review some of these findings, and offer recommendations on how the strengths of search-based test generation methods can alleviate these issues.
7th International Workshop on Search-Based Software Testing (SBST'14). Hyderabad, India, June 2014.
@inproceedings{gay2014moving, title={Moving the goalposts: coverage satisfaction is not enough}, author={Gay, Gregory and Staats, Matt and Whalen, Michael W and Heimdahl, Mats PE}, booktitle={Proceedings of the 7th International Workshop on Search-Based Software Testing}, pages={19--22}, year={2014}, organization={ACM} }