University of Minnesota
Software Engineering Center

You are here

Coverage Metrics for Requirements-Based Testing

Date of Publication: 
July 2006
Associated Research Groups: 
Publication Files: 
In black-box testing, one is interested in creating a suite of tests from requirements that adequately exercise the behavior of a software system without regard to the internal structure of the implementation. In current practice, the adequacy of black box test suites is inferred by examining coverage on an executable artifact, either source code or a software model. In this paper, we define structural coverage metrics directly on high-level formal software requirements. These metrics provide objective, implementation-independent measures of how well a black-box test suite exercises a set of requirements. We focus on structural coverage criteria on requirements formalized as LTL properties and discuss how they can be adapted to measure finite test cases. These criteria can also be used to automatically generate a requirements-based test suite. Unlike model or code-derived test cases, these tests are immediately traceable to high-level requirements. To assess the practicality of our approach, we apply it on a realistic example from the avionics domain.
Proceedings of the 2006 International Symposium on Software Testing and Analysis
@INPROCEEDINGS{Whalen06:CovMetrics-ReqBased, author = {M.W~Whalen and A.~Rajan and M.P.E.~Heimdahl}, title = {Coverage Metrics for Requirements-Based Testing}, booktitle = {Proceedings of International Symposium on Software Testing and Analysis}, pages={25--36}, year = {2006}, Month = {July}, publisher = {ACM} }