University of Minnesota
Software Engineering Center

You are here

Better Testing Through Oracle Selection

Date of Publication: 
May 2011
Associated Research Groups: 
Publication Files: 
In software testing, the test oracle determines if the application under test has performed an execution correctly. In current testing practice and research, significant effort and thought is placed on selecting test inputs, with the selection of test oracles largely neglected. Here, we argue that improvements to the testing process can be made by considering the problem of oracle selection. In particular, we argue that selecting the test oracle and test inputs together to complement one another may yield improvements testing effectiveness. We illustrate this using an example and present selected results from an ongoing study demonstrating the relationship between test suite selection, oracle selection, and fault finding.
New Ideas and Emerging Results Track, 33rd International Conference on Software Engineering, Honolulu, Hawaii, May 21-28, 2011.
@inproceedings{Staats:2011:BTT:1985793.1985936, author = {Staats, Matt and Whalen, Michael W. and Heimdahl, Mats P.E.}, title = {Better testing through oracle selection (NIER track)}, booktitle = {Proceedings of the 33rd International Conference on Software Engineering}, series = {ICSE '11}, year = {2011}, isbn = {978-1-4503-0445-0}, location = {Waikiki, Honolulu, HI, USA}, pages = {892--895}, numpages = {4}, url = {}, doi = {10.1145/1985793.1985936}, acmid = {1985936}, publisher = {ACM}, address = {New York, NY, USA}, keywords = {empirical studies, test oracles}, }