Skip to main content

Research Repository

Advanced Search

Aggregate-strength interaction test suite prioritization

Huang, Rubing; Chen, Jinfu; Towey, Dave; Chan, Alvin T.S.; Lu, Yansheng

Authors

Rubing Huang

Jinfu Chen

Dave Towey

Alvin T.S. Chan

Yansheng Lu



Abstract

Combinatorial interaction testing is a widely used approach. In testing, it is often assumed that all combinatorial test cases have equal fault detection capability, however it has been shown that the execution order of an interaction test suite's test cases may be critical, especially when the testing resources are limited. To improve testing cost-effectiveness, test cases in the interaction test suite can be prioritized, and one of the best-known categories of prioritization approaches is based on “fixed-strength prioritization”, which prioritizes an interaction test suite by choosing new test cases which have the highest uncovered interaction coverage at a fixed strength (level of interaction among parameters). A drawback of these approaches, however, is that, when selecting each test case, they only consider a fixed strength, not multiple strengths. To overcome this, we propose a new “aggregate-strength prioritization”, to combine interaction coverage at different strengths. Experimental results show that in most cases our method performs better than the test-case-generation, reverse test-case-generation, and random prioritization techniques. The method also usually outperforms “fixed-strength prioritization”, while maintaining a similar time cost.

Citation

Huang, R., Chen, J., Towey, D., Chan, A. T., & Lu, Y. (2015). Aggregate-strength interaction test suite prioritization. Journal of Systems and Software, 99, https://doi.org/10.1016/j.jss.2014.09.002

Journal Article Type Article
Acceptance Date Sep 2, 2014
Online Publication Date Sep 16, 2014
Publication Date Jan 30, 2015
Deposit Date May 14, 2018
Publicly Available Date May 14, 2018
Journal Journal of Systems and Software
Print ISSN 0164-1212
Electronic ISSN 0164-1212
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 99
DOI https://doi.org/10.1016/j.jss.2014.09.002
Keywords Software testing; combinatorial interaction testing; test case prioritization; interaction coverage; fixed-strength prioritization; aggregate-strength prioritization;algorithm
Public URL http://eprints.nottingham.ac.uk/id/eprint/51753
Publisher URL https://www.sciencedirect.com/science/article/pii/S0164121214001940
Copyright Statement Copyright information regarding this work can be found at the following address: http://creativecommons.org/licenses/by-nc-nd/4.0

Files


ASPS-revised-2014.07.29.Dave.pdf (293 Kb)
PDF

Copyright Statement
Copyright information regarding this work can be found at the following address: http://creativecommons.org/licenses/by-nc-nd/4.0



Downloadable Citations