Aggregate-strength interaction test suite prioritization

Huang, Rubing; Chen, Jinfu; Towey, Dave; Chan, Alvin T.S.; Lu, Yansheng

Abstract

Combinatorial interaction testing is a widely used approach. In testing, it is often assumed that all combinatorial test cases have equal fault detection capability, however it has been shown that the execution order of an interaction test suite's test cases may be critical, especially when the testing resources are limited. To improve testing cost-effectiveness, test cases in the interaction test suite can be prioritized, and one of the best-known categories of prioritization approaches is based on “fixed-strength prioritization”, which prioritizes an interaction test suite by choosing new test cases which have the highest uncovered interaction coverage at a fixed strength (level of interaction among parameters). A drawback of these approaches, however, is that, when selecting each test case, they only consider a fixed strength, not multiple strengths. To overcome this, we propose a new “aggregate-strength prioritization”, to combine interaction coverage at different strengths. Experimental results show that in most cases our method performs better than the test-case-generation, reverse test-case-generation, and random prioritization techniques. The method also usually outperforms “fixed-strength prioritization”, while maintaining a similar time cost.

Citation

Huang, R., Chen, J., Towey, D., Chan, A. T., & Lu, Y. (2015). Aggregate-strength interaction test suite prioritization. Journal of Systems and Software, 99, https://doi.org/10.1016/j.jss.2014.09.002

• Journal Article Type: Article
• Acceptance Date: Sep 2, 2014
• Online Publication Date: Sep 16, 2014
• Publication Date: Jan 30, 2015
• Deposit Date: May 14, 2018
• Publicly Available Date: May 14, 2018
• Journal: Journal of Systems and Software
• Print ISSN: 0164-1212
• Electronic ISSN: 1873-1228
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 99
• DOI: https://doi.org/10.1016/j.jss.2014.09.002
• Keywords: Software testing; combinatorial interaction testing; test case prioritization; interaction coverage; fixed-strength prioritization; aggregate-strength prioritization;algorithm
• Public URL: https://nottingham-repository.worktribe.com/output/742234
• Publisher URL: https://www.sciencedirect.com/science/article/pii/S0164121214001940
• Contract Date: May 14, 2018