M. Jean Harrold
Mary Lou Soffa
Abstract
This paper presents a technique to select a representative set of test cases from a test suite that provides the same coverage as the entire test suite. This selection is performed by identifying, and then eliminating, the redundant and obsolete test cases in the test suite. The representative set replaces the original test suite and thus, potentially produces a smaller test suite. The representative set can also be used to identify those test cases that should be rerun to test the program after it has been changed. Our technique is independent of the testing methodology and only requires an association between a testing requirement and the test cases that satisfy the requirement. We illustrate the technique using the data flow testing methodology. The reduction that is possible with our technique is illustrated by experimental results.
- 1 ~AHO, A. V., SETm, R., XND ULLMAN, J. D Compilers, Princzples~ Techmques, and Tool, ~Addison-Wesley, Reading~ Mass. 1986. ~ACM Transaetmns on Software Engineering and Methodology, Vol 2, No 3, July 1993 Google Scholar
- 2 ~BE~ZER, B. Software Testzng Techniques. Van Nostrand Reinhold, New York, 1990. Google Scholar
- 3 ~FRANKL, P. G., AND WEYUKER, }~. J. An applicable family of data flow testing criteria. IEEE ~Trans. Softw. Eng. SE-14, 10 (Oct. 1988), 1483-1498. Google Scholar
- 4 ~GAREY, M. R., AND JOHNSON, n.S. Computers and ~ntractabdity, A Guide to the Theory of ~NP-Completeness, V. Klee, Ed. Freeman, New York, 1979. Google Scholar
- 5 ~GUPTA, R. A reconfigurable LIW architecture and its compiler. Tech. Rep. 87-3. Dept. ~Computer Science, Univ. Pittsburgh, Pittsburgh, Pa., 1987.Google Scholar
- 6 ~GUPTA, R., AND SOFFA, M.L. Compile-time techniques for improving scalar access perfor- ~mance in parallel memories. IEEE Trans. Parallel and Distruibuted Systems 2, 2 (Apr. ~1991), 138-148. Google Scholar
- 7 ~HARROLD, M. J. An approach to incremental testing. Tech. Rep. 89-1. Ph.D dissertation. ~Dept. Computer Science, Univ. Pittsburgh, Pittsburgh, Pa., 1989. Google Scholar
- 8 ~HARROLD, M. J., A~D KOLTE, P. Combat: A compiler-based data flow testing system. In ~Proceedings of Pacific Northwest Quality Assurance (Oct.). Lawrence and Craig, 1992, ~311 323.Google Scholar
- 9 ~HARROLD, M. J., AND SOFFA, M. L. Computation of interprocedural definition and use ~dependencies. In Proceedings of IEEE Computer Society 1990 International Conference on ~Computer Languages, (New Orleans, La., Mar.). IEEE, 1990, 297-306.Google Scholar
- 10 ~HARROLD, M. J., AND SOFFA, M.L. An incremental data flow testing tool. In Proceedings of ~the 6th International Conference on Testing Computer Software (Washington, D.C., May). ~USPDI, 1989.Google Scholar
- 11 ~HARROLD, M. J., AND SOFFA, M.L. An incremental approach to unit testing during mainte- ~nance. In Proceedings of the Conference on Software Ma~nteaance 1988 (Oct.). IEEE, New ~York, 1988, 362-367.Google Scholar
- 12 ~LASKL J. W., AND KOREL, B. A data flow oriented program testing strategy. IEEE Trans. ~Softw. Eng. SE-9, 3 (May 1983), 347-354.Google Scholar
- 13 ~LEUNC, H. K., AND WHITE, L A cost model to compare regression test strategies. In ~Proceedings of Conference on Software Maintenace 1991 (Oct.). IEEE, New York, 1991, ~201 208.Google Scholar
- 14 ~LEUN6, H. K. L., AND WHITE, L. A study of regression testing. In Proceedings of the 6th ~International Conference on Testing Computer Software (Washington, D.C., May). USPDI, ~1989.Google Scholar
- 15 ~NTAFOS, S. C. An evaluation of required element testing strategies. In Proceedings of the ~7th International Conference on Software Engineering (Mar.). IEEE, New York, 1984, ~250-256. Google Scholar
- 16 ~OSTRAND, T. J., AND WEYUKER, E.J. Using data flow analysis for regression testing. In ~Proceedtngs of the 6th Annual Pacific Northwest Software Quality Conference (Sept.). IEEE, ~New York, 1988, 58-71.Google Scholar
- 17 ~RAPPS, S., AND WEYUKER, E.J. Selecting software test data using data flow information. ~IEEE Trans. Softw. Eng. SE-11, 4 (Apr. 1985), 367-375. Google Scholar
- 18 ~TAHA, A. M., THEBUT, S. M., AND LIu, S.S. An approach to software fault localization and ~revalidation-based on incremental data flow analysis. In Proceedings of COMPSAC 89 ~(Sept.). IEEE, New York, 1989, 527-534.Google Scholar
Index Terms
- A methodology for controlling the size of a test suite
Recommendations
Empirically evaluating Greedy-based test suite reduction methods at different levels of test suite complexity
Test suite reduction is an important approach that decreases the cost of regression testing. A test suite reduction technique operates based on the relationship between the test cases in the regression test suite and the test requirements in the program ...
Probability Model-Based Test Suite Reduction
The paper presents a test suite reduction approach based on probability models in regression testing. First, we model the process of software testing by using the joint probability of both test cases and program faults, and propose two probability ...
Improving Fault Detection Capability by Selectively Retaining Test Cases during Test Suite Reduction
Software testing is a critical part of software development. As new test cases are generated over time due to software modifications, test suite sizes may grow significantly. Because of time and resource constraints for testing, test suite minimization ...
Reviews
Michael Marcotty
Typically, the many modifications that a program undergoes during its lifetime require the development of new test cases, which are usually added to the test suite used for regression testing after modification. Unless special steps are taken, the test suite grows and regression testing becomes time-consuming. This paper presents a technique that helps in the management of software test suites by identifying a representative set of test cases from a suite that provides the same coverage as the entire test suite. This selection is performed by identifying and then eliminating the redundant and obsolete test cases in the test suite. The representative set replaces the original test suite. The representative set can also be used to identify those test cases that should be rerun to test the program after it has been changed. The authors discuss their algorithm in detail and illustrate its use in data flow testing methodology. They also give experimental results that show that, even for small programs, a significant reduction in the test suite may be realized.
Access critical reviews of Computing literature here
Become a reviewer for Computing Reviews.
Comments