Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Modeling the Effects of Combining Diverse Software Fault Detection Techniques
Littlewood B., Popov P., Strigini L., Shryane N. IEEE Transactions on Software Engineering26 (12):1157-1167,2000.Type:Article
Date Reviewed: Jun 1 2001

There have been relatively few studies on the effectiveness of applying different fault-finding strategies together. The authors propose a model to estimate this efficacy. They find that researchers tend to assume statistical independence for repeated applications of the same strategy. They suggest that, in real life, we should be able to find fewer faults with such repetitions. On the other hand, they prove that when the expected efficacies of different strategies are the same, the most diverse choice of strategies will give the best results. They verify their model using empirical studies on a railroad signaling system. The paper is innovative and interesting.

The paper has a serious limitation, however. Although the authors argue against the assumption of statistical independence, the main proofs are actually based on this assumption. They support their case by quoting the law of diminishing returns, so that the probability that a strategy fails will increase when it is repeatedly applied. Unfortunately, this law may not be true in general, because people learn from experience. Consider a program with only three input cases, one of which is at fault. Suppose the strategy is to execute one test case randomly. When a sensible tester applies the strategy the first, second, and third time, the probabilities that it fails to work will be two-thirds, one-half, and zero, respectively. In such circumstances, the main proofs and, hence, the main results in the paper will no longer apply.

Reviewer:  T.H. Tse Review #: CR125179
Bookmark and Share
 
Testing And Debugging (D.2.5 )
 
Would you recommend this review?
yes
no
Other reviews under "Testing And Debugging": Date
Software defect removal
Dunn R., McGraw-Hill, Inc., New York, NY, 1984. Type: Book (9789780070183131)
Mar 1 1985
On the optimum checkpoint selection problem
Toueg S., Babaoglu O. SIAM Journal on Computing 13(3): 630-649, 1984. Type: Article
Mar 1 1985
Software testing management
Royer T., Prentice-Hall, Inc., Upper Saddle River, NJ, 1993. Type: Book (9780135329870)
Mar 1 1994
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2023 ThinkLoud®
Terms of Use
| Privacy Policy