Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Automated support for reproducing and debugging field failures
Jin W., Orso A. ACM Transactions on Software Engineering and Methodology24 (4):1-35,2015.Type:Article
Date Reviewed: Oct 26 2015

Field failures are difficult to reproduce for debugging in-house. This paper applies a BugRedux technique to capture the essential execution data and to reproduce the failures. It then applies F3, a technique to conduct fault localization of the reproduced failures.

The fault localization approach is developed by optimizing four existing spectrum-based fault localization (SBFL) techniques. Results show that aggressive filtering, using profile information, and grouping relevant entities vastly improve the performance of the SBFL techniques. The similarity of the failing executions justifies the proposed approach. The synthesized programs are sufficient to achieve fault localization. The effectiveness of the SBFL techniques is enhanced. Time and space overheads are acceptable. Thus, the paper is of great importance to the debugging of field failures.

As to the choice of SBFL techniques, the authors selected Ochiai and observation-based model (OBM) for study because of historical interest, and selected Naish1 and Naish2 because they are “optimal.” Please note, however, that the risk evaluation formulas in SBFL form a partially ordered set. Yoo et al. [1] proved mathematically that no formula can be more effective than all the other formulas. The so-called optimal techniques are only local maxima. In particular, Xie et al. [2] proved that Naish1 and Naish2 have exactly the same effectiveness. Furthermore, Xie et al. [2,3] identified ten maximal formulas in five distinct groups such that the formulas in any two groups cannot be compared in effectiveness. It would be interesting if the authors could further optimize a couple of these maximal formulas to better illustrate the advantages of their approach.

Reviewer:  T.H. Tse Review #: CR143883 (1601-0061)
1) Yoo, S.; Xie, X.; Kuo, F.-C.; Chen, T. Y.; and Harman, M. No pot of gold at the end of program spectrum rainbow: greatest risk evaluation formula does not exist. University College London, Research Note, No. RN/14/14 (Nov. 2014), London, UK.
2) Xie, X.; Chen, T. Y.; Kuo, F.-C.; Xu, B. A theoretical analysis of the risk evaluation formulas for spectrum-based fault localization. ACM Transactions on Software Engineering and Methodology 22, 4(2013), Article No. 31.
3) Xie, X.; Kuo, F.-C.; Chen, T. Y.; Yoo, S.; Harman, M. Provably optimal and human-competitive results in SBSE for spectrum based fault localization. In Search based software engineering (LNCS 8084). Springer, 2013, 224-238.
Bookmark and Share
 
Testing And Debugging (D.2.5 )
 
Would you recommend this review?
yes
no
Other reviews under "Testing And Debugging": Date
Software defect removal
Dunn R., McGraw-Hill, Inc., New York, NY, 1984. Type: Book (9789780070183131)
Mar 1 1985
On the optimum checkpoint selection problem
Toueg S., Babaoglu O. SIAM Journal on Computing 13(3): 630-649, 1984. Type: Article
Mar 1 1985
Software testing management
Royer T., Prentice-Hall, Inc., Upper Saddle River, NJ, 1993. Type: Book (9780135329870)
Mar 1 1994
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2023 ThinkLoud®
Terms of Use
| Privacy Policy