Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Belief & evidence in empirical software engineering
Devanbu P., Zimmermann T., Bird C.  ICSE 2016 (Proceedings of the 38th International Conference on Software Engineering, Austin, TX, May 14-22, 2016)108-119.2016.Type:Proceedings
Date Reviewed: Jul 28 2016

A survey of Microsoft software engineers had respondents answer a series of questions about software development. The number of respondents was 564, which represents a 22 percent response rate. There was most agreement for the proposition that code reviews improve software quality. There was least agreement for the proposition that code quality depends on which programming language is used. Some respondents thought that programming skill matters more than language while others thought that fewer mistakes are made using statically typed languages. The survey also asked about how opinions were formed. The boxplot of Figure 1 makes clear that personal experience was the most influential factor while findings from empirical research was in fifth position. Several examples are discussed in which the beliefs of respondents are not aligned with research findings. For example, respondents believed that coding standards help improve software quality, but there is no evidence to support this.

Two geographically distributed Microsoft projects were studied in detail. Millions of changes to code were analyzed to determine the numbers of defect repairs associated with each file. Regression modeling, which took account of confounding factors, found that both projects were essentially comparable in terms of code quality. Members of one of the projects, however, had previously disagreed with the proposition that being geographically distributed did not affect code quality.

A convincing argument is made for improved dissemination of research findings and for software engineers to base their decisions on such findings. This paper is very strongly recommended to the software engineering community.

Reviewer:  Andy Brooks Review #: CR144641 (1611-0810)
Bookmark and Share
  Reviewer Selected
Featured Reviewer
 
 
Software Engineering (D.2 )
 
Would you recommend this review?
yes
no
Other reviews under "Software Engineering": Date
Perspectives of system informatics: a comparative presentation of object-oriented programming with C++ and Java
Broy M. (ed), Zamulin A. (ed), Bjorner D., Springer-Verlag New York, Inc., Secaucus, NJ, 2002.  561, Type: Book (9783540430759)
Jul 3 2003
Relationship quality: the undervalued dimension of software quality
Russell B., Chatterjee S. Communications of the ACM 46(8): 85-89, 2003. Type: Article
Oct 14 2003
Executable JVM model for analytical reasoning: a study
Liu H., Moore J.  Interpreters, Virtual Machines and Emulators (Proceedings of the 2003 workshop, San Diego, California, Jun 12, 2003)15-23, 2003. Type: Proceedings
Sep 24 2003
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy