![Page 1: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/1.jpg)
COMPARING THE DEFECT REDUCTION BENEFITS OF CODE INSPECTION AND TEST-DRIVEN
DEVELOPMENT
By Veronika Movagharianpourand Adam Brakel
![Page 2: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/2.jpg)
IntroductionSoftware Developers face challenges:
Producing high-quality software with low-defect levels while doing it on-time and on-budget
![Page 3: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/3.jpg)
4 Cases to ExploreCase 1: No Code Inspections or Test Driven Development
Case 2: Code Inspection Only
Case 3: Test Driven Development
Case 4: Code Inspection and Test Driven Development
![Page 4: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/4.jpg)
No Code Inspections and NoTest Driven Development
We know from our reading and other student’s reports that programs will have bugs.
That the everyday debugging that occurs does not catch all of them.
So NOT testing in addition to the minimal amount carried out is just a poor design choice!
![Page 5: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/5.jpg)
Code Inspection
We all know what the process for Code Inspections is…
![Page 6: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/6.jpg)
Error Detection Efficiency of Software Inspection
Defect yield rates for SI ranges between 66 and 82 percent where the total number of defects prior to inspection is:
The Defect Detection Yield was found to be:
![Page 7: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/7.jpg)
Test Driven Development
Writing automated unit tests before code Subsequent coding completed when all new
and previous tests succeed Process completed iteratively until software
is complete Successful unit tests execution verified after
write code and refactor steps
![Page 8: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/8.jpg)
The Process of TDD Identifies and removes defects at the
introduced point in the development process
Early defect elimination is the TDD most significant benefit
Leads to huge cost saving due to early defect removal
![Page 9: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/9.jpg)
An Example of Test Driven Development
Example Explanation –
Run Demo -
![Page 10: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/10.jpg)
Purpose & Research Questions: 1. Which software defect reduction method
is most effective at reducing software defects?
H1:Code inspection is more effective than TDD at reducing software defects. 2. Are there interaction effects associated
with the combined use of these methods?H2: The combined use of code inspection and TDD is more effective than either method alone. 3. What are the relative costs of these
software defect reduction methods?H3:Code Inspection and TDD differ in implementation cost
![Page 11: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/11.jpg)
Research Method
Programming assignment: creating part of a spam filter using Java
554 non-commentary source statements on average
261 NCSS provided in a starter project
![Page 12: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/12.jpg)
Participants Excluded by Group:
Participants: undergraduate computer science students With good Java programming and object-
oriented design knowledge Highly motivated to perform well
![Page 13: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/13.jpg)
Experimental Procedures: All Participants were trained in the
Inspection Process and TDD using JUnit. They were then given a detailed
description of the spam filter they were to code and were given two weeks to do so.
Then the resulting code from each of the four groups was analyzed.
![Page 14: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/14.jpg)
Measurements:
Measurement explanation: - Using “yield” to measure selected method effectiveness- Yield measure is not reliably for TDD
number of defects found by using the method Yield = --------------------------------------------------------------------Total Number of defects prior to inspection
![Page 15: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/15.jpg)
Cost of Testing Methods: The total cost is the sum of three areas of
activity; 1. the original development hours by the code
author. 2. the hours spent by software inspectors and
moderator (preparation time + meeting time). 3. hours spent by the author correcting
defects by inspection. TDD seems to save the implementation
cost Inspection had the highest
implementation cost
![Page 16: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/16.jpg)
Implementation Cost:
![Page 17: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/17.jpg)
Threats to Validity: Internal:
Section bias: possibility of unequal participants division
Mortality bias: unequal number of members in each group
Maturation bias: unequal participants learning rates during experiment
Order bias: vulnerability to order bias caused by performed inspections order and whether they were performed on the first or second inspection day
Implementation bias: variability in the treatment conditions implementing or applying means
![Page 18: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/18.jpg)
Threats to Validity (continue)
External: Participants were undergraduate junior or senior
students, not professional programmers Code inspectors were also college students
without code inspection experience Code inspection process did not follow the
normal regulations. Authors did not participate the inspections The iterative cycle of rework, follow-up, and reinspection
did not performed Inspectors performed multiple inspections of
code performing the same function in a short time resulting in finding more defects in the later inspections
![Page 19: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/19.jpg)
Results:
![Page 20: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/20.jpg)
Implementation Cost Summaries:
![Page 21: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/21.jpg)
Summary of Results
![Page 22: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/22.jpg)
Summary and Conclusions: Compare of defect rates and implementation
costs associated with code inspection and test-driven development software defect reduction methods: Inspection:
More effective at reducing defects More expensive to implement
TDD May result in implementation cost savings
More research is require to validate this findings
![Page 23: Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development](https://reader035.vdocuments.us/reader035/viewer/2022062222/56816932550346895de082de/html5/thumbnails/23.jpg)
¿¿¿ Questions ???