What is “New Defects”?
The “New Defects” DevOps quality metric measures the sum of new defects identified during API testing. This can include defects exposed by automated tests as well as other testing approaches (e.g., exploratory testing).
How “New Defects” Ranks vs. Other Quality Metrics
In new Forrester research on DevOps quality metrics, DevOps leaders ranked “New Defects” as the #2 most valued integration/API testing quality metric. Of the 29% of DevOps leaders who measured this metric, 64% of them ranked it as one of their most valuable DevOps quality metrics. This metric was not found to be a “DevOps Differentiator” (DevOps experts/leaders measured it significantly more than DevOps laggards did).
Here‘s a quick look at how “New Defects” is positioned vs. other Integration/API Testing metrics—based on the raw data collected from DevOps experts. “DevOps Differentiators” are highlighted in green.
These findings are expanded upon in the new ebook: Forrester Research on DevOps Quality Metrics that Matter: 75 Common Metrics—Ranked by Industry Experts.