Critical Defects [Functional Validation]

Software testing 101

Critical Defects [Functional Validation]

What is “Critical Defects”?

The  “Critical Defects” DevOps quality metric tracks how the total amount of critical functional defects changes over time. Critical functional defects are estimated to cause severe damage to the user experience and/or the organization delivering the application.  

How “Critical Defects” Ranks vs. Other Quality Metrics

In new Forrester research on DevOps quality metrics, DevOps leaders ranked “Critical Defects” as the #2 most valued functional validation quality metric. Of the 21% of DevOps leaders who measured this metric, 66% of them ranked it as one of their most valuable DevOps quality metrics. This metric was not found to be a “DevOps Differentiator” (DevOps experts/leaders measured it significantly more than DevOps laggards did).

Here‘s a quick look at how “Critical Defects” is positioned vs. other Functional Validation Metrics—based on the raw data collected from DevOps experts. “DevOps Differentiators” are highlighted in green.

These findings are expanded upon in the new ebook: Forrester Research on DevOps Quality Metrics that Matter: 75 Common Metrics—Ranked by Industry Experts.