Section 5 Review

Section 5 built a complete metrics and reporting discipline: choosing quality KPIs and defect metrics that reflect real outcomes, measuring automation health and release readiness beyond raw counts, and translating that data correctly for both executive and engineering audiences.

Knowledge Check

Work through these four scenarios before checking the Section 5 Solutions.

Scenario 1: The Growing Test-Case Count

A QA Manager's quality report leads with "test cases executed this quarter: 3,200, up from 2,100 last year," presented as a success story. What's missing from this metric, and what should replace it?

Scenario 2: The Ignored Red Suite

An automated suite has grown to 2,000 tests, but developers have started ignoring red results, assuming they're probably flaky. What metric would diagnose this, and what should the response be?

Scenario 3: The Deck Nobody Discusses

A fifteen-slide, highly detailed quality deck presented quarterly to executive leadership consistently generates no discussion or follow-up decisions. What's the likely cause?

Scenario 4: The Ignored Engineering Report

An engineering team ignores a weekly quality report because it's just a single flake-rate percentage with no further detail. What's missing, and how should it be fixed?

Next: Check your answers against the Section 5 Solutions, then continue to Section 6 — Team Management.