Evidence-Based QA: Proving Quality with Agentic Test Runs — and Open-Sourcing How We Do It

Watch the recording

Watch on YouTube ↗

31:51

In regulated industries, "the tests passed" isn't enough — you need evidence: what ran, against what build, with what result, traceable end to end. This session shows how agentic testing changes the compliance story. Because every Kane-CLI run produces structured execution logs, screenshots, and artifacts by default, evidence collection stops being a manual afterthought and becomes a byproduct of testing itself. We'll then go a step further and introduce evidence-cli, our newly open-sourced tool for capturing, structuring, and exporting quality evidence from test runs — walking through how it turns raw agent output into an audit-ready evidence trail you can attach to a PR, a release, or a compliance report. We'll connect this to DORA metrics and audit-readiness, drawing on patterns from enterprise QE teams in banking, and show how to satisfy both your engineering leaders and your auditors without slowing either down.