Build Your Own Benchmark: Why Agents Need Custom Evals and How to Create Them | TestMu 2026

Welcome to TestMu Conference 2026

Keynote: Testing In The Era of AI - From QA to Trust Engineering

Building Deterministic Infrastructure for Non Deterministic AI Agents

Confidence - Correctness The Agentic Validation Loop

Ask Me Anything: AI Agents, Skills, Career & Growth

Context That Dreams

From AI Assistants to AI Coworkers: How Engineering Teams Ship Faster with Enterprise Context

Architects of Trust: Redefining Quality Leadership in an Agentic World

When Software Becomes Everyone's Job

Fireside Chat: AI Trust and Governance in QE - Who Actually Signs Off

Can You Trust Your ChatBot: Techniques for Testing LLM Responses

Flaky, Fragile, and Forgotten: The Fall of a Test Automation Project

The Right Model for the Right Job: Cutting LLM Costs Without Cutting Quality

System Prompt Design for Voice Agents

Testing at the Speed of Agents: Salesforce's Evolving Approach to Agentic Testing

Panel Discussion: The Agentic Software Factory That Enterprises Actually Need

The Bionic Workforce: Where Humans and AI Co-exist

Keynote: Beyond Benchmarks - Evaluating Agents Against What They Are Actually Supposed to Do

Build Trustworthy AI Agents powered by Evals

Real World Lessons from Scaling Test Automation at Microsoft

Canal Mania and the Philosopher's Stone

Why RL Environments Are All You Need for Building Agents

Panel Discussion: QE at Enterprise Scale - What Will a QE Org Look Like in 2027?

Working With Developers: A Tester's Survival Guide

Testing What Matters: Evaluating LLM Relevancy with DeepEval

Beyond Scoring: Rethinking Ranking in the LLM Era

Backwards Scoring: Ranking Test Suites by Which Real Incidents They Would Have Caught

Panel Discussion: The BFSI Playbook - Scaling AI with Trust and Quality

Keynote: Is the Developer Lifecycle Dead?

Going Past the Vibes: How to Build Real Apps

Bringing Mobile App Validation into the Agentic Loop

Workshop: Advanced Web Testing with Playwright and AI

Panel Discussion: AI in Mobile QA - What Actually Works Today?

Local Agentic Theory for Accessible Mobile Games

Agentic Engineering: From Writing Code to Reviewing It

Revisit Old Problems with New Eyes

Panel Discussion: Scaling Enterprise Practice in the Agentic Era

Workshop: The Full Agentic QA Loop for Web Applications

The Trust Problem: Designing Quality Frameworks for AI-Generated Code

Why Does AI Suddenly Need Forward-Deployed Engineers?

Stop Guessing A11y: Auto-Generate Playwright Tests from Your GraphQL Schema

Workshop: Debug with Appium MCP

Your AI Agent Passed Every Test. Your Humans Still Rejected It. Now What?

You Can't assertEquals an Agent: A Tester's Guide to Agentic Quality

Panel Discussion: Money Moves at Machine Speed - Trust, Risk, and Quality in Agentic Finance

From Load Testing to Reliability Engineering: Making Performance Testing Predict Production Behavior

Scaling Trust, Not Automation - Rethinking Quality for the AI Era

Eval-First QA Agents: Testing Streaming Platforms at Fox Networks

Workshop: Engineering RemoteXPC: Building Wireless iOS Automation with Appium

Agentic AI Changed What We Test, And How We Test It

Cloud Assumes You Know What a Request Will Cost

Building Once, Running Everywhere: The Future of Portable AI Applications

The New Skill Stack for SDETs in the Agentic Era

Developing AI Agents for Disability and Self Determination: Lessons from Project RAISE

Panel Discussion: Who Tests the Machines? QE Leaders on Quality in the Age of AI-Written Code

Fireside Chat: The Economics of AI Agents: How Startups Are Rethinking Value and Monetization

Agentic AI and the Next Decade of Quality Engineering

When You Run Out of Requirements: What Happens When You Go All-In on Agents

Keynote: The Next Era of AI: Moving from “Can We Build It?” to “Can We Trust It?”

Panel Discussion: Mission-Critical Priorities in Quality Engineering: The Leader's Playbook

Panel Discussion: Agentic Engineering and Quality in Healthcare

Scaling Quality in a Decision Intelligence Platform: The Agentic QA Playbook

Panel Discussion: Driving the Agentic Shift in Banking Adoption Governance and Scale

Keynote: The Self Driving Company

AI Applications Security Puzzle

The Last Manual Handoff: Redesigning End-to-End Testing in the Age of AI

Panel Discussion: Reinventing the QE Practice at Global Scale in Agentic Era

Workshop: The Full Agentic QA Loop for Mobile Applications

The Copilot Wrote It but Who Saves It: Surviving the AI Code Tsunami

Evidence-Based QA: Proving Quality with Agentic Test Runs and OpenSourcing How We Do It

ML-Driven Test Intelligence at Scale - What Works What Fails and Why It Matters

Workshop: Legacy vs Autonomous QA Arena - Surviving the AI Driven Quality Evolution

Building a Billion-Dollar Healthcare Product at Zebra Technologies

Productize Yourself: AI Proof Yourself

AI Architecture Thinking: From Idea to Impact

Keynote: Will the Real Autonomous Agent Please Stand Up

Redefining Test Data Strategy in the Gen AI Era

Build Your Own Benchmark: Why Agents Need Custom Evals and How to Create Them

From Pilots to Practice: Transforming Sales with AI

Fast, Smart, and Fragile: Rethinking Testing Leadership in the Age of AI

Autonomous Quality Engineering: AI Systems That Generate Execute Heal Learn and Govern Quality

Panel Discussion: Engineering Trust Quality in AI-Driven Commerce

Discovery Found Everything: Your Agent Still Doesnt Know What Matters

Testing the Untestable: Turning OWASP AILLM Risks into Practical QA Checks

When Software Starts Thinking: The Now of Quality Engineering

AI-Powered Impact-Based Testing for Faster Safer Releases

Closing Note TestMu Conference 2026