TestMu 2026 Home / Video /

Flaky, Fragile, and Forgotten: The Fall of a Test Automation Project | TestMu 2026

Flaky, Fragile, and Forgotten: The Fall of a Test Automation Project | TestMu 2026

...Playlist

...

About the talk

Do you have flaky, fragile, and forgotten tests in your repository? I did. In this session, I will explain why tests end up in such a poor state—and, of course, how to avoid falling into the same trap.

When I joined one of my recent projects, people kept saying they had not been able to deliver properly for a long time. There were constant complaints about instability, slow pipelines, and too many testing-related problems slowing development down.

After spending some time with the team, I realized the issue was much deeper than just "flaky tests." At one point, the entire team had to reserve most of its capacity just to fix broken tests and stabilize automation.

The result was a vicious cycle where tests failed, pipelines became blocked, stories could not be completed, pressure on the team increased, and the quality of the test code degraded even further. Instead of accelerating development, the automation suite had become one of the main bottlenecks preventing delivery.

Test code is as important as product code and directly affects delivery, since failing tests can block the pipeline. Avoiding anti-patterns and following good practices is necessary, but not sufficient on its own. Effective automation requires a holistic approach across the team and system. Without strong lower-level tests and proper tooling, even well-designed system tests will fail to deliver value. Ultimately, success depends on collaboration between QA, developers, product owners, and managers to build a sustainable quality strategy.

Key Takeaways:

Treat automation as a shared responsibility: align QA, developers, and product teams on tooling, ownership, and quality standards.

Reduce duplication and improve clarity: avoid repeated workflows and remove unnecessary abstraction that hides test intent.

Test functionality at the right level and avoid overloading UI tests.

Design tests to eliminate suite dependency and maximize efficiency, ensuring each test is independent, fast, and reliable.

More from TestMu Conf 2026

Session details, speaker bio, and abstract

All 87 TestMu Conf 2026 recordings

TestMu Conf

TestMu Conf

Testμ(TestMu) Conference is TestMu AI’s (Formerly LambdaTest) annual flagship event, one of the world’s largest virtual software testing conferences dedicated to decoding the future of testing and development. Built by the community, for the community, it’s a space where you’re at the center, connecting, learning, and leading together. From deep-dive sessions on emerging trends in engineering, testing, and DevOps, to hands-on workshops and inspiring culture-driven talks, every experience is designed to keep you at the heart of the conversation.

More Videos from TestMu 2026

LT Video

Welcome to TestMu Conference 2026

TestMu 2026
LT Video

Keynote: Testing In The Era of AI - From QA to Trust Engineering

TestMu 2026
LT Video

Building Deterministic Infrastructure for Non Deterministic AI Agents

TestMu 2026
LT Video

Confidence - Correctness The Agentic Validation Loop

TestMu 2026
LT Video

Ask Me Anything: AI Agents, Skills, Career & Growth

TestMu 2026
LT Video

Context That Dreams

TestMu 2026
LT Video

From AI Assistants to AI Coworkers: How Engineering Teams Ship Faster with Enterprise Context

TestMu 2026
LT Video

Architects of Trust: Redefining Quality Leadership in an Agentic World

TestMu 2026
LT Video

When Software Becomes Everyone's Job

TestMu 2026
LT Video

Fireside Chat: AI Trust and Governance in QE - Who Actually Signs Off

TestMu 2026
LT Video

Can You Trust Your ChatBot: Techniques for Testing LLM Responses

TestMu 2026
LT Video

Flaky, Fragile, and Forgotten: The Fall of a Test Automation Project

TestMu 2026
LT Video

The Right Model for the Right Job: Cutting LLM Costs Without Cutting Quality

TestMu 2026
LT Video

System Prompt Design for Voice Agents

TestMu 2026
LT Video

Testing at the Speed of Agents: Salesforce's Evolving Approach to Agentic Testing

TestMu 2026
LT Video

Panel Discussion: The Agentic Software Factory That Enterprises Actually Need

TestMu 2026
LT Video

The Bionic Workforce: Where Humans and AI Co-exist

TestMu 2026
LT Video

Keynote: Beyond Benchmarks - Evaluating Agents Against What They Are Actually Supposed to Do

TestMu 2026
LT Video

Build Trustworthy AI Agents powered by Evals

TestMu 2026
LT Video

Real World Lessons from Scaling Test Automation at Microsoft

TestMu 2026
LT Video

Canal Mania and the Philosopher's Stone

TestMu 2026
LT Video

Why RL Environments Are All You Need for Building Agents

TestMu 2026
LT Video

Panel Discussion: QE at Enterprise Scale - What Will a QE Org Look Like in 2027?

TestMu 2026
LT Video

Working With Developers: A Tester's Survival Guide

TestMu 2026
LT Video

Testing What Matters: Evaluating LLM Relevancy with DeepEval

TestMu 2026
LT Video

Beyond Scoring: Rethinking Ranking in the LLM Era

TestMu 2026
LT Video

Backwards Scoring: Ranking Test Suites by Which Real Incidents They Would Have Caught

TestMu 2026
LT Video

Panel Discussion: The BFSI Playbook - Scaling AI with Trust and Quality

TestMu 2026
LT Video

Keynote: Is the Developer Lifecycle Dead?

TestMu 2026
LT Video

Going Past the Vibes: How to Build Real Apps

TestMu 2026
LT Video

Bringing Mobile App Validation into the Agentic Loop

TestMu 2026
LT Video

Workshop: Advanced Web Testing with Playwright and AI

TestMu 2026
LT Video

Panel Discussion: AI in Mobile QA - What Actually Works Today?

TestMu 2026
LT Video

Local Agentic Theory for Accessible Mobile Games

TestMu 2026
LT Video

Agentic Engineering: From Writing Code to Reviewing It

TestMu 2026
LT Video

Revisit Old Problems with New Eyes

TestMu 2026
LT Video

Panel Discussion: Scaling Enterprise Practice in the Agentic Era

TestMu 2026
LT Video

Workshop: The Full Agentic QA Loop for Web Applications

TestMu 2026
LT Video

The Trust Problem: Designing Quality Frameworks for AI-Generated Code

TestMu 2026
LT Video

Why Does AI Suddenly Need Forward-Deployed Engineers?

TestMu 2026
LT Video

Stop Guessing A11y: Auto-Generate Playwright Tests from Your GraphQL Schema

TestMu 2026
LT Video

Workshop: Debug with Appium MCP

TestMu 2026
LT Video

Your AI Agent Passed Every Test. Your Humans Still Rejected It. Now What?

TestMu 2026
LT Video

You Can't assertEquals an Agent: A Tester's Guide to Agentic Quality

TestMu 2026
LT Video

Panel Discussion: Money Moves at Machine Speed - Trust, Risk, and Quality in Agentic Finance

TestMu 2026
LT Video

From Load Testing to Reliability Engineering: Making Performance Testing Predict Production Behavior

TestMu 2026
LT Video

Scaling Trust, Not Automation - Rethinking Quality for the AI Era

TestMu 2026
LT Video

Eval-First QA Agents: Testing Streaming Platforms at Fox Networks

TestMu 2026
LT Video

Workshop: Engineering RemoteXPC: Building Wireless iOS Automation with Appium

TestMu 2026
LT Video

Agentic AI Changed What We Test, And How We Test It

TestMu 2026
LT Video

Cloud Assumes You Know What a Request Will Cost

TestMu 2026
LT Video

Building Once, Running Everywhere: The Future of Portable AI Applications

TestMu 2026
LT Video

The New Skill Stack for SDETs in the Agentic Era

TestMu 2026
LT Video

Developing AI Agents for Disability and Self Determination: Lessons from Project RAISE

TestMu 2026
LT Video

Panel Discussion: Who Tests the Machines? QE Leaders on Quality in the Age of AI-Written Code

TestMu 2026
LT Video

Fireside Chat: The Economics of AI Agents: How Startups Are Rethinking Value and Monetization

TestMu 2026
LT Video

Agentic AI and the Next Decade of Quality Engineering

TestMu 2026
LT Video

When You Run Out of Requirements: What Happens When You Go All-In on Agents

TestMu 2026
LT Video

Keynote: The Next Era of AI: Moving from “Can We Build It?” to “Can We Trust It?”

TestMu 2026
LT Video

Panel Discussion: Mission-Critical Priorities in Quality Engineering: The Leader's Playbook

TestMu 2026
LT Video

Panel Discussion: Agentic Engineering and Quality in Healthcare

TestMu 2026
LT Video

Scaling Quality in a Decision Intelligence Platform: The Agentic QA Playbook

TestMu 2026
LT Video

Panel Discussion: Driving the Agentic Shift in Banking Adoption Governance and Scale

TestMu 2026
LT Video

Keynote: The Self Driving Company

TestMu 2026
LT Video

AI Applications Security Puzzle

TestMu 2026
LT Video

The Last Manual Handoff: Redesigning End-to-End Testing in the Age of AI

TestMu 2026
LT Video

Panel Discussion: Reinventing the QE Practice at Global Scale in Agentic Era

TestMu 2026
LT Video

Workshop: The Full Agentic QA Loop for Mobile Applications

TestMu 2026
LT Video

The Copilot Wrote It but Who Saves It: Surviving the AI Code Tsunami

TestMu 2026
LT Video

Evidence-Based QA: Proving Quality with Agentic Test Runs and OpenSourcing How We Do It

TestMu 2026
LT Video

ML-Driven Test Intelligence at Scale - What Works What Fails and Why It Matters

TestMu 2026
LT Video

Workshop: Legacy vs Autonomous QA Arena - Surviving the AI Driven Quality Evolution

TestMu 2026
LT Video

Building a Billion-Dollar Healthcare Product at Zebra Technologies

TestMu 2026
LT Video

Productize Yourself: AI Proof Yourself

TestMu 2026
LT Video

AI Architecture Thinking: From Idea to Impact

TestMu 2026
LT Video

Keynote: Will the Real Autonomous Agent Please Stand Up

TestMu 2026
LT Video

Redefining Test Data Strategy in the Gen AI Era

TestMu 2026
LT Video

Build Your Own Benchmark: Why Agents Need Custom Evals and How to Create Them

TestMu 2026
LT Video

From Pilots to Practice: Transforming Sales with AI

TestMu 2026
LT Video

Fast, Smart, and Fragile: Rethinking Testing Leadership in the Age of AI

TestMu 2026
LT Video

Autonomous Quality Engineering: AI Systems That Generate Execute Heal Learn and Govern Quality

TestMu 2026
LT Video

Panel Discussion: Engineering Trust Quality in AI-Driven Commerce

TestMu 2026
LT Video

Discovery Found Everything: Your Agent Still Doesnt Know What Matters

TestMu 2026
LT Video

Testing the Untestable: Turning OWASP AILLM Risks into Practical QA Checks

TestMu 2026
LT Video

When Software Starts Thinking: The Now of Quality Engineering

TestMu 2026
LT Video

AI-Powered Impact-Based Testing for Faster Safer Releases

TestMu 2026
LT Video

Closing Note TestMu Conference 2026

TestMu 2026