Flaky, Fragile, and Forgotten: The Fall of a Test Automation Project
Do you have flaky, fragile, and forgotten tests in your repository? I did. In this session, I will explain why tests end up in such a poor state—and, of course, how to avoid falling into the same trap.
When I joined one of my recent projects, people kept saying they had not been able to deliver properly for a long time. There were constant complaints about instability, slow pipelines, and too many testing-related problems slowing development down.
After spending some time with the team, I realized the issue was much deeper than just "flaky tests." At one point, the entire team had to reserve most of its capacity just to fix broken tests and stabilize automation.
The result was a vicious cycle where tests failed, pipelines became blocked, stories could not be completed, pressure on the team increased, and the quality of the test code degraded even further. Instead of accelerating development, the automation suite had become one of the main bottlenecks preventing delivery.
Test code is as important as product code and directly affects delivery, since failing tests can block the pipeline. Avoiding anti-patterns and following good practices is necessary, but not sufficient on its own. Effective automation requires a holistic approach across the team and system. Without strong lower-level tests and proper tooling, even well-designed system tests will fail to deliver value. Ultimately, success depends on collaboration between QA, developers, product owners, and managers to build a sustainable quality strategy.
Key Takeaways:
Treat automation as a shared responsibility: align QA, developers, and product teams on tooling, ownership, and quality standards.
Reduce duplication and improve clarity: avoid repeated workflows and remove unnecessary abstraction that hides test intent.
Test functionality at the right level and avoid overloading UI tests.
Design tests to eliminate suite dependency and maximize efficiency, ensuring each test is independent, fast, and reliable.
About the speaker
Mesut Durukal:
Mesut is a Quality Assurance Capabilities Leader with extensive experience in test automation, CI/CD transformation, and building quality into development lifecycles. In his role as a cross-squad quality leader, he focuses on scaling organizational quality capabilities across teams while continuously improving the efficiency and impact of QA practices.
About
TestMu Conf
Testμ (TestMu) is the world’s largest virtual conference on agentic engineering and quality, built by the community, for the community. As AI reshapes how we build, test, and ship software, Testμ Conf is where you connect, grow, and lead: agentic workflows, autonomous quality, battle-tested AI playbooks, hands-on workshops, and the engineering culture driving it all.