Real-world Lessons from Scaling Test Automation at Microsoft

As software systems grow in scale and complexity, traditional approaches to test automation are no longer enough. At Microsoft, we are evolving test automation by combining scalable automation platforms with AI agents that help engineers generate, maintain, and improve tests more efficiently.

In this session, I will share real-world lessons from scaling test automation across large engineering teams. We will explore how standardized automation frameworks, reliable CI/CD integration, and self-service tooling enable quality at scale. I will also demonstrate how AI agents are transforming the developer experience by generating Playwright tests from requirements, creating meaningful test cases, suggesting improvements to existing tests, and reducing the maintenance effort required to keep automation reliable.

The session will cover practical challenges such as reducing flaky tests, increasing framework adoption across multiple teams, balancing AI-generated tests with human validation, and establishing governance for enterprise-scale automation. You will see how AI can accelerate testing while maintaining the reliability and confidence that engineering teams expect.

Whether you are beginning your AI testing journey or looking to modernize an existing automation ecosystem, you will leave with practical insights and proven strategies that can be applied immediately.