Beyond Scoring: Rethinking Ranking in the LLM Era
Watch the recording
Watch on YouTubeRanking systems have traditionally been built around carefully engineered objective functions, learned behavior, and years of optimization. But what happens when we introduce models that can reason, interpret intent, and understand natural language? This talk explores how LLMs are reshaping modern ranking systems through the lens of engineering tradeoffs.
Drawing on the latest academic research and public industry work, we'll examine emerging approaches to expressing ranking objectives, combining reasoning with prediction, designing production-ready architectures, and tackling new challenges around validation and continuous improvement. Rather than focusing on a single architecture, this session explores what researchers and industry practitioners are trying today, what seems promising, and what questions remain open.
Key Takeaways:
Practical challenges with launching LLM-powered systems in production and open research areas.
About the speaker
Rhea Goel:
Rhea Goel is an Applied Science Manager at Amazon, where she leads the development of large-scale machine learning systems for ranking, recommendations, and personalization. Her work focuses on applied AI, production ML, and LLM-powered systems.
More Sessions
Join the builders, testers, and innovators shaping the next generation of web experiences.
Testμ Conf 2026 is where they meet.
