Expedia's AI Chief: Evals Are the New PRD
The future of AI-assisted coding focuses on evaluations.
1The New Role of Evaluations
Expedia's Chief AI and Data Officer Xavi Amatriain stated at VB Transform 2026 that evaluations are the new Product Requirement Document (PRD). This approach involves encoding what the product should do through evaluations.
2The Future of AI-Assisted Coding
Amatriain emphasized that AI-assisted or AI-generated coding will play a significant role in the future. In this process, all thinking will focus on evaluations.
3Feedback Loop
Amatriain noted that artificial business rules in the system disrupt the feedback loop and mislead the user. It's necessary to minimize the impact of these rules.
4Three-Layered AI Governance
Expedia bases AI governance on three layers: principles, processes and tools, and automation. This approach shapes governance according to risk levels.
5The Importance of Specialized Agents
Amatriain argued that systems composed of specialized agents are more effective than a single model. This also enhances system security.
6User Control
In Expedia's system, users must make the final decision. AI agents can make recommendations, but the final click must belong to the user.
7Future Security Threats
Amatriain stated that future attacks could come from other AI systems. Security should be addressed as early as possible as part of the design.