# Snowflake introduces routing feature that cuts AI query costs by 3x Dynamic model routing prevents enterprises from overpaying for simple AI queries. - **Source:** [VentureBeat](https://venturebeat.com) - **Published:** 2026-08-18 - **Topic:** [Data & AI](https://brifing.si/c/data-ai) - **Original article:** - **On Brifing:** https://brifing.si/s/9567549c-3eed-46d3-97d3-c91dd6e96cca ## The cost trap in enterprise AI Companies' AI agents often use a single model for all tasks, leading to overuse of expensive models for simple queries. Snowflake's internal tests show this can increase token costs by up to 300%. Using advanced models for basic questions results in unnecessarily slow and costly responses. The problem worsens at scale where inefficient model usage compounds operational expenses. ## How dynamic routing works Snowflake Cortex AI Gateway operates through two mechanisms: The 'advisor pattern' starts with a smaller model, escalating only when necessary. A classifier analyzes past queries to automatically route simple questions to appropriate models. Customers can optionally pin specific models. Pricing remains purely token-based, with routing decisions incurring no additional fees. ## Security as priority The routing system integrates with Snowflake's existing data governance access controls. All AI inference stays within the company's security perimeter. Role-based access extends from data to models and agents. Regional data residency requirements are automatically handled, especially important for Chinese-origin models like DeepSeek-V4-Flash and GLM-5.3. ## Context reduces costs Snowflake's Horizon Context and Cortex Sense tools provide packaged context, enabling cheaper models to handle tasks. Without context, models waste resources on exploratory work like writing/test SQL. Agent memory accumulates knowledge from repeated use, preventing redundant problem-solving. This context-aware approach significantly cuts computational expenses. ## Competitive market landscape The model routing market divides into three approaches: Databricks focuses on data engineering lineage, Snowflake on analytics/access controls, while neutral gateways like OpenRouter emphasize model variety. According to SanjMo's Sanjeev Mohan, Snowflake's differentiation lies in routing that never exits governed data boundaries - crucial for existing customers. ## Industry adoption Model routing technology is gaining rapid adoption. Nvidia launched Switchyard in August, Databricks introduced Smart Routing for Unity AI Gateway. AWS and Google Cloud are developing similar solutions. Snowflake's Cortex AI Gateway, launched July 2026, stands out with comprehensive enterprise features. The Natoma acquisition added 100+ new connectors. ## Customer flexibility Automatic routing remains optional. Customers can restrict routing to approved model sets. Access controls begin at data level, extending through models to agents. An agent can have narrower permissions than its invoking user. This granular control maintains security while optimizing model selection based on task requirements. ## Future of enterprise AI Snowflake's move represents significant progress in AI operational efficiency. Automatic model selection optimizes both cost and performance. Deep integration with data security/compliance makes it particularly valuable for regulated industries. Model routing could remove cost barriers to enterprise AI adoption while maintaining governance standards. ## Sources covering this story - https://venturebeat.com/orchestration/enterprises-are-overpaying-for-simple-ai-queries-snowflakes-gateway-now-auto-routes-to-cut-costs-up-to-3x — --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._