# NVIDIA Launches Auto Ontology for Agentic Data Reasoning An open-source framework building semantic layers to improve LLM data accuracy. - **Source:** [Hacker News (news.ycombinator.com)](https://brifing.si/source/13c923cd-6d99-442b-9b8b-1181f4d8cd91) - **Published:** 2026-11-03 - **Topic:** [Data & AI](https://brifing.si/c/data-ai) - **Original article:** - **On Brifing:** https://brifing.si/s/8d9bc676-0303-4c31-a99f-a00345d5441d ## Bridging Data and Agents NVIDIA released Auto Ontology to address reliability gaps in agentic analytics. Agents often struggle with data context, leading to inaccurate revenue metrics or incorrect SQL generation. This open-source library constructs a semantic layer from enterprise metadata, allowing agents to understand data origins, definitions, and relationships across complex systems. ## Technical Architecture Overview The system utilizes a FastAPI backend with LangChain for NL-to-SQL tasks and a Postgres database with pgvector for metadata and embeddings. It features a Next.js frontend for UI-based data cataloging and analysis. The architecture supports flexible deployment via Docker Compose or Kubernetes Helm charts for enterprise-grade scalability. ## Semantic Layer Mechanism Auto Ontology reconciles definitions across disparate systems by creating a unified catalog stored in Postgres. It exposes this layer to agent harnesses through MCP, CLI, and API endpoints. By providing a structured context layer, it ensures that LLMs generate deterministic queries rather than relying on ambiguous, unverified data interpretations. ## NVIDIA NIM Integration The framework leverages NVIDIA NIM endpoints for inference, supporting both hosted and self-hosted models. Configuration is managed through environment variables, allowing users to define specific models for chat, ingestion, and embedding roles. This modular design ensures compatibility with various LLM backends while maintaining a consistent API gateway. ## Authentication and Security Security is managed via Better Auth, supporting RBAC and SSO configurations. For sensitive environments, the system integrates with HashiCorp Vault to secure database connection strings, preventing plaintext storage. API access is facilitated through token-based authentication, enabling secure programmatic interaction for scripts, notebooks, and automated scheduled data jobs. ## Conversational Context Handling The FastAPI backend manages conversation history by loading up to five recent turns, bounded at 12,000 characters. It rewrites contextual follow-up questions into standalone queries before executing the text-to-SQL graph. This stateful approach ensures that conversational agents maintain coherence without reusing raw SQL result sets as input context. ## Deployment and Governance Distributed under the Apache License 2.0, the project currently operates as a closed-contribution repository maintained by NVIDIA. Users are responsible for managing external data interactions and compliance. The framework includes specific evaluation tools, such as the BIRD benchmark repository, to validate SQL generation accuracy before production deployment. ## Strategic Significance Auto Ontology represents a shift toward deterministic, explainable AI in enterprise settings. By formalizing the relationship between raw data and natural language interfaces, it reduces the hallucination risks inherent in agentic workflows. This tool provides the necessary infrastructure for organizations to build reliable, data-driven agents on top of existing relational sources. ## Sources covering this story - https://github.com/NVIDIA/auto-ontology — --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._