# Advancing Physical AI Through NVIDIA Cosmos Models Exploring how world models enable robots and autonomous systems to navigate physical environments. - **Source:** [Podcast Archives - Software Engineering Daily](https://brifing.si/source/ebac6c96-a262-4d7d-b25b-c51b890e7d05) - **Published:** 2026-10-20 - **Topic:** [Data & AI](https://brifing.si/c/data-ai) - **Original article:** - **On Brifing:** https://brifing.si/s/50eea0f3-aece-4680-8557-46123f59ccb7 ## Transitioning AI to Physical Domains While AI has primarily transformed software engineering, its long-term impact is shifting toward the physical world. This evolution reshapes how autonomous vehicles drive, how factories operate, and how robots navigate complex spaces like warehouses. NVIDIA is leading this transition by focusing on physical AI, which integrates intelligence directly into mechanical systems. ## Core Role of World Models World models serve as the foundation for bringing AI into physical spaces by processing current environmental observations to predict future states. These models allow robots to plan movements and autonomous cars to anticipate road conditions effectively. By predicting what comes next, these systems bridge the gap between digital perception and physical action. ## The Cosmos Model Family NVIDIA is actively developing the Cosmos family of models to advance physical AI and robotics capabilities. These models are designed to handle the complexities of real-world environments, moving beyond static data processing. By leveraging these architectures, developers can create systems that understand and interact with the physical world with higher precision. ## Expertise in Robotics Ecosystems Amit Goel, the Head of Robotics Ecosystem and Edge AI Product at NVIDIA, provides critical insights into this technological shift. With fifteen years of experience at the company, he explains the fundamental differences between digital and physical AI. His perspective highlights the unique challenges of deploying intelligence in dynamic, unpredictable physical settings. ## Two-Tower Architecture Mechanics The two-tower architecture is a key technical component that enables robots to reason and act simultaneously. This design separates perception from execution, allowing for faster decision-making in real-time scenarios. By decoupling these processes, the system maintains high performance while navigating complex environments, ensuring that the robot remains responsive to sudden changes. ## Data Pipeline Challenges Training physical AI models on video data necessitated the creation of entirely new data pipelines. Unlike standard digital datasets, video-based training requires capturing temporal dynamics and spatial relationships accurately. These specialized pipelines allow models to learn from visual inputs, which is essential for robots to interpret their surroundings and perform tasks. ## Developer Accessibility and Tools NVIDIA is lowering the barrier to entry for developers interested in building physical AI applications. Through resources like the GR00T Teleop and LeRobot integration, practitioners can start experimenting with advanced robotics frameworks. These tools provide the necessary infrastructure for developers to implement world models and test their own autonomous solutions. ## Future of Physical Intelligence The integration of world models into robotics marks a significant milestone in artificial intelligence development. As these technologies mature, the ability for machines to predict and adapt to physical environments will become standard. This shift promises to redefine industrial automation, logistics, and household robotics, marking a new era for intelligent physical systems. ## Sources covering this story - https://softwareengineeringdaily.com/podcasts/physical-ai-at-nvidia/ — --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._