# MIT Researchers Develop Uncertainty-Aware Memory System for Robots New UQ-DAAAM framework allows robots to identify and correct mislabeled objects in real-time. - **Source:** [MIT News — AI](https://news.mit.edu/topic/artificial-intelligence2) - **Published:** 2026-11-05 - **Topic:** [technology](https://brifing.si/c/technology) - **Original article:** - **On Brifing:** https://brifing.si/s/3dd22833-71ea-40a2-98ac-2077f5733f7d ## Addressing Robotic Memory Errors Robotic assistants often struggle with misidentified objects, such as confusing a defibrillator with a fire extinguisher. MIT researchers developed UQ-DAAAM to address these critical memory failures. By quantifying uncertainty, the system identifies potentially incorrect labels, ensuring robots can perform complex, multistep tasks safely in both household and industrial environments. ## The UQ-DAAAM Framework Explained The system, standing for Uncertainty Quantification for Describe Anything, Anywhere, at Any Moment, builds upon previous vision-language model research. It compares multiple object descriptions captured from different viewpoints to calculate confidence levels. When uncertainty exceeds a specific threshold, the robot actively seeks additional images to refine its internal object captions. ## Real-Time Processing Efficiency A major challenge was enabling these calculations to run on a moving robot within a fraction of a second. Researchers employed a heuristic rule to select optimal viewpoints without rerunning the vision-language model. This mathematical approach dramatically reduces computational load, allowing for continuous, real-time updates to the robot's 3D environment map. ## Language Model Integration Once additional captions are gathered, a large language model fuses them into a single, accurate description. The system prioritizes new data and less ambiguous captions to resolve conflicts. This refinement process successfully resolves ambiguities for approximately 92 percent of objects in the environment, requiring only two additional captions per object. ## Performance and Accuracy Gains Compared to existing baseline methods, UQ-DAAAM increased the accuracy of object descriptions by 5 percent. The system also improved the robot's ability to answer specific questions regarding object identity, spatial location, and temporal history. These enhancements provide a more reliable foundation for robots operating in dynamic, unpredictable human-centric spaces. ## Safety in Physical AI Senior author Luca Carlone emphasizes that physical AI requires more than simple disclaimers about potential errors. Unlike software-based chatbots, robots must understand their own limitations to operate safely alongside humans. Knowing what it does not know is a fundamental requirement for deploying autonomous systems in real-world, high-stakes scenarios. ## Future Research Directions The team plans to apply UQ-DAAAM to mobile robotic manipulators and explore new domains for uncertainty quantification. They are investigating how robots might proactively revisit areas of high uncertainty to improve environmental understanding. Additionally, the researchers are studying systems that predict the future state of a robot's surrounding environment. ## Academic and Institutional Context The research will be presented at the Conference on Neural Information Processing Systems. The project was led by Luca Carlone, with graduate students Harry Zhang and Nicolas Gorlo serving as co-lead authors. Funding was provided by the U.S. Army Research Laboratory and the U.S. Office of Naval Research for this study. ## Sources covering this story - https://news.mit.edu/2026/clearing-up-robot-fuzzy-memory-1105 — --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._