World models that ignore human beliefs predict the wrong actions, new research shows
World models are supposed to be the missing foundation for autonomous AI agents, predicting how a scene changes when an action is taken. A new paper argues that the current generation of these systems ignores a critical building block: what’s going on inside the heads of the people involved.
Existing world models like Sora, Genie 3, JEPA, and Marble only model the physical layer of the world, according to the paper: objects, positions, motion, and occlusion. What people in that world believe, want, or consider socially appropriate never shows up in their state space. For service robots, medical assistants, or collaborative agents, that’s not enough, because hidden mental states largely drive human behavior. The authors illustrate the gap with a simple example. If someone’s cup gets moved into a cabinet while they’re not looking, the scene looks correct to a purely physical world model. But it still predicts the wrong next action. Only a model that also tracks the person’s belief about where the cup is can explain what they’ll actually do. Their framework, called “Mental World Modeling” (MWM) and published on GitHub, extends classic world models with mental variables like beliefs, attention, goals, intentions, emotions, norms, and social relationships. The target agent only sees an egocentric partial view, while the world model holds the complete state. Every action splits into a physical carrier, such as speaking, pointing, or grasping, and a mental payload, such as comforting, deceiving, or rejecting. The same gesture of sliding a cup across the table can be an apology, a deception, or an act of care. Only the world model holds the variables that tell them apart. The authors explicitly don’t claim to simulate consciousness. Mental states are hypotheses drawn from behavior and context, not measurements. Systems built on the framework should represent uncertainty and keep their assumptions transparent.
