Topic briefing
Robot Foundation Models
An introduction to broadly trained models for robot perception, planning, language grounding, and action.
Updated · By Physical AI Guide Editorial Team
Robot foundation models are broadly trained models intended to support more than one task, environment, or robot. Their inputs may include images, language, robot state, and demonstrations; their outputs may include representations, plans, or actions.
The central idea
Traditional robot learning often builds a model for one task and hardware setup. Foundation-model research asks whether diverse datasets can produce reusable knowledge—about objects, instructions, spatial relationships, or action—that can be adapted rather than rebuilt.
Vision-language-action models
A vision-language-action model connects observations and instructions to robot actions. The name describes an interface, not a guarantee of generality or reliability. Systems differ in data, architecture, action horizon, supported hardware, and the safeguards around execution.
The data challenge
Internet-scale text and images are abundant; high-quality robot trajectories are not. Robot data is expensive, heterogeneous, and tied to particular bodies. Research therefore combines demonstrations, teleoperation, simulation, video, synthetic data, and cross-robot normalization.
Questions for readers
Ask which robots and tasks appear in training, how performance is measured, whether results transfer to new settings, and how failures are detected. A broad model can still require task-specific data and conventional control.
See the glossary for key vocabulary and What Is Physical AI? for the wider stack.