SIRModel and the Missing Geometry Layer in Vision–Language Manipulation
Long-horizon robotic manipulation requires a policy to bridge task-level semantic reasoning with metric three-dimensional interaction geometry. Existing vision–language–action policies usually acquire geometry implicitly from visual tokens or introduce deterministic intermediate representations that lack spatial grounding. This paper proposes SIRModel, which learns a spatial intermediate representation to parameter-efficiently fine-tune a vision language model for robotic manipulation tasks. In this episode of Embodied AI 101, we explore "SIRModel and the Missing Geometry Layer in…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.