VEGA-3D: Teaching multimodal LLMs spatial reasoning through video generation
A plug-and-play framework extracts implicit 3D priors from video diffusion models to enhance multimodal LLMs with spatial reasoning capabilities, enabling improved geometric scene understanding and embodied decision-making without explicit 3D supervision.
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.