SpatialDex: Does 3D Video Pretraining Help Bimanual Manipulation?
Can ordinary RGB human videos teach a robot to coordinate two dexterous hands? This episode explains how SpatialDex reconstructs spatial context from video and uses it to train bimanual manipulation policies. We cover three findings: why a shared video-level scale matters for aligning hands with their surroundings; how geometry enters both the policy's observations and its prediction targets; and what the matched pretraining experiment reveals beyond the headline baseline comparison. SpatialDex reports a 38.3-percentage-point real-robot improvement over its strongest tested baseline and a…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.