Squint: Visual RL for Sim-to-Real Manipulation in 15 Minutes
Can tiny camera images make sim-to-real reinforcement learning genuinely faster? This episode explains how Squint combines compact visual inputs with off-policy learning to accelerate robot-policy training. We cover three questions: why rendering first and downsampling later differs from directly rendering tiny images; how replay, distributional critics, and GPU execution fit together; and what the physical-robot evaluations establish. Squint trains separate manipulation policies in ManiSkill3 and deploys them on an SO-101 arm using a wrist camera and proprioception. Its task suite covers…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.