SOLE-R1: Can Video-Language Rewards Train Manipulation Policies?
Can a robot learn manipulation from random actions using only rewards generated from video? This episode explains what SOLE-R1 demonstrates, how its reward model is trained, and where its generalization claims need qualification. We examine three questions: why realistic failure coverage matters beyond reversed demonstrations; what the reasoning and reinforcement-learning ablations actually establish; and whether benchmark success translates into a practical on-robot learning system. The discussion connects video-language reward modeling with off-policy reinforcement learning across simulated…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.