Does VLA Even Know the Basics? Act2Answer Benchmark
Introduces a benchmark showing VLAs lose 20–40 points in commonsense/world knowledge versus source VLMs after robotics fine-tuning, evaluated via action-based answering.
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.