Shows / Embodied AI 101
Embodied AI 101
Embodied AI 101 tracks the latest research at the intersection of AI and physical intelligence. Robotics, manipulation, world models, and the path from digital intelligence to embodied agents — each episode breaks down recent papers and advances in the field. We examine the methodology, real-world implications, and path to deployment. Covering robot learning, perception, control, and the fundamental challenge of grounding intelligence in the physical world. New episodes daily.
Episodes
- Embodied AI 101
CycleRL: Teaching a Bicycle to Balance in Simulation—and Trusting It on Asphalt
CycleRL: Sim-to-Real Deep Reinforcement Learning for Robust Autonomous Bicycle Control
- Embodied AI 101
Feeling the World Without a Force Sensor: UniFP for Legged Loco-Manipulation
Proposes a unified RL policy that jointly learns force and position control in simulation without force sensors, enabling compliant behaviors and force-aware…
- Embodied AI 101
The Robot Needs a Memory: Multi-Agent Reasoning Inside a Digital Twin
Digital Twin-enabled adaptive robotics: multi-agent reasoning over language, vision, and structured database
- Embodied AI 101
Language Is Not Just a Prompt: Four Ways Robots Turn Words into Action
Language-conditioned robot manipulation is an emerging field aimed at enabling seamless communication and cooperation between humans and robotic agents by…
- Embodied AI 101
Becoming the Path: Planning Motion, Shape, and Stiffness Together
Autonomous operation in confined spaces demands robots that can simultaneously navigate tight passages and manipulate objects. However, conventional mobile…
- Embodied AI 101
Meaning, Motion, and Two Hands: A Task Graph That Actually Plans
Semantic–Geometric Task Representations for Bimanual Manipulation From Human Demonstrations to Robot Action Planning
- Embodied AI 101
Safety Before Failure: Giving Robot Plans a One-Second Reflex
Robots that execute language-conditioned tasks in dynamic environments often rely on feedback only after an action has failed, which can be insufficient when…
- Embodied AI 101
VL-GRiP3 and the Case for Keeping VLMs Away from the Motor Loop
VL-GRiP3: A hierarchical pipeline leveraging vision-language models for autonomous robotic 3D grasping
- Embodied AI 101
Think Late, Act Now: TIC-VLA Turns Reasoning Latency into a Control Variable
Robots in dynamic, human-centric environments must follow language instructions while maintaining real-time reactive control. Vision-language-action (VLA)…
- Embodied AI 101
One Policy, Many Bodies: Inside Qwen-VLA's Generalist Robot Model
Embodied intelligence is often studied through specialized models for individual tasks such as manipulation or navigation, resulting in fragmented capabilities…
- Embodied AI 101
VLAbot: A Human-in-the-Loop Control Plane for Long-Horizon Robot Assembly
VLAbot: A human Vision–Language–Action models interaction framework for robotic assembly
- Embodied AI 101
Teaching Isaac Sim to Feel: A Real-Time Digital Twin for Capacitive Touch
With advances in robotic manipulation in recent years, tactile sensing has become increasingly important in scenarios where visual information is unreliable or…
- Embodied AI 101
Stop Starting From Noise: Action-to-Action Flow Matching for Fast Robot Control
Proposes a new flow-matching approach for robot action generation that improves efficiency in learning and repurposing generalist policies. Targets improved…
- Embodied AI 101
ACE-Data-0: Turning a Home into a Multimodal Robot-Learning Instrument
An embodied data engine releasing 150 hours of synchronized egocentric video, full-body motion, hand tracking, object trajectories, audio, and tactile signals…
- Embodied AI 101
Before the Robot Feels It: How N₀-VTLA Predicts Contact to Control It
A vision-tactile-language-action model that predicts latent tactile tokens for fine-grained contact-rich manipulation, achieving wins on all 9 real-robot tasks…
- Embodied AI 101
Metis Gives Foundation Models a Native, Mutable Memory
Equips foundation models with persistent, dynamically evolving native memory state and gradient-free online updates, enabling continual adaptation without…
- Embodied AI 101
TurboVLA and the Case for Taking the LLM Out of the Servo Loop
Achieves high-speed inference for vision-language-action policies at 32 Hz on an RTX 4090 with less than 1 GB VRAM using a 0.2B parameter model, enabling…
- Embodied AI 101
Catching on Optical Expansion: Inside Pixel2Catch's Monocular Sim-to-Real Pipeline
Pixel2Catch: Multi-Agent Sim-to-Real Transfer for Agile Manipulation With a Single RGB Camera
- Embodied AI 101
Calibrate the Robot, Randomize the World: PACE for Legged Sim-to-Real
Legged robots must achieve both robust locomotion and energy efficiency to be practical in real-world environments. Yet controllers trained in simulation often…
- Embodied AI 101
HumanCLAW: The Model Sees the Chair but Loses the Body
Introduces a benchmark with 1,218 embodied episodes that decouples high-level VLM action decisions from low-level motor control; no current VLM solves the…
- Embodied AI 101
Get Up, Adapt, Survive: Recovery Skills for Small Quadrupeds
Real-to-Sim-to-Real: Learning Agile and Robust Recovery Skills With Terrain Imagination via Adversarial Imitation
- Embodied AI 101
A Patch Only Needs a Glimpse: Breaking VLA Robots Under Partial Observability
Partially Observable Adversarial Patch Attacks on Vision-Language-Action Models in Robotics
- Embodied AI 101
A Thousand Tasks, One Day, and the Case Against Learning Everything End to End
Presents a scalable approach to robot task learning enabling acquisition of a large number of tasks within a single day. Details were discussed in a podcast…
- Embodied AI 101
HUG: Turning Everyday Human Grasps Into a Robot-Ready Prior
Collects 1M frames (27.8 hours) of egocentric human grasping video and trains a flow-matching model to predict and retarget hand poses to robots. Achieves…
- Embodied AI 101
SkillPlug: Teaching Robot Policies to Reuse the Moves Between Tasks
SkillPlug: Unsupervised Skill Mining for Few-Shot Adaptation in Robotic Manipulation
- Embodied AI 101
Expand Before You Compress: TEAM-VLA's Training-Free Shortcut to Faster Robot Policies
Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Models
- Embodied AI 101
One Policy, Three Bodies, Zero Messages: Inside CHORUS
Trains a single VLA policy that enables multiple heterogeneous robots to collaborate on complex manipulation tasks using only local observations and robot IDs…
- Embodied AI 101
Anchor the Semantics, Align the Actions: A Better Way to Fine-Tune VLAs
Proposes a VLA fine-tuning technique that preserves pretrained VLM representations while aligning language to actions, raising real-robot generalization…
- Embodied AI 101
Learning the Rule, Not the Gait: Stick-Insect Behavior as a Portable Robot Objective
Insect locomotion exhibits remarkable adaptability and flexibility despite the limited scale of its nervous system. However, the underlying principles that…
- Embodied AI 101
Two Brains Under Pressure: How UnderwaterVLA Connects Language Models to AUV Control
The UnderwaterVLA dual-brain vision-language-action architecture enables robust autonomous underwater navigation
- Embodied AI 101
From Demo to Duty: RL-100's Real-World Reinforcement Learning Flywheel
Real-world robotic manipulation in homes and factories demands reliability, efficiency, and robustness that approach or surpass skilled human operators. We…
- Embodied AI 101
Distilling a Swarm into 158 Million Parameters: Inside MiniUAV-VLA
Coordinating multiple unmanned aerial vehicles (UAVs) for cooperative missions requires agents that perceive their environment, reason about objectives, and…
- Embodied AI 101
Imagining Locomotion: Learning a Neural World Model for Legged Robots
A neural dynamics world model paired with model-free RL policies for quadruped and humanoid locomotion in IsaacLab, enabling long-horizon autoregressive…
- Embodied AI 101
One Model to See, Plan, and Act: Introducing EO-1 for Embodied AI
A 3B parameter unified decoder-only transformer that interleaves vision, text, and action tokens for perception, planning, reasoning, and control in a single…
- Embodied AI 101
Video-Action Models for Robot Learning
Introduces Video-Action Models (VAMs) that leverage pretrained internet-scale video models such as Cosmos-Predict2 as backbones instead of VLMs, paired with a…
- Embodied AI 101
FastDSAC: Unlocking the Potential of Maximum Entropy RL in High-Dimensional Humanoid Control
Introduces FastDSAC, a method that scales maximum entropy reinforcement learning to high-dimensional humanoid control tasks, improving sample efficiency and…
- Embodied AI 101
A Minimalist Retargeting-Guided Reinforcement Learning Recipe for Dexterous Manipulation
Proposes a minimalist pipeline using retargeting-guided RL for dexterous manipulation in humanoid robots. Focuses on simplifying the training recipe while…
- Embodied AI 101
DexNDM: Closing the Reality Gap for Dexterous In-Hand Rotation
DexNDM bridges the sim-to-real gap for stable in-hand rotation of complex objects, enabling learning from biased real-world data without requiring any…
- Embodied AI 101
Learning Multi-Modal Trajectory Policies for Data-Efficient Robotic Manipulation
Proposes learning multi-modal trajectory policies to improve data efficiency in robotic manipulation tasks.
- Embodied AI 101
ACE: Agentic Control for Embodied Manipulation via Zero-shot Workflow Reasoning
A zero-shot workflow reasoning approach for agentic control of embodied manipulation, enabling robots to perform complex tasks without task-specific training.
- Embodied AI 101
Let the Body Follow: Coupled Egocentric Control for Whole-Body Robot Teleoperation
A coupled egocentric control approach for whole-body robot teleoperation that coordinates body and limb movements from an egocentric perspective, submitted to…
- Embodied AI 101
GigaWorld-Policy-0.5: An Efficient Mixture-of-Transformers Policy for Real-Time Robot Control
A Mixture-of-Transformers robot policy that achieves 85 ms inference on RTX 4090 by separating visual dynamics from action generation. Demonstrates efficient…
- Embodied AI 101
Xiaomi-Robotics-1: A Scalable Vision-Language-Action Foundation Model for Mobile Manipulation
A scalable vision-language-action (VLA) foundation model pretrained on over 100k hours of real-world manipulation trajectories, enabling out-of-the-box mobile…
- Embodied AI 101
Local Policies Enable Zero-shot Long-Horizon Manipulation
Proposes training local policies in simulation that transfer zero-shot to real-world long-horizon robotic manipulation tasks. Addresses the challenge of…
- Embodied AI 101
Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids
Trains perception-driven dexterous manipulation policies in simulation for zero-shot real-world transfer on humanoid robots. Focuses on bridging the…
- Embodied AI 101
UniTracker: A Universal Motion Tracking Framework for Humanoid Robots
A framework enabling humanoid robots to execute diverse motions within physical limits, with video demonstrations and open-source code. Targets generalizable…
- Embodied AI 101
ViTacFormer: Dexterous Manipulation via Active Vision and High-Resolution Touch Sensing
A pipeline combining active vision and high-resolution tactile sensing for dexterous manipulation on high-DoF robot hands, achieving approximately 2.5 minutes…
- Embodied AI 101
Masked IRL: LLM-Guided Reward Disambiguation from Demonstrations and Language
Uses language and demonstrations to learn which aspects of behavior matter for reward in imitation learning, enabling 5× faster learning by avoiding copying…
- Embodied AI 101
FlowDAgger: Human-in-the-Loop Adaptation of Generative Robot Policies in Latent Space
Steers frozen robot foundation models including VLAs, diffusion policies, and world models using human corrections via action inversion in latent space without…
- Embodied AI 101
RoboTTT: End-to-End Robotic Assembly with Test-Time Training
Presents a single end-to-end policy that performs precise, unscripted assembly of complex objects, measuring every grasp and alignment without speed-ups or…
- Embodied AI 101
Xiaomi-Robotics-U0: A 38B World-Foundation Model for Unified Embodied Perception and Synthesis
38B autoregressive world foundation model unifying text-to-image, multi-view scene generation, embodied transfer, and video generation; ranks #1 on World Arena.
- Embodied AI 101
SpatialPoint: Spatial-Aware Point Prediction for Embodied Localization
A spatial-aware point prediction method for embodied localization tasks. Addresses grounding and spatial reasoning in embodied AI settings.
- Embodied AI 101
Multi-AUV Scene-Adaptive Embodied Intelligence for Multi-Target Tracking
An embodied AI framework for multi-AUV (Autonomous Underwater Vehicle) multi-target tracking in ad-hoc underwater networks. Incorporates scene-adaptive…
- Embodied AI 101
Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulation
Proposes a plug-and-play policy module designed to accelerate existing embodied manipulation policies without retraining them from scratch.
- Embodied AI 101
R3DP: Real-Time 3D-Aware Policy for Embodied Manipulation
Introduces a real-time 3D-aware policy framework for embodied manipulation tasks, enabling spatially grounded action generation.
- Embodied AI 101
VistaVLA: Geometry- and Semantic-Aware 3D Gaussian-Grounded VLA for Robotic Manipulation
Presents a vision-language-action model grounded in 3D Gaussian representations that integrates geometric and semantic awareness for improved robotic…
- Embodied AI 101
SKooP: Symmetric Koopman Predictions for Legged Robot Reinforcement Learning
Leverages symmetric Koopman operator predictions within a reinforcement learning framework to achieve faster training and better generalization for legged…
- Embodied AI 101
RobotTT: A Tactile Transformer for Dexterous Manipulation
A tactile foundation model and sim-to-real pipeline designed for dexterous manipulation tasks. Combines transformer-based tactile sensing with a sim-to-real…
- Embodied AI 101
TAC-LOCO: Unified Whole-Body Control for Contact-Aware Locomotion and Manipulation
A tactile-informed whole-body loco-manipulation controller for quadrupedal robots that unifies locomotion and manipulation using tactile sensing. Enables…
- Embodied AI 101
TACTIC: Contact-Centric Control for Whole-Arm Manipulation
A contact-centric whole-arm manipulation framework that conditions control on both tactile and visual inputs. Targets dexterous manipulation tasks requiring…