Latest / AI Fire Daily / 🎙️ EP 338: GEN-1.5 Physical Prompting Robotics & Claude Autonomously Designs Functional Proteins
Transcript
- 0:00Imagine showing a robot what to do for just three
- 0:02seconds. Beat. And then, well, he just does it.
- 0:06No coding. Just watching. Yeah, it's wild. Let's
- 0:10jump right in. Welcome to today's Deep Dive.
- 0:13We're taking a stack of new sources and extracting
- 0:16the most important signals from the noise, just
- 0:18for you. Exactly. Lots to cover today. Today,
- 0:21we are exploring how AI is stepping out of the
- 0:23chat box and, you know, into the physical world.
- 0:26We'll unpack a new robotics model called GEN
- 0:291 .5. Right. And we'll sift through today's rapid
- 0:32-fire AI updates, including a bizarre data center
- 0:37cooling idea. Yeah, that one is weird. And we'll
- 0:39look at how Claude is autonomously running complex
- 0:41biological labs, I'll be honest. Beep! I still
- 0:44wrestle with getting my smart thermostat to listen
- 0:46to me, so handing a robot a tool feels a bit
- 0:48surreal. I mean, the pace is definitely disorienting,
- 0:51but the mechanics behind this shift are like...
- 0:54Absolutely fascinating. Okay, let's unpack this.
- 0:56Generalists just introduced GEN 1 .5, a robot
- 0:59model that learns a physical task from a single
- 1:013 to 12 second demonstration. Right, just a tiny
- 1:04video clip. Yeah. It watches the human perform
- 1:08the task. And then it attempts the task almost
- 1:11immediately. Over 10 simple tasks, one demo gave
- 1:14it a 59 % average success rate. Which is actually
- 1:18a huge deal. They call it physical prompting.
- 1:20Instead of retraining the robot from scratch,
- 1:22you just drop a short video into its 30 -second
- 1:25context window. Let me define that real quick.
- 1:27A context window is basically the AI's short
- 1:29-term memory for a task. Exactly. 12 words. Spot
- 1:32on. So instead of, you know, writing complex
- 1:35code or mapping strict spatial coordinates for
- 1:37every single motor. It just takes forever. Right.
- 1:40It just holds that visual in its memory. And
- 1:42it infers depth and physics from a flat 2D video.
- 1:45But here's where it gets nuts. Okay. With just
- 1:48five minutes of extra data and 10 weight updates,
- 1:51that success rate jumped to 83%. Wow. Yeah. It
- 1:55imitates human hands. It transfers skills from
- 1:58simulation to reality seamlessly. And it can
- 2:01even combine multiple prompts. Whoa. Imagine
- 2:04it just picking up a tool it's never seen during
- 2:06training and improvising on the fly. I know.
- 2:08It's like bridging the sim to real gap instantly.
- 2:10The sim to real gap. That's the difference between
- 2:14a perfect digital simulation and the messy real
- 2:17world. Precisely. A simulation has perfect physics.
- 2:21But the real world has friction and weird lighting.
- 2:24GEN 1 .5 handles that transition beautifully.
- 2:27That is wild. But wait, what is the actual difference
- 2:31between its two learning modes here? The source
- 2:33mentions one -shot versus few -shot learning.
- 2:36Right, good question. So the one -shot demo is
- 2:39in -context learning. It's learning on the fly
- 2:41without changing its core programming. Like holding
- 2:44a temporary instruction. Yeah, exactly. But the
- 2:47few -shot version actually updates the model's
- 2:49weights. That makes it closer to continual learning,
- 2:52permanently updating its brain with new skills
- 2:54like stacking Lego blocks of data. Got it. So
- 2:57it either holds the memory temporarily or permanently
- 3:00rewires itself. Spot on. And that permanent rewiring
- 3:03is, you know, the holy grail for robotics. So
- 3:06robots are learning physical tasks, but our everyday
- 3:09software agents are also taking more direct action
- 3:12on our behalf. Oh, definitely. We're giving them
- 3:13broader goals now. Here's where it gets really
- 3:16interesting. Chat GPT can now draft replies and
- 3:20literally text people for you through an Apple
- 3:23Messages plug -in. Right. And Meta AI launched
- 3:26a Mac app with system -wide dictation and screen
- 3:29awareness. Screen awareness, meaning it, like,
- 3:31sees everything on my monitor. Basically, yeah.
- 3:33Yeah. Personal custom GPTs are kind of fading
- 3:36out while these workspace encoding agents take
- 3:38over. They can see your open spreadsheets, your
- 3:40emails, everything. That feels incredibly intrusive.
- 3:43It is a lot of access. But the market is moving
- 3:45fast. Replit launched a free mode using GPT 5
- 3:50.6 Luna. Which is huge for developers. Totally.
- 3:53But it's not all flawless. Grok Lite had a rare
- 3:57glitch recently where it was sending absolute
- 3:59gibberish to people. See, that is exactly my
- 4:01fear. Yeah, the company called it a temporary
- 4:03glitch, but it highlights the tension right now.
- 4:05To stop those hallucinations, you need astronomically
- 4:09better training data. Which explains the massive
- 4:11data boom. Exactly. To power all this, MicroOne's
- 4:15AI training data business jumped from a 100 million
- 4:17to 500 million gross annual run rate in just
- 4:21eight months. A five -fold increase in eight
- 4:24months. The demand is massive. And all that processing
- 4:28runs incredibly hot. Which leads to... Liquid
- 4:33death joking about cooling data centers with
- 4:35pee. Which experts say isn't fully ridiculous.
- 4:38Right. I mean, scientifically speaking, liquid
- 4:41cooling is vastly superior to air. Water absorbs
- 4:44heat exponentially faster. So as the chips get
- 4:48denser, traditional fans just can't keep up.
- 4:50The servers would literally melt. Exactly. It's
- 4:53absurd marketing, but the underlying physics
- 4:56are real. But let me circle back to the texting
- 4:58thing. With ChatGPT directly texting people for
- 5:01you, aren't we handing over a bit too much autonomy?
- 5:03Yes, which is exactly why the source heavily
- 5:06warned you to keep human approval turned on before
- 5:08anything actually gets sent as you. Right. Keep
- 5:11human approval on so it doesn't text your boss
- 5:12absolute gibberish. The human in the loop is
- 5:14still your best defense, sponsor. We just talked
- 5:17about handing over autonomy for sending texts,
- 5:19but Anthropic is handing over autonomy for scientific
- 5:22research. It's a massive escalation. It really
- 5:25is. Anthropic tested Mythos Preview and Clawed
- 5:29Opus 4 .8 on autonomous protein design campaigns.
- 5:32It produced working molecules for 14 out of 15
- 5:35targets. The numbers are staggering. The binding
- 5:39success rates hit 22 to 35 percent. Anthropic
- 5:43notes the industry baseline is usually just 10
- 5:45to 15 percent. So it's literally doubling the
- 5:48industry standard. Yeah. And protein design is
- 5:51basically solving 3D biological puzzles. It's
- 5:53the foundation of drug discovery. But Claude
- 5:55didn't actually mix the chemicals in a physical
- 5:57lab, did it? No, no. Twist Bioscience and Adaptive
- 6:01Bio handled the actual real -world lab synthesis.
- 6:04But Claude did the heavy lifting. Generating
- 6:07the chemical candidates. Right. Generating candidates,
- 6:09evaluating results, and revising ideas with minimal
- 6:12human direction. He was acting like the lead
- 6:14architect. Exactly. And the speed breakthrough
- 6:16is incredible. In another experiment, Claude
- 6:19Opus 5 analyzed raw instrument files and estimated
- 6:22a sample's purity at 96 .4%. And parsing those
- 6:25complex data outputs usually takes forever. It
- 6:29did this in 19 minutes. The lab's normal report
- 6:31takes four days. 19 minutes. Beat. Is Claude
- 6:35just acting as a really fast calculator here,
- 6:38or is it actually leading the scientific process?
- 6:41What's fascinating here is it's moving beyond
- 6:43just answering biology questions. It's autonomously
- 6:47running multi -step scientific workflows and
- 6:50leading the research loop. So it is practically
- 6:52running the entire lab loop on its own now. Yes,
- 6:55effectively steering the ship. Faster iteration
- 6:58means faster breakthroughs. Let's step back.
- 7:01We covered a lot today. We've seen AI learn physical
- 7:04tasks in a three -second window, embed itself
- 7:07into our daily text messages, and cut four -day
- 7:10lab analyses down to 19 minutes. If we connect
- 7:13this to the bigger picture, AI is shifting. It's
- 7:15no longer just a passive chat box you query.
- 7:17It is an active agent observing, learning, and
- 7:20executing in the real world. So what does this
- 7:22all mean? Think about your own day. If AI can
- 7:25learn a task from a single three -second video,
- 7:27what is the very first task you would demonstrate
- 7:29for it? And take it a step further. If Claude
- 7:32can design proteins twice as well as industry
- 7:34baselines, what happens when Gene 1 .5's improvising
- 7:38robotic hands are paired with Claude's scientific
- 7:40brain in a fully automated lab? Two sec silence.
- 7:44Something to think about. Thanks for joining
- 7:45us on this deep dive. Stay curious. Out to your
- 7:47own music.