Latest / AI Fire Daily / 🎙️ EP 356: Gemini 3.8 Live #1 Benchmark & Shanghai AI Lab Releases Atria Dawn
Transcript
- 0:00Intro music. Imagine an AI that keeps chatting
- 0:03with you, naturally, while simultaneously launching
- 0:06parallel API calls to book your flights in the
- 0:08background. That is not a concept for next year.
- 0:12It just dropped today. Beat. It really, um...
- 0:16It just changes our entire baseline for these
- 0:19systems. It does. Welcome to the Deep Dive. We
- 0:21are very glad you're here today. We've got a
- 0:23lot of ground to cover. We really do. We are
- 0:25sorting through today's stack of AI breakthroughs
- 0:28to understand a massive shift happening right
- 0:30now. We are moving from AI that just talks to
- 0:33AI that actively thinks in the background. And
- 0:36that background thinking is definitely not cheap.
- 0:38It carries a heavy, heavy physical cost. We're
- 0:41going to look at those staggering real -world
- 0:42energy costs shortly. Then we'll explore some
- 0:45new tools interacting with digital physics. That
- 0:47part is wild. Yeah. And finally, we'll unpack
- 0:50an open -weight model capable of running entire
- 0:53research projects autonomously. There is a really
- 0:56clear through line today. Let's start with Google's
- 0:59newest release. It fundamentally changes the
- 1:01rhythm of human -AI conversation. Google just
- 1:04launched Gemini 3 .8 Live. And also GemEye 3
- 1:07.8 Live extended thinking. Yeah, and you can
- 1:10find this across their API, AI Studio, the app,
- 1:12workspace, and search. It's everywhere now. Which
- 1:15is a huge rollout. It is. The standard 3 .8 Live
- 1:19really focuses on latency. They want fast, cost
- 1:22-efficient voice agents. And it relies incredibly
- 1:26heavily on visual grounding. Let's define that
- 1:28really quickly. Visual grounding means connecting
- 1:31what the AI sees to real -world context instantly.
- 1:34Exactly. It roots the AI in our physical space.
- 1:37But the extended thinking model... That is the
- 1:40real paradigm shift here. How so? Well, it handles
- 1:43131K input and 65K output tokens. It just effortlessly
- 1:48accepts text, images, audio, video. And the underlying
- 1:51mechanism making this possible is acing tool
- 1:53calls. Right. Which means doing complex tasks
- 1:55in the background without freezing the conversation.
- 1:57Yeah, it completely changes the UX. It's like
- 2:00talking to a master chef who is actively explaining
- 2:03the recipe to you while simultaneously chopping
- 2:06vegetables and checking the oven. That is a great
- 2:08way to picture it. I still wrestle with prompt
- 2:10drift myself, so the idea of a model maintaining
- 2:12context while launching parallel API calls is
- 2:16staggering. Beat. It's a massive hurdle they've
- 2:18cleared. State management during real -time speech
- 2:20is usually incredibly fragile. And the benchmarks
- 2:23are solid, right? Very solid. Extended Thinking
- 2:25High actually hit number one on the Artificial
- 2:27Analysis Speech -to -Speech Quality Index today.
- 2:30Wow. Number one. Yeah, though it's not number
- 2:33one on most general benchmarks, but... The standard
- 2:363 .8 live hit number two on the speech agent
- 2:38arena. I am looking at this continuous voice
- 2:41mode and I'm a bit skeptical. Does it actually
- 2:44think better or is it just talking faster to
- 2:46hide the loading time? It genuinely executes
- 2:50multi -step reasoning over the retrieved results.
- 2:52It's not just using filler audio. It actually
- 2:55assesses the fresh data and then it synthesizes
- 2:57a new conclusion before it speaks. So it trades
- 3:00instant answers for deeper, continuous background
- 3:02reasoning. Precisely. You get a much more robust
- 3:05response. But, you know, that constant background
- 3:07thinking requires an unfathomable amount of compute
- 3:11power. It burns so much energy. Which is shaking
- 3:13up the physical world. By 2035, US AI data centers
- 3:18could burn more natural gas than Germany and
- 3:21Japan combined. Let that sink in. Germany and
- 3:24Japan. Whoa. Imagine scaling that kind of energy
- 3:27burn to a billion queries a day. Two sec silence.
- 3:31The physical grid is really struggling to support
- 3:34the digital world right now. And because of these
- 3:36costs, monetization is accelerating fast. Right.
- 3:38The era of free inference is shifting. Meta is
- 3:41a perfect example. They are expanding paid AI,
- 3:44calling it Meta One, starting at $7 .99 a month.
- 3:47But the creator and business tiers are what you
- 3:50really have to watch. Those reach up to almost
- 3:52$500 a month. That proves these agentic systems
- 3:55are serious enterprise tools now. Absolutely.
- 3:58And that race for premium output is why OpenAI
- 4:01just made a massive acquisition. Glass imaging,
- 4:03right. Yeah. A strategic $300 million plus acquisition.
- 4:07They were founded by ex -Apple engineers who
- 4:10actually built portrait mode. Oh, wow. Portrait
- 4:13mode. Yeah. They use AI to bring smartphone photos
- 4:15to DSLR quality. OpenAI wants to own that visual
- 4:18input layer. Because better visual input means
- 4:21better reasoning. Exactly. Speaking of shifts,
- 4:24Google just opened Claude to all its engineers.
- 4:27Which is fascinating. They are keeping Anthropic
- 4:29close, even despite their massive investments
- 4:32in Gemini. It shows how pragmatic you have to
- 4:34be in this space. And things move fast. GPT 5
- 4:37.5 is officially expiring on October 14th. Yeah.
- 4:41Codex users have to migrate immediately. Sam
- 4:44Ullman actually posted recently about two AI
- 4:46risks worrying him, and he stressed the need
- 4:49to earn public trust. Public trust is the only
- 4:51way they avoid crushing regulation. Right. Meanwhile,
- 4:54Grok Imagine just rolled out precise text editing
- 4:57inside generated images. That is a huge quality
- 5:01of life update. You can edit font, size, color,
- 5:03alignment. It's all moving so fast. Yeah. But
- 5:05I have to ask. With data centers burning that
- 5:07much gas and meta charging 500 bucks a month,
- 5:10are we hitting a ceiling on what free AI can
- 5:13actually do for everyday users? We kind of are.
- 5:16There's a growing divide now. Free models will
- 5:18handle basic conversational stuff, but the really
- 5:21expensive high compute agentic models, they just
- 5:23cost too much to give away. Right. The truly
- 5:26advanced autonomous capabilities will increasingly
- 5:29sit behind steep paywalls. It's just the laws
- 5:31of thermodynamics at this point. So if companies
- 5:34are paying massive premiums for these advanced
- 5:36capabilities, what exactly are they building?
- 5:38They are building tools that can touch and manipulate
- 5:41our actual workflows and physics. Like Odyssey
- 5:443. Yes. Odyssey 3 is wild. It is a physics agent.
- 5:48A physics agent, meaning it learns how the world
- 5:51works. From visual input. Right. It doesn't just
- 5:53read code. It visually learns physical rules
- 5:56and then literally controls robots, drones, and
- 5:59video games. It anticipates momentum and gravity.
- 6:03Exactly. And we are seeing this embodiment in
- 6:05software too. Look at Kilo Code. Kilo Code is
- 6:08a game changer for developers. You can run coding
- 6:10agents, control VS Code, and manage CLI sessions
- 6:13and PR reviews entirely from a smartphone. It
- 6:16basically untethers you from your desk. You have
- 6:18an autonomous developer in your pocket. There
- 6:20are also new workflow apps, fundamentally restructuring
- 6:23how we work, like SIFT. SIFT is brilliant. It
- 6:26turns all your messy AI chats and ideas into
- 6:29a living business map. Right. It connects your
- 6:32decisions to actual evidence and risks. It stops
- 6:35your AI outputs from just getting lost in a chat
- 6:37window. And for the builders, there is Tune.
- 6:40Tune gives AI builders instant off billing and
- 6:43analytics. You can launch paid products from
- 6:46day one. But I want to go back to Odyssey 3 for
- 6:48a second. Is a physics agent just a fancy marketing
- 6:51term for a drone autopilot? Not at all. Standard
- 6:53autopilots just follow pre -programmed, rigid
- 6:57mathematical flight paths. Odyssey 3 visually
- 7:00learns world models, so it actively adapts to
- 7:03actual physics in real time. It actually understands
- 7:05real -world physics rather than just following
- 7:07rigid code. Exactly. It intuits how the world
- 7:10works. Which is incredible. And that leads us
- 7:12perfectly into our final topic. But first, a
- 7:15quick break, mid -roll. Welcome back. We've seen
- 7:19AI learn physics and control code today. Yeah,
- 7:22the embodiment phase is here. But the final evolution
- 7:24is moving from an AI that helps you research
- 7:26to an AI that is the researcher. This is a monumental
- 7:29shift in computational science. The Shanghai
- 7:32AI Lab just released the Atria Dawn preview and
- 7:35it's open weight, which is a huge deal. Let's
- 7:38quickly define that. Open weight means the model's
- 7:41core architecture is freely available to download
- 7:44and run. Right. It's under an MIT license, full
- 7:47and FP8 versions. And it has a massive context
- 7:50window. A context window is how much data the
- 7:52model can hold in its memory at once. Yeah. And
- 7:55Adria Dawn has a staggering 256K context window.
- 8:00It can digest entire stacks of academic literature
- 8:02in seconds. But it doesn't just answer questions.
- 8:05You give it a research question, and it drives
- 8:07it to a verifiable, reproducible result. Autonomously.
- 8:11Right. It searches evidence, writes and executes
- 8:13its own code, runs experiments, inspects the
- 8:16results, and produces final reports. And the
- 8:18craziest part, it recovers from its own failures.
- 8:21Yeah. Its capabilities are grouped into discovery,
- 8:23creation, delivery, and cybersecurity. And the
- 8:25benchmarks back it up. They really do. It scored
- 8:2796 .0 on DeepSearch QA. Which is near perfect
- 8:30retrieval. It hit 92 .5 on BrowseComp, 77 .0
- 8:33on BFCLv4, and 53 .8 on AutomationBench. It actually
- 8:37beat or closely matched Kimi K3, GPT 5 .6 Sol,
- 8:41and Opus 5 on some published tasks. Which brings
- 8:44up a really deep question. If the model can inspect
- 8:47its own results and recover from its own failures,
- 8:51What is left for the human scientist to actually
- 8:53do? Well, the paper argues that humans shift
- 8:55to overseeing the broad direction. We validate
- 8:58the final output, but the AI completes the whole
- 9:01project. Humans shift from doing the grunt work
- 9:04to acting as the principal investigator. Exactly.
- 9:07You design the lab. The AI runs the experiments.
- 9:10We have covered a lot today. We really have.
- 9:12And there is such a clear through line here.
- 9:14Autonomy. Autonomy. Exactly. We started today
- 9:17with Gemini 3 .8 reasoning silently in the background
- 9:20while chatting. Then we saw the massive physical
- 9:22energy costs required to run these systems. Right.
- 9:25Which is pushing the industry toward premium
- 9:26subscriptions. Then we explored tools like Odyssey
- 9:303, manipulating real world physics. And we ended
- 9:33with Atria Dawn independently executing entire
- 9:35research projects. The era of AI as a simple
- 9:39Q &A chatbot is over. The era of the autonomous
- 9:41digital agent is definitely here. I want to leave
- 9:44you with a final thought to mull over today.
- 9:46Beat. If an open weight model on your laptop
- 9:49can independently form a hypothesis, run the
- 9:52experiments, recover from its own errors, and
- 9:55publish a verifiable result. Wait, let me rephrase
- 9:57that. If it can do all of that on its own. Beat.
- 10:01whose name goes on the patent, yours, or the
- 10:04model's. See you next time. Outro music.