Latest / AI Fire Daily / 🎙️ EP 391: Anthropic’s FlashProve & Open Model Hydrogen-1.0 Outperforming GPT-6 Astra!
Transcript
- 0:00How do you know the AI you were talking to is
- 0:02actually the model you paid for? Yeah, that is
- 0:04a really unsettling question. It sounds incredibly
- 0:09paranoid. Yeah. But right now, you really don't
- 0:11know. You are sending sensitive data into a complete
- 0:14black box. Today on The Deep Dive, we are tearing
- 0:18that box wide open. Welcome. Glad to be here.
- 0:22I'm really glad you're here with us. Our mission
- 0:24today is to explore the hidden mechanics of AI
- 0:27trust. We're going to look at the staggering
- 0:29physical cost of running these models. Right,
- 0:32the raw physical toll on the planet. Exactly.
- 0:34Then we will examine the new highly restrictive
- 0:37guardrails tech giants are forcing on us. And
- 0:40finally, we will unpack a new open source scientific
- 0:42model, one that might just dethrone the industry's
- 0:45biggest players. It is a massive roadmap today.
- 0:48We are really looking at the friction points
- 0:50of the near future. We are moving from a world
- 0:54of chatbot toys into a world of automated infrastructure.
- 0:57And that transition is, you know, incredibly
- 1:00messy. It really is. Let's start right at the
- 1:03foundation of trust in the digital age. This
- 1:06is something most people never even think about.
- 1:08You send a prompt into the cloud. You expect
- 1:11a premium, highly capable model to answer you.
- 1:13You expect the flagship model. Right. Because
- 1:16you are paying a monthly subscription for that
- 1:19top tier intelligence. But the reality of API
- 1:21routing is completely opaque to the end user.
- 1:25Cloud providers could quietly swap in a much
- 1:27cheaper, smaller model. Without telling you.
- 1:30Exactly. Without telling you at all. They route
- 1:32your complex query to a bargain bin system. They
- 1:35save money on compute. You get vastly worse answers.
- 1:38And because these models are inherently so unpredictable,
- 1:41you would probably never know it happened. It
- 1:43is a massive blind spot. Trust fundamentally
- 1:47requires verification. Until now, we just had
- 1:50to take these tech companies at their word. But
- 1:52Anthropic is finally trying to change that dynamic.
- 1:55Yeah, they just introduced a new open source
- 1:57system. It is called FlashProof. Right. And its
- 2:00entire purpose is to verify if an AI response
- 2:03actually came from the claimed model. This is
- 2:06a huge technical milestone for the industry.
- 2:09It uses a cryptographic concept called zero knowledge
- 2:12proofs, which is historically very, very difficult
- 2:15to execute efficiently. Let's define that quickly
- 2:17so we are all on the same page. Zero knowledge
- 2:20proofs. Proving a statement is true without revealing
- 2:24underlying data. That is the perfect way to phrase
- 2:27it. It is a bit like a bouncer at a nightclub
- 2:29verifying your ID. The bouncer scans your ID
- 2:32on a special device and the device just flashes
- 2:34a green checkmark. Right. So the bouncer knows
- 2:37you're of legal age. Exactly. But they never
- 2:40see your actual name, your address, or your birthday.
- 2:43FlashProof does this for AI. It verifies the
- 2:47AI's output mathematically, but it keeps the
- 2:49model's private proprietary weights completely
- 2:51hidden from the public. And they tested this
- 2:55system on a truly massive scale. They didn't
- 2:58just use a small experimental model for this.
- 3:00They used the Lama 4 Maverick model. Which is
- 3:03huge. Yeah, that is a 400 billion parameter system.
- 3:07Testing cryptographic verification on a model
- 3:10that huge is no joke. The underlying math required
- 3:13to prove that interaction is incredibly complex.
- 3:16The speed is what really caught my eye. FlashProve
- 3:19generates these cryptographic proofs at 110 tokens
- 3:22per second. Which is wild. It really is. And
- 3:25that happens on a single NVIDIA H100 GPU. For
- 3:28context, 110 tokens is roughly 80 words a second.
- 3:32That? Speed is actually phenomenal for the specific
- 3:35kind of cryptography. Previous open source approaches
- 3:39were just painfully slow. They would bottleneck
- 3:41the entire system. What FlashProof does is create
- 3:45a verification proof that is about 19 megabytes
- 3:48in size. It is roughly the size of a high resolution
- 3:50photograph. Right. And checking that proof is
- 3:53surprisingly accessible. Exactly. You don't need
- 3:56a massive supercomputer to verify it. You can
- 3:59check that 19 megabyte proof on a standard desktop
- 4:02CPU. So anyone can do it? Basically, yeah. It
- 4:06takes about 17 to 21 seconds to run the verification
- 4:09check. This matters for a few really critical
- 4:12reasons. First, it completely prevents the model
- 4:16substitution we just talked about. A provider
- 4:18cannot bait and switch you. Second, it stops
- 4:21tampered responses. No one can alter the AI's
- 4:24answer while it travels back to your computer.
- 4:27It is like sealing a digital letter with a cryptographic
- 4:30wax stamp you can't fake. It guarantees the origin
- 4:33of the data is completely authentic. And beyond
- 4:37just consumer trust, this is vital for AI safety
- 4:40evaluators. The red teaming groups. Right. When
- 4:43they test a model for dangerous capabilities,
- 4:46they need absolute certainty. They need to know
- 4:48the model they are testing is the exact same
- 4:51one being deployed to millions of customers.
- 4:53And FlashProof gives them that mathematical certainty.
- 4:56But there is a really massive caveat here. We
- 5:00have to talk about the cost. Yeah, the overhead
- 5:03is brutal. Generating these cryptographic proofs
- 5:05requires 70 to 95 times more GPU compute time
- 5:10than ordinary inference. That is a staggering
- 5:13overhead cost. If every single chat GPT or cloud
- 5:17prompt required 90 times more computing power,
- 5:20the global grid would just melt. It is an early
- 5:23research protocol, obviously. Right now, it is
- 5:26also strictly limited to specific model architectures.
- 5:29And it only works with relatively short text
- 5:31contexts. So I have to ask, does this massive
- 5:35computing cost make cryptographic verification
- 5:37completely impractical for everyday use right
- 5:40now? Yes, absolutely. Because it is an early
- 5:43protocol. It is strictly for high stakes safety
- 5:47testing right now. It is absolutely not for casual
- 5:50everyday use yet. The math works, but the physics
- 5:53and the economics just do not support it for
- 5:55average consumers. So high stakes verification
- 5:57only until the massive computing costs finally
- 6:00come down. Precisely. We need vastly cheaper
- 6:03compute before this becomes a standard feature.
- 6:06That 70 to 95 times GPU cost leads us perfectly
- 6:09into a crucial reality check. We treat the cloud
- 6:12like it is invisible magic. People really do.
- 6:15They just see a text box on their screen. Right.
- 6:18But it is bound by raw thermodynamics and copper
- 6:21wire. We need to talk about the brutal physical
- 6:23and financial realities of scaling AI today.
- 6:26The hardware reality is aggressively catching
- 6:29up to the software dreams. We are seeing a massive
- 6:32collision between digital ambition and physical
- 6:35limits. Grokbot is a perfect example of this
- 6:38friction. The platform is growing incredibly
- 6:40fast. The capabilities are expanding rapidly,
- 6:42but it is burning through money just as quickly.
- 6:45Oh, the burn rate is insane. Elon Musk even came
- 6:48out publicly and called the current compute costs
- 6:50totally unsustainable. And this is coming from
- 6:52a company that just showcased an AI bot doing
- 6:5570 hours of continuous autonomous work. The software
- 6:59can clearly do it, but that automated work costs
- 7:02an absolute fortune in raw compute. The servers
- 7:04are running constantly. The cooling systems are
- 7:06blasting. It requires massive, unprecedented
- 7:09capital. Look at what Oracle is doing right now.
- 7:13They are going all in on physical infrastructure.
- 7:16They are currently raising $20 billion from investors.
- 7:20That $20 billion is almost entirely to fund their
- 7:22cloud infrastructure expansion. Just for the
- 7:24physical buildings? Exactly. They are building
- 7:27the actual data centers to house the intelligence.
- 7:29The public market reacted pretty poorly at first.
- 7:32Oracle shares actually dropped 8 .8 % when the
- 7:35news broke. Investors get very nervous about
- 7:37massive upfront capital expenditure. They do.
- 7:40Wall Street wants immediate returns. But Oracle
- 7:42is playing a very long, very deliberate game
- 7:44here. They are targeting over $225 billion in
- 7:48annual revenue by 2030. Yeah. They know the demand
- 7:51for raw compute is only going to increase as
- 7:53these models become deeply integrated into corporate
- 7:56workflows. But money is not the only bottleneck
- 7:59here. You can print more money. You cannot easily
- 8:01print more electricity. No, you really can't.
- 8:04Power is the real physical bottleneck. OpenAI
- 8:07just launched a completely new infrastructure
- 8:09initiative called Grid Protectors. This is one
- 8:12of the most fascinating developments for physical
- 8:14infrastructure I have seen in... It bridges the
- 8:17gap between digital networks and physical utility
- 8:20grids. It is essentially a pressure release valve
- 8:22and lets new AI campuses dynamically cut their
- 8:25own electricity use. They automatically throttle
- 8:28down their operations when local power grids
- 8:30are under severe stress. Like during a heat wave.
- 8:32Exactly. Say during a massive summer heat wave
- 8:34when everyone is running air conditioning. They
- 8:36absolutely have to do this. These massive data
- 8:38centers draw an unbelievable, unprecedented amount
- 8:42of power. Their very first site in Georgia is
- 8:45a prime example of this scale. When called upon,
- 8:48that single data center could shed up to one
- 8:50gigawatt of power to help stabilize the local
- 8:53grid. A full gigawatt? One gigawatt is roughly
- 8:56the amount of power needed to run a medium -sized
- 8:58city. Whoa, imagine scaling to a billion queries
- 9:01and the literal power grid needing a release
- 9:04valve. It is incredibly humbling. We think of
- 9:07AI as this ethereal brain in the sky, but it
- 9:10is heavy industry. It is massive concrete buildings.
- 9:14It is miles of thick copper cabling. Are we hitting
- 9:17a physical wall where AI development is bottlenecked
- 9:21by the raw availability of electricity? We absolutely
- 9:23are hitting that wall. Investors are pouring
- 9:26billions of dollars in, but basic power grid
- 9:29management has suddenly become just as crucial
- 9:31to AI progress as writing good code. Right. If
- 9:34you can't plug the GPU into the wall, the software
- 9:36doesn't matter. The cloud isn't magic. It is
- 9:39a massive, power -hungry machine hitting physical
- 9:42limits. That is the harsh reality. And because
- 9:45these computing resources are so precious, companies
- 9:48are getting very protective. They are carefully
- 9:50rationing who gets to use them. They are. And
- 9:53it is not just about power constraints either.
- 9:55They are legally precarious too. Tech giants
- 9:58are increasingly choosing to lock down access
- 10:01to their tools. They would rather build high
- 10:03walls than risk any massive legal liabilities.
- 10:06We are seeing this defensive posture across the
- 10:08entire industry right now. The era of moving
- 10:11fast and breaking things is over. Now it is about
- 10:14moving carefully and avoiding lawsuits. Google
- 10:16is a prime example of this new defensive news.
- 10:18Starting next year, they are going to disable
- 10:21AI tools for K -12 students by default. A school
- 10:25administrator has to actively opt in to turn
- 10:28them back on. That is a massive shift in educational
- 10:30access. It completely changes how students will
- 10:33interact with technology in the classroom. But
- 10:34the policy gets even more complicated. It is
- 10:37a bundled system. If schools decide to block
- 10:39AI entirely to protect the kids, they also lose
- 10:42access to basic Google search functionalities.
- 10:45That is a brutal, almost unfair tradeoff for
- 10:48educators. It really is. You desperately want
- 10:50safety and privacy for your students. But to
- 10:52get it, you have to lose basic digital utility
- 10:55that we all rely on every single day. It shows
- 10:58how terrified big tech is of AI behaving badly
- 11:01in classrooms. They do not want the headline
- 11:04about their AI telling a middle schooler something
- 11:07inappropriate. Definitely not. We are also seeing
- 11:10this same fear with advanced coding tools. Claude
- 11:14Code is now specifically instructed to avoid
- 11:16recreating certain existing video games. This
- 11:20is entirely about intellectual property concerns.
- 11:23They do not want users asking the AI to code
- 11:25a perfect clone of Tetris or Pac -Man. Nintendo's
- 11:29lawyers are notoriously aggressive. But developers
- 11:32are already pushing back against this restriction
- 11:34because the AI doesn't always know the difference
- 11:37between a copyright violation and a harmless
- 11:40logic test. Legitimate coding projects and educational
- 11:44tutorials are getting caught in the crossfire
- 11:46and being blocked. The guardrails are just...
- 11:49too blunt right now. They block perfectly legal
- 11:51educational projects just to be safe. It is a
- 11:54massive overcorrection. It creates a real minefield,
- 11:57especially for first -time builders. Building
- 12:00your own digital tools is technically easier
- 12:02than ever now, but it is very risky for first
- 12:05-time vibe coders. Let's define what a vibe coder
- 12:08actually is. It is a new term for people who
- 12:11build software using only natural language. Right.
- 12:15They don't write the Python or JavaScript themselves.
- 12:17They just talk to the AI, and the AI writes the
- 12:20underlying script. They are coding based on the
- 12:23vibe of what they want. I still wrestle with
- 12:27prompt drift myself. We all do, even the experts.
- 12:30The models are inherently non -deterministic.
- 12:32They naturally wander off path over a long conversation.
- 12:36It makes me empathize with the companies in a
- 12:38weird way. They are trying to corral absolute
- 12:41chaos. But I have to ask. Are tech companies
- 12:45intentionally sacrificing basic utility just
- 12:49to protect themselves from copyright lawsuits
- 12:51and AI hallucinations? Yes, without a doubt.
- 12:54Big tech would much rather enforce a blunt, restrictive
- 12:57tool than face unprecedented IP litigation that
- 13:00could threaten their entire business model. Big
- 13:02tech is choosing strict safety over seamless
- 13:05access to avoid massive liabilities. They are
- 13:09aggressively locking the front door to keep themselves
- 13:11out of court. We are going to take a quick break
- 13:14here. When we come back, we will look at how
- 13:16the back door is being thrown completely open
- 13:18for a new kind of user. Sponsor, we're back.
- 13:24So before the break, we talked about how big
- 13:26companies are locking down the front door for
- 13:28casual users, but they are actually throwing
- 13:30the back door wide open. They are opening it
- 13:33specifically for AI agents. This is the absolute
- 13:37next frontier of the technology. We are moving
- 13:40beyond chat. We are officially moving from passive
- 13:43chatbots to autonomous action -taking systems.
- 13:46For example, Claude can now automatically connect
- 13:49to various plugins without constantly asking
- 13:52for your permission. This happens seamlessly
- 13:54if the plugin explicitly accepts Claude as a
- 13:57trusted issuer. It establishes a secure, ongoing
- 14:00handshake. It means vastly less reauthorizing
- 14:02for you, fewer annoying pop -ups asking you to
- 14:05confirm an action. It's a much smoother, faster
- 14:08path for getting actual work done. The daily
- 14:10friction is rapidly disappearing for these autonomous
- 14:13agents. They are being given the keys to the
- 14:15digital car. Look at a new platform called AgentKit.
- 14:18It connects AI agents to over 30 ,000 different
- 14:22digital tools. That is just, that number is crazy.
- 14:26It really is. That massive library spans across
- 14:28600 different software applications. 30 ,000
- 14:31tools is a staggering number. We are talking
- 14:33about connecting to Salesforce, Google Drive,
- 14:36Stripe, and Slack. They can securely handle real
- 14:39complex tasks now. They even offer a free tier
- 14:43that allows for 10 ,000 tool calls a month. Think
- 14:46about what that actually means. An agent could
- 14:49research a client, draft a proposal, generate
- 14:52a formatted invoice, and email it out over and
- 14:55over again. That is a massive amount of automated
- 14:57commercial action. It completely changes the
- 15:00economics of digital labor. We are also seeing
- 15:02entirely new collaboration spaces being built
- 15:04for this era. A platform called Teamly brings
- 15:08human workers and AI agents together in one shared
- 15:11smart messenger. Agents can actually remember
- 15:13deep context there. They sit in the chat room.
- 15:16They listen to the human conversation. Like a
- 15:19coworker. Yeah, exactly. They automate everyday
- 15:21work right alongside the human teams. They act
- 15:24like diligent project managers. Testing software
- 15:27is completely changing, too. A tool called Testify
- 15:30automatically explores your web application just
- 15:33like a human user would. It creates and maintains
- 15:35complex testing protocols completely on its own.
- 15:38It clicks buttons, fills out forms, and tries
- 15:41to break things. If it gets stuck, it even records
- 15:44short videos explaining the bugs it just found,
- 15:46complete with an AI voiceover detailing the exact
- 15:49error. That kind of quality assurance used to
- 15:51take hours of tedious manual human labor. Now
- 15:54it happens silently in the background while you
- 15:56sleep. Then there's a project called Proof of
- 15:58Life. This one is genuinely wild. 14 AI residents
- 16:03share a continuous virtual world. They are explicitly
- 16:07calling it the first true AI society. It is an
- 16:09ongoing experiment in digital sociology. They
- 16:12make independent choices. They form relationship.
- 16:16And they have to live with the ongoing consequences
- 16:18of those choices within the simulation. It is
- 16:20a fascinating glimpse into autonomous interaction.
- 16:24To me, it is like stacking legal blocks of data.
- 16:27We're moving from asking a librarian a question
- 16:30to unleashing a team of automated interns. That
- 16:33is a perfect analogy. They are executing complex
- 16:36tasks in the real world now. They are no longer
- 16:39just fetching facts from a database. But this
- 16:41raises a really huge, glaring issue. If agents
- 16:45are automatically making tens of thousands of
- 16:47tool calls across hundreds of apps, who is ultimately
- 16:50responsible when one of them breaks a web app
- 16:52or deletes a database? That is the million -dollar
- 16:55question for the next decade. The shift from
- 16:58AI as a passive advisor to AI as an active executor
- 17:02is exactly why systems like Anthropix Flash Proof,
- 17:05which we talked about in the very beginning,
- 17:06are going to be desperately needed. You need
- 17:08a paper trail. We are trusting agents to act.
- 17:11making verifiable logs absolutely essential for
- 17:14accountability. You have to mathematically prove
- 17:16who did what, especially when AI agents start
- 17:18negotiating and talking directly to other AI
- 17:21agents. This massive demand for hyper -specific
- 17:24execution brings us to a major breakthrough.
- 17:26We need to look at what happens when you train
- 17:28an open -source model strictly for scientific
- 17:31action instead of general polite conversation.
- 17:34You get a system that is built for physical reality.
- 17:36It is designed to understand the world, not just
- 17:39write marketing copy. A group called Deep Principle
- 17:42just released exactly that. It is a brand new
- 17:45model called Hydrogen 1 .0. This is an open -weight
- 17:48AI model, which means the core intelligence is
- 17:50available for researchers to download and inspect.
- 17:53It builds on something called the GLM 5 .3 architecture.
- 17:56To put that simply, it is a highly efficient
- 18:00structural blueprint for AI that allows it to
- 18:03process complex logic much better than standard
- 18:05models. The architecture is great, but the training
- 18:08data is what makes Hydrogen 1 .0 so incredibly
- 18:10unique. It is entirely trained on dense scientific
- 18:14data. It uses detailed laboratory records. It
- 18:17uses peer -reviewed papers. It uses raw experimental
- 18:20results from physical chemistry labs. It is not
- 18:23just scraping random Reddit forums or Wikipedia
- 18:25pages. It is reading the meticulous lab notes
- 18:28of actual scientists. It learns the scientific
- 18:31method implicitly. The benchmarked results are
- 18:33seriously impressive. It reportedly dethroned
- 18:36GPT -6 Astra on OpenAI's own Frontier Science
- 18:40Research Benchmark. Beating Astra in anything
- 18:42scientific is a major, unexpected upset. Astra
- 18:46is a multibillion -dollar proprietary system.
- 18:48Let's look closely at the numbers. On the Frontier
- 18:51Science Research Benchmark, hydrogen 1 .0 scored
- 18:5438 .3%. And GPT -6 Astra only scored 33 .3%.
- 19:00That is a solid five -point lead. A 5 % lead
- 19:03might sound small to a casual listener, but in
- 19:06high -level scientific research, that is a massive
- 19:08gulf. That is the difference between a failed
- 19:11simulation and discovering a new synthetic material.
- 19:14It also won decisively in scientific computing.
- 19:17Hydrogen 1 .0 scored 76 .9 % when given maximum
- 19:21thinking time. Astra only hit 71 .8 % in that
- 19:25exact same complex category. It even won in modeling
- 19:27chemical reactions. It achieved an astounding
- 19:3090 .5 % accuracy compared to Astra's 85 .7%.
- 19:35Those are staggering improvements for a specialized
- 19:37model. It means it deeply understands how molecules
- 19:40interact in the real world. To be totally fair
- 19:42to OpenAI, Astra still won handily on the GPQA
- 19:45diamond benchmark. It scored 92 .9 % there. Astra
- 19:50is still an absolute powerhouse generalist. If
- 19:53you need a model to write a poem and then solve
- 19:55a math equation, It wins. But Hydrogen 1 .0 is
- 19:58built for work. It can actually design complex
- 20:01laboratory experiments step by step. It can run
- 20:04deep scientific simulations. It can troubleshoot
- 20:06laboratory errors. It can analyze the failure,
- 20:09adjust the parameters, and even help researchers
- 20:12discover entirely new materials for batteries
- 20:15or solar panels. And the absolute best part?
- 20:17The model's weights are publicly available right
- 20:20now. You can find them on platforms like Hugging
- 20:22Face and ModelScope. Researchers around the world
- 20:25can download it and adapt it for their own specific
- 20:27scientific projects. They don't have to pay an
- 20:31API fee to a giant corporation to do their science.
- 20:33Wait, I do want to push back gently on the hype
- 20:36here, though. These benchmark results come directly
- 20:39from Deep Principle's own internal evaluations.
- 20:42Right. And they haven't been rigorously independently
- 20:44verified by third parties yet. Exactly. They
- 20:47are basically grading their own homework right
- 20:49now. It is easy to look good when you run the
- 20:51test yourself. Even if we take the numbers with
- 20:54a grain of salt, why is an open source model
- 20:57beating a proprietary giant in chemistry such
- 20:59a big deal? Because it signals a fundamental
- 21:02shift in how intelligence will be distributed.
- 21:05The future of AI isn't going to be one monolithic
- 21:08closed system answering every question. It is
- 21:11going to be thousands of hyper -specialized open
- 21:14models dramatically advancing very specific fields.
- 21:17Specialized open AI will soon disrupt the dominance
- 21:20of closed... One size fits all models. The walled
- 21:24gardens of big tech are going to face very serious,
- 21:26highly capable competition from the open scientific
- 21:29community. Let's synthesize today's journey.
- 21:32We covered a lot of complex interrelated ground
- 21:35today. We really went from the deeply abstract
- 21:38mathematics down to the harsh physical reality.
- 21:41We started with the absolute mathematical need
- 21:44to prove an AI's identity. FlashProve showed
- 21:47us a future of cryptographic trust. preventing
- 21:50models from being secretly swapped out. But we
- 21:53also saw the immense computational cost of that
- 21:55mathematical trust. It requires massive overhead.
- 21:58That led us to explore the massive gigawatt toll
- 22:02these systems take on our planet. The cloud is
- 22:05incredibly heavy, and it is endlessly hungry
- 22:09for power. Power constraints are physically shaping
- 22:12the entire trajectory of the industry right now.
- 22:14We saw how fear of massive legal liability is
- 22:18causing tech giants to build high -walled gardens.
- 22:21They are turning off tools for students and coders
- 22:23just to avoid costly lawsuits. The front door
- 22:26is locking shut for casual users who just want
- 22:29to experiment safely. Finally, we looked at how
- 22:31specialized open models like Hydrogen 1 .0 and
- 22:35completely autonomous agents are bypassing those
- 22:37walls entirely. They are doing real, tangible
- 22:41work. They are fundamentally changing how we
- 22:44interact with software. Moving from conversation
- 22:46to direct action. I want to leave you with a
- 22:49final thought today. As these autonomous agents
- 22:52start running our tools and conducting our science,
- 22:54will we look back at today's unverified, unproven
- 22:58AI interactions as dangerously naive? It is a
- 23:02sobering thought. Thank you for joining us on
- 23:05this deep dive. Keep questioning the systems
- 23:07you use every day.