Latest / AI Fire Daily / 🎙️ EP 394: Nvidia CEO Admits Affair Amid Spy Probe & Nous Research’s "Mind-Wiped" AI!
Transcript
- 0:00The CEO of the world's most crucial AI chip maker,
- 0:03a $4 .8 billion customer, and a suspected intelligence
- 0:09asset. Yeah, it's wild. It is. This isn't a spy
- 0:12thriller, it's reality. Welcome to the Deep Dive.
- 0:15Today we are exploring the unseen battlegrounds
- 0:17of artificial intelligence. Right, because the
- 0:19battlefield is, you know, it's not just about
- 0:21the code anymore. No, it's much bigger than that.
- 0:23We will look at three distinct layers of this
- 0:26global AI war. First, human vulnerability at
- 0:29the hardware level with NVIDIA. Second, the massive
- 0:32scramble for infrastructure and talent. And finally,
- 0:34an attempt to mind wipe an AI's political ideology.
- 0:38It is a fascinating stack of interconnected problems.
- 0:41We're going to unpack the mechanics behind all
- 0:43these messages. Exactly. So let's start at the
- 0:46physical bedrock of AI. We were talking about
- 0:48the hardware itself, and there is a major human
- 0:52complication right at the very top. Yeah, the
- 0:54Jensen Huang situation. Right. Jensen Huang is
- 0:57the CEO of NVIDIA. He recently sent a company
- 1:00-wide email admitting to an extramarital affair.
- 1:03Which, you know, normally would just be a standard
- 1:05HR or corporate governance issue. But the specific
- 1:08context here, it elevates it to a national security
- 1:11level. Right, because the affair was with a woman
- 1:14named Alice Huang. She is a former executive
- 1:16at a company called Megaspeed. They are a massive
- 1:19tech player based in Singapore. But here is where
- 1:22it gets... Highly complicated. U .S. intelligence
- 1:24officials suspect she's operating as a Chinese
- 1:27intelligence asset. Right. And they believe her
- 1:29specific target was NVIDIA's business strategy.
- 1:33I mean, state sponsored intelligence doesn't
- 1:35always look like, you know, someone hacking a
- 1:36mainframe. Yeah, it's more subtle. Exactly. Often
- 1:39it is about mapping out a hardware roadmap. through
- 1:42personal relationships. Which makes the stakes
- 1:44here just astronomical. Megaspeed is not a small
- 1:47-time buyer. They reportedly purchased over $4
- 1:50.8 billion in NVIDIA chips, and that volume occurred
- 1:54just over the last two years. That is a staggering
- 1:57amount of compute power. Singapore has obviously
- 2:00become a major hub for AI infrastructure, but
- 2:03it also acts as a potential proxy node. Right,
- 2:05for routing things. Yeah. Companies can sometimes
- 2:08use third -country hubs to circumvent international
- 2:11sanctions. Because U .S. export controls are
- 2:14incredibly strict right now. They are aggressively
- 2:16trying to keep high -end chips out of China.
- 2:18It feels like setting up the world's most advanced
- 2:21security system only to realize you left a human
- 2:24backdoor wide open. That is the perfect way to
- 2:27look at it. The physical hardware is completely
- 2:30locked down. The global supply chains are heavily
- 2:33monitored. But intimate human relationships bypass
- 2:36all those expensive firewalls entirely. So...
- 2:40NVIDIA's board immediately took aggressive action.
- 2:43They appointed independent directors. They brought
- 2:45in outside legal counsel to run a full investigation.
- 2:49They had to. Yeah. They are looking for any potential
- 2:51national security risks. They literally have
- 2:53no other choice. The minute U .S. intelligence
- 2:56flags a $4 .8 billion customer, everything changes.
- 2:59The board's fiduciary duty forces them to assume
- 3:03the worst case scenario. They have to investigate
- 3:05if a hardware roadmap was actually leaked. So
- 3:08far, NVIDIA claims there is zero proof of a breach.
- 3:11They have no reason to believe company secrets
- 3:13were actually compromised. They don't think U
- 3:15.S. national security was breached in any way.
- 3:17But the underlying concern is about strategic
- 3:20insights, right? Not just blueprints. Investigators
- 3:24worry she gained high -level context about NVIDIA's
- 3:27business strategy. Especially regarding upcoming
- 3:29negotiations with the new Trump administration.
- 3:32Exactly. That political angle is completely undeniable.
- 3:35Republican lawmakers are already stepping in
- 3:37aggressively. They have requested a private briefing
- 3:39with Huang on November 18th. They are citing
- 3:42severe national security concerns over this entire
- 3:45situation. You can easily see why Washington
- 3:47is so nervous. NVIDIA is the absolute linchpin
- 3:51of American tech dominance right now. If their
- 3:54strategic posture is compromised. the whole ecosystem
- 3:57wobbles. Yep. There is currently no public proof
- 4:00of actual espionage. There is no proof that Huang
- 4:03disclosed sensitive information. There is no
- 4:05proof he knowingly assisted Chinese intelligence
- 4:08at all. Right. And the board continues to strongly
- 4:11support his leadership. There are zero announced
- 4:13plans to replace him. Which is a very calculated
- 4:16statement from the board. It is. Given the massive
- 4:19geopolitical stakes, why is the board standing
- 4:22so firmly behind him without a pause? Well, it...
- 4:25It comes down to stark market reality. Replacing
- 4:27a visionary founder during an unprecedented tech
- 4:30boom is incredibly dangerous. It could instantly
- 4:34crash the stock and completely disrupt their
- 4:36entire hardware roadmap. They are essentially
- 4:39balancing corporate stability against these lingering
- 4:42intelligence risks. So he's simply too critical
- 4:46to NVIDIA's future to sideline right now. Exactly.
- 4:48You don't rebuild the airplane's engine while
- 4:50you are cruising at 30 ,000 feet. Yeah, that
- 4:53makes sense. So let's follow this thread from
- 4:56the chips to the broader ecosystem. NVIDIA supplies
- 4:59the raw hardware, obviously, but those chips
- 5:02require massive physical and digital ecosystems
- 5:05to function. Massive is an understatement. Right.
- 5:07Anthropic needs 1 .7 gigawatts because models
- 5:10are scaling exponentially. That scale is the
- 5:13underlying force driving everything else. Anthropic
- 5:15just locked in a $3 .4 billion power deal. This
- 5:19infrastructure investment is just for their AI
- 5:21data centers. It includes 1 .7 gigawatts of gas
- 5:25-fired generators. A power deal that size isn't
- 5:28just about paying the electric bill. It is really
- 5:30about grid density. Break that down for me. Why
- 5:33can't they just, you know, plug these into the
- 5:35existing municipal grid? Because the localized
- 5:37heat and power draw would literally melt the
- 5:39substations. Wow. Yeah, you cannot drop a gigawatt
- 5:42load on a standard city grid. So these AI companies
- 5:46are essentially having to become their own utility
- 5:47providers. They are building bespoke energy infrastructure
- 5:51just to feed the models. And that insatiable
- 5:53power demand is driven by the rise of agents.
- 5:56The scale of usage is just exploding everywhere
- 5:58right now. Look at Deep Sea Karnas. Oh, yeah.
- 6:01The metrics coming out of there are stunning.
- 6:03Whoa. Processing 92 trillion tokens every single
- 6:07day. That is just difficult to even conceptualize.
- 6:09The growth curve is basically vertical at this
- 6:12point. They hit 1 .54 million daily users in
- 6:15barely three months. They already have 35 ,000
- 6:18distinct plugins. Open model agnostic agents
- 6:21are going completely viral. Developers desperately
- 6:24want systems that can operate across different
- 6:26platforms. They want AI that can fetch data,
- 6:30execute code, and complete workflows seamlessly.
- 6:33But when agents have that much systemic access,
- 6:36security completely breaks down, which explains
- 6:39why Palo Alto Networks is making massive moves.
- 6:41Yeah, they are. They might pay $500 million just
- 6:44to acquire Clutch. Clutch is a startup specifically
- 6:46focused on protecting AI agents system access.
- 6:49And that specific valuation is a massive sign
- 6:52of the times. 500 million is roughly 50 times
- 6:57their annual recurring revenue. It is nearly
- 6:59six times their projected 2025 valuation. 50
- 7:03times revenue for a startup like Clutch, is that
- 7:06a sustainable valuation or just sheer panic?
- 7:08It is about existential risk. Securing AI agents
- 7:12that have system -level database access is a
- 7:14hard requirement. If an agent goes rogue, it
- 7:16can delete your entire backend. Right. So traditional
- 7:19revenue multiples are mostly irrelevant in the
- 7:21short term. Enterprise companies desperately
- 7:23need that specific security layer right now.
- 7:26Basically, they are paying a massive panic premium
- 7:29to secure the AI frontier. Right. And they can
- 7:32afford to do it. But the cost of a systemic agent
- 7:34breach is just infinitely higher. Now, to build
- 7:38all these secure and scalable agent ecosystems,
- 7:40you need elite talent. And the talent pool capable
- 7:43of building this architecture is tiny, which
- 7:46explains Kat Wu's recent move. She just jumped
- 7:48from Anthropic over to OpenAI. Yeah, that specific
- 7:51talent war is incredibly fierce right now. OpenAI
- 7:53is aggressively poaching top -tier engineers
- 7:56from Anthropic. She is the fourth key Claude
- 7:58Code departure in recent weeks. Wait, four key
- 8:01architects leaving in just a few weeks. Yeah.
- 8:03That is not just normal corporate turnover. Are
- 8:06they anticipating a fundamental shift in how
- 8:08these agents are built? It certainly looks like
- 8:10a coordinated brain drain. When top talent moves
- 8:13in clusters, they're usually following a specific
- 8:16technological breakthrough. Also, it is kind
- 8:18of funny. Her ex -bio accidentally still links
- 8:21to Anthropic. Oh, really? Yeah. It's a tiny industry,
- 8:24but they're moving at breakneck speed. And to
- 8:27support that speed, we are seeing a flood of
- 8:29new developer tools. Companies are racing to
- 8:31lower the friction of building these systems.
- 8:34Mistral Studio also just launched to solve this
- 8:36exact problem. It is a brilliant play for developer
- 8:39capture. It lets you build, host, and refine
- 8:42AI apps in one unified place. You can connect
- 8:45data and launch complex agents or workflows.
- 8:48Then you deploy fast and use real traces to iteratively
- 8:51improve them. It is all about accelerating that
- 8:54feedback loop for the developer. OpenAI is also
- 8:57rolling out ChatGPT Remix for Enterprise. Teams
- 9:00can actually fork a colleague's ChatGPT site,
- 9:03and you can edit your own copy in the chat interface,
- 9:05and it keeps the original prompt architecture
- 9:07completely safe. That is a massive update for
- 9:10corporate collaboration. You really don't want
- 9:13a junior employee accidentally breaking a critical
- 9:15working prompt. Honestly, I still wrestle with
- 9:17prompt drift myself. I tweak one little parameter
- 9:20and the whole output just completely falls apart.
- 9:23So having a safe sandbox to remix things is an
- 9:28absolute lifesaver. It brings essential version
- 9:30control to natural language processing, which
- 9:33is a necessary evolution if we want reliable
- 9:36enterprise tools. We are also seeing tools that
- 9:39blend coding with culture. OpenAI is teasing
- 9:43Mod Retro's Chromatic for November 9th. It physically
- 9:46plays Game Boy Classics, but the catch is that
- 9:50Codex can actually help you build games for it.
- 9:52It is a remarkably clever way to showcase their
- 9:55coding capabilities. They are mixing deep nostalgia
- 9:59with cutting -edge generation to engage developers.
- 10:02So we've secured the chips, the power, and the
- 10:05software agents. But how do you actually secure
- 10:08the thoughts of the AI itself? We are moving
- 10:11now from physical infrastructure to cognitive
- 10:13control. This is where we touch the ideological
- 10:16source code. Noose Research just released a model
- 10:19called Arete 27B. It is an entirely open source
- 10:23AI model, but it was built directly on top of
- 10:26Alibaba's QEM 3 .8 -27B model. And Alibaba obviously
- 10:30built that base model under strict Chinese regulatory
- 10:33frameworks. It was naturally aligned with their
- 10:37specific domestic policies. Right. Now, I want
- 10:40to be very clear with you here. We aren't taking
- 10:42a side on the politics of this issue. We are
- 10:44just looking at the fascinating mechanics of
- 10:46how they achieved this. Noose Research specifically
- 10:49modified this base model. They wanted to fundamentally
- 10:52reduce Chinese government aligned responses.
- 10:56They aimed to strongly reinforce Western democratic
- 10:59values instead. It is a deliberate surgical.
- 11:03ideological rewiring of a massive system. They
- 11:06used a technical process called fine -tuning
- 11:08to do this, giving an existing AI a specialized
- 11:11crash course in new rules. They trained it on
- 11:14a data set of just 53 million tokens. Which is
- 11:17actually a surprisingly tiny amount of training
- 11:19data. Exactly. But how does 53 million tokens
- 11:23override a massive base model? Doesn't aggressive
- 11:26retraining usually break the general intelligence
- 11:28of the system? Usually, yes. It causes something
- 11:30called catastrophic forgetting. You align the
- 11:33politics, but it suddenly forgets how to do basic
- 11:35math. Right. The genius here is this surgical
- 11:39weight modification. By using highly targeted
- 11:42tokens, they rewrote the cultural guardrails
- 11:44without touching the core logic engine. That
- 11:47makes total sense. Yeah. They tested this intervention
- 11:50across 803 specific prompts. These covered freedom
- 11:53of speech, democracy, privacy, and other sensitive
- 11:56topics. The resulting metrics are pretty wild.
- 11:59The propaganda rate dropped from 22 % all the
- 12:01way down to 0 .9%. That is an absolute collapse
- 12:05of the previous ideological guardrails. Factual
- 12:08accuracy actually improved during this process,
- 12:10too. The score went from 2 .32 to 2 .98 out of
- 12:14a possible 5. On freedom of expression specifically,
- 12:17the shift was incredibly dramatic. Propaganda
- 12:20-related responses fell from 60 % to just 1%.
- 12:23And they managed to do this while keeping the
- 12:25general intelligence completely intact. Right.
- 12:29General AI performance remained nearly unchanged
- 12:31across the board. It scored 65 .60 % versus 65
- 12:36.77 % on the Hermes bench evaluation. Rewiring
- 12:41an AI's political ideology while keeping its
- 12:43intelligence intact is incredibly difficult.
- 12:45It's like replacing the foundation of a skyscraper
- 12:48while people are still working upstairs. One
- 12:50wrong move and the whole logic structure collapses.
- 12:53But they pulled it off. And it is available on
- 12:55Hugging Face right now. It is released under
- 12:58an Apache 2 .0 license. But what is the actual
- 13:01strategic implication of that? specific license.
- 13:04Well, because it's Apache 2 .0, any Fortune 500
- 13:06company can legally take this Western -aligned
- 13:09model, they can embed it deeply into their proprietary
- 13:11software, and they can fully commercialize it
- 13:13without owing Alibaba a single dime. It proves
- 13:16that a model's political framing is highly malleable.
- 13:19It can be significantly changed through relatively
- 13:22small amounts of additional training. But there
- 13:24is a crucial catch to these benchmark numbers.
- 13:27There is always a catch when we talk about AI
- 13:30benchmarks. The results come entirely from Noose
- 13:33Research's own internal evaluation. They used
- 13:36an automated AI judge to score all the outputs.
- 13:38These results have not been independently verified
- 13:41by a third party yet. Right. They used an automated
- 13:44system to grade their own ideological shift.
- 13:46If they used their own AI judge to evaluate their
- 13:49own political shift, doesn't that completely
- 13:52skew the results? Well, self -grading in AI is
- 13:55a heavily documented blind spot. If the judge
- 13:57shares the same foundational biases of the developer,
- 14:00it naturally validates the new behavior. It basically
- 14:03creates a closed ideological feedback loop. All
- 14:06right. We really cannot fully trust the grader
- 14:09if it built the rubric. Exactly. We absolutely
- 14:12need third -party validation to know how deep
- 14:14the change really goes. It is a fascinating technical
- 14:17achievement, regardless of the underlying politics.
- 14:19We are going to take a quick break. This deep
- 14:22dive is brought to you by Nimbus Roasters. You
- 14:25know how much mental focus it takes to keep up
- 14:26with the tech world. Nimbus crafts small -batch,
- 14:29cognitively optimized coffee blends for deep
- 14:32thinkers. They source directly from high -altitude
- 14:34farms across the globe. It gives you that clean,
- 14:37sustained energy without the devastating afternoon
- 14:40crash. It is absolutely perfect for deep work
- 14:42sessions or late -night coding runs. I'm literally
- 14:44drinking their dark roast right now. It is incredibly
- 14:47smooth. Stay sharp and stay focused. Welcome
- 14:50back. Let's pull all of these disparate threads
- 14:53together. We are looking at a massive, heavily
- 14:56interconnected global system. The big overarching
- 14:59takeaway here is that AI is not just software.
- 15:01Not at all. It is a highly complex multi -front
- 15:04battlefield. You have to actively navigate human
- 15:07espionage at the hardware level. The smartest
- 15:10chips in the world still ultimately depend on
- 15:12flawed human relationships. And then you have
- 15:15to secure the sheer physical reality of the compute.
- 15:17We are talking gigawatts of power and billions
- 15:20of dollars in infrastructure. The sheer physical
- 15:22scale is acting as a massive barrier to entry.
- 15:25And finally, you are fighting over the ideological
- 15:28alignment of the systems. You are actively shaping
- 15:31the actual thoughts of the models themselves.
- 15:34It's like stacking Lego blocks of data, power,
- 15:36and politics into one massive global structure.
- 15:39And every single one of those blocks is actively
- 15:42being contested right now. There is no quiet
- 15:45front in this entire technological war. It really
- 15:48makes you question the nature of the tools we
- 15:49use daily. We interact with these models constantly.
- 15:52We inherently assume a baseline level of algorithmic
- 15:56objectivity. Which is proving to be a highly
- 15:58dangerous assumption. I want to leave you with
- 16:01a final provocative thought today. Think about
- 16:03that Alibaba -based model we just discussed.
- 16:05If three million tokens is all it takes to completely
- 16:09flip a model's worldview from one ideology to
- 16:12another, is there really such a thing as a neutral
- 16:15AI? Or are we just choosing which bias we prefer
- 16:18to talk to? That might just be the defining question
- 16:21of the decade. Thank you so much for taking this
- 16:23deep dive with us today. We absolutely love exploring
- 16:26this stuff with you. Hit reply and say hello.
- 16:28We read your comments and feedback every single
- 16:31day. And if you enjoyed this conversation, please
- 16:33forward the deep dive to a friend who loves exploring
- 16:36the absolute edge of tech. We will see you next
- 16:39time.