Latest / Elon Musk Podcast / AI UPDATE: Vibe coding, what is it?
Transcript
- 0:00Clairvaux shipped 44 poll requests containing 93,000 lines
- 0:05of code. Wow.
- 0:06Yeah, and that was across more than 1000 files in just five
- 0:11days using Open AI's codecs and Anthropics Claudopis 4.6.
- 0:16I mean, the sheer scale of that achievement really highlights a
- 0:20massive transition happening right now.
- 0:22Absolutely, because software engineering is it's shifting
- 0:25away from those simple auto complete tools toward fully
- 0:28agentic orchestration, right where developers coordinate AI
- 0:32systems rather than, you know, just writing code line by line
- 0:35themselves. So how do you choose between an
- 0:37AI that acts like an interactive intern and one that operates as
- 0:41a completely autonomous manager for your digital workforce?
- 0:44Well, to understand how a single person even ships 93,000 lines
- 0:48of code, we first have to look at the interface where the work
- 0:52actually happens, right? Which splits into two radically
- 0:55different philosophies. Yeah, we are looking at a
- 0:56fundamental split between tools like Cursor and clawed code.
- 1:00Let me describe how Cursor operates for a second.
- 1:03It is an AI native code editor, which means you are working in a
- 1:08highly visual environment. Right, very visual.
- 1:10Focused entirely on interactive editing, you have features in
- 1:14there like Composer. Which is huge.
- 1:16Which handles multi file edit simultaneously and supermaven
- 1:20which provides this incredibly fast autocomplete.
- 1:24And when we say fast I mean we mean sub 100 millisecond
- 1:28latency. Which is wild to think about.
- 1:29It is that speed is crucial for the visual approach though.
- 1:33Because you need it to feel instant.
- 1:34Exactly. Sub 100 millisecond latency
- 1:37means the AI is suggesting the next block of logic before you
- 1:41even finish typing the variable name.
- 1:42You don't perceive a delay at all.
- 1:45Right cursor gives you immediate visual feedback on every single
- 1:48change. You literally see the diffs.
- 1:50Yeah, the exact lines being added or removed.
- 1:53You accept or reject them and you stay constantly engaged with
- 1:57the text on the screen. It feels very much like
- 1:59traditional programming. Just, you know, supercharged.
- 2:02Right, because you are looking directly at the code.
- 2:04But Claude Code Opera, it's entirely differently.
- 2:07Totally different. It is a terminal native command
- 2:10line interface. Yeah, there is no traditional
- 2:12editor window for the AI. It relies on deep code based
- 2:17reasoning, recursive context gathering and a specific plan
- 2:22mode to outline strategies before writing anything.
- 2:25So instead of sitting inside your visual editor, Claude Code
- 2:28lives in the terminal. Just that black screen with a
- 2:31blinking cursor. Exactly.
- 2:32It sits alongside whatever text editor you prefer, but it
- 2:35doesn't need to look at your active window, right?
- 2:37When you give it a command, it performs what we call recursive
- 2:40context gathering. Explain how that actually works
- 2:43for the listener, because I mean, recursive context
- 2:46gathering sounds incredibly dense, yeah.
- 2:48No, it does sound technical. Think of it like sending a
- 2:51detective into an archive room. OK, if you ask the AI to fix a
- 2:55bug in a specific feature, it doesn't just look at the one
- 2:58file you have open. Because it can't even see the
- 3:01file you have. Open right, It starts at the
- 3:03feature, reads the code, notices a function pulling data from
- 3:07somewhere else. Oh, I see.
- 3:09And follows that thread into your database schema.
- 3:12Wow. Then it reads the schema,
- 3:14realizes there is an authentication rule attached to
- 3:16it, and goes and reads the security security file.
- 3:19It just keeps. Digging it recursively follows
- 3:21the logic through the entire tree of your project until it
- 3:25has all the context it needs. All before it executes a single
- 3:28command. Exactly.
- 3:30I look at it this way, cursor is like having a driving instructor
- 3:34in the passenger seat with dual controls.
- 3:36That's a good way to put it. Now you are both steering.
- 3:38You are both looking out the exact same windshield, right?
- 3:41And if the instructor veers too close to the curb, you can grab
- 3:45the wheel and intervene instantly.
- 3:47Because you see it happening in real time.
- 3:49Exactly. But Claude code is like handing
- 3:52a mechanic a list of instructions and sending them
- 3:55into the garage alone. Yeah, you just sit in the
- 3:57waiting room until the car is fixed.
- 3:58Which is stressful for some people.
- 4:00Oh totally, But by giving up the visual control of an editor,
- 4:04aren't you severely increasing the risk of the AI writing
- 4:08faulty code that you can't easily monitor?
- 4:11I mean, I understand that fear. It feels completely unnatural to
- 4:13let go of the wheel like that. Yeah, but doing so shifts the
- 4:17developer's role from writing syntax to specifying intent,
- 4:21right? Yes.
- 4:22It limits your immediate visual feedback.
- 4:25You aren't watching the letters appear on the screen.
- 4:27Which is what we're all used to. But it opens up the ability to
- 4:31execute massive complex refactors across an entire
- 4:35project structure. Because it isn't waiting for
- 4:37your approval on every single line.
- 4:39Exactly when the AI is not constrained by what is currently
- 4:43visible in your active editor window, it can apply logic to
- 4:47hundreds of files sequentially just.
- 4:49Ripping through them. Yeah, and that is where plan
- 4:52mode comes in. You verify the architecture in
- 4:55plan mode. So it tells you what it's going
- 4:56to do first. Right, the AI prints out a step
- 4:59by step strategy of what it intends to change across the
- 5:03entire code base. OK, you review that high level
- 5:06plan, you approve it, and then the agent handles all the syntax
- 5:09on its own. Wait, back up.
- 5:10Yeah. How does the terminal agent
- 5:12actually know what to do without seeing the screen?
- 5:14What? Do you mean?
- 5:15Well, I like the mechanic analogy, but there is a hole in
- 5:17that logic. OK, let's hear it.
- 5:19Handing a mechanic a lift of instructions only works if the
- 5:22mechanic actually knows where the tools are kept.
- 5:26If they walk into a strange garage, they're going to spend
- 5:29hours just opening drawers. Yeah, totally lost.
- 5:33How does an AI operating entirely in a text based
- 5:36terminal know where your design files are or how your specific
- 5:40company structures its databases?
- 5:42That mechanism relies entirely on the Model Context Protocol,
- 5:47or MCP. MCP, right?
- 5:49Anthropic designed MCP to let AI securely connect to external
- 5:53data sources. So.
- 5:54It's a direct connection. Yes, and it does it without
- 5:57developers having to build custom API connections for every
- 6:00single tool. So instead of writing, you know,
- 6:02brittle glue code to connect your terminal to other
- 6:04platforms, MCP provides A standardized bridge.
- 6:08Exactly. Think of MCP like a universal
- 6:10security badge for your AI, instead of the AI needing a
- 6:13completely different set of custom built keys to access your
- 6:16Figma designs, your Slack messages, or your Notion
- 6:18documents. Which would be a nightmare to
- 6:20maintain. Total nightmare.
- 6:22MCP gives it a standardized way to walk into those rooms, read
- 6:26the files, and pull that knowledge directly into its
- 6:29reasoning process. That makes a lot of sense, and
- 6:32that leads directly to context. Engineering engineers now write
- 6:36specific files in their repositories, usually named
- 6:39agents dot MD or Claude dot MD, right, which basically act as a
- 6:45project constitution. A rule book.
- 6:47Yeah, you use context engineering to lay out the
- 6:50architectural rules, the naming conventions, and the strict
- 6:53constraints of the repository. So you are building a grounded
- 6:56source of truth. Right, so the AI knows the exact
- 6:59layout of the garage before it starts working.
- 7:01You are literally telling the AI AI.
- 7:03Here's how we name our variables.
- 7:05Here's the specific database structure we use.
- 7:07Do not use this outdated library.
- 7:09Giving it the exact lay of the land.
- 7:11Exactly. You combine that internal
- 7:13constitution with the external access provided by MCP, and
- 7:16suddenly the terminal agent has perfect awareness of your entire
- 7:19working environment. I want to look at a specific
- 7:21example of this because it clarifies exactly how powerful
- 7:24this combination is. Yeah, the Notion example.
- 7:27Right at Notion, a designer named Brian Lovin used MCP to
- 7:31build what he calls a Rototye playground UCH.
- 7:34A cool roject. It really is.
- 7:36He created a custom command where the AI takes a Figma link,
- 7:40extracts the design tokens, writes the code, opens a browser
- 7:44to verify it visually, and then loops to fix its own errors.
- 7:47And that extraction part is crucial.
- 7:49How so? Because of MCP, the AI doesn't
- 7:52just look at it like a picture of the design.
- 7:54It's not just a screenshot. No.
- 7:56It goes into Figma and extracts the literal design tokens, the
- 8:00exact hex codes for the colors, the precise pixel measurements
- 8:04for the padding, the specific font weights.
- 8:06So. It's pulling the raw data.
- 8:07It pulls the mathematical truth of the design.
- 8:10He even built a custom find icon skill.
- 8:12Oh yeah, because Notion has more than 5000 SVG files files in its
- 8:16icon library. Right, so instead of the AI
- 8:18guessing which icon to use, or, you know, hallucinating a file
- 8:22path entirely, which. Happens a lot without these
- 8:24skills. Exactly.
- 8:26The skill allows the AI to automatically search through the
- 8:29entire library, find the exact vector graphic it needs, and
- 8:33implement it. That's amazing.
- 8:34But the craziest part to me is the verification loop.
- 8:37Right, the visual checking. Yeah, how does a terminal AI
- 8:40verify a visual prototype? Well, the agent leverages a
- 8:45Chrome Devtools MC key. OK.
- 8:48This allows the AI to physically interact with the browser.
- 8:52It builds the code, renders the prototype in Chrome, and uses
- 8:55Devtools to inspect the Dom and analyze the layout.
- 8:58So it's actually looking at the page.
- 9:00It can essentially look at the prototype it just built, compare
- 9:03the CSS output to the original Figma design tokens, realize
- 9:06that a button is misaligned or the padding is wrong, and
- 9:09correct its own pathing or layout issues.
- 9:12It's doing it all itself. It handles the verification loop
- 9:14entirely on its own, without a human ever checking the browser.
- 9:18This completely removes the traditional handoff from design
- 9:21to engineering totally. You no longer have a designer
- 9:24creating a mock up, handing it to a front end developer and
- 9:27waiting for them to translate it into code.
- 9:29Right, the way is gone. ID has become interactive
- 9:32working prototypes almost instantly.
- 9:34It creates A seamless pipeline and you know once an agent has
- 9:37the context to verify its own work visually and
- 9:40architecturally, it no longer needs to run on your local
- 9:43machine at all. Right, which brings us to Open
- 9:45AI codecs operating as a cloud based autonomous agent.
- 9:49This is a. Huge shift.
- 9:51This is the third major workflow.
- 9:54You assign a task and codecs, spins up a sandbox virtual
- 9:57machine, close the repository, does the work asynchronously and
- 10:01delivers a finished pull request.
- 10:04And for context, A sandboxed virtual machine is basically a
- 10:07secure isolated room in the cloud.
- 10:10Like a safe space for the code to run.
- 10:12Exactly. The AI gets its own temporary
- 10:14computer. It copies all your code into
- 10:16that room and gets to work. That's a great way to visualize
- 10:19it. It acts like a slow cooker for
- 10:20software features. OK, I like that you set the
- 10:22parameters, add your instructions and let it run.
- 10:25The meal is ready later, fully cooked and ready to consume.
- 10:28Hold on. Yeah, it just runs the code
- 10:30itself in the background. What happens if it introduces a
- 10:32massive security vulnerability? Well, if I have an AI blindly
- 10:37writing and executing code while I am not watching, couldn't it
- 10:41accidentally delete a database or expose user data?
- 10:44That is exactly why the sandbox is so important.
- 10:47Well, because it's isolated. Right.
- 10:49The sandboxed execution environment allows codecs to
- 10:52safely run tests, execute builds, and verify changes
- 10:55before ever presenting the code for your review.
- 10:58So not touching your live stuff. It operates in total isolation.
- 11:02That means the agent can attempt a complex fix, run the project's
- 11:06entire test suite, fail completely, diagnose the error
- 11:09message from the failure, and try again.
- 11:12Without you even knowing it failed the first time.
- 11:14It can do this fifty times in a row without ever affecting your
- 11:17local development environment or your production servers.
- 11:20And because it connects to the ChatGPT ecosystem, a user can
- 11:23spot a bug on their phone. Literally while out of the
- 11:26house. Prompt the codecs agent to fix
- 11:28it and the agent does the work in the cloud while the user
- 11:31orders coffee. Yeah, you are completely
- 11:34untethered from your desktop. You don't even need to have your
- 11:36laptop open to be actively engineering software.
- 11:39This creates true parallelization.
- 11:41Which is incredibly powerful. It limits real time
- 11:44interactivity just like the terminal agents, but it
- 11:47drastically increases total throughput.
- 11:50Because you can. You can run so many at once.
- 11:51Exactly. It allows a solo developer to
- 11:54manage multiple threads of work simultaneously.
- 11:57You can have one cloud agent completely refactoring a back
- 12:01end database schema while you are interactively styling a
- 12:05front end component on your laptop using cursor So.
- 12:08You are acting as a manager of multiple digital workers.
- 12:11Yes, managing a massive parallelized cloud workforce
- 12:14sounds ideal, but running top tier AI models continuously
- 12:19presents a massive financial. Oh absolutely, the costs add up.
- 12:22If you have autonomous agents recursively searching files and
- 12:25running 50 verification loops in the cloud, you are burning
- 12:29through compute power. Cost becomes the primary
- 12:31bottleneck really quickly, right?
- 12:33That introduces the concept of sub agents and tiered model
- 12:36execution. Specifically looking at open
- 12:38AIS, GPT 5.4 mini and nano models.
- 12:41The smaller ones. Right, the mini model scores
- 12:4454.38% on the SWE bench pro coding test.
- 12:49We should clarify what that test actually is.
- 12:51Yeah, go ahead. The SWE Bench Pro is a benchmark
- 12:54where the AI is dropped into a massive real world open source
- 12:58code base and asked to solve complex issues originally
- 13:01flagged by human engineers on GitHub.
- 13:03It's a very rigorous test. Extremely.
- 13:06Scoring over 54% on that is staggering for a smaller model.
- 13:10It is very close to the performance of the massive
- 13:13flagship model, but it costs a fraction of the price at just
- 13:16$0.75 per million input tokens. Which is incredibly cheap.
- 13:20Very cheap. But I mean, delegating work to
- 13:22cheaper models seems counterproductive when writing
- 13:25production level software. Why do you see that?
- 13:27If you are trusting an autonomous agent to write code
- 13:29that runs your business, risking the introduction of subtle logic
- 13:32errors just to save a few cents on API calls feels incredibly
- 13:36risky. I can see that.
- 13:37If the goal is reliable autonomous output, cutting
- 13:41corners on the intelligence of the model seems like a fast
- 13:44track to broken software. You would think so, but the data
- 13:47actually proves otherwise. Really.
- 13:49Yeah, Notion's AI engineering lead a Besic Modi, found that
- 13:54for focused, well defined tasks like formatting, the mini models
- 13:58actually exceed the performance of previous flagship models.
- 14:01Wait, how is a smaller, cheaper model outperforming a massive
- 14:05reasoning engine? It comes down to cognitive load.
- 14:09The cognitive load required to parse a document or apply a
- 14:12specific formatting rule is narrow.
- 14:15Very narrow. When the task is highly
- 14:17constrained, the smaller model executes with extreme precision.
- 14:21Large models can overthink simple tasks or get distracted
- 14:25by the broader context of the repository.
- 14:27Because they're trying to do too much at once.
- 14:29Exactly. A mini model given one strict
- 14:31rule and one specific file just executes the rule.
- 14:34Florida State. So the strategy is now tiered
- 14:37orchestration. Yes, a senior model like Claude
- 14:39Opus 4.6 or GPT 5.4 thinking handles the initial planning and
- 14:44complex architectural decisions. Big picture stuff.
- 14:47Right then it delegates tasks to junior models like GPT 5.4 Mini
- 14:54which execute high volume subtasks such as searching code
- 14:58or processing documents. The senior model acts as the
- 15:01lead architect. It reads your agents dot MD
- 15:03constitution, formulates the strategy, and breaks the project
- 15:07down into 50 smaller steps. And then it just hands them out.
- 15:10Exactly. It hands those steps to 50
- 15:13junior models. The junior models do the heavy
- 15:15lifting of reading thousands of lines of syntax, executing the
- 15:19repetitive changes and reporting back.
- 15:21This changes the entire economic structure of building software.
- 15:25It really does. Instead of paying flat
- 15:26subscription fees for visual editors where you do all the
- 15:29manual typing, engineering teams manage granular API budgets.
- 15:33You are optimizing the precise amount of intelligence required
- 15:36for every specific task. Because you don't need a genius
- 15:39to do formatting. Right, You no longer apply a
- 15:41massive expensive reasoning engine to a simple syntax
- 15:45update. That makes perfect sense.
- 15:46You buy exactly the compute necessary for the complexity of
- 15:49the operation, you pay for the architect only when you need
- 15:53architecture, and you pay for the intern when you just need
- 15:56someone to format the files. Software development is
- 15:58fractured into 3 distinct workflows.
- 16:00Yeah, interactive visual editing, deep terminal, native
- 16:03reasoning, and autonomous cloud execution.
- 16:07The defining skill for builders now is orchestrating the right
- 16:11agents with the exact right context.
- 16:14And as these peered agents become increasingly capable of
- 16:18verifying their own work in secure sandboxes, what happens
- 16:21to the entry level engineering roles that traditionally handled
- 16:24those exact verification tasks? If you're not subscribed yet,
- 16:27take a second and hit follow on whatever app you're using.
- 16:30It helps us keep making this. We appreciate you being here.