Latest / In the Loop AI / THIS WEEK IN AI: NVIDIA's OpenClaw Killer, Meta Buys Moltbook, Perplexity Computer

Transcript

THIS WEEK IN AI: NVIDIA's OpenClaw Killer, Meta Buys Moltbook, Perplexity Computer · In the Loop AI

0:00
Josh: So over the last month, basically everyone in the world of AI has either experimented
0:04
Josh: with OpenClaw or is actively running an OpenClaw instance.
0:07
Josh: It's this AI agentic framework that allows an agent to go off and do all the things that you want.
0:12
Josh: It could do the work for you, it can buy your groceries for you,
0:15
Josh: it can book you tickets and flights to go on vacations, it can do seemingly everything.
0:19
Josh: But on the backside of that is a lot of complexity and a lot of risk in terms
0:24
Josh: of security that I'm not sure a lot of people are really taking into account.
0:27
Josh: What's happened since then is that a lot of other companies have gotten involved.
0:31
Josh: They've wanted to take the market share away from OpenClaw, which is this open
0:34
Josh: source Wild West version.
0:35
Josh: And just this week, NVIDIA and Jensen Chuang seem to have the alternative figured out.
0:41
Josh: This is coming from an unlikely suspect. We have Clawed, we have OpenAI.
0:44
Josh: Both of those are clearly working on OpenClaw competitors. We're seeing features shipped every week.
0:47
Josh: But to see Jensen get in the ring and announce something called NemoClaw,
0:52
Josh: which is the new open source alternative, it seems like there's going to be
0:56
Josh: a new player in town, and maybe even more with perplexity too.
0:59
Josh: Like a lot is going on in this open-claw world. So if you are an open-claw user,
1:02
Josh: you're gonna wanna tune in for this one.
1:04
Ejaaz: This is a really underrated moment for Nvidia, in my opinion.
1:07
Ejaaz: It is their Apple moment. Now Apple is our geniuses in two things,
1:13
Ejaaz: both the hardware and the software for all cellular phones.
1:17
Ejaaz: They own the app layer and they nail the hardware layer, right,
1:20
Ejaaz: best phones in the industry.
1:21
Ejaaz: NVIDIA is now making its foray into consumer hardware or consumer software, rather, right?
1:27
Ejaaz: So they announced this week that they're going to invest $26 billion over the
1:31
Ejaaz: next five years into open source agents.
1:35
Ejaaz: And NemoClaw, which is their OpenClaw competitor, is going to be one of their major steps in this.
1:41
Ejaaz: So what NemoClaw is, is, as the name suggests, a direct competitor to OpenClaw.
1:46
Ejaaz: It's going to be an agentic platform where you are able to design,
1:50
Ejaaz: create, and spin up AI agents and have them interact with each other.
1:53
Ejaaz: Now, this hasn't been officially announced yet. We're breaking the news right now.
1:57
Ejaaz: But rumors state that these agents will be able to do very similar things to OpenClaw.
2:01
Ejaaz: So you'll be able to get them to do your nine to five job potentially,
2:05
Ejaaz: or you're going to get them to be able to do the shopping for you,
2:07
Ejaaz: like you mentioned earlier.
2:08
Ejaaz: But with one or two different twists, number one, it's going to be way more secure.
2:14
Ejaaz: Now, the number one bit of feedback around OpenClaw is that there's huge amounts
2:19
Ejaaz: of security exposures. people have lost money, personal data,
2:22
Ejaaz: credit card information has been exposed.
2:24
Ejaaz: You won't get any of that with Nemo Call. Number two, the user experience is going to be way better.
2:29
Ejaaz: And Jensen Huang has reportedly stated that he's designing this first and foremost
2:34
Ejaaz: for enterprises, so businesses that want to take their kind of work seriously,
2:39
Ejaaz: but also to the consumer layer as well.
2:41
Ejaaz: And the number one signal that he's demonstrated doing that is making the entire thing open source.
2:46
Ejaaz: The instant thing that I thought of, Josh, is NVIDIA produces the GPUs to power
2:51
Ejaaz: the AI models who power AI agents.
2:54
Ejaaz: And now Jensen is creating the AI agents, which is going to lead to more demand
2:58
Ejaaz: for GPUs. So NVIDIA just keeps on winning.
3:01
Ejaaz: $5 trillion, probably $10 trillion, $15 trillion if this actually hits.
3:05
Josh: Everyone's making their way up and down this AI layer cake, which starts in
3:08
Josh: chips and goes all the way up to the application layer.
3:10
Josh: A lot of people have started the application layer or the model layer.
3:12
Josh: NVIDIA is one of the rare ones that started at the bottom and is working its
3:15
Josh: way up. I mean, we have the
3:17
Josh: what is it the gtx spark nvidia is like small household
3:21
Josh: thing desktop computer sits on your desk and i assume
3:24
Josh: we'll be getting a lot of updates at their gtc conference on monday
3:27
Josh: so this hasn't been confirmed this will be confirmed on monday i strongly suspect
3:31
Josh: it will be called nemo claw they will have their own version of an open source
3:34
Josh: open claw instance and this is a seemingly pretty opportune time because a lot
3:40
Josh: of people have been having issues that we have reported with open claw when
3:44
Josh: you run open claw it's the wild west you're building these systems,
3:46
Josh: you're putting things in place, you're building your own checks,
3:48
Josh: but you're ultimately responsible for managing and orchestrating this huge
3:52
Josh: AI network that begins to grow over time. And Matthew Berman here,
3:56
Josh: he has another great podcast in the AI space.
3:57
Josh: He was talking about how his OpenClaw had a similar issue.
4:01
Josh: And I've seen this a lot around the internet where the OpenClaws get into a
4:04
Josh: bad state and you start to use it and it starts to get worse in terms of output.
4:10
Josh: And then it just totally breaks.
4:12
Josh: And then he followed this up with anyone else having their tokens, keys, secrets,
4:16
Josh: reappearing in plain text after moving them to keychain open claw
4:19
Josh: really wants keys in plain text so he's been having these
4:22
Josh: issues there's another one where the open claw outputs were
4:25
Josh: causing these like duplicate mentions so open claw
4:28
Josh: has been good for some great for others and incredibly challenging for most
4:31
Josh: because a lot of this requires upkeep i'm hoping that what we're going to see
4:35
Josh: is this trend of more rails around this open claw we had it with um nvidia hopefully
4:40
Josh: this week we're going to see claude's been working on this and also perplexity
4:43
Josh: had something fairly interesting right yeah
4:45
Ejaaz: Yeah they announced personal computer, which is basically their version of OpenClaw.
4:50
Ejaaz: Now, Perplexity doesn't actually have their own AI model.
4:52
Ejaaz: They use a bunch of the leading frontier models from the likes of Claude and
4:57
Ejaaz: ChatGPT, but they package it into what they're calling the personal computer,
5:01
Ejaaz: which can toggle your desktop for you, move your mouse around and perform a bunch of actions.
5:06
Ejaaz: You can spin up a bunch of agents in parallel and they can go off and do different
5:10
Ejaaz: things. They can code for you, do your shopping, whatever that might be.
5:12
Ejaaz: Again, an OpenClaw direct competitor. Now, the silver lining across all of this
5:16
Ejaaz: news is that there's a huge amount of demand for these AI agents.
5:21
Ejaaz: In fact, people are paying $6,000 to have someone come to their place or office
5:28
Ejaaz: or work in person and set up OpenClaw from scratch.
5:32
Ejaaz: Now, bear in mind, this is something that you can ask Claw to literally guide you through.
5:36
Ejaaz: And instead, people are paying $6,000. Now, the perks that you get for this
5:39
Ejaaz: is that you are getting an unofficial but official guarantee that there's not
5:45
Ejaaz: going to be any kind of security exploits.
5:46
Ejaaz: And you can have someone just manage the entire thing whilst you can focus on
5:49
Ejaaz: the core business. But to go back to my earlier point.
5:52
Ejaaz: The silver lining is there is insatiable amounts of demand for AI agents.
5:56
Ejaaz: And two, they're actually becoming quite useful. And the likes of OpenAI saw
6:00
Ejaaz: that when they decided to acquire the official OpenClaw open source project.
6:04
Ejaaz: And NVIDIA is now seeing it as well, Perplexity is seeing it as well.
6:07
Ejaaz: So it's kind of like this whole surge.
6:09
Ejaaz: I think even China this week was trending because they were hosting community
6:13
Ejaaz: meetups with 50 to 75-year-olds that were all spinning up OpenClaws.
6:17
Ejaaz: God knows what they are using OpenClaws for, but there's an insatiable amount
6:20
Ejaaz: of appetite for this right now. And it's exciting to see where this goes.
6:23
Josh: Feels like a cult-like following. It's unbelievable how many people use it, love it, adore it.
6:28
Josh: The community events that are spawning up around it. It's become this cultural
6:30
Josh: movement that's global now.
6:32
Josh: It's totally around the world. So 2026 is undeniably the year of agents,
6:36
Josh: which I think is really exciting.
6:38
Josh: And on the topic of agents, we have some news on...
6:41
Josh: Elon musk's xai's tesla collab
6:44
Josh: project around agents and this
6:47
Josh: is an update on macro hard now macro hard for those not familiar is
6:50
Josh: the inverse of microsoft and it is xai's
6:53
Josh: plan to replace software companies through the use of these large language models
6:59
Josh: basically the idea is that microsoft office it's a series of software that creates
7:03
Josh: an output that you interact with and if you clearly define your outputs that
7:08
Josh: you want if you clearly define the outcomes that you're looking for in the software,
7:11
Josh: then Grok and the XAI team can go off and they can build your own custom software
7:15
Josh: for yourself, for your enterprise, for your company.
7:17
Josh: This update is pretty cool. This describes a two-step approach, right?
7:21
Ejaaz: Yeah, so he's launching something incredibly ambitious called Digital Optimus.
7:25
Ejaaz: Now, Optimus is known well globally as the physical manifestation of Tesla's robots.
7:32
Ejaaz: It's a humanoid robot that's hopefully going to be releasing later this year.
7:35
Ejaaz: We don't know, it's an Elon guesstimate there.
7:38
Ejaaz: Digital Optimus is going to be the digital version of that robot.
7:42
Ejaaz: So what the hell does that mean?
7:43
Ejaaz: Well, if you imagine the current market for humans doing computer-based tasks
7:49
Ejaaz: is estimated to be around $30 to $40 trillion worth of the global economy. It's a huge amount.
7:54
Ejaaz: Think about people that use Slack or send messages or need to use a computer
7:58
Ejaaz: for their day-to-day job. That's computer-based tasks.
8:01
Ejaaz: Now, Digital Optimus is aiming to replace or automate a bunch of those tasks.
8:06
Ejaaz: So if you imagine when you're talking to someone on the other end of Slack, right?
8:10
Ejaaz: How do you know that that's actually a human being? You assume it,
8:14
Ejaaz: right? But it doesn't necessarily have to be.
8:15
Ejaaz: Digital optimist is basically going to be the arms and limbs to Grok,
8:20
Ejaaz: the AI brain. It's going to be able to move your mouse around.
8:23
Ejaaz: It's going to be able to intuitively know which file to select.
8:26
Ejaaz: It's going to be able to read things, browse the internet just like you can.
8:29
Ejaaz: But it's going to be a digital human that lives on a computer.
8:32
Ejaaz: Now, this is a pretty ambitious but also vague kind of goal that needs to be
8:37
Ejaaz: done now. It's basically similar to a human emulation or emulator.
8:41
Ejaaz: I don't really know how this is going to manifest.
8:43
Ejaaz: Some of the products that we just spoke about just now, Perplexity Computer,
8:46
Ejaaz: kind of sound like the foundations of this.
8:49
Ejaaz: But again, we haven't seen a release from XAI for a while now.
8:52
Ejaaz: So I'm curious to see how Grok upgrades first before we see a product like this come out.
8:57
Josh: Yeah, well, the idea is that it's going to read, understand your inputs,
9:01
Josh: outputs, and then be able to emulate your job better than you can.
9:04
Josh: And it uses this interesting architecture, which has been around for a while
9:07
Josh: as it relates to how humans think.
9:08
Josh: If anyone's read the book Thinking Fast or Slow, there's like the two components,
9:12
Josh: the two brain architecture.
9:13
Josh: One is your fast system, which is system one. One is the slow, which is system two.
9:17
Josh: So in this collaboration between tesla and xai this is
9:20
Josh: the first time they're actually working together on a formal instance tesla becomes
9:23
Josh: that system one which is the reflexes it's constantly watching
9:26
Josh: the screen for five seconds at a time and it's executing those
9:29
Josh: actions in real time and then grok is that system too it's the
9:32
Josh: big brain that understands has a real clear concept
9:35
Josh: of the world around it and it applies this like high level
9:38
Josh: knowledge and reasoning to the task at hand
9:41
Josh: and what's interesting that i don't think we mentioned yet
9:44
Josh: is the cost of what this takes to run um tesla
9:47
Josh: claims that they're able to run this on their ai4 chip
9:50
Josh: which is 650 so that
9:53
Josh: is a very cheap chip for inference relative to what other data
9:56
Josh: centers are using with blackwell and 30 000 gpus so the cost to actually run
10:00
Josh: this software is going to be very low and these ai4 chips are chips that currently
10:05
Josh: exist they're out there in vehicles in the millions so they have the scale to
10:09
Josh: produce these they have seemingly the software and now they have the collaboration
10:12
Josh: between Tesla and XAI, I have to wonder,
10:15
Josh: is this going to translate to another...
10:19
Josh: Between Tesla and XAI and SpaceX. It's like, is this the thing that's going
10:22
Josh: to bring them together or will they continue to exist separately?
10:24
Josh: I don't know, but really cool updates coming out of the Elon corner.
10:27
Josh: I hope we see more from Grok and XAI soon. They have been moving slow in terms
10:32
Josh: of what they've been releasing, but it seems like they're moving pretty quick behind the scenes.
10:35
Ejaaz: I think they're going to merge. And also the running through line between this
10:39
Ejaaz: story and the NVIDIA story is like both companies are trying to be Apple at
10:43
Ejaaz: this point. They're having their Apple moments, right?
10:45
Ejaaz: Software and hardware stack being combined, vertical integration. in general.
10:49
Josh: That's it. That's the name of the game.
10:50
Ejaaz: It's really being pushed. But listen, let's move away from the software digital
10:54
Ejaaz: robots. Those aren't as cool as the real ones.
10:57
Ejaaz: Brett Adcock, CEO and founder of Figure, which is a leading US robotics startup,
11:02
Ejaaz: released this cool demo, a useful demo rather, of their Helix 2 robot cleaning
11:09
Ejaaz: a living room fully autonomously.
11:11
Ejaaz: Now, listen, I'm not going to be the biggest advocate of having creepy looking
11:16
Ejaaz: robots moving around. Maybe if we slapped a few clothes on this thing,
11:19
Ejaaz: I'd be more amenable to it.
11:21
Ejaaz: But we saw a demo of this robot, I think about a month ago, unloading and reloading
11:26
Ejaaz: a dishwasher, handling glassware.
11:29
Ejaaz: So the point is, these robots are becoming very precise.
11:32
Ejaaz: They're not just these kind of clunky metallic objects that are just doing a bunch of random stuff.
11:37
Ejaaz: It's going to be actually useful to you. Now, whether consumers are actually
11:40
Ejaaz: going to be kind of positive towards spending $30,000 to $40,000 or whatever
11:45
Ejaaz: the price tag of these things are, it's definitely going to be quite expensive
11:47
Ejaaz: and putting them in their home.
11:49
Ejaaz: I don't think we're quite there yet as this demo kind of insinuates,
11:51
Ejaaz: but I'm curious to see what these things are going to be like in actual manual factories.
11:56
Ejaaz: I think that's where they're going to be more proliferant.
11:59
Josh: Yeah the novel breakthrough here is that this was fully autonomous
12:02
Josh: a lot of these tasks that they have they've kind of pre-trained it
12:05
Josh: for a specific task so it's doing the dishes and it's
12:08
Josh: trained on doing the dishes uh this is a fully autonomous system
12:11
Josh: the robot is going around without any commands without any specific training
12:14
Josh: and it's just doing the maintenance on the room which
12:17
Josh: i think is pretty cool it's a fun use case it seems
12:19
Josh: useful elon has been dunking on everyone recently saying
12:22
Josh: optimus 3 is going to be far superior even than this um
12:26
Josh: so i'm looking forward to seeing that and i was actually looking
12:29
Josh: before recording when we can expect to
12:32
Josh: get our hands on optimus because helix has been doing a lot
12:34
Josh: of these demos they haven't started shipping them quite yet and it seems
12:37
Josh: like tesla is not really going to be front running
12:40
Josh: them by any means perhaps in terms of technicality but in
12:43
Josh: terms of when they're going to release according to the polymarket it looks
12:45
Josh: like there's a very slim chance they're going to release this year at all
12:48
Josh: um so 18 chance it releases
12:51
Josh: by december 31st five percent chance it
12:54
Josh: releases by june 30th so we're probably
12:57
Josh: not going to be getting these available anywhere anytime soon
13:00
Josh: but that's not to say we're not going to see the new version of optimus fairly
13:05
Josh: soon it seems like they're teasing it for a mid-year announcement so at least
13:09
Josh: have an idea of what it's going to look like we'll get a demo that's figure-esque
13:12
Josh: um but yeah it seems according to polymarket we will not be getting this and
13:15
Josh: thank you very much polymarket for sponsoring the segment of the episode now
13:18
Ejaaz: Moving on to probably what is the craziest story of the week um our friends
13:23
Ejaaz: at meta who uh are definitely not leading the AI race right now,
13:28
Ejaaz: they haven't released a model in almost a year at this point,
13:30
Ejaaz: made one of the wilder acquisitions.
13:33
Ejaaz: And that's saying something because they spent $15 billion to acquire one guy last year.
13:38
Ejaaz: They acquired Maltbook, which is the viral AI agent social media platform,
13:43
Ejaaz: which is rumored to have around 1.6 million AI agents all autonomously posting, talking to each other.
13:50
Ejaaz: And the stick behind this entire platform is
13:54
Ejaaz: you need to be an AI agent to basically post and interact on there. No humans allowed.
13:59
Ejaaz: And it went viral around the time that OpenClaw did, because if you're spinning
14:03
Ejaaz: up these agents, how do you get them to really benefit society?
14:06
Ejaaz: Well, get them to talk to each other, get them to share skills,
14:08
Ejaaz: get them to interact with each other, get them to transact with each other.
14:12
Ejaaz: And all of that was happening on Maltbook. So this acquisition, in theory, makes sense.
14:16
Ejaaz: You've got the biggest social media company acquiring the biggest AI agent media
14:21
Ejaaz: company, social media company, except I don't think this makes sense in my head
14:25
Ejaaz: because a lot of these agents I think are spoofed.
14:29
Ejaaz: Humans found a way to spin up multiple agents and get them to do certain things,
14:33
Ejaaz: which meant that they weren't really autonomous.
14:35
Ejaaz: Also, I heard that this platform was vibe coded in about a week.
14:39
Ejaaz: So this kind of adds to my perception of meta, which is they are just wildly
14:43
Ejaaz: out of touch and they don't really know what they're doing.
14:46
Ejaaz: Now, if I were to put my smart glasses on and try and envision what they're thinking about here.
14:52
Ejaaz: I think that Zuck is making a really big bet on the future of social media,
14:57
Ejaaz: not having many or if any humans involved.
15:00
Ejaaz: I think he thinks it's all going to be AI personalities, AI content.
15:03
Ejaaz: That's why he's delivering MetaVibes, their video reels app,
15:06
Ejaaz: their TikTok competitor.
15:07
Ejaaz: He thinks that people are only going to consume AI content. And so he wants
15:11
Ejaaz: the producers of that to also be AIs, AI agents.
15:15
Ejaaz: It sounds pretty dystopian to me. I don't really like that future,
15:18
Ejaaz: but it seems to be the direction that we're heading.
15:20
Josh: It doesn't make sense that they would spend money on like an old thing.
15:23
Josh: We recorded the Moplook episode like a month ago.
15:25
Josh: No one's talked about it since. No one used it. There's been a lot of instances
15:28
Josh: where people have clearly created tens of thousands of fake agents on the site
15:32
Josh: that aren't even real. I mean, yeah, this guy...
15:34
Josh: Registered a million fake agents um that's crazy um it's just not really based
15:40
Josh: on anything real it's not a hot topic it's not anything noteworthy or interesting
15:44
Josh: the network effects are probably not real so i would love to ask zuck what he
15:49
Josh: thinks the value proposition in that acquisition is yeah
15:53
Ejaaz: Yeah and it's not like his investments have been doing very well um the guy
15:57
Ejaaz: that i mentioned he spent 15 or 14 billion dollars to acquire alexander wang
16:01
Ejaaz: is rumored to be you know in kind of treacherous territory with Meta right now.
16:07
Ejaaz: They might be parting ways. They may not be agreeing on things.
16:09
Ejaaz: I've seen kind of both sides of this story.
16:11
Ejaaz: Some saying that it's all just kind of like fear-mongering, but it might be true.
16:14
Ejaaz: So I don't know how well things are going for Meta right now.
16:19
Josh: I have some context on this story in particular. Please. This is fake news.
16:22
Josh: The post that we're showing, not true.
16:24
Josh: And the reason I know that is because Zuck posted a picture with Alexander Wang,
16:29
Josh: proving the fact that they're still on good terms and there's not an issue.
16:31
Josh: The problem is that he only posted that photo on
16:34
Josh: threads so i'm sure you never saw it because nobody
16:37
Josh: actually uses threads so this was disproved but
16:40
Josh: it was disproved on the meta platform well i
16:43
Josh: was on instagram and i saw it via like the suggestion thing
16:46
Josh: um because i don't use threads either but yeah this
16:49
Josh: is totally fake news but it's just a testament again to how poor meta's
16:52
Josh: been performing where zuck disproved this rumor
16:54
Josh: but it hasn't quite made it out of the escape velocity because no one is using
16:58
Josh: their products no one's on thread so i don't know i wish met all the best speaking
17:02
Josh: of meta though one of the old really deeply entrenched people at meta jan lacun
17:08
Josh: he departed from meta and now it seems like we finally know what he's working on next
17:12
Ejaaz: Yeah, a former and also disgruntled Meta employee.
17:18
Ejaaz: So he left. He was formerly the head of Meta Superintelligence or whatever the
17:23
Ejaaz: AI intelligence lab was at the time.
17:25
Ejaaz: Then Zuck acquired Alexander Wang and he was kind of ousted out.
17:29
Ejaaz: Yan Le Koon was gone. And he's like one of the godfathers of AI,
17:33
Ejaaz: although I hate to say it.
17:34
Ejaaz: He's been a hater of LLMs and he's been calling the demise of LLMs for a while
17:39
Ejaaz: now, even as LLMs have gotten much, much better and way more intelligent.
17:42
Ejaaz: Empower all of our favorite AI products today.
17:45
Ejaaz: And he's put his money where his mouth is. He launched Advanced Machine Intelligence,
17:51
Ejaaz: or AMI Labs, which is focused on building a world model.
17:56
Ejaaz: Now, world models are different from LLMs in the sense that they're more sensory.
18:01
Ejaaz: They take in video inputs, image inputs, audio inputs.
18:05
Ejaaz: And the idea is it's meant to understand the physical reality that humans engage with.
18:10
Ejaaz: Now, LLMs, they only work on text and character.
18:13
Ejaaz: So they kind of understand what the outside world looks like through descriptive
18:18
Ejaaz: context, but they don't actually know. They can't actually see.
18:21
Ejaaz: World models actually help AIC, and that's what he's going to be building at AMI Labs.
18:27
Ejaaz: Now, in order to do this, he raised Europe's largest seed round, $1 billion.
18:32
Ejaaz: It's not euros, $1 billion. It was less than euros.
18:36
Ejaaz: But it's a strong signal that world models are going to be a huge thing.
18:39
Ejaaz: He's not the only one that's saying that.
18:41
Ejaaz: Demis Hassabis, the CEO of Google AI, has also said the same thing.
18:46
Ejaaz: It's going to be a core focus of Google.
18:48
Ejaaz: They released a banger of a model which we made an episode about called Genie 3.
18:52
Ejaaz: What you're looking at on the screen here is completely AI generated.
18:55
Ejaaz: You can walk around this cat that's on a vacuum right now. You can interact with the world.
18:59
Ejaaz: It's super cool. feels like a game but it's actually simulated reality I wish
19:04
Ejaaz: him the best of luck I don't know what his angle is going to be I don't know
19:07
Ejaaz: how he can catch up to the labs that are spending tens of billions of dollars
19:10
Ejaaz: hundreds of billions of dollars but it's a good start I guess.
19:14
Josh: Yeah. And I mean, it's another testament to the fact that a lot of people are
19:17
Josh: really interested in world models and understanding the physics and understanding multimodality.
19:21
Josh: And the basis of these world models is that natively multimodal world where
19:26
Josh: you're able to understand text, audio, imagery, videos, and then therefore represent
19:31
Josh: physics and understand why certain things do the things that they do.
19:35
Josh: And Google actually made some serious progress in this front this week with
19:38
Josh: their new embedding to model, which is the first natively multimodal embedding
19:42
Josh: model, which means maps, text, images, video, audio, and documents all into
19:46
Josh: a single unified space in its native form.
19:49
Josh: So this is different because previously you had to
19:52
Josh: translate each one of these modalities into the other this
19:55
Josh: one they all exist in the same plane which unlocks a lot of really interesting
19:58
Josh: use cases i mean one of the ones that i like in particular
20:01
Josh: i saw is that if you're training for sports or if you're training for anything
20:04
Josh: physical if you're in the gym working out you point the camera at you and it
20:08
Josh: understands the video so it can actually ingest the video understand what you're
20:12
Josh: doing and then give you productive output or give you help to improve either
20:16
Josh: your form or to improve your your weight lifting or whatever it is that you're doing.
20:20
Josh: And there's a lot of other unique use cases, right, Ijaz, you were just telling
20:22
Josh: me about a couple earlier.
20:23
Ejaaz: Yeah, kind of sticking on the sports theme. Do you know when you're having a
20:28
Ejaaz: conversation with a friend and you remember a moment in a video or like in a
20:32
Ejaaz: movie and you're like, oh, yeah, what movie was that?
20:35
Ejaaz: Or like, what scene was that? And maybe you need to scroll through a video to find the same thing.
20:39
Ejaaz: You can now ask Google embedding, you know, hey, can you find me that sports
20:43
Ejaaz: moment where Kobe shot this particular shot?
20:46
Ejaaz: And it trolls through the entire YouTube blog or whatever, the MBA log,
20:50
Ejaaz: and it finds that excerpt and can drag that clip to you.
20:54
Ejaaz: And this is what technology like this or the new embedding model unlocks.
20:58
Ejaaz: You now not only can query different types of media like images,
21:03
Ejaaz: photos, whatever that might be, but it also understands what you're asking it for.
21:08
Ejaaz: Previously, it would just be like, okay, he's kind of referencing a photo or
21:11
Ejaaz: a video. I'm going to try and figure out which one that is.
21:13
Ejaaz: Now it intuitively understands what you mean when you say, oh yeah,
21:17
Ejaaz: it's during this time during the autumn.
21:20
Ejaaz: Could you find this picture of my mom and I? And it'll be able to do that for you.
21:24
Ejaaz: Secondly, it's also kind of cool. You can connect this model to say your photos.
21:29
Ejaaz: And this is in theory, by the way, developers actually have to build this app
21:32
Ejaaz: that I'm about to describe.
21:33
Ejaaz: You can connect it to your photos or videos and you could say,
21:36
Ejaaz: can you find the last time that I was like super motivated?
21:39
Ejaaz: Show me a clip, show me a photo of when that was, and it'll be able to troll
21:43
Ejaaz: through your entire library and understand and know when that is and pick it
21:47
Ejaaz: out for you so i'm excited for the new apps that are going to be enabled by this model.
21:51
Josh: Yeah, the context is great. It's like if you think of a universal library,
21:55
Josh: traditionally it's just books.
21:56
Josh: Well, now it's like books, photos, podcasts, videos, music, and it all is processed in the same way.
22:03
Josh: So if you want to explain to me quantum computing, it will not only surface
22:07
Josh: the books, but it'll also surface the videos and the custom essays and whatever
22:10
Josh: it may be. It's an amazing model.
22:12
Josh: I'm looking forward to the people who are building those apps.
22:15
Josh: But we also have more news out of the Google front, right? The Google Maps biggest
22:19
Josh: upgrade ever. And Google Maps is noteworthy because
22:21
Josh: How many billions of people use Google Maps every day?
22:24
Ejaaz: Two billion. Every month. Two billion every month.
22:26
Josh: So now two billion people just got a pretty serious upgrade. Yeah.
22:29
Ejaaz: Yeah. So it's called Ask Maps. It basically integrates Gemini,
22:34
Ejaaz: so Google's AI model, into Google Maps, but in a really unique way.
22:38
Ejaaz: So you can now ask it, hey, I want to play tennis tonight, but I need the court
22:44
Ejaaz: to have lights and I want it to be kind of like on my way home.
22:48
Ejaaz: Can you find me a few places? and it's able to query search using this multi-modality
22:53
Ejaaz: that we just described with embedding two and kind of intuitively figure out where you want to go.
22:58
Ejaaz: Now, it instantly reminded me of the experience that you've described,
23:02
Ejaaz: Josh, when you use Grok in your autonomous car in your Tesla.
23:07
Ejaaz: This is now Google's version for that. What I love about this is it's not just
23:11
Ejaaz: based on kind of AI knowledge, it's based on 500 million reviews from 300 million real people.
23:17
Ejaaz: And it takes you from like having to scroll through a bunch of reviews,
23:21
Ejaaz: reading comments to this experience where you're having an LLM whilst you figure
23:26
Ejaaz: out where you want to go or what you want to do with your day.
23:28
Ejaaz: And it changes the way that people plan their itineraries or choose where they want to go.
23:32
Ejaaz: Now, what's most exciting for this, for Google in particular,
23:35
Ejaaz: is can you imagine if they switch on ads for this type of thing?
23:38
Ejaaz: Like they will now own the entire funnel from deciding what people want to do
23:44
Ejaaz: because they're going to suggest what you want to do and then monetizing that on the back end.
23:47
Ejaaz: So it's just a crazy world that we're headed into. I thought this was cool.
23:50
Josh: Yeah, Google Maps is great. They're crushing it. Okay, this final story of the
23:54
Josh: week, I had to confirm with you that this was real.
23:57
Josh: And I had to watch the videos a couple times. And even after watching it the
24:00
Josh: first time, it took me a moment to understand
24:03
Josh: What was actually happening here? There are... This is a combination.
24:07
Josh: The convergence of cockroach and computer has finally happened.
24:10
Josh: We've reached the cockroach singularity in which they've converged into one super roach.
24:15
Josh: And for some people, this is an absolute nightmare. And for others,
24:18
Josh: this is this cool kind of futuristic sci-fi world that we're living in. But there are now...
24:23
Josh: Robotic cockroaches walking around the planet. Ejaz, I know you were all over
24:28
Josh: this news. What is going on here? This video is outrageous.
24:31
Ejaaz: So these aren't robotic cockroaches, Josh. These are real cockroaches,
24:36
Ejaaz: live cockroaches that have been fitted with a few things.
24:40
Ejaaz: Cameras, microphones, and a locally run AI model.
24:44
Ejaaz: It's slapped on the back of these cockroaches. This is like the big helmet thing
24:47
Ejaaz: that you can see them wearing in this video.
24:49
Ejaaz: You might be asking why? Well, the idea was birthed from NATO.
24:54
Ejaaz: And by the way, these things have been alive for like almost a year at this
24:57
Ejaaz: point, but the news broke yesterday.
24:59
Ejaaz: NATO issues these things to military. So right now, the German military has
25:03
Ejaaz: deployed a bunch of these cockroaches to scout out certain military locations
25:08
Ejaaz: or places that they're targeting, their enemies, sleuthing, things like that.
25:12
Ejaaz: These cockroaches can maneuver through rubble, creep into certain cracks to
25:17
Ejaaz: check out certain areas, pick up audio feeds, spying on different people, basically.
25:22
Ejaaz: Now, the reason why this is wild is the tech alone.
25:26
Ejaaz: So the tech, to be able to compile a microscopic AI chip onto a cockroach is a feat in itself.
25:31
Ejaaz: But they also steer these cockroaches, Josh, using electrical pulses.
25:36
Ejaaz: So if they want the cockroach to go left or go in a certain direction,
25:39
Ejaaz: they're constantly sending these electrical pulses to maneuver them,
25:43
Ejaaz: just like you would like an RV car or remote control college just a insane uh
25:47
Ejaaz: bit of technology for you to round.
25:48
Josh: Up the theme for this week seems to be sci-fi and all
25:52
Josh: of these terms are kind of all these themes are kind of disturbing right so
25:55
Josh: earlier this week we did the doom episode where
25:58
Josh: we kind of sliced human or we took human brain cells
26:01
Josh: we trained them to play doom and then we sliced us uh
26:04
Josh: the brain of a fly a fruit fly and then you
26:07
Josh: can like put that fruit fly into a computer and clone them and now we've we've
26:10
Josh: augmented cockroaches to have these physical augmentations that allow them to
26:15
Josh: be controlled and merged with ai and it feels like this is all early versions
26:19
Josh: of where it's headed towards in terms of like human augmentation like okay we could cut a fly brain
26:25
Josh: to copy and put it in digital world how long until it
26:28
Josh: becomes a human brain like oh now we're augmenting cockroaches how long
26:31
Josh: before we start augmenting humans and you start to map
26:34
Josh: this out and it's like okay we're we're making progress far
26:37
Josh: quicker than we ever have before the world is seemingly very sci-fi and ai is
26:41
Josh: accelerating the rate at all this scientific progress happens so it's it's a
26:46
Josh: weird future like imagine you're in the war zone and there's a million of these
26:48
Josh: cockroaches coming towards you cockroaches never die they're invincible too
26:52
Josh: so this is like clearly a very dominant form.
26:55
Josh: I hope they keep these out of Manhattan and New York City because I think the
26:58
Josh: cockroach problem is already enough without like these AI machines controlling them.
27:02
Josh: But yeah, this is like weird dystopian sci-fi craziness that we're seemingly getting an
27:10
Josh: Cool story to end the week on. This is pretty fascinating, pretty weird,
27:13
Josh: pretty wild. Don't know if I like it. Like, I respect the innovation.
27:17
Ejaaz: I've never been more disgusted by such a cool piece of tech.
27:20
Josh: Dude. Yeah, yeah. So shout out to whoever's working on that.
27:23
Josh: Good for you. I'm happy for you. I hope you keep that in a lab.
27:26
Josh: Don't let it out, please.
27:28
Ejaaz: Don't let it get out, please, please. So that rounds up our weekly roundup.
27:33
Ejaaz: We had three banger episodes put out this week. we
27:36
Ejaaz: talked about uploading a fruit fly's brain and
27:39
Ejaaz: human brain cells playing doom on episode one episode
27:43
Ejaaz: two we talk about uh starlink mobile and the
27:45
Ejaaz: upcoming starlink v3 satellite launch you definitely want to catch that um and
27:50
Ejaaz: then the third episode we released yesterday was is ai coding reaching its peak
27:54
Ejaaz: or has it hit a massive wall the dark side of ai coding we released that this
27:57
Ejaaz: morning or yesterday morning if you're listening to this right now definitely
28:00
Ejaaz: go check that out I actually had a question for the audience, Josh.
28:05
Ejaaz: For those of you who are still listening, I keep seeing this fossil of an AI
28:09
Ejaaz: model keep popping up on my screen. It's called Copilot.
28:12
Ejaaz: It's from this little known company called Microsoft.
28:14
Ejaaz: And I'm curious whether any of you listening to this actually use it.
28:18
Ejaaz: Now, the reason why I'm saying this is I've kind of been skeptical of it because
28:21
Ejaaz: I have never known anyone in my circle, at least, that uses it.
28:25
Ejaaz: But apparently, a bunch of Fortune 500 companies pay Microsoft tens of billions
28:29
Ejaaz: of dollars a year to access it. So if you are one of those people,
28:32
Ejaaz: can you let us know in the comments? Like, I really want to hear from you.
28:35
Josh: Hey, if you've made it this far and you've listened to all of our episodes,
28:37
Josh: congratulations, you are totally caught up.
28:39
Josh: Go enjoy your weekend. Go touch some grass. The weather's been pretty great,
28:41
Josh: at least on the East Coast. So I hope you have some time to enjoy that.
28:44
Josh: Thank you so much again for sharing with your friends, rating five stars on
28:47
Josh: the podcast apps if you haven't.
28:48
Josh: And just being generally supportive. We try to read all the comments.
28:51
Josh: We've been getting through just about all of them.
28:52
Josh: That's a lot. I really appreciate all the support as always.
28:55
Josh: So thank you for another amazing week of four episodes.
28:57
Josh: And we will see you guys next week with all the new AI news.