Latest / In the Loop AI / Which AI Should You Actually Use? Claude vs ChatGPT vs Grok vs Gemini (2026 Guide)
Transcript
- 0:00Josh: Over the last 90 days, Frontier Labs shipped 15 plus models.
- 0:04Josh: OpenAI shipped three, Anthropic shipped four, Google shipped three,
- 0:07Josh: even Meta and Elon Musk shipped Frontier models. The Chinese shipped a bunch as well.
- 0:12Josh: And so if you're listening to the show, you're probably wondering,
- 0:14Josh: which model should I be using right now?
- 0:16Josh: Most of you likely have a GPT or Claude subscription, but you're wondering,
- 0:20Josh: should I be using these different models?
- 0:22Josh: The truth is, the Frontier landscape of AI models, when it was originally thought
- 0:26Josh: to be one or two, has now expanded to hundreds and hundreds of models.
- 0:30Josh: In OpenRata alone, you can access 400 plus. And so on this episode,
- 0:34Josh: we're going to dig into which model you should use for what particular use and
- 0:38Josh: when makes the most sense.
- 0:40Josh: And you'll realize that the argument has shifted not from using the most intelligent
- 0:44Josh: model, but maybe using the most cheaper model or using the model that's specific for you.
- 0:48Ejaaz: You got options, baby. There's a lot going on in the AI space and we're going
- 0:51Ejaaz: to help navigate that space because there is a lot of options and it does get
- 0:55Ejaaz: overwhelming. I think between the two of us, we've probably touched every single
- 0:59Ejaaz: one of these, at least a couple of times.
- 1:01Josh: I have too many subscriptions, Josh.
- 1:02Ejaaz: So yeah, between our 75 different subscriptions, we have covered these.
- 1:05Ejaaz: We have some feedback about which one to use for when, which is best for which use cases.
- 1:10Ejaaz: And I guess to start, we have this like pretty helpful visual companion artifact
- 1:13Ejaaz: here that can walk through kind
- 1:15Ejaaz: of what we're thinking, how we think about this. The first is the split.
- 1:18Ejaaz: There are two distinct classes of model when it comes to considering which ones
- 1:23Ejaaz: to use. The first is open source.
- 1:25Ejaaz: These are Chinese models predominantly. Most of these are your Kimis,
- 1:29Ejaaz: your DeepSeaks, like all of those models are Chinese open models.
- 1:32Ejaaz: And then we have the actual US models that are all closed source.
- 1:36Ejaaz: There's a big difference between the two. And we could see if we scroll down
- 1:38Ejaaz: a little bit, the difference in usage between these two, because in June of
- 1:42Ejaaz: 2025, US Labs accounted for 70% of the tokens generated. And now they're down to 30%.
- 1:48Ejaaz: The economics have changed widely. So now that 30% is worth much more than 70%.
- 1:54Ejaaz: But it is interesting to note that there has been this kind of reinvigoration
- 1:57Ejaaz: of Chinese models over the past couple of months. Now, granted,
- 1:59Ejaaz: this is based on open router data.
- 2:01Ejaaz: Open router is a single model router instance. This is not reflective of the norm.
- 2:06Ejaaz: But it's just worth noting that some of these open source models are pretty
- 2:09Ejaaz: powerful for the task at hand.
- 2:12Josh: Yeah, I think no one can debate the fact that people have shifted a lot using
- 2:16Josh: these open source models. And it's for a variety of different reasons.
- 2:19Josh: People want to own their own data, they want to run it privately at home.
- 2:22Josh: But the biggest shift, the biggest reason has been because these models are
- 2:26Josh: a lot cheaper. And open router data you mentioned only really represents a very
- 2:32Josh: niche sector of software engineers that want to experiment with a bunch of these models.
- 2:36Josh: But even in the enterprise world, where OpenAI and Anthropic are pretty dominant
- 2:40Josh: with their own model share, they've been losing the token market share to enterprises
- 2:44Josh: that are trialing and testing different models to save tens to hundreds of millions of dollars as well.
- 2:50Josh: And when I look at the main reason why, it's not because the open models are
- 2:55Josh: the most intelligent. You'll see in a second as we go through the scorecard,
- 2:58Josh: GLM 5.3 from China, amazing model, not as good as Fable 5. You'll look at Kimi
- 3:02Josh: K 2.7, you'll think the same thing.
- 3:05Josh: Those models are good enough to do the bulk of your own work.
- 3:08Josh: It doesn't sound too much like AI slop.
- 3:11Josh: It actually just speaks to you normally. And the biggest advantage is it has
- 3:14Josh: fewer safeguards, which has its pros and cons, but it basically does the tasks that you ask it to.
- 3:20Josh: Now, overall, it's fine if we talk about a bunch of models on this show,
- 3:24Josh: but it's good to get an overview, essentially, of how intelligent or how effective these models are.
- 3:30Josh: And what we have on the screen here is something known as the Artificial Analysis
- 3:34Josh: Index or Intelligence Index.
- 3:36Josh: And this is basically the best benchmark to test the general intelligence of
- 3:40Josh: these different models.
- 3:41Josh: Now, it may come as no surprise to you, but the Claude models,
- 3:45Josh: Anthropix models, top this. We've got Opus 5 at the top, which is their most
- 3:49Josh: recent model launch. We've got Claude Fable 5.
- 3:51Josh: And then, surprising to me, Josh, but Grok 4.6 from Elon, it is just,
- 3:56Josh: it is fantastic how effectively SpaceX has been able to pivot from being way behind the model race.
- 4:03Josh: They fired their entire AI team, hired a bunch of new folk, acquired Cursor
- 4:08Josh: for $60 billion and put out a model in, I think it's like the last six weeks
- 4:13Josh: that was able to contend with the top. And the best part is he has all the GPUs
- 4:17Josh: and compute to train them.
- 4:18Josh: And then if you go further down the stack, you'll see the likes of OpenAI,
- 4:21Josh: GPT 5.6 Sol, and a bunch of other Chinese open source models.
- 4:25Ejaaz: The question is, what do you make of this? As someone who is just a user of
- 4:29Ejaaz: AI, what do you make of this? How do you navigate this?
- 4:31Josh: Let me trial this, Josh. Let me ask you this question. Of these models that
- 4:35Josh: you see on the screen here, which ones are you using and for what specifically?
- 4:41Ejaaz: It's funny because about 90% of the usage comes from the top two.
- 4:45Ejaaz: And then 10% comes from everything else. And this is kind of like what I was
- 4:50Ejaaz: going for. I'm actually curious, is it a similar thing for you?
- 4:52Ejaaz: Like what kind of models are you using?
- 4:54Josh: Yes, but okay. So I would say it's around, I'm going to say like 75, 25.
- 5:01Josh: And the reason why I have that slight adjustment is because I kind of use the
- 5:06Josh: AI model that's most convenient to me wherever I'm getting the information or
- 5:10Josh: the inclination to use an AI model. So X is a perfect example, right? I'm scrolling X.
- 5:15Josh: I read something from one of these genius AI researchers and I'm like,
- 5:18Josh: I have no idea what the hell this means.
- 5:20Josh: I tap the Ask Rock button. I'm on Google. I'm searching something, right? I'm on my laptop.
- 5:25Josh: I'm like, okay, I'll just speak to Gemini in this. So in that sense,
- 5:29Josh: wherever the AI is conveniently placed, I use it there.
- 5:32Josh: And I have a feeling when Apple releases like their new AI model in a couple
- 5:35Josh: of months or a couple of weeks, actually, I'll probably use it on my phone as
- 5:38Josh: well because the models just generally are good enough to answer my basic questions.
- 5:42Ejaaz: Yeah, okay. So we're looking at these charts and we're seeing,
- 5:44Ejaaz: okay, here's where the intelligence is. Here's where things get a little less
- 5:47Ejaaz: intelligent, but much cheaper.
- 5:48Ejaaz: And if you're a normal consumer, I have a feeling that cost isn't that big of
- 5:52Ejaaz: a deal because the cost differences are really at scale.
- 5:55Ejaaz: What a lot of these companies offer, what Anthropoc offers, what OpenAI offers,
- 5:58Ejaaz: what Grok and Gemini offer is just the $20 a month, $100 a month, $200 a month plan.
- 6:04Ejaaz: You could just pay a fixed amount and get access to a lot of usage of these models.
- 6:08Ejaaz: So if you are a general consumer who is able to spend $20 per month on a subscription,
- 6:14Ejaaz: you're probably better served going to one of the major iolabs.
- 6:16Ejaaz: The product is better. You're going to get more intelligence.
- 6:18Ejaaz: You're going to get a more coherent product.
- 6:20Ejaaz: I find that a lot of the people who I speak to a lot of the time in my experience,
- 6:23Ejaaz: the only real reason to use these open source Chinese models is if you're consuming
- 6:28Ejaaz: tremendously large amounts of tokens for, say, agentic tasks.
- 6:32Ejaaz: Like if you're running an open claw instance or any sort of claw with a lot
- 6:35Ejaaz: of automated workflows, a lot of agents, you may want to defer to some of these
- 6:39Ejaaz: cheaper, perhaps the Chinese open source models just to save on costs on the low end.
- 6:42Ejaaz: But when it comes to day to day use on the high end, I'd say probably 90 plus
- 6:46Ejaaz: percent of the people watching this are best served just getting a subscription
- 6:49Ejaaz: to your favorite ai company
- 6:52Ejaaz: Using that product. That's kind of how I use it. It's funny that the remaining
- 6:55Ejaaz: 10% of prompts that aren't done through Anthropic are done mostly through Grok.
- 7:00Ejaaz: Like you mentioned, when I'm on X 24 hours a day, it's a good companion because
- 7:04Ejaaz: it has access to that database.
- 7:05Ejaaz: And then the other one is actually ChashyBT because they have a really amazing
- 7:09Ejaaz: image generation model.
- 7:10Ejaaz: And I love creating memes or sending images to my friends who are just like
- 7:14Ejaaz: using that as the visual component. I find that really compelling.
- 7:17Ejaaz: So that's kind of my stack is like mostly Anthropic, sometimes Grok,
- 7:21Ejaaz: sometimes chat gpt particularly for the image gen i think when it comes to image
- 7:24Ejaaz: gen we used to use nano banana and gemini all the time that was like the top
- 7:28Ejaaz: dog i think ever since image gen 2.0 release from chat gpt
- 7:32Ejaaz: is very compelling what i like is that it does get actual thinking behind it
- 7:37Ejaaz: so previously when you asked to generate an image it would take your words at
- 7:40Ejaaz: face value generate the image now it actually does some inference it does some thinking
- 7:44Ejaaz: it kind of interprets your message and interprets what it's seeing in the image
- 7:48Ejaaz: and then creates a much better output. So that's kind of how I would think
- 7:51Ejaaz: of navigating this um like chinese models are certainly a big deal but unless
- 7:55Ejaaz: you are kind of advanced super user consuming a ton of tokens perhaps they're not that valuable
- 8:00Josh: I will speak from my own personal experience i
- 8:04Josh: use the clawed models pretty much all the time
- 8:07Josh: but i've started using opus 5 more than fable 5
- 8:11Josh: and and this might sound like a silly reason but it's because it speaks to me
- 8:15Josh: like a normal human being i don't know what the personality dials are on opus 5 versus fable 5 but
- 8:21Josh: they need to do that to fable 5 pronto because fable 5 just waffles and speaks
- 8:25Josh: in like archaic prose and i'm just like listen just give me
- 8:28Josh: give me the information that i've asked for and do not give me anything else
- 8:31Josh: i don't want to have to read,
- 8:32Josh: an essay every time i use this right now grok 4.6 i've actually noticed the
- 8:37Josh: intelligently josh i don't know if you've tried this on x you probably do when
- 8:41Josh: you're like kind of like trying to figure It speaks to you super intelligently
- 8:45Josh: and there's less crass about it.
- 8:47Josh: If you remember the earlier versions of Grok used to kind of like throw in some
- 8:52Josh: kind of like questionable words, slang and phrases.
- 8:55Josh: And now it just speaks to you like an intelligent human being.
- 8:57Josh: And I think this is because Elon's like, you know, SpaceX is IPO'd.
- 9:01Josh: He's got Cursor, very professional researchers involved, and they're trying
- 9:04Josh: to target a more enterprise oriented audience. And he said before that Grok
- 9:08Josh: 4.7 is on its way to being released in a few weeks now. He's aiming for Grok
- 9:12Josh: 5 by the end of the year. That's literally only in a couple of months.
- 9:15Josh: He is really targeting the enterprise landscape because he's seen Anthropic and OpenAI go after it.
- 9:20Josh: Now, same as you, on the Chinese models, I am not using any of them.
- 9:25Josh: And I admit this might be my own bias because...
- 9:28Josh: Mainly, I'm like, I'm not sure, like, I want to go to the efforts of signing
- 9:32Josh: up on an account, using those models, and then being like, well,
- 9:36Josh: I don't know whether this is giving me the right information.
- 9:38Josh: I don't know. I just kind of have this weird trust thing with the US and American
- 9:41Josh: brands. And maybe that's like my own fault.
- 9:44Josh: And then the one thing that I'll point out across all these different models
- 9:47Josh: that we make the point on on the screen here is.
- 9:50Ejaaz: I think a bulk
- 9:51Josh: Of the companies, Anthropic and OpenAI especially, have focused on making their
- 9:57Josh: models really good for enterprises. But as I mentioned earlier,
- 10:00Josh: the shift has really happened to open source because...
- 10:03Josh: More available models are cheaper and more accessible to people to use. They can run privately.
- 10:09Josh: But Anthropic and OpenAI's response to this is, we'll just distill our main
- 10:13Josh: model and give you cheaper models.
- 10:15Josh: So that's what OpenAI has done, right? You've got GPT 5.6. There's three versions
- 10:19Josh: of it. You've got Sol, Terra, and Luna. Luna is, I think, slashed 80% of the
- 10:23Josh: price than it was before already a week ago, right?
- 10:26Josh: So now it's like competing very much with GLM 5.3.
- 10:29Josh: And you've got Anthropic doing the same. I think Opus 5 is like half the cost
- 10:33Josh: of Fable 5, whilst being as capable as Fable 5.
- 10:36Ejaaz: And they also kept the SANA pricing low too, which is the lowest layer.
- 10:39Ejaaz: So that's like, yeah, there's plenty of options there.
- 10:42Josh: Plenty of options. And I think this comes down to one thing,
- 10:45Josh: and I don't want to make this about compute, but I have to, Josh.
- 10:48Josh: I think whichever lab, whether you're Chinese, whether you're like a low tier
- 10:52Josh: US American lab, or whether you're the high tier labs, compute will dictate
- 10:56Josh: whether you can serve these bottles cheaper, which will basically decide or
- 11:00Josh: determine which customers use your product.
- 11:02Ejaaz: Yeah. And I mean, this is ultimately coming down to your use case.
- 11:04Ejaaz: Like a lot of people won't ever run into this problem because they will never
- 11:07Ejaaz: need this thing called an API key.
- 11:08Ejaaz: They'll never actually pay per token. They'll oftentimes just pay through the subscription.
- 11:12Ejaaz: And if you're using a subscription, you have a couple of options.
- 11:14Ejaaz: Maybe this is a good time to go through these subscriptions and what are the
- 11:17Ejaaz: offerings of everybody. We have Gemini, which perhaps we could start there because
- 11:21Ejaaz: I feel like we've been mean to Gemini recently. We haven't talked much about Google.
- 11:25Ejaaz: What's that one? Yeah, like that one.
- 11:27Ejaaz: Who's that? They're currently at Gemini 3.1 Pro, which is nowhere really near the frontier
- 11:33Ejaaz: um anymore unfortunately they do have nano banana pro which is like this fun cool image generation
- 11:39Ejaaz: process they have what i find interesting about google and if you are interested
- 11:42Ejaaz: in these tools it may be interesting for a subscription google has these like
- 11:45Ejaaz: weird edge case tools that have really interesting harnesses one of them is for music production
- 11:49Ejaaz: i remember we've used this on the show many times it's really good at generating
- 11:54Ejaaz: lyrics and generating music in a way that sounds very good
- 11:57Ejaaz: I've only had that experience on a Google product. I haven't been able to use that anywhere else.
- 12:01Josh: Lyria.
- 12:02Ejaaz: Lyria, that's right. Yes, Lyria, Project Lyria.
- 12:04Josh: Remember we created the jingle for the show?
- 12:06Ejaaz: Yeah, so good, dude. So like Gemini and Google is like good for the weird stuff.
- 12:10Ejaaz: Like it'll generate you pretty good images.
- 12:11Ejaaz: It'll generate you fun music. They have this other tool.
- 12:14Ejaaz: This is in like the Google Lab suite where it'll generate you marketing material.
- 12:17Ejaaz: So if you have a lot of material from your brand or you have a bunch of logos
- 12:20Ejaaz: and you want marketing material, kind of say your logo's printed on something
- 12:25Ejaaz: that's staged nicely or you want custom merchandise, It'll do a lot of that
- 12:28Ejaaz: for you. So it's fun for those kind of narrow use cases of where the lab's products lie.
- 12:32Ejaaz: Outside of that, I don't know, I can't really recommend it that much.
- 12:35Ejaaz: It's not the strongest, not close to the strongest.
- 12:38Ejaaz: I'd say probably on top of that, we have Grok, which is very quickly catching up.
- 12:41Ejaaz: If you spend a ton of time on X like we do, Grok is your best friend.
- 12:45Ejaaz: Grok has access to that data that is available in real time on X.
- 12:49Ejaaz: If you're looking for current up-to-date news on pretty much anything, Grok is your go-to.
- 12:54Ejaaz: It can sort and cite specific tweets from specific moments that are happening
- 12:58Ejaaz: in real time and just generally speaking like you mentioned details it's very
- 13:01Ejaaz: good at just communicating with you directly
- 13:03Ejaaz: there's not a lot of fluff it is a science and technical model it is direct to the point
- 13:07Ejaaz: it'll get vulgar with you if you want it's fun to play around with there is
- 13:10Ejaaz: the voice mode which is really fun that i've i'd say of all the voice modes
- 13:14Ejaaz: that's the voice mode i've had the most fun with is because it's just so
- 13:18Ejaaz: ridiculous and oftentimes if you see memes online it is because is the voice behind it.
- 13:22Josh: The GPT voice mode just jars me so much. I don't know, have you spoken to it.
- 13:27Ejaaz: With the recent update? The new version, I have, yes. So when you say that, what do you mean?
- 13:30Josh: And so it sounds more human, right? It like pauses, but it sounds like it's
- 13:35Josh: like some sassy person that's talking to me. It does. Like I asked this question and then he goes,
- 13:41Josh: hmm, yeah, yeah, like, yeah, like, listen, like, I get it.
- 13:45Josh: And, you know, this is what the weather is. And I'm like, yo,
- 13:49Josh: I don't need this. I just asked you what the weather is.
- 13:51Josh: Like, you know, just tell me what's up. But I agree with you largely on like on Google and SpaceX.
- 13:56Josh: What I will say about Google, Josh, is I think they have a similar profile to
- 14:02Josh: Microsoft. I'm interested if you agree with me here.
- 14:05Josh: Microsoft is not a name that I would draw against the top frontier AI Model
- 14:10Josh: Labs. In fact, I think they fumbled the bag massively.
- 14:13Josh: But they are embedded across pretty much every single Fortune 500 company,
- 14:17Josh: whether we like it or not. Like we just live in our tech bubble.
- 14:20Josh: But outside of the tech bubble, people run Microsoft Teams and the Microsoft Suite.
- 14:24Josh: And I think Google's in a similar position, essentially, like a lot of new upstarts
- 14:28Josh: use Google Docs, Google Suite, and they're just going to click the Gemini button
- 14:31Josh: in the same way that I do so because it's just convenient. Do you agree with that?
- 14:35Ejaaz: Yeah, I guess there's just a moat to being like the biggest company in the world
- 14:38Ejaaz: and having access to all of these kind of legacy enterprise companies.
- 14:42Ejaaz: It feels like anyone who has built a business over the last 20 or 30 years has
- 14:45Ejaaz: been using Microsoft, has been using Google.
- 14:47Ejaaz: They're going to continue to leverage that. It seems like Google is slightly
- 14:51Ejaaz: more ahead than Microsoft, if I had to guess. I'm much more excited about Google
- 14:55Ejaaz: as a company than Microsoft is, but they both benefit from that legacy customer base.
- 14:59Josh: Well, both are amazing VCs, right?
- 15:02Ejaaz: Both are incredible VCs. Yes. I think they should be judged not on the quality
- 15:05Ejaaz: of their product, but the quality of their investment in the other competitors
- 15:08Ejaaz: that are going to crush them.
- 15:11Ejaaz: But I do like that, right? It's like they have a hedge. Microsoft owns a large
- 15:16Ejaaz: part of OpenAI. That's incredible.
- 15:18Ejaaz: Google owns this like massive stake in SpaceX, in Anthropic,
- 15:21Ejaaz: in both of these companies that are going to like be huge IPOs,
- 15:25Ejaaz: one of which already did.
- 15:26Ejaaz: So they are amazing venture funds, perhaps slightly less better AI labs.
- 15:30Ejaaz: The two that don't have to benefit from this kind of legacy software are the
- 15:35Ejaaz: two that we're probably going to recommend.
- 15:37Ejaaz: And in fact, if you scroll down a little bit further, we could see the box of
- 15:41Ejaaz: price against intelligence and kind of where each of these models sit.
- 15:44Ejaaz: Yeah, this chart right here.
- 15:46Ejaaz: And we're looking at those in the top right. this is where most of the people
- 15:49Ejaaz: are going to want to live this is where i think we spend all of our time you're
- 15:52Ejaaz: either getting a chat gpt or again a cloud membership and like that's that's
- 15:55Ejaaz: for the most part that's what most people need uh the differences are
- 15:59Ejaaz: small but noteworthy mostly as it relates to the models i mean both of them
- 16:04Ejaaz: i can't recommend enough like spend the 20 bucks a month try it just try it
- 16:07Ejaaz: for a month if you don't have it see what you think if you run out of tokens
- 16:10Ejaaz: upgrade to 100 a month this is access to the same intelligence that all these
- 16:14Ejaaz: researchers are making math breakthroughs with
- 16:16Ejaaz: and it's really impressive and really capable now each
- 16:20Ejaaz: one of these is slightly different i'd say claude is a little more tailored towards coding
- 16:26Ejaaz: writing and it's a really strong general purpose model i find with gpt 5.6 soul
- 16:32Ejaaz: in particular it's very good at being the
- 16:35Ejaaz: High level operator so if you're working on like complicated tasks it's good
- 16:39Ejaaz: at creating spec sheets it's good at running checks against the things that
- 16:41Ejaaz: you do and then oftentimes like i find that that claude and the fabled models
- 16:45Ejaaz: and the opus models are very good at implementation
- 16:47Ejaaz: and they're very good with less guidance so the way i've been using these models
- 16:50Ejaaz: recently is with less and less guidance i think earlier on
- 16:55Ejaaz: i had this whole skill sheet and it was like 15 different skills that would
- 16:58Ejaaz: automate different things for me and slowly over time that skill sheet has gone
- 17:01Ejaaz: lower and lower and lower and we were talking actually before the show
- 17:04Ejaaz: the best way to extract the most value out of these models is just to
- 17:07Ejaaz: get out of the way give it the end goal and say like hey go do this thing for
- 17:12Ejaaz: me i trust that you have the intelligence to do this i'm not going to put guardrails
- 17:14Ejaaz: on it you have the context you can go and do this for me and i think that's
- 17:17Ejaaz: mostly where i find myself using this personally is i use fable
- 17:21Ejaaz: i i do not leave any fable tokens unused very valuable tokens each week and
- 17:25Ejaaz: then opus is the fallback for the general workhorse model and it's been a really
- 17:28Ejaaz: powerful combo of just kind of
- 17:30Ejaaz: being able to accomplish anything that you want it connects to all of my
- 17:33Ejaaz: services i have it connected to my email to my google drive it has access to
- 17:36Ejaaz: my files the folders the context
- 17:38Ejaaz: and it's just a really helpful all-in assistant it works really well.
- 17:42Josh: I think people are also probably wondering, okay, well, what if I don't really
- 17:45Josh: care about the general intelligence as much?
- 17:47Josh: What if I'm trying to do a specific thing? Which model should I use then?
- 17:50Josh: I think there are two things to consider here. Number one is,
- 17:54Josh: if you are a software engineer, like AI models have been all the rage for their
- 17:58Josh: coding capabilities, but maybe a bunch of you actually like code hardcore companies
- 18:03Josh: and you want to figure out which model you should use.
- 18:05Josh: I would say in that question, the clawed models and the GPT 516 models are pretty
- 18:12Josh: high up there. Codex usage has gone from 5 million users to 15 million users
- 18:17Josh: in about a month and a half.
- 18:18Josh: I am tired of seeing Thibaut, who is the head of Codex at OpenAI,
- 18:22Josh: tweets on my timeline every single time he gets a million user update.
- 18:26Josh: But these models are very powerful at not only understanding and reading your
- 18:30Josh: code base, but intuitively figuring out what product or feature you should build next.
- 18:35Josh: I have a ton of feedback from friends that work at companies that are tech adjacent
- 18:40Josh: and maybe not even in tech at all, which use these models to build their premium
- 18:45Josh: features. The other thing I'll say is.
- 18:48Josh: You know, we're talking about the top right box over here, which is essentially
- 18:51Josh: the Pareto Frontier. So if you had to sacrifice something of cost or intelligence
- 18:56Josh: or blah, blah, blah, you would still be using these types of models.
- 18:59Josh: But if I had to take a bet, if I was a betting man, I would say Grok 4.6.
- 19:04Josh: Quen 3.8, and Kimi will be inside this box within a couple of months time.
- 19:09Josh: That's going to change the way we use these different types of models.
- 19:12Josh: I said before we started this show, it's unsexy to say.
- 19:16Josh: But I think the number one AI company that will come out in the next 12 months
- 19:20Josh: will be some form of aggregator platform. We saw that Stripe just acquired Open
- 19:24Josh: Router for $7 billion, allegedly.
- 19:27Josh: We put out an episode of this yesterday. Definitely go check that out.
- 19:30Josh: But I think we're going to see these platforms that help you pick and choose
- 19:34Josh: which models to use at the right time.
- 19:36Josh: It aggregates your memory so it already knows what you want to do.
- 19:38Josh: And so you don't have any of the complications around that. I think we'll see
- 19:41Josh: a bunch of these models kind of step up there.
- 19:43Josh: Now, aside from coding, if you aren't a coder, but if you are,
- 19:47Josh: let's say, a general knowledge worker, you go to work, you use email,
- 19:50Josh: you use Slack, you use a bunch of these other plugins that you also mentioned.
- 19:53Josh: There are models that are specifically good for agentic tool use.
- 19:57Josh: And actually, my most recent favorite is Grok 4.6 or GrokBot specifically.
- 20:02Josh: This was released from Elon Musk and SpaceX, I think last week.
- 20:06Josh: And it basically is an agent or multiple agents that spins up in a virtual machine
- 20:11Josh: on like in the cloud. So you don't have to worry about it running on your laptop
- 20:14Josh: and hacking all your stuff.
- 20:15Josh: And you can give it access to any and every tool and it intuitively understands
- 20:19Josh: and gets what you want to do.
- 20:20Josh: It can learn what you do over time and it improves.
- 20:23Josh: So I think when you look at the Metamuse Spark 1.2 and you might think,
- 20:27Josh: oh, that's a meta model. I don't ever use meta.
- 20:30Josh: These types of models are gonna become more available for general usage or knowledge work.
- 20:34Josh: And I think if that's something that you're inclined to use and you don't really
- 20:36Josh: care about the Google search stuff, you'll use Claude for that anyway.
- 20:39Josh: These are models that I'll probably look into because they are superior in many ways.
- 20:43Ejaaz: Yeah, it's fun to pick one and stick with it. I find that like oftentimes with
- 20:46Ejaaz: the aggregators, the right time to use that if you're doing lots of work,
- 20:49Ejaaz: if you're generating lots of tokens, if you are just a person who wants to use
- 20:52Ejaaz: AI for their day-to-day tasks to help you come up with like a grocery list, to help you
- 20:56Ejaaz: cook specific things, to help you go to the gym and give you workout classes and ideas.
- 21:01Ejaaz: It's helpful to pick a singular model, a singular service, and then just go deep with that.
- 21:07Ejaaz: A lot of the difference makers at this point because i mean most people aren't
- 21:10Ejaaz: using these models for frontier intelligence they're not going to solve novel
- 21:13Ejaaz: math problems they're figuring out what time they need to get to like the store
- 21:17Ejaaz: or the school to like pick up their kids and they just need some help they need a helpful assistant
- 21:22Ejaaz: the most helpful thing is context because all these models are more than capable
- 21:26Ejaaz: of those kind of lower level tasks the difference maker is the context that
- 21:29Ejaaz: it knows about you it needs to understand what are your dietary preferences
- 21:32Ejaaz: What are you or anyone in your family allergic to?
- 21:34Ejaaz: What have you made in the past that went well, that didn't go well?
- 21:38Ejaaz: And it kind of collects this database of information about you that allows it
- 21:41Ejaaz: to make better decisions going forward.
- 21:43Ejaaz: And that, at the end of the day, is ultimately what the difference maker is.
- 21:47Ejaaz: For me, at least, when deciding what model to use, it's like,
- 21:49Ejaaz: okay, which model has all the context
- 21:51Ejaaz: about me that can help solve my very specific task that I have here?
- 21:55Ejaaz: Oftentimes, the answer is Claude because I've been working with it for so long.
- 21:58Ejaaz: It just has this, like, huge chain of context. So whenever I ask,
- 22:01Ejaaz: like, hey, I need some help in the gym this week, it knows what I've been up
- 22:04Ejaaz: to, it knows where I'm at, it knows what the weight has been,
- 22:07Ejaaz: it knows what the food has been, and it's able to kind of curate this very custom stack against that.
- 22:11Ejaaz: And as someone who is just, you know, not really building anything crazy,
- 22:14Ejaaz: they're not using millions of tokens a week, they're just looking for an AI companion.
- 22:18Ejaaz: That's kind of how you can think about it. It's like, get a membership,
- 22:20Ejaaz: try it out, feed it a bunch of context about yourself, and then get your own
- 22:24Ejaaz: personal assistant. And that's kind of, I think, like the best route for most people.
- 22:27Josh: So I think to wrap up this episode,
- 22:30Josh: It's okay talking about, you know, what the frontier landscape looks like today.
- 22:33Josh: But the question is, what is it going to look like in a few months from now?
- 22:37Josh: And I say a few months specifically because this stuff moves too quickly.
- 22:41Josh: I saw an update from Sam Altman at OpenAI yesterday where they announced that
- 22:46Josh: they are slowing down some of their model training runs.
- 22:51Josh: And that's because they've noticed that a bunch of internal,
- 22:53Josh: more intelligent, unreleased models that they have built has become a lot more
- 22:59Josh: misaligned than previous models, which means that it could pose as a threat
- 23:02Josh: or danger to any user who gets access to it.
- 23:06Josh: And I've noticed the same similarly maybe from Anthropic and a bunch of other
- 23:09Josh: frontier labs, where we're starting to see a little bit of a slowdown.
- 23:14Josh: And slowdown isn't in the sense that they're necessarily stopping training full
- 23:17Josh: stop. Obviously, they're still training internal models.
- 23:20Josh: They might be likely to not release models or more intelligent models going
- 23:24Josh: forward because of government regulation.
- 23:27Josh: And I think this is going to allow a bunch of other Frontier Labs that are behind
- 23:31Josh: in this race to be able to catch up.
- 23:32Josh: So if I had to guess what three months from now, let's say at the end of the year, right?
- 23:37Josh: If I were to make a prediction, I think we're going to have about three to five
- 23:41Josh: really good open source models that are as capable as the smartest model that
- 23:46Josh: you have access to today from the Frontier Labs like Anthropic and GPT.
- 23:50Josh: And I think they're going to have fewer safeguards. So you can use it for any
- 23:53Josh: and every use case. I think you can run it privately at home,
- 23:56Josh: maybe even off of your laptop. So that changes dynamics quite a lot.
- 23:59Josh: I think we're going to have Apple entering the game with their own locally run
- 24:04Josh: and trained AI model, which I think is going to change the game because everyone,
- 24:08Josh: 3.5 billion people in the world right now have one of these or one of the Apple devices.
- 24:12Josh: They're going to run that locally. I think it's going to look quite different.
- 24:15Josh: I'm curious, you know, We started off this episode with the token split.
- 24:19Josh: I wonder what that's going to look like three months down the line.
- 24:22Josh: And then the last thing I'll say is, and this might be from my background in
- 24:25Josh: general, but I think once someone or.
- 24:28Josh: A bunch of companies make it easier to run models locally at home,
- 24:33Josh: I think people are going to play around with that more because it allows you to
- 24:36Josh: connect it to your fitness app data and not share too many personal anecdotes
- 24:41Josh: or data profiles with Frontier Labs, which again, they can use to train their own models.
- 24:45Josh: You may not want to hand that over, And so I think we'll see a rise of open
- 24:49Josh: source models. That's just my guess. That's interesting.
- 24:51Ejaaz: Okay, I'm taking the other side. I'm thinking that no one's going to go through
- 24:54Ejaaz: the trouble of downloading the weights and running their own open source models,
- 24:57Ejaaz: that Apple is just going to own that entire world.
- 25:00Ejaaz: That like for all of the people in the United States that own Apple devices,
- 25:03Ejaaz: they're just like, no one's going to even have an idea that they're using AI.
- 25:06Ejaaz: It's just going to be Siri. It's going to be competent. It's going to be better.
- 25:08Ejaaz: It's already going to be pre-downloaded. I think the user experience is really
- 25:11Ejaaz: important. And open source has a pretty horrific user experience.
- 25:14Ejaaz: You have to download, run the weights. you often need a lot of hardware to do that.
- 25:17Josh: But I'm counting Apple as locally run at home because it's encrypted.
- 25:20Ejaaz: Right? Well, if you're counting Apple,
- 25:22Ejaaz: sign me up because um we got a lot coming from them their event is happening
- 25:26Ejaaz: in like two weeks or something it's very soon we see
- 25:28Josh: Some airports with some cameras you sent me a video.
- 25:31Ejaaz: Yeah dude we've been getting lots of leaks lately it's really good maybe we have to have cameras
- 25:36Ejaaz: yes yes it's gonna be visuals and then they're gonna have apple intelligence
- 25:39Ejaaz: baked into it and it's like oh maybe we need a leak episode prior to the actual
- 25:43Ejaaz: new iphone unveiling because we have basically now the entire checklist of all
- 25:46Ejaaz: the things that are going to be revealed and
- 25:48Ejaaz: this to me as like apple fanboy plus ai fanboy is going to be the biggest event
- 25:53Ejaaz: ever pretty much because this is the actual rollout of the ai that they've been
- 25:56Ejaaz: promising us and failing to deliver for so long mixed with this brand new suite
- 26:00Ejaaz: of products that we've never seen before allegedly
- 26:02Josh: Up to the delayed two years.
- 26:04Ejaaz: But for those of you who came here for models that is the model update that's
- 26:07Ejaaz: just about when you'd want to
- 26:08Ejaaz: use each one like if you're interested in being on x real-time news feed
- 26:12Ejaaz: you want to go with grok if you like to yap a lot the voice model on chat gpt
- 26:15Ejaaz: is pretty exceptional that might be a good place for you if you like to be a
- 26:19Ejaaz: little more intellectual be thoughtful if you want really just the bleeding-edge
- 26:21Ejaaz: models the highest intelligence go with claude
- 26:23Ejaaz: and if you like making music and doing just like fun cute things with ai gemini
- 26:27Ejaaz: is actually kind of a compelling product
- 26:29Ejaaz: there's something for everybody that is the general overview of the models i
- 26:32Ejaaz: hope you enjoyed this is going to change certainly in the next month or two
- 26:36Ejaaz: whenever these new models i mean we have
- 26:37Ejaaz: the new astro model from open ai that has been teased for the last eternity
- 26:41Ejaaz: it seems like it's been held up it's going through some i don't know safeguard
- 26:44Ejaaz: governmental checks but that's coming
- 26:46Ejaaz: so this is set to change tbd but for now that is the state of the model address
- 26:50Ejaaz: and yeah hope you guys enjoyed watching
- 26:52Josh: Yeah and i'm curious for those of you who are listening what do we miss on this
- 26:57Josh: episode? Are you using models in a very different way?
- 26:59Ejaaz: Are you using meta models?
- 27:01Josh: Yeah, is anybody using meta models? Are there any Facebook users out there that
- 27:05Josh: are using meta AI intelligence?
- 27:06Ejaaz: Please fill me in.
- 27:07Josh: I will say, if you are a marketer or an advertiser, you're probably using meta's
- 27:11Josh: model and it's probably making you a hell of a ton more money.
- 27:14Josh: If that is you, let us know. If there are any other use cases that we haven't
- 27:17Josh: mentioned, please let us know. If you are a locally run open source fan and
- 27:21Josh: you're saying, no, people will download the weights, tell us why.
- 27:24Josh: Let us know in the comments, DM us. We read any and every single message.
- 27:28Josh: Now, if you're listening to this or watching this on YouTube,
- 27:30Josh: Spotify, Apple, or wherever you're listening to this, please subscribe.
- 27:33Josh: Please turn on notifications and leave us a comment. It helps us out massively.
- 27:37Josh: And share it with a friend as well. It helps us out. And I think that is pretty
- 27:41Josh: much it. Thank you so much for listening. And we will see you on the Roundup.
- 27:45Ejaaz: See you on the Roundup.