Latest / Now Shipping: A Mind the Product podcast / Is anyone actually using AI agents?

Transcript

Is anyone actually using AI agents? · Now Shipping: A Mind the Product podcast

• 0:00
  SPEAKER_00: I'm Mike Belcito, and this is Now Shipping, the weekly AI news show for product people.
• 0:06
  SPEAKER_00: Every week I bring you three AI news stories that matter to you, the people actually building products for a living.
• 0:12
  SPEAKER_00: Not the hype, not the noise, just the stuff you need to keep up with.
• 0:16
  SPEAKER_00: Brought to you by the team at Mind the Product, this is Now Shipping.
• 0:21
  SPEAKER_00: All right, story number one is all about Salesforce and Slack.
• 0:25
  SPEAKER_00: And I'll start this off with a question.
• 0:27
  SPEAKER_00: Where is it that you and your team go to actually get stuff done?
• 0:32
  SPEAKER_00: Like, where do you go for the coordination, the handoffs, the communication?
• 0:38
  SPEAKER_00: For me, it's Slack.
• 0:40
  SPEAKER_00: Like that happens to be where my team lives throughout the day.
• 0:44
  SPEAKER_00: And that's true for a lot of teams.
• 0:45
  SPEAKER_00: Now, Slack, of course, is owned by Salesforce, and they just spent the last 18 months building a massive AI agent platform called Agent Force.
• 0:55
  SPEAKER_00: And it's working.
• 0:56
  SPEAKER_00: Salesforce reported$1.4 billion in annual recurring revenue from Agent Force.
• 1:02
  SPEAKER_00: And that's 114% year-over-year growth.
• 1:06
  SPEAKER_00: And a lot of that growth is coming from large enterprise customers.
• 1:10
  SPEAKER_00: But they've been wrestling with a problem that anybody who's built agent-powered features would probably relate to.
• 1:18
  SPEAKER_00: And that's if your AI agents live in one place and your team lives in another place, agents don't actually work.
• 1:26
  SPEAKER_00: I mean, they technically work, but when you think about the fact that they're a tool that you have to go visit and they're not happening in the places that you're living in all day, it probably isn't helping you the way that you were intending for it to help you, right?
• 1:40
  SPEAKER_00: So Salesforce announced that their Slackbot is now a fully functional MCP client.
• 1:46
  SPEAKER_00: And by making Slack an MCP client, Salesforce is bringing the agents to you specifically to the place where you're already living and working with your team every single day.
• 1:57
  SPEAKER_00: Now, what does that actually look like in practice?
• 2:00
  SPEAKER_00: Well, it could be that a sales rep, maybe they're in Slack and they pull up a deal on the Slack bot and pull the latest account activity from Salesforce's CRM.
• 2:10
  SPEAKER_00: They summarize the last three customer interactions and they draft a follow-up email all in that same thread.
• 2:17
  SPEAKER_00: The bot actually orchestrates across Agent Force, across all of Salesforce's 6,000 different app exchange integrations, the 2,600 Slack marketplace apps, and it does it all in one thread.
• 2:31
  SPEAKER_00: Now, ahead of Dreamforce, which of course is Salesforce's big annual conference that's coming up in September, they've been previewing this news.
• 2:39
  SPEAKER_00: And the theme of Dreamforce sort of tells you everything, which is the agentic enterprise.
• 2:44
  SPEAKER_00: They're saying the enterprise is reorganized around agents doing real work.
• 2:50
  SPEAKER_00: Now, for product people, I think one important takeaway is that the interface layer of enterprise AI is now starting to be wherever people work, right?
• 3:00
  SPEAKER_00: It's not a separate AI dashboard or some new app.
• 3:03
  SPEAKER_00: So if you're building for enterprise and you haven't thought hard about how your product fits into Slack or Teams or the places where people are actually working today, it might be something you want to start thinking about, probably like right now.
• 3:19
  SPEAKER_00: I think products and companies that end up living within this layer, they're gonna have a huge advantage.
• 3:25
  SPEAKER_00: And also, I'd say if you sell to the enterprise, some percentage of your customers are already in agent force conversations with Salesforce.
• 3:34
  SPEAKER_00: Some of them have already signed, some of them are already living this reality now.
• 3:38
  SPEAKER_00: So the assumption that, you know, oh, our customers, yeah, they're big enterprises, they're not ready for AI agents quite yet.
• 3:45
  SPEAKER_00: That's probably a lot less true now than it was even six months ago.
• 3:49
  SPEAKER_00: So it's worth asking your sales teams, your customer success teams, like, what are you hearing out there?
• 3:55
  SPEAKER_00: What companies are actually starting to adopt agentic work within specifically enterprises?
• 4:03
  SPEAKER_00: I think it's more than everybody's letting on.
• 4:05
  SPEAKER_00: And I think we're gonna continue to see more and more companies consider MCP as just table stakes for how others can access the features of their product.
• 4:14
  SPEAKER_00: I don't think it's it's one of these like pilot program sort of things now.
• 4:18
  SPEAKER_00: I think everybody is just sort of expecting it.
• 4:21
  SPEAKER_00: So that is story number one.
• 4:24
  SPEAKER_00: On to story number two.
• 4:28
  SPEAKER_00: Okay, story number two on July 30th, OpenAI cut the price of its lower cost GPT 5.6 models by up to 90%.
• 4:38
  SPEAKER_00: So look, if your product is making 10,000 AI calls a day and each call processes an average of 5,000 tokens, that's 50 million tokens a day.
• 4:49
  SPEAKER_00: At$2 per million, that's$100 every day in AI cost.
• 4:54
  SPEAKER_00: It's over$35,000 per year.
• 4:57
  SPEAKER_00: Now, what does that look like at 20 cents per million?
• 5:00
  SPEAKER_00: That's$10 a day.
• 5:02
  SPEAKER_00: That's less than$4,000 a year, close to a 90% reduction.
• 5:07
  SPEAKER_00: Now, at that price point, entire use cases that didn't make economic sense before, they start to make sense.
• 5:14
  SPEAKER_00: High volume extraction pipelines, running AI over large historical data sets, products or features where you had to be selective about when they fired off an AI call because of the cost.
• 5:26
  SPEAKER_00: Now, maybe you don't have to make that trade-off anymore.
• 5:29
  SPEAKER_00: OpenAI also announced separately that it's giving roughly 100,000 researchers free access to its frontier models through 2027.
• 5:38
  SPEAKER_00: That is a market development move.
• 5:40
  SPEAKER_00: I think it's like get a lot of builders deeply embedded into the platform at no cost, and probably they'll keep building on that platform.
• 5:49
  SPEAKER_00: So, what does this all mean for you?
• 5:51
  SPEAKER_00: I think a few things.
• 5:52
  SPEAKER_00: First, go back and look at the features that you killed in prioritization because AI cost was the blocker.
• 6:00
  SPEAKER_00: Like, literally, right now, go back and do that.
• 6:02
  SPEAKER_00: I mean, some of the features that you probably cut were cut for the right reasons, but maybe cost was one of those reasons.
• 6:10
  SPEAKER_00: Maybe the only reason you couldn't do it was because it was just too expensive.
• 6:14
  SPEAKER_00: Now the math has changed, so it's time to revisit that.
• 6:18
  SPEAKER_00: And second thing is if frontier quality AI is nearly free, all right, maybe not free, but cheap enough, right?
• 6:26
  SPEAKER_00: Like what is the moat?
• 6:28
  SPEAKER_00: I mean, the moat in your product is probably not the AI anymore.
• 6:32
  SPEAKER_00: It probably is like your data and your distribution, your customer relationships.
• 6:37
  SPEAKER_00: AI is just becoming the infrastructure.
• 6:39
  SPEAKER_00: It's sort of like cloud storage or compute.
• 6:42
  SPEAKER_00: It's basically now table stakes.
• 6:45
  SPEAKER_00: So the faster your team internalizes this, the better off you'll be.
• 6:49
  SPEAKER_00: Now, I think we will start to see some pricing pressure on Anthropic and Google and really everyone else for similar models.
• 6:57
  SPEAKER_00: Now, we saw that kind of thing happen when the pricing for Sonnet 5 changed.
• 7:02
  SPEAKER_00: I think we'll continue to see it again.
• 7:04
  SPEAKER_00: And that's good news for our budgets for sure.
• 7:06
  SPEAKER_00: So hopefully we'll continue to see that cost get driven lower and lower.
• 7:11
  SPEAKER_00: All right, one more story to go.
• 7:15
  SPEAKER_00: This last story is a little bit different from the stories we've been doing.
• 7:20
  SPEAKER_00: This is actually about a post from Josh Miller that's been making the rounds on X.
• 7:26
  SPEAKER_00: So quick background Josh Miller, he's the co-founder of the browser company.
• 7:30
  SPEAKER_00: Now, the browser company made the Arc browser.
• 7:32
  SPEAKER_00: Maybe you've used it or at least have heard of it.
• 7:35
  SPEAKER_00: And now they're building Dia, a new kind of AI first browser.
• 7:39
  SPEAKER_00: Um, but the point is, this isn't somebody just like random, somebody from the sidelines.
• 7:45
  SPEAKER_00: This is somebody who's actually staked his company on a bet of where AI agents are going.
• 7:51
  SPEAKER_00: And his post on X goes something like this.
• 7:53
  SPEAKER_00: I'm going to paraphrase it, but basically he asks the question isn't it kind of crazy that basically nobody outside of tech is using AI agents?
• 8:04
  SPEAKER_00: Now, think about that.
• 8:05
  SPEAKER_00: It's really true, right?
• 8:07
  SPEAKER_00: I mean, you have software engineers, you have the early adopters, you know, those of us in product.
• 8:13
  SPEAKER_00: Um, you have people at companies where their company is sort of force feeding it to them.
• 8:17
  SPEAKER_00: But if you think about your college friends in the group chat, you know, people that aren't working in tech at all, you you probably remember with that group, you know, the feeling you got when people started first using Instagram or TikTok or maybe Uber, like word started going in those circles about it, and very quickly everybody sort of latched on.
• 8:38
  SPEAKER_00: I don't think we're there yet with AI agents.
• 8:41
  SPEAKER_00: Anyway, that's what Josh was saying.
• 8:42
  SPEAKER_00: Josh is saying we're not there yet.
• 8:45
  SPEAKER_00: And he's asking, when will that moment actually come for agents?
• 8:50
  SPEAKER_00: Now, I will say that group has probably already experienced the chat GPT moment.
• 8:55
  SPEAKER_00: That wasn't just for the early adopters, that really made it to everybody, including your college group chat, right?
• 9:02
  SPEAKER_00: But it's an interesting question.
• 9:04
  SPEAKER_00: He lays out this sort of contradiction because the models are remarkable.
• 9:08
  SPEAKER_00: I mean, where we're at right now compared to where we were a year ago, it's crazy.
• 9:12
  SPEAKER_00: The infrastructure's there.
• 9:14
  SPEAKER_00: I mean, now every major tech company seemingly has their own agent platform.
• 9:18
  SPEAKER_00: I mean, we just talked about them earlier in this episode.
• 9:21
  SPEAKER_00: Hundreds of, you know, YC startups, they're all building vertical agents.
• 9:25
  SPEAKER_00: And yet, again, most people out of tech, the people who spend all day on their iPhones and get paid to work in browser tabs, they don't really care yet.
• 9:34
  SPEAKER_00: They're using ChatGPT, they're using other chat-based platforms.
• 9:38
  SPEAKER_00: Um, but he says, uh, Josh says that the engagement data for those platforms like ChatGPT and Claude, it shows that most people are using them like a glorified Google Meets Grammarly, which is useful.
• 9:52
  SPEAKER_00: It probably helps a lot, but they're not using it in the way of like, hey, I gave it a goal and it went and accomplished those things.
• 10:00
  SPEAKER_00: So why doesn't the general public care about AI agents yet?
• 10:06
  SPEAKER_00: And why might the fact that they don't care, why should that make you care?
• 10:11
  SPEAKER_00: Now, I think the gap between agents and consumers is mostly a user experience problem.
• 10:17
  SPEAKER_00: Think about what made Chat GPT go viral.
• 10:20
  SPEAKER_00: Just a blank text box, one input, one output.
• 10:23
  SPEAKER_00: Very easily people could just type something and the AI responded.
• 10:29
  SPEAKER_00: I mean, it felt like magic, right?
• 10:31
  SPEAKER_00: The interface eliminated every possible barrier to entry.
• 10:35
  SPEAKER_00: Agents ask something much different of people.
• 10:39
  SPEAKER_00: You have to articulate a goal and delegate the execution and then trust something to complete a multi-step task on your behalf without you watching.
• 10:48
  SPEAKER_00: And you have to do that all in a place where it doesn't quite feel accessible yet to just sort of like the general public.
• 10:57
  SPEAKER_00: Now, when the user experience removes all of that, things start to change.
• 11:03
  SPEAKER_00: I mean, I just think of myself with open claw at first.
• 11:07
  SPEAKER_00: It took me a lot of work to get to the point where open claw could just feel magical, right?
• 11:13
  SPEAKER_00: I had to go through all sorts of technical hurdles.
• 11:16
  SPEAKER_00: Definitely my sort of like non-tech friends, it's not something they would have even tried to do, right?
• 11:23
  SPEAKER_00: I think Claude Cowork took a step in the right direction.
• 11:26
  SPEAKER_00: It's easy to fire off agents without even really thinking of it.
• 11:30
  SPEAKER_00: It sort of feels like, you know, just chatting with the AI, but it might not be there completely yet.
• 11:37
  SPEAKER_00: I think the other reason why we might not have so much adoption on the consumer side is nobody's really forcing it, right?
• 11:44
  SPEAKER_00: Enterprise has IT departments to deploy things, it has well-defined workflows to plug agents into.
• 11:50
  SPEAKER_00: Companies can force it on their employees, and it's hard at first, but then people get used to it and then uh they can't imagine a life without agents.
• 11:59
  SPEAKER_00: But nobody's telling your parents to set up an AI agent to manage their schedule.
• 12:03
  SPEAKER_00: Um, unless you are.
• 12:05
  SPEAKER_00: Maybe you're encouraging your parents to do that.
• 12:06
  SPEAKER_00: If you are, great, but um, in all honesty, nobody's forcing them to do it.
• 12:12
  SPEAKER_00: They have to discover it themselves and put in the work to get to that point.
• 12:15
  SPEAKER_00: So distribution's a real issue.
• 12:18
  SPEAKER_00: Now, is the consumer agent breakout adoption coming?
• 12:22
  SPEAKER_00: That's the trillion dollar question.
• 12:24
  SPEAKER_00: I think yes.
• 12:25
  SPEAKER_00: I in fact, I would bet hard that it will be coming.
• 12:29
  SPEAKER_00: But for product people that are building consumer products right now, this is a really important question to think about.
• 12:35
  SPEAKER_00: And you'll have to ask yourself whether you would make that same bet.
• 12:40
  SPEAKER_00: All right, that is going to wrap up this week's episode of Now Shipping.
• 12:44
  SPEAKER_00: If you found this valuable, please subscribe, tell a friend, and if you have any suggestions, please leave a comment below.
• 12:51
  SPEAKER_00: I promise I will read every single comment you leave.
• 12:54
  SPEAKER_00: I will see you right here next week with three more AI stories that matter to you as a product person.
• 13:00
  SPEAKER_00: Once again, my name is Mike Belsito, and from the team at Mind the Product, this is now shipping.