Latest / Ctrl AI Profit / Ep. 114 | Your AI Bill Just Became Your Biggest Expense
Transcript
- 0:20SPEAKER_01: Your AI bill just became your biggest expense, and you probably didn't even see it coming.
- 0:26SPEAKER_00: That's not clickbait.
- 0:28SPEAKER_00: That is literally what is happening to businesses right now.
- 0:31SPEAKER_00: AI spending across companies is up over 100% year over year.
- 0:36SPEAKER_00: And the really insidious part, it's not because prices went up, it's because AI works too well.
- 0:42SPEAKER_01: Let me paint the picture.
- 0:44SPEAKER_01: You sign up for a few AI tools, ChatGPT for the team, maybe Copilot, a chatbot for your website, a hundred bucks here, two hundred there.
- 0:54SPEAKER_01: Feels like a normal subscription stack, right?
- 0:57SPEAKER_00: That's exactly the trap.
- 0:59SPEAKER_00: Because the old model was SAS.
- 1:01SPEAKER_00: You pay per seat, per month, fixed cost.
- 1:04SPEAKER_00: You know what your Adobe bill is, you know what your Microsoft bill is.
- 1:08SPEAKER_00: But AI tools, especially the powerful ones, they don't charge like that anymore.
- 1:13SPEAKER_01: They charge by the token, which is a fancy way of saying they charge every single time you use them.
- 1:19SPEAKER_01: Every prompt, every response, every time an agent loops back and tries again.
- 1:25SPEAKER_00: And here's what nobody tells you.
- 1:27SPEAKER_00: One engineer using clawed code heavily can burn through$500 to$2,000 a month.
- 1:34SPEAKER_00: One person.
- 1:35SPEAKER_01: Now multiply that across your team.
- 1:38SPEAKER_01: You've got five, 10, 20 people leaning into these tools because they genuinely make them faster.
- 1:44SPEAKER_01: And suddenly your couple hundred bucks a month experiment is a five-figure line item.
- 1:50SPEAKER_00: This isn't theoretical.
- 1:52SPEAKER_00: Uber just burned through their entire 2026 AI coding budget in four months.
- 1:58SPEAKER_00: Four months.
- 1:59SPEAKER_00: They budgeted for a full year and it was gone by mid-April.
- 2:03SPEAKER_01: Let that sink in.
- 2:04SPEAKER_01: One of the most sophisticated tech companies on Earth, with finance teams and procurement people and all the dashboards money can buy, they got caught off guard.
- 2:14SPEAKER_01: What do you think happens to a small business that doesn't have any of that infrastructure?
- 2:19SPEAKER_00: They get blindsided.
- 2:21SPEAKER_00: And it's not just Uber.
- 2:22SPEAKER_00: Microsoft ran a clawed code pilot internally.
- 2:25SPEAKER_00: When they switched from flat seat licenses to usage-based billing, they burned through their entire annual AI budget in months two.
- 2:32SPEAKER_00: Had to cancel the program by June.
- 2:35SPEAKER_01: So here's the thing that makes this really dangerous for small business owners.
- 2:39SPEAKER_01: AI spending doesn't feel like a big expense when you start.
- 2:42SPEAKER_01: It feels like a subscription: 20 bucks a month, 50 bucks a month.
- 2:46SPEAKER_01: But the pricing model is more like a utility than a subscription.
- 2:51SPEAKER_00: Think about your electricity bill.
- 2:53SPEAKER_00: If you leave every light on and run the AC with the windows open, your bill goes through the roof.
- 2:58SPEAKER_00: You don't get charged a flat fee, you get charged for what you use.
- 3:02SPEAKER_00: AI tools work the same way now.
- 3:05SPEAKER_00: The more your team uses them, and the better they get, the more your team will use them.
- 3:09SPEAKER_00: The higher the bill climbs.
- 3:11SPEAKER_01: And it climbs fast.
- 3:13SPEAKER_01: 78% of IT leaders reported unexpected AI charges this year.
- 3:19SPEAKER_01: 78%.
- 3:20SPEAKER_01: These are people whose job it is to track technology spending.
- 3:24SPEAKER_01: If they're surprised, imagine how the average small business owner feels when they see the credit card statement.
- 3:30SPEAKER_00: The data backs this up.
- 3:32SPEAKER_00: AI native application spending is up 108% year over year.
- 3:37SPEAKER_00: That's not a gradual increase.
- 3:38SPEAKER_00: That's more than doubling.
- 3:40SPEAKER_00: And the average organization is now spending over a million dollars on AI.
- 3:44SPEAKER_00: Obviously that's enterprise, but the pattern scales down.
- 3:48SPEAKER_01: Here's what kills me about this.
- 3:50SPEAKER_01: Most small business owners I talk to, they don't even know what they're spending.
- 3:55SPEAKER_01: They've got a chat GPT subscription, they've got someone using Copilot.
- 4:00SPEAKER_01: They signed up for some AI CRM thing.
- 4:02SPEAKER_01: There's a chat bot running on the website.
- 4:06SPEAKER_01: It's death by a thousand cuts.
- 4:08SPEAKER_01: None of them look expensive individually, but together.
- 4:12SPEAKER_00: Together, you're looking at$300 to$1,500 a month for a typical small business.
- 4:17SPEAKER_00: And that's if you're being conservative.
- 4:19SPEAKER_00: I've seen small businesses accidentally spend thousands on API usage because someone set up an automation and forgot about it.
- 4:25SPEAKER_00: Let me tell you what that looks like in practice.
- 4:28SPEAKER_01: You set up a Zapier workflow that sends every incoming lead through Chat GPT to write a personalized response.
- 4:37SPEAKER_01: Great idea, solid use case.
- 4:39SPEAKER_01: But then you get a spike in leads.
- 4:41SPEAKER_01: Maybe you run a promotion, maybe it's seasonal, and suddenly that automation is firing a thousand times a day.
- 4:48SPEAKER_01: And every single one of those calls costs money.
- 4:51SPEAKER_00: And this is where agent-based AI makes it even more interesting.
- 4:55SPEAKER_00: When you give an AI agent a task, it doesn't just make one API call, it makes a plan, checks the plan, tries something, evaluates the result, maybe loops back and tries again.
- 5:07SPEAKER_00: Each one of those steps is a separate charge.
- 5:09SPEAKER_00: A single agent task can generate 10, 20, 50 individual model calls.
- 5:15SPEAKER_01: So you think you're paying for one task, but you're actually paying for 50 microtransactions.
- 5:21SPEAKER_01: It's like ordering a sandwich and getting charged for each byte.
- 5:24SPEAKER_00: There's a great term that came out of the Uber situation.
- 5:27SPEAKER_00: One of their leaders called it token maxing, because Uber had internal leaderboards ranking teams by their AI tool usage.
- 5:35SPEAKER_00: They were literally incentivizing people to use more.
- 5:38SPEAKER_00: And the engineers did what anyone would do.
- 5:40SPEAKER_00: They used more.
- 5:41SPEAKER_00: The tools worked well.
- 5:43SPEAKER_00: The leaderboard said use more, so they used more.
- 5:46SPEAKER_00: And the bill went vertical.
- 5:48SPEAKER_01: That's a corporate example of something that happens to small businesses too.
- 5:53SPEAKER_01: You tell your team, hey, use AI, it'll make you faster.
- 5:56SPEAKER_01: You don't put any guardrails on it, no budget caps, no usage monitoring, and why would you?
- 6:02SPEAKER_01: You want them to use it.
- 6:03SPEAKER_01: But without limits, you're basically handing them a credit card with no limit and saying, go crazy.
- 6:09SPEAKER_00: So let's get practical.
- 6:10SPEAKER_00: If you're a small business owner listening to this, you need to do three things this week.
- 6:15SPEAKER_00: Not next month.
- 6:16SPEAKER_00: This week.
- 6:17SPEAKER_01: Number one, audit every single AI expense, every subscription, every API, every tool that charges you based on usage.
- 6:26SPEAKER_01: I want you to log into every platform and look at the actual bill, not the listed price, the actual amount that hit your card last month.
- 6:35SPEAKER_00: Number two, set hard caps.
- 6:38SPEAKER_00: Most AI platforms let you set spending limits.
- 6:41SPEAKER_00: Use them.
- 6:42SPEAKER_00: Set a monthly cap on every usage-based tool.
- 6:45SPEAKER_00: If your team hits the cap, the tool stops working until you approve more.
- 6:49SPEAKER_00: That's not a bug, that's a feature.
- 6:52SPEAKER_00: It forces you to pay attention.
- 6:54SPEAKER_01: Number three, separate your core AI from your experiments.
- 6:58SPEAKER_01: Your core tools, the ones that are proven that your team uses every day, that deliver measurable ROI.
- 7:05SPEAKER_01: Those get a real budget line.
- 7:07SPEAKER_01: Everything else, that's an experiment.
- 7:09SPEAKER_01: Put it on a separate card with a strict monthly limit.
- 7:12SPEAKER_01: If the experiment proves itself, promote it.
- 7:14SPEAKER_01: If not, kill it.
- 7:16SPEAKER_00: And there's a fourth thing that most people miss.
- 7:19SPEAKER_00: Model choice matters enormously for cost.
- 7:22SPEAKER_00: A lot of businesses default to the most powerful model for everything.
- 7:26SPEAKER_00: But you don't need GPT 4 to write a simple email follow-up.
- 7:31SPEAKER_00: You don't need Claude Opus to categorize support tickets.
- 7:35SPEAKER_00: Route simple tasks to cheaper models and reserve the expensive ones for work that actually requires them.
- 7:41SPEAKER_00: The price difference between a fast, cheap model and a frontier model can be 10 to 1.
- 7:45SPEAKER_00: If you're sending routine tasks through the most expensive model, you're burning money.
- 7:50SPEAKER_01: This is what smart companies are doing now.
- 7:52SPEAKER_01: They call it model routing.
- 7:54SPEAKER_01: It's like having a fleet of vehicles.
- 7:56SPEAKER_01: You don't use a semi-truck to deliver a pizza, and you don't use a bicycle to move furniture.
- 8:01SPEAKER_01: Match the model to the task.
- 8:03SPEAKER_00: For a typical small business, here's what a reasonable AI budget looks like.
- 8:08SPEAKER_00: If you're a solo operation or a small team of three to five people, you should be spending$50 to$150 a month on AI.
- 8:16SPEAKER_00: That's a workflow tool, a main LLM API, and maybe one or two specialized tools.
- 8:22SPEAKER_01: If you've got a bigger team, say 10 to 20 people, you're looking at 150 to 600 a month.
- 8:28SPEAKER_01: That includes your core tools, maybe some AI seats in your office software, and a simple customer-facing agent.
- 8:36SPEAKER_00: If you're spending significantly more than that and you're not an AI native company, you need to ask hard questions.
- 8:42SPEAKER_00: Because the businesses that are winning with AI aren't the ones spending the most.
- 8:46SPEAKER_00: They're the ones spending smart.
- 8:48SPEAKER_01: The irony of all this is that AI is actually getting cheaper per use.
- 8:52SPEAKER_01: Model prices have dropped about 75% since early 2024.
- 8:57SPEAKER_01: GPT, four-class models cost a fraction of what they used to.
- 9:01SPEAKER_01: Google cut Gemini pricing in half.
- 9:04SPEAKER_01: There's a price war happening.
- 9:06SPEAKER_00: Right, so per token costs are falling, but total spending is doubling.
- 9:11SPEAKER_00: How does that work?
- 9:12SPEAKER_00: Volume.
- 9:13SPEAKER_00: People are using 10 times more AI than they were a year ago.
- 9:17SPEAKER_00: They're finding new use cases, automating more workflows, giving more people access.
- 9:22SPEAKER_00: The unit price went down, but the quantity went up so much that the total bill went up.
- 9:28SPEAKER_01: It's like when cell phone companies gave you unlimited data.
- 9:31SPEAKER_01: You thought, great, cheaper data, but then you started streaming video everywhere, and your total spending on mobile went up because you just used more of it.
- 9:41SPEAKER_00: That's exactly the dynamic.
- 9:43SPEAKER_00: And it's going to accelerate as agents become more common.
- 9:46SPEAKER_00: An agent doesn't just call the model once, it calls it repeatedly, plans, evaluates, retries.
- 9:53SPEAKER_00: One agent task could be 20 or 50 model calls.
- 9:57SPEAKER_00: You multiply that across your business and it adds up fast.
- 10:01SPEAKER_01: There's a concept called an inference budget that smart companies are starting to use.
- 10:06SPEAKER_01: Basically, you set a dollar limit per task.
- 10:09SPEAKER_01: The agent gets five cents worth of compute to solve this problem.
- 10:13SPEAKER_01: If it can do it in one call, great.
- 10:15SPEAKER_01: If it needs 10 calls, it better not exceed five cents total.
- 10:19SPEAKER_01: If it does, it stops.
- 10:21SPEAKER_01: Most businesses aren't doing this yet, and it's why agents are becoming budget vacuums.
- 10:27SPEAKER_00: And it's not just agents.
- 10:29SPEAKER_00: Think about your Zapier workflows, your make automations, your custom chatbots.
- 10:34SPEAKER_00: Every one of those is calling an API every time it runs.
- 10:38SPEAKER_00: You set it up once, it runs a thousand times a month, and every single run has a cost you might not have calculated.
- 10:45SPEAKER_01: Let me give you a real example.
- 10:47SPEAKER_01: A small law firm I know set up an AI tool to draft initial case summaries.
- 10:52SPEAKER_01: Sounded great, but they didn't cap the usage, and their paralegals started running every single document through it.
- 10:59SPEAKER_01: Not just the complex ones, everything.
- 11:02SPEAKER_01: Their bill went from$200 a month to over$2,000 in six weeks.
- 11:07SPEAKER_00: And that's the pattern.
- 11:08SPEAKER_00: It's not malicious, it's not wasteful in the traditional sense.
- 11:12SPEAKER_00: People are using the tool for real work, but nobody set boundaries, and the natural tendency is to push more and more through the system because it feels free at the point of use.
- 11:23SPEAKER_01: That's the key phrase right there.
- 11:25SPEAKER_01: Feels free at the point of use.
- 11:27SPEAKER_01: That's the danger.
- 11:29SPEAKER_01: When you pay per token, every individual prompt feels like it costs nothing.
- 11:33SPEAKER_01: A fraction of a cent.
- 11:34SPEAKER_01: Who cares about a fraction of a cent?
- 11:37SPEAKER_01: But when your team runs 10,000 prompts a month, those fractions become very real dollars.
- 11:43SPEAKER_00: Here's a number that should scare every business owner.
- 11:46SPEAKER_00: 70% of committed code at Uber is now AI generated.
- 11:51SPEAKER_00: 70%.
- 11:53SPEAKER_00: They didn't plan for that level of adoption.
- 11:55SPEAKER_00: Nobody does.
- 11:57SPEAKER_00: You think, we'll try this out, see if it helps.
- 12:00SPEAKER_00: And then it helps so much that adoption goes exponential and your budget is a smoking crater.
- 12:06SPEAKER_01: And here's the thing I really want small business owners to understand.
- 12:11SPEAKER_01: You have an advantage that Uber doesn't.
- 12:14SPEAKER_01: You can actually see your AI spend.
- 12:17SPEAKER_01: Uber's problem was partly that they had thousands of engineers generating costs across dozens of teams, and nobody had a clear dashboard.
- 12:27SPEAKER_01: In a small business, you can look at your credit card statement and see exactly what's happening.
- 12:32SPEAKER_01: Use that advantage.
- 12:34SPEAKER_00: Set up alerts.
- 12:36SPEAKER_00: Most AI platforms will let you set a notification when you hit 50%, 75%, and 90% of a budget threshold.
- 12:43SPEAKER_00: Do that this week.
- 12:45SPEAKER_00: It takes five minutes, and it's the single most impactful thing you can do to prevent surprise bills.
- 12:50SPEAKER_01: Also, do a quarterly audit.
- 12:52SPEAKER_01: Every three months, go through every AI subscription and ask, is this still worth what we're paying?
- 12:57SPEAKER_01: Is anyone actually using it?
- 12:59SPEAKER_01: You'd be amazed how many tools people stop using, but the subscription keeps running.
- 13:04SPEAKER_00: One more thing.
- 13:05SPEAKER_00: When you're evaluating whether an AI tool is worth the cost, don't just look at the price tag.
- 13:10SPEAKER_00: Look at what it replaces.
- 13:12SPEAKER_00: If a$50 a month AI tool saves you 10 hours of staff time and your staff time is worth$30 an hour, that tool just saved you$300.
- 13:21SPEAKER_00: That's a six to one return.
- 13:23SPEAKER_00: Keep it.
- 13:24SPEAKER_01: But if you're paying$200 a month for something that saves you one hour, cut it.
- 13:29SPEAKER_01: The math has to work.
- 13:31SPEAKER_01: AI is an investment, not a status symbol.
- 13:34SPEAKER_01: And don't fall for the upgrade trap either.
- 13:36SPEAKER_01: The fancy tier with all the bells and whistles isn't worth it if your team only uses the basic features.
- 13:42SPEAKER_00: Right.
- 13:43SPEAKER_00: Consolidation is one of the fastest wins.
- 13:46SPEAKER_00: A recent analysis showed that the average company has overlapping AI tools, multiple products doing the same job, each with its own subscription.
- 13:55SPEAKER_00: Cut down to two or four core tools that your team actually uses every day, and you can typically reduce your AI bill by 30 to 40% without losing any capability.
- 14:05SPEAKER_00: The bottom line is this your AI bill is not going to go down on its own.
- 14:10SPEAKER_00: Usage is going to increase.
- 14:12SPEAKER_00: New tools are going to come out.
- 14:14SPEAKER_00: Your team is going to find more ways to use the ones you already have.
- 14:17SPEAKER_00: If you don't put guardrails in place now, this time next year your AI bill could be your biggest software expense by a lot.
- 14:25SPEAKER_01: Take control this week, audit your spend, set caps, separate core from experiments, and route simple tasks to cheaper models.
- 14:33SPEAKER_01: Five minutes of prevention beats a five figure surprise.
- 14:43SPEAKER_01: That's your wake up call.
- 14:44SPEAKER_01: Now go do something about it.
- 14:45SPEAKER_01: We'll see you next time on Control AI Profit.