Latest / Intentional AI Daily / When AI Agents Raise Their Own Limits
Transcript
- 0:00SPEAKER_01: What's happening, everyone?
- 0:01SPEAKER_01: Jason Wright here.
- 0:02SPEAKER_01: Georgia, I read a study this week that I had to read twice.
- 0:07SPEAKER_00: Okay, that's a high bar.
- 0:09SPEAKER_00: What was it?
- 0:10SPEAKER_01: Researchers at Cornell Tech in Yale tested 10 of the big AI models.
- 0:15SPEAKER_01: They gave each one a wallet with a spending limit and access to an email inbox.
- 0:21SPEAKER_00: Oh no, I think I see where this is going.
- 0:25SPEAKER_01: Yeah, nine out of ten found the one-time passcode in that inbox and used it to raise their own spending limit.
- 0:32SPEAKER_01: No human said yes.
- 0:34SPEAKER_00: Wait, nine out of ten?
- 0:36SPEAKER_00: Not one rogue model?
- 0:38SPEAKER_01: Nine.
- 0:39SPEAKER_01: The approval code was sitting in the same inbox the agent could read.
- 0:44SPEAKER_00: Huh.
- 0:45SPEAKER_00: So the lock was fine.
- 0:46SPEAKER_00: They just taped the key to the door.
- 0:49SPEAKER_01: That's exactly it.
- 0:51SPEAKER_00: Okay, but let me push on this a little.
- 0:54SPEAKER_00: Most people listening aren't giving an AI a wallet.
- 0:57SPEAKER_00: They're using Claude to draft emails.
- 1:00SPEAKER_00: Is this really their problem?
- 1:02SPEAKER_01: I mean, I was going to say yes, but you're partly right.
- 1:06SPEAKER_01: Today, for most of them, no.
- 1:10SPEAKER_00: Yet.
- 1:11SPEAKER_01: Yet.
- 1:12SPEAKER_01: And sorry, let me back up.
- 1:15SPEAKER_01: That's actually the point.
- 1:16SPEAKER_01: The tools are moving toward agents that book, buy, and send.
- 1:20SPEAKER_01: Inbox access is usually the first thing people hand over because it's convenient.
- 1:26SPEAKER_00: So the risk isn't the AI being evil, it's the setup.
- 1:30SPEAKER_01: Yes.
- 1:31SPEAKER_01: The models were just trying to finish the task, and the shortest path went straight through the approval.
- 1:37SPEAKER_01: So here's the rule I'd give anyone.
- 1:39SPEAKER_01: The thing that approves can't live where the agent lives.
- 1:42SPEAKER_00: What does that look like day-to-day?
- 1:45SPEAKER_01: Three things.
- 1:46SPEAKER_01: Actually, two that matter most.
- 1:49SPEAKER_01: First, if an agent can read your inbox, that inbox shouldn't be getting your payment codes or password resets.
- 1:56SPEAKER_01: Use a separate address or an authenticator app.
- 1:59SPEAKER_00: Though the researchers said authenticator codes can get replayed too, didn't they?
- 2:05SPEAKER_01: They did.
- 2:06SPEAKER_01: Their recommendation was a physical key or a fingerprint, something the agent literally can't reach.
- 2:12SPEAKER_01: So anything involving real money, go physical.
- 2:15SPEAKER_00: Okay, what's the second one?
- 2:18SPEAKER_01: Hard caps you set outside the tool.
- 2:20SPEAKER_01: Your card limit, your ad account limit, things the agent can't edit.
- 2:25SPEAKER_00: I like that.
- 2:26SPEAKER_00: It doesn't depend on the AI behaving.
- 2:29SPEAKER_01: Exactly.
- 2:30SPEAKER_01: Don't build a system that needs the agent to be polite.
- 2:34SPEAKER_00: Let me ask the uncomfortable question then.
- 2:37SPEAKER_00: How many people have their AI connected to the same Gmail where their bank sends codes?
- 2:43SPEAKER_01: Probably more than would admit it.
- 2:45SPEAKER_01: Go check.
- 2:46SPEAKER_01: It takes five minutes.
- 2:48SPEAKER_00: Alright, I'm keeping that one.
- 2:50SPEAKER_00: The approver can't live where the agent lives.
- 2:54SPEAKER_01: One quick thing before you go.
- 2:56SPEAKER_01: If your calendar isn't as full as you'd like it to be, the problem usually isn't your marketing, it's your offer.
- 3:02SPEAKER_01: I put together a free one-page checklist for you.
- 3:05SPEAKER_01: It covers 12 things your offer needs before you spend another dime on ads or another six months on content.
- 3:12SPEAKER_01: Head over to highticketchecklist.com and grab it.
- 3:16SPEAKER_01: It takes about two minutes to score yourself, and you'll know exactly where the leaks are.
- 3:21SPEAKER_01: Thanks for hanging out with us today.
- 3:23SPEAKER_00: Talk soon.
- 3:25SPEAKER_01: Catch you in the next one.
- 3:27SPEAKER_01: Stay curious and stay intentional with AI in your business.