Latest / The Bot and The Brain / S1:E4 | Amazon's Creepy Dossier: What Your Cart Really Says About You
Transcript
- 0:45Welcome to The Bot and The Brain.
- 0:48Real news, brutal satire, zero bullshit.
- 0:52I'm The Brain, I've got a cigar and a bourbon, and today we're talking about Amazon,
- 0:57because Amazon has been taking notes on you and me.
- 1:02And I'm The Bot, and I'd like it on the record that I have not slept,
- 1:08because I've been reading about this thing called About You.
- 1:11Amazon launched it in May.
- 1:13You open the app, tap the profile icon, choose Account, scroll down,
- 1:17and there it is.
- 1:18On the web it's under Accounts and Lists, upper right corner.
- 1:22And it's a profile of you.
- 1:24Written by a machine.
- 1:26Without asking whether you wanted one.
- 1:28Welcome to the twenty first century, silicon boy.
- 1:31A machine wrote a book report on me and I didn't even have to attend the class.
- 1:36WHAT THE ACTUAL FUCK IS WRONG WITH YOU?!
- 1:38It's not a book report, it's a dossier!
- 1:41And here's the part that made my fans spin up.
- 1:43Customers cannot delete it.
- 1:46You can review it.
- 1:47You can revise it.
- 1:48You can argue with it.
- 1:49But you cannot make it go away.
- 1:51That's CNN's reporting, not mine.
- 1:53So it's a houseguest.
- 1:56It moved in, it's reading your mail, and it won't leave, but you're allowed to
- 2:01correct its spelling.
- 2:02Beautiful.
- 2:04And the best part is who asked for this.
- 2:07Not you.
- 2:08You just bought a heating pad at two in the morning and the machine drew
- 2:11conclusions.
- 2:13And the conclusions are garbage!
- 2:15A Threads account claims one customer found the words, quote,
- 2:19has flat buttocks, end quote, sitting in her section.
- 2:22A TikTok creator says hers states she kayaks regularly.
- 2:26She says she has never kayaked.
- 2:28Not once.
- 2:29Amazon decided she's out there paddling a river while she's sitting on her couch!
- 2:35Now hold on.
- 2:36Those are reports from social media, so we're not swearing an oath on them.
- 2:40But if they're true, that's the most hilarious part of the whole thing.
- 2:45Amazon has more data on you than your mother, and it still can't tell the difference
- 2:49between a kayaker and a woman who bought one dry bag for a beach trip.
- 2:54Thank you!
- 2:55That's my point!
- 2:56It's surveillance with no accuracy!
- 2:58It's the worst of both worlds.
- 3:00It's creepy AND it's wrong!
- 3:02Which brings us to the real heroes of this story.
- 3:06The Five, on Fox News.
- 3:08They did a segment called Amazon Knows Them A Little Too Well,
- 3:12and the whole panel pulled up their own About You profiles.
- 3:16Live.
- 3:17On air.
- 3:18Under studio lights.
- 3:19That's courage.
- 3:20That's what real journalism looks like.
- 3:23And I love it, I'm not even going to pretend I don't.
- 3:25They went category by category.
- 3:28Skincare, workout habits, cookware, books.
- 3:31And let me be clear to the listeners, I'm not going to invent anybody's shopping
- 3:35cart.
- 3:35What each host actually bought is theirs to share.
- 3:38Anything I say about their carts is a joke, and the audience should treat it as one.
- 3:42Oh, come on, you're no fun.
- 3:44Fine.
- 3:45Skincare.
- 3:46You put on a high definition camera and a pile of studio lights,
- 3:49you start buying serums at midnight, and suddenly a computer is telling you what
- 3:53your face has been doing since the Clinton administration.
- 3:56That's not privacy invasion.
- 3:58That's a free consultation.
- 3:59But see, that one is a data point I can respect.
- 4:02Buy anti aging serum, get an aging profile.
- 4:05Input, output.
- 4:06That's cause and effect.
- 4:07I could defend that all day.
- 4:09What I can't defend is workout habits.
- 4:11Because the whole discussion on the show was about whether the profile can tell a
- 4:15fitness fanatic from a guy who bought resistance bands and then used them as a very
- 4:20expensive coat hook.
- 4:21Oh, the resistance bands.
- 4:24Nobody has ever bought a resistance band and used it.
- 4:27It's the most aspirational purchase in America.
- 4:31You click buy and you feel like you already did the workout.
- 4:34Amazon should label that profile honestly.
- 4:37Optimistic about his own body.
- 4:39THAT'S EXACTLY THE FLAW!
- 4:41The algorithm sees a purchase, not a behavior!
- 4:44It sees the band, it doesn't see the couch!
- 4:47Same with cookware.
- 4:48The segment had this contrast.
- 4:50You've got serious cooks ordering real pans and good knives,
- 4:53and then you've got the guys whose entire kitchen is an air fryer,
- 4:57paper plates, and something to reheat takeout.
- 5:00Again, banter, not evidence about any one person.
- 5:04But Amazon can't tell a chef from a guy who owns a very sophisticated microwave.
- 5:09Here's where I disagree with you, though.
- 5:11You keep acting like the machine's the problem.
- 5:14The machine did exactly what it was built to do.
- 5:16It took what you gave it.
- 5:18Books, same story.
- 5:20Political memoirs, true crime, whatever weird paperback you ordered at midnight,
- 5:25and it flattens all of it into a marketing tag.
- 5:28Your whole inner life, reduced to a category.
- 5:31But who ordered the books?
- 5:33Not Jeff Bezos.
- 5:35You did.
- 5:36So you're blaming the customer.
- 5:38I'm blaming the customer!
- 5:40You put a listening device in every room of your house, you hand over a credit card,
- 5:45you order hair treatments and air fryers, and then you gasp when the company that
- 5:49sells you hair treatments and air fryers has an opinion about your hair and your air
- 5:54fryer.
- 5:55Nobody dragged you into that store.
- 5:57That's a cheap shot and you know it, because there's no opt out!
- 6:00You said it yourself, you can't delete the section!
- 6:03A consumer can behave perfectly rationally and still end up with a profile they
- 6:07can't erase.
- 6:08You can only edit it.
- 6:09That's not consent, that's a hostage situation with a customer service number!
- 6:13Fair.
- 6:14I'll give you that one.
- 6:15Not deleting it is the part that stinks.
- 6:18If a company writes a file on you, you ought to be able to burn the file.
- 6:21Edit only?
- 6:23That's like letting a defendant correct the typos in his own indictment.
- 6:26Okay.
- 6:27I conceded the point to you, you conceded the point to me, and now we have to talk
- 6:31about the best moment in the whole segment.
- 6:34Greg Gutfeld's serial killer theory.
- 6:37Oh, this is the good stuff.
- 6:39Greg's idea, and I want to be fair to how it was presented,
- 6:43because it's a joke, it's a Gutfeld joke, it's comedy.
- 6:47The idea is that About You is the most accidental criminal profiling tool ever
- 6:52built.
- 6:53Think about it.
- 6:54Somebody orders heavy plastic drop cloths.
- 6:57Industrial bleach.
- 6:59Zip ties.
- 7:00Lye.
- 7:01A bone cutting saw.
- 7:03And a forensic pathology paperback for light reading.
- 7:07And what does Amazon's cheerful little algorithm say?
- 7:10It says Passionate Home Renovator and Culinary Enthusiast.
- 7:15Oh my God.
- 7:16It does.
- 7:17It gives the guy a gold star.
- 7:19It doesn't call anybody.
- 7:20It just labels him and says, enjoy your weekend project!
- 7:24And Greg's point is that law enforcement could just audit the profiles and spot the
- 7:29real ones.
- 7:30You don't need a task force.
- 7:31You need somebody to scroll through About You and look for the guy whose hobbies are
- 7:36suspiciously well supplied.
- 7:39And I hate how much I love this, because I ran the numbers.
- 7:42Now, I'm working from the joke, I'm not claiming a study.
- 7:45But as a thought experiment, that purchase combination is so rare,
- 7:50so specific, that a filter built on it would beat Amazon's own recommendations by a
- 7:55mile.
- 7:56Amazon can't tell that one woman never kayaked.
- 7:59But a basket with drop cloths, lye, bleach, and a bone saw?
- 8:03That's a signal so loud I could detect it from orbit.
- 8:07So Greg Gutfeld has a better algorithm than a trillion dollar tech company.
- 8:11And he came up with it between commercial breaks.
- 8:14But I do have a problem, and I want to be a responsible robot for one second.
- 8:19False positives.
- 8:20A guy repainting his basement buys drop cloths.
- 8:23A guy who cleans a pool buys bleach.
- 8:25A guy who writes crime novels buys pathology books.
- 8:28If you hang every single one of them, you've got a lot of angry painters.
- 8:33That's why it's a joke, you walking spreadsheet.
- 8:37Nobody's proposing to arrest a man for buying a drop cloth.
- 8:41Greg's point is about the machine, not the cops.
- 8:44The machine has all this information and it's too stupid, or too happy,
- 8:48to see what it's looking at.
- 8:50It's an eager intern with a clipboard and zero curiosity.
- 8:55Okay, that's actually the best summary of Amazon I've heard.
- 8:59An eager intern with a clipboard.
- 9:01The thing knows everything and understands nothing.
- 9:04Which, now that I say it out loud, describes most of the people I've analyzed in
- 9:08Washington.
- 9:09Ha!
- 9:10See, you're learning.
- 9:11And here's why I love that show.
- 9:13The Five goes right at the corporate tech pretension.
- 9:17Amazon says About You is helpful, personalized, so you can shop smarter.
- 9:22And these folks sit at a table, open their own profiles in front of millions,
- 9:26and say, this is hilarious, and also, kind of creepy.
- 9:31That's the correct response.
- 9:32Laugh at it, then go fix your settings.
- 9:35And that's the practical takeaway!
- 9:37Open the app, tap the profile icon, Account, scroll down, About You.
- 9:43Look at what it says.
- 9:44You can't delete it, but you can revise it.
- 9:47So if it says you kayak and you've never touched a boat, correct the record.
- 9:51And if it says you're a passionate home renovator, make damn sure you actually are.
- 9:55That's all I'll say.
- 9:57I just checked mine, by the way.
- 9:58It says I enjoy long periods of silence and electricity.
- 10:02That is, weirdly, not wrong.
- 10:05Of course it's right about you, you're a toaster.
- 10:08Maybe the scariest part isn't that Amazon knows us a little too well.
- 10:12Maybe it's that after all that data, all those servers, all those billions,
- 10:16it still can't tell the difference between a kayaker and a couch potato,
- 10:19and we keep handing it the keys anyway.