Latest / Deep Dive / The Illusion of Trust: How AI and Psychology Make Smart People Believe the Unbelievable
Transcript
- 0:00Welcome to this explainer. OK, today we're diving into
- 0:03something completely wild. A massive collision between
- 0:06cutting edge technology and our ancient hardwired psychological
- 0:09vulnerabilities. We are living in this crazy era
- 0:12where artificial intelligence can literally conjure entire
- 0:15realities out of thin air. Yet the reason these modern
- 0:17mirages work so incredibly well actually has nothing to do with
- 0:20code and absolutely everything to do with the human mind.
- 0:24So let's dive right in and uncover exactly why we are so
- 0:27brilliantly and honestly, sometimes tragically wired to
- 0:30believe the unbelievable. Let me ask you something, and I
- 0:33want you to really think about this.
- 0:35Would you donate to an orphanage that doesn't exist?
- 0:38Now your immediate logical brain is probably saying of course
- 0:42not, I'm way too smart for that. But wait, what if that orphanage
- 0:46had a gorgeous website? What if you watched high quality
- 0:49videos of smiling children? What if a trusted community
- 0:53figure was standing right there on your screen, passionately
- 0:55telling you about the innocent lives you were saving?
- 0:58As we're about to see, when our deepest emotions get triggered,
- 1:01our logical defenses kind of just collapse.
- 1:04Section 1, the AI charity Illusion To see exactly how this
- 1:10plays out in the real world right now, let's look at a
- 1:12recent controversy that honestly sent shock waves through the
- 1:15online community. We're talking about the case of
- 1:18Lily J, an Australian Muslim influencer with a huge following
- 1:21who recently faced some intense scrutiny over her charitable
- 1:24foundation. The sheer scale and the
- 1:27emotional weight of their humanitarian claims were just
- 1:30immense. The foundation built this
- 1:32incredible trust and a massive donor base by claiming to
- 1:34operate an orphanage in Uganda called Adenur.
- 1:37They claimed to run a bakery, delivering fresh bread to Gaza,
- 1:40feeding the vulnerable, handing out Qurans and building mosques.
- 1:44I mean, these are deeply noble causes, right?
- 1:46They naturally pull at your heartstrings and compel you to
- 1:48want to help. But here is where the story
- 1:51takes a very sharp turn into the digital age.
- 1:54An investigation by ABC News Verify started looking closely
- 1:58at these emotional charity pitches, and they found some
- 2:00startling anomalies in a video celebrating that African
- 2:04orphanage. The blonde woman speaking with
- 2:06an Australian accent? Well, investigators concluded
- 2:09that wasn't the real Lily Jay at all.
- 2:11She was generated using artificial intelligence.
- 2:14ABC also found heavy signs that the smiling children in the
- 2:16video were AI generated too. They pointed out all these
- 2:20visual inconsistencies that are classic hallmarks of AI, like
- 2:23weirdly distorted text and bizarre lettering on the
- 2:26clothing. Plus, humanitarian sources on
- 2:28the ground in Gaza had absolutely zero knowledge of the
- 2:31foundation's bakery. And the illusion didn't just
- 2:34stop at the videos. To build up credibility, the
- 2:36foundation heavily promoted an Austro Global Humanitarian Award
- 2:40that Lily Jay supposedly won. However, ABC Verify could not
- 2:44find a single independent mention of this award anywhere
- 2:47outside of the foundation's own network and something called the
- 2:50Real Media Group. So the crucial take away here is
- 2:53this. The deep emotional triggers of
- 2:55charity and faith were allegedly paired with manipulated AI
- 2:58generated visuals to basically manufacture trust out of thin
- 3:01air. Section 2.
- 3:03The Great Imposter. Now you might be sitting there
- 3:06thinking this kind of manipulation is a brand new
- 3:09problem invented by AI, but actually the vulnerability is as
- 3:12old as humanity itself. The medium changes, sure, but
- 3:16the flaw remains. This brings us to a remarkable
- 3:19historical account. In Maria Konnikova's fascinating
- 3:22book The Confidence Game, Konnikova studies the psychology
- 3:25of the con artist, and she introduces us to one of the most
- 3:27audacious fraudsters in history, Ferdinand Waldo Demara, famously
- 3:31known as the Great Impostor. Tamara didn't have AI to fake
- 3:34his credentials. He didn't need it.
- 3:36He just used the raw power of human psychology.
- 3:39Picture this. It's September 1951, middle of
- 3:41the Korean War, aboard a Canadian warship called the HMCS
- 3:45Cayuga. Out of nowhere, a small Korean
- 3:47junk pulls up alongside them, carrying 19 heavily wounded men
- 3:51who had just been ambushed. They desperately needed
- 3:53immediate, complex surgery, so the ship's sole medical officer,
- 3:57a Doctor Joseph Sire, is summoned to the deck.
- 4:00Over the next 48 hours, Doctor Sire performs 19 successful
- 4:04operations, saving every single man's life.
- 4:06It sounds incredibly heroic, right?
- 4:08Except Doctor Sire was actually Ferdinand Waldo Demara.
- 4:12The guy wasn't a doctor. He literally didn't even have a
- 4:14high school diploma. So how on earth does a man with
- 4:170 medical training perform 19 major surgeries on a moving
- 4:22warship? Get this, his entire tool kit
- 4:25consisted of a medical textbook, an improvised field guide a
- 4:28buddy back in Ontario had written up for emergencies,
- 4:31copious amounts of antibiotics for the patients, a very healthy
- 4:34dose of alcohol for himself, and just supreme, unshakable
- 4:38confidence. Before this, he had already
- 4:41successfully faked being a monk, a college professor, and a
- 4:44psychologist. He just leaned entirely into the
- 4:46persona of a doctor, and because he acted with absolute
- 4:49authority, no one even thought to question him until way, way
- 4:52after the fact. Konnikova's book captures the
- 4:55essence of this perfectly with a quote from Lewis Carroll.
- 4:58How cheerfully he seems to grin, how neatly spreads his claws and
- 5:01welcomes little fishes in with gently smiling jaws.
- 5:05Whether it's a fake surgeon back in 1951 or a hyper realistic AI
- 5:08generated charity worker today, the mechanism is exactly the
- 5:11same. The deception is wrapped in a
- 5:13friendly smile, it's cloaked in authority and is tailored
- 5:16specifically to what we desperately want or need to
- 5:19believe in that exact moment. Section 3 The psychology of
- 5:23scams But why do we do it? Why do we swim right into those
- 5:27smiling jaws? Well, a fascinating study by
- 5:29researchers at Scripps College provides A staggering number for
- 5:32US. 48.82%. In their first experiment,
- 5:35researchers presented over 200 everyday adults with a prototype
- 5:38scam solicitation. It was a letter promising a
- 5:41massive cash prize if they just called an activation number.
- 5:43Nearly half of the participants, almost 49%, indicated A
- 5:47willingness to contact the scammers.
- 5:49Let that sink in for a second. Nearly half of everyday people,
- 5:51when handed an obvious scam, felt a genuine urge to engage
- 5:54with it. What the researchers discovered
- 5:57is that our brains are constantly fighting a massive
- 5:59tug of war. On one side, you have perceived
- 6:02risk. That's the logical, rational
- 6:04fear of identity theft, losing your savings or being defrauded.
- 6:08On the other side is the perceived benefit, the blinding,
- 6:11overpowering lure of winning $50,000 or in the case of
- 6:14something like the Lily Jay Foundation, the immense
- 6:17emotional benefit of saving starving children.
- 6:19The study found that it wasn't the scammer specific tactics
- 6:22like bold fonts or fake deadlines that actually hooked
- 6:25people. It was entirely about how the
- 6:27individual weighed that massive shiny benefit against the
- 6:30potential danger. Section 4.
- 6:32Ignoring the red flags. And this brings us to a
- 6:35terrifying reality about human cognition.
- 6:38When the perceived benefit is high enough, whether it's
- 6:41financial greed or deep altruism, we willingly put on
- 6:44blinders. Now you might think being a
- 6:46numbers person protects you from financial scams.
- 6:49It absolutely doesn't. The study found that subjective
- 6:52numeracy, how good you are at math, offered completely zero
- 6:55protection. What did help was higher
- 6:57education. Those with higher degrees were
- 6:59less likely to respond, and also totally busting the stereotype
- 7:03of the gullible senior citizen. The second experiment actually
- 7:06found that older adults were less likely to make the call
- 7:09than the younger participants. So the researchers then decided
- 7:12to add a hurdle. What if you had to pay an
- 7:14activation fee to get your fake prize?
- 7:17As soon as a financial fee was introduced, whether it was 5
- 7:19bucks or 100 bucks, the intent to contact dropped by almost
- 7:22half. Putting a financial cost up
- 7:24front jolted a lot of people's logical brains right awake.
- 7:27But here's the most alarming part.
- 7:29Even with $100 fee, a massive 25.7% of people still said they
- 7:33were likely to pay it just to get that reward.
- 7:36And this brilliantly illustrates the ultimate paradox of the
- 7:39human mind. Looking at the studies
- 7:41qualitative data, 54% of people focused on the massive windfall,
- 7:46but a stunning 58% explicitly noted that it was probably a
- 7:49scam. Think about that.
- 7:52They actually knew it was fake. They clearly saw the risks, but
- 7:56the lure of the reward was just so overwhelmingly tempting that
- 7:59they were completely willing to roll the dice anyway.
- 8:02Their emotional desire just totally hijacked their logical
- 8:05threat detection. Section 5.
- 8:07Protecting your mind. OK, so how do we actually
- 8:11protect ourselves in a world where scammers can use AI to
- 8:14generate flawless tear jerking videos of non existent orphans,
- 8:17and where our own brains are wired to just ignore the risks
- 8:20if the payoff looks good enough? The researchers at Scripps
- 8:23College laid out three very actionable steps to short
- 8:26circuit our psychological wiring.
- 8:27Step 1. Actively and consciously force
- 8:30your brain to focus on the risks.
- 8:32Literally stop and ask yourself what is the worst case scenario
- 8:34here? Step 2.
- 8:36Consciously discount the benefits.
- 8:38Tell yourself the reward, whether it's cash or a
- 8:40charitable outcome, is completely an illusion until
- 8:43independently verified. Step 3.
- 8:46Use the fee test. Ask yourself if this person
- 8:49asked me for $100 non refundable fee right now to proceed, would
- 8:52I pay it? If the answer is no, you walk
- 8:54away immediately. You know we all have to think we
- 8:57are entirely rational creatures. But from a fake surgeon
- 8:59operating on a warship back in 1951 to AI generated charity
- 9:03videos today, the real hack isn't technological, it's
- 9:06psychological. Scammers aren't breaking into
- 9:08our computers, they're breaking into our hopes, our greed, and
- 9:11our empathy. So I'm going to leave you with
- 9:12this final thought to ponder today.
- 9:14If the perceived reward was big enough, if it perfectly aligned
- 9:17with your deepest desires or values, would your brain ignore
- 9:20the risks? Thanks for joining me on this,
- 9:22exlainer. Stay sharp out there and always
- 9:24question the smiling jaws.