Latest / AI Fire Daily / 🎙️ EP 326: Top University Rocks Online Admissions & Managers Rely on AI for Layoffs

Transcript

🎙️ EP 326: Top University Rocks Online Admissions & Managers Rely on AI for Layoffs · AI Fire Daily

0:00
Imagine dedicating months of your life to study
0:02
for this massive, life -changing exam you put
0:05
in the endless hours. Yeah, you make all those
0:07
sacrifices. Exactly, the sacrifices. And then
0:10
a machine just coldly flags you as a cheater.
0:13
Or, you know, even worse, imagine an algorithm
0:15
deciding it's time for you to be fired. Right.
0:17
And it makes that final call just based entirely
0:19
on your sick leave. Yeah, it's incredibly chilling.
0:21
So welcome to today's deep dive. We are looking
0:24
at a massive collision today. It's this fundamental
0:27
collision between artificial intelligence and,
0:30
well, basic human trust. And it is happening
0:33
everywhere right now. It really is. We've got
0:36
a fascinating roadmap for you today. First, we're
0:38
going to examine how AI is completely upending
0:41
university admissions in Mexico. Then we'll look
0:43
at how it warps our shared online reality. Right.
0:46
And finally, we'll uncover how it quietly makes
0:49
these ruthless corporate firing decisions. Before
0:52
we jump in, though, I have to offer a slightly
0:54
vulnerable admission here. Yeah. I mean, I still
0:56
wrestle with whether I can actually trust an
0:58
algorithm to fairly evaluate human effort. Honestly,
1:02
I still wrestle with prompt drift myself. Oh,
1:05
right. Which is when AI quietly changes answers
1:08
to the exact same instructions over time. It's
1:12
really hard to place your trust in a constantly
1:13
moving target. The ground is just always shifting
1:16
beneath you. Exactly. So let's start right at
1:19
the beginning of a person's career. We're looking
1:21
closely at university admissions today. The primary
1:24
battle lines of AI trust are currently being
1:26
drawn right here. We're focusing on Mexico's
1:29
top university, UNAM. Right, a massive, highly
1:32
prestigious institution. They recently held their
1:35
very first fully online entrance exam. And well,
1:39
the sheer scale of this is hard to wrap your
1:40
head around. Over 158 ,000 applicants took this
1:44
remote test. Whoa. I mean, imagine monitoring
1:47
158 ,000 applicants simultaneously. Yeah. It's
1:50
a staggering logistical challenge for any institution.
1:53
To handle that volume, they deployed a very intense
1:56
surveillance system. They essentially turned
1:58
each student's laptop into a strict digital panopticon.
2:01
Let's unpack how that surveillance actually functioned.
2:05
The testing platform utilized severe browser
2:07
restrictions first. That means installing software
2:11
that physically stops you from opening any other
2:13
applications. Right. But they didn't stop there.
2:16
They required active webcams and open microphones
2:18
the entire time. Right. And they had human proctors
2:21
attempting to watch the feeds. But human eyes
2:24
can only do so much at that scale, you know.
2:26
Yeah, obviously. So they layered an overarching
2:29
AI monitoring system on top of everything. The
2:32
algorithm was instructed to relentlessly hunt
2:34
for any suspicious behavior. It sounds incredibly
2:37
secure on paper. It sounds like an airtight digital
2:40
testing environment. But then the final data
2:42
actually came back. Historically, only about
2:44
3 .5. percent of students managed to score above
2:47
100 correct answers. Yeah, that's the firmly
2:50
established historical baseline for this specific
2:52
exam. It is a notoriously difficult test. But
2:55
this year, under the watchful eye of the AI,
2:57
that number abruptly jumped to 16 .3 percent.
3:00
Which is a massive statistical anomaly. You just
3:03
don't see organic jumps like that naturally.
3:05
An increase of that magnitude implies a systemic
3:08
failure somewhere in the chain. Something clearly
3:12
went incredibly wrong during this process. UNM
3:15
reacted quickly and disqualified more than 3
3:19
,000 of these online exams. And the fallout actually
3:21
goes much further than just those 3 ,000 disqualified
3:24
students. The trust in the entire digital ecosystem
3:28
has collapsed. Yeah. They're now forcing tens
3:31
of thousands of applicants to completely retake
3:34
it. These students must travel to take a physically
3:36
supervised control exam now. The administration
3:39
claims the initial scores just fell into a highly
3:42
suspicious range. The political pressure surrounding
3:44
this has become immense. Even President Claudia
3:47
Scheinbaum has publicly demanded a full investigation
3:49
into the debacle. Because you have thousands
3:51
of innocent students caught in this bureaucratic
3:53
nightmare. But here's the core conflict at the
3:56
center of this story. The students are heavily
3:58
questioning the automated system itself. They're
4:00
actively wondering if the AI can actually tell
4:02
the difference. Can this algorithm genuinely
4:05
distinguish clever cheating from legitimate high
4:09
performance that is the critical underlying flaw
4:12
in this whole surveillance setup the ai is fundamentally
4:16
looking for behavioral anomalies but extreme
4:19
focus and high performance often look a lot like
4:22
cheating to a rigid algorithm oh interesting
4:24
yeah if a student stares unblinkingly at the
4:26
screen while thinking deeply the ai flags it
4:30
It's kind of like setting a highly sensitive
4:31
burglar alarm for your house. Yeah. But the alarm
4:34
goes off every single time the wind blows outside.
4:36
Yeah, exactly. How do we ever know who actually
4:38
broke in? You just get completely flooded with
4:40
false positives. When everything is flagged as
4:43
suspicious, the system becomes entirely useless.
4:46
The university administrators end up drowning
4:48
in unverified alerts. So if both the cheaters
4:52
and the proctors are using AI, who actually wins
4:55
this arms race? Right now, profound uncertainty
4:58
is the only real winner here. Universities are
5:02
relying heavily on these automated systems to
5:04
detect AI assistance or cheating. But those systems
5:08
simply cannot provide unquestionable proof of
5:11
a violation. Right. They can't definitively prove
5:14
a student actually intended to break the rules.
5:17
So... Perfectly innocent students inevitably
5:19
get caught in the digital crossfire. So AI spots
5:23
patterns, but it still can't definitively prove
5:25
human intent. Exactly. It highlights anomalies,
5:28
but it's completely blind to the human context.
5:31
Well, we just saw that we can't fully trust AI
5:33
to monitor a simple test. But what happens when
5:36
we literally can't trust it? to show us reality.
5:39
Or what happens when tech leaders go to war over
5:41
who controls it. The stakes get significantly
5:43
higher in this next phase. We're moving from
5:46
academic testing to the manipulation of our global
5:48
perception. Let's look at Google Earth for a
5:50
moment. They recently launched a brand new, highly
5:52
anticipated AI feature. And it was severely abused
5:55
almost instantly by the public. People quickly
5:58
figured out how to use it to create fake satellite
6:00
images. The generated imagery was incredibly
6:03
realistic and honestly deeply concerning. It
6:06
was so bad they had to remove the feature within
6:08
24 hours. Wow. Yeah, the fake landscapes and
6:11
fabricated structural changes were just too convincing.
6:14
It really highlights how quickly generative AI
6:16
can warp our shared reality. I mean, creating
6:19
a fake satellite image could easily spark a massive
6:22
geopolitical crisis. Exactly. Then you have open
6:25
AI struggling on the public relations front.
6:27
They recently tried to host an exclusive luxury
6:30
influencer trip. Yeah, they booked a lavish $5
6:33
,000 a night stay for these. creators. It was
6:36
clearly designed to be a massive glossy marketing
6:39
spectacle. But the whole event backfired wildly
6:41
online. The influencers were immediately accused
6:44
of essentially selling their souls to big tech.
6:46
One creator even deleted her video entirely after
6:49
facing massive public backlash. Yeah, people
6:51
have a deeply visceral reaction to this kind
6:54
of stuff. They actively reject the artificial
6:56
manufactured gloss when it feels completely inauthentic.
6:59
So we're seeing these constant PR and perception
7:01
nightmares play out publicly. But at the exact
7:05
same time, massive institutional money is quietly
7:08
moving. Right. The real power is being consolidated
7:11
entirely behind the scenes. While we argue about
7:15
influencers, the enterprise data war is escalating.
7:17
Calenteer just posted a staggering $1 .1 billion
7:21
quarterly profit. A billion dollars in a single
7:25
three -month window. And they don't deal in flashy
7:28
consumer chatbots or influencer marketing campaigns.
7:31
They deal in massive enterprise data integration
7:33
and highly secure defense contracts. And their
7:36
CEO, Alex Karp, recently issued a very stark
7:40
warning. He openly called the major frontier
7:42
AI labs. Just to quickly clarify the tech jargon
7:47
for a second, Frontier AI Labs simply means companies
7:49
building the most advanced AI models. Right.
7:51
Think of organizations like OpenAI, Anthropic,
7:54
or Google DeepMind. Right. And I want to be extremely
7:57
clear for you listening here. We are strictly
7:59
reporting Karp's stated viewpoint as it appears
8:01
in our sources. We remain entirely neutral on
8:04
his specific political framing and rhetoric.
8:06
We aren't endorsing it. But we need to understand
8:09
what he means. Well, he's using that provocative
8:11
term to describe a specific data philosophy.
8:14
He claims these massive labs are actively trying
8:16
to control companies' proprietary data. He says
8:19
they fundamentally want to absorb and control
8:22
all enterprise workflows. It's a truly fascinating
8:25
disconnect when you zoom out. We have these massive
8:28
tech giants utterly failing to control basic
8:31
image generators. Right. They literally can't
8:33
even manage a luxury PR trip without triggering
8:36
a massive backlash. But despite those clumsy
8:39
public failures, they are fighting a billion
8:42
dollar war. They're fighting tooth and nail over
8:44
the ultimate control of global enterprise workflows.
8:47
Why is there such a massive gap between AI's
8:51
struggle with simple reality like fake satellite
8:53
photos and this high stakes battle for corporate
8:56
data? It really comes down to the underlying
8:58
complexity of the tasks. Generating convincing
9:01
visual illusions is actually mathematically quite
9:04
easy for AI now. It's essentially just predicting
9:07
pixel patterns based on existing public imagery.
9:10
But securely managing an entire global enterprise's
9:13
private data is vastly more complex. That requires
9:17
flawless security, precise logic, and absolute
9:20
reliability. Yeah, that makes sense. That is
9:23
exactly why Karp is aggressively defending corporate
9:26
data autonomy. He's fiercely defending corporate
9:29
sovereignty against these major data hungry AI
9:32
labs. Creating fakes is easy. Controlling secure
9:35
enterprise data is the real billion dollar war.
9:38
That's the perfect way to synthesize it. Visual
9:41
perception is incredibly cheap now. Proprietary
9:43
enterprise data is the actual enduring goldmine.
9:47
If these powerful tech leaders are fighting a
9:49
war over corporate data. What happens when that
9:51
data is actually you? That's where this transition
9:54
gets deeply personal and, frankly, quite unsettling.
9:57
We are crossing a very dangerous line in the
9:59
workplace right now. We're moving far away from
10:01
AI clumsily grading university tests. We're moving
10:04
way past AI faking satellite images of the globe.
10:07
We are now looking at AI literally deciding if
10:10
you get to keep your job. This is undoubtedly
10:11
the most alarming part of our source material
10:13
today. It fundamentally changes the relationship
10:16
between employers and employees. There's a shocking
10:19
new, highly detailed survey out right now. It
10:23
directly looked at 1 ,000 U .S. managers who
10:26
actively use AI at work. And these aren't theoretical
10:29
researchers. These are real middle managers making
10:32
real daily decisions about people's livelihoods.
10:35
The reported numbers in this survey are frankly
10:37
staggering. A massive 59 % of them use AI when
10:41
making critical layoff decisions. Over half of
10:44
the managers surveyed are outsourcing these choices.
10:46
And 58 % use it specifically for individual firing
10:50
decisions. Even worse, one in four admit they
10:53
use it for layoffs often or all the time. It's
10:55
rapidly becoming standard operating procedure
10:57
inside corporate human resources. It's shifting
11:00
from an experimental tool to a foundational management
11:02
crutch. But here's the most alarming statistical
11:05
reality we found. A full 17 % let AI make these
11:08
termination decisions with little to no human
11:10
supervision. They're literally just handing over
11:13
the keys to the algorithm. They let the machine
11:14
choose who stays and who goes, no questions asked.
11:17
And a concerning 38 % have zero training on ethical
11:21
AI use in HR. Absolutely zero formal training
11:25
on the tool ending their employees' careers.
11:27
They don't even fully understand what legal or
11:29
moral boundaries they're risking. They're operating
11:31
completely blind in a highly regulated space.
11:34
Let's look closely at this specific data actually
11:36
being weighed here. The AI is obviously analyzing
11:40
standard metrics like overall job performance.
11:43
It looks at historical salary bands and an employee's
11:46
total tenure. Which all sounds like... standard
11:49
traditional HR data analysis. But it is also
11:51
heavily weighing deeply personal protected metrics.
11:54
It's analyzing things like the frequency of sick
11:57
leave. Oh, wow. It looks at extended medical
11:59
leave and is even analyzing employee age. Those
12:02
are highly sensitive, often legally protected
12:04
areas of a person's life. It's kind of like stacking
12:07
colorful Lego blocks of data on a table. But
12:10
these aren't just plastic blocks being sorted
12:12
by an algorithm. They're actual livelihoods,
12:14
mortgages, and families being coldly categorized.
12:17
That is exactly what is happening inside these
12:20
black box models. Complex human beings are being
12:22
violently reduced to simple, optimized data points.
12:26
And the necessary bias testing is practically
12:28
non -existent across the board. A huge 58 % of
12:32
managers couldn't even confirm if their AI was
12:35
tested. They honestly didn't know if it was tested
12:37
for bias or discrimination. Ignorance is definitely
12:40
not a valid excuse when you're ruining careers.
12:42
Another 23 % explicitly confirmed that no bias
12:46
testing happened at all. They fully know the
12:48
tool is completely untested and they use it anyway.
12:51
They're actively using unverified algorithms
12:53
to abruptly end human careers. The potential
12:56
for systemic discrimination here is absolutely
12:59
massive. And the employee replacement factor
13:01
we found is genuinely terrifying. 34 % of the
13:05
managers using AI for these layoffs asked a very
13:07
specific question. They literally asked the AI
13:09
if it could just perform the fired employee's
13:11
job. Can you fire this person and then immediately
13:14
do their daily work? It's a completely chilling
13:16
dystopian loop of corporate efficiency. Given
13:19
that factors like medical leave and age are legally
13:22
protected in many places, how are managers getting
13:25
away with feeding this into an unmonitored AI?
13:28
The underlying technology has completely outpaced
13:31
corporate policy and labor laws. Software vendors
13:35
are rapidly adding these AI features to standard
13:38
HR dashboards. Right. And because 38 % lack ethical
13:42
training, they completely ignore the need for
13:44
bias testing. These managers are blindly trusting
13:47
the confident outputs on their screens. They
13:50
simply don't realize they might be generating
13:51
highly illegal, discriminatory decisions. The
13:55
tech moves too fast, leaving managers blindly
13:57
trusting. potentially illegal biased algorithms.
14:00
Exactly. The essential human oversight is just
14:03
missing entirely from the equation. We need to
14:05
take a very quick break right here. Sponsor.
14:08
Welcome back to the Deep Dive. We've certainly
14:10
covered a massive amount of conceptual ground
14:12
today. We really have. We've jumped from university
14:14
exams to global perception to corporate layoffs.
14:18
Let's take a moment to synthesize the overarching
14:20
theme of these sources. We are rapidly deploying
14:23
AI as an absolute unquestionable authority right
14:26
now. It's happening silently across practically
14:28
every major sector of society. It ranges from
14:32
UNAM's admissions department all the way to corporate
14:34
HR offices. But we're doing this incredibly prematurely.
14:38
We're deploying it widely before we actually
14:41
have the ability to audit its truthfulness. Or
14:44
audit its underlying, potentially devastating
14:46
biases. We're adopting the technology without
14:49
adopting the necessary safety harnesses. AI is
14:53
essentially acting as the ultimate societal gatekeeper
14:55
today. But the gatekeeper is operating entirely
14:58
within an opaque black box. It's a black box
15:01
functioning without any proper, meaningful human
15:04
oversight. Thank you so much for joining us for
15:06
this deep dive. We strongly encourage you to
15:08
critically question the automated systems around
15:10
you. Question how they operate in your workplace
15:13
or your academic life. You really have to actively
15:15
advocate for human oversight in these systems.
15:18
Don't just accept the algorithm's output as undeniable
15:20
gospel. I want to leave you with one final lingering
15:23
thought today. Consider everything we just unpacked
15:27
about how these automated systems govern our
15:29
lives. If a faceless algorithm ultimately determines
15:32
your hard -earned entry into a university, and
15:35
another algorithm coldly determines your abrupt
15:37
exit from a company, Where exactly is the space
15:41
left in our society for human redemption, second
15:44
chances, or just a simple bad day?