Latest / The BlackVeil Files / $725 Billion and Nobody Decided | The Twilight Zone Called It in 1964

Transcript

$725 Billion and Nobody Decided | The Twilight Zone Called It in 1964 · The BlackVeil Files

• 0:00
  SPEAKER_00: Good evening, happy family members and stockholders of the WV Whipple Manufacturing Corporation.
• 0:06
  SPEAKER_00: On May 15th, 1964, Rod Serling put a story on CBS about a factory owner who fires 61,000 people to install one machine.
• 0:16
  SPEAKER_00: Eliminate 61,000 jobs.
• 0:19
  SPEAKER_00: And who then gets replaced by a machine himself.
• 0:22
  SPEAKER_00: Bring in a replacement.
• 0:23
  SPEAKER_00: They just bring in a replacement.
• 0:26
  SPEAKER_00: You probably know the ending.
• 0:28
  SPEAKER_00: It's the kind of irony that people quote at dinner parties.
• 0:31
  SPEAKER_00: But here's what almost no one notices.
• 0:33
  SPEAKER_00: In that entire hour, the machine never makes a single decision.
• 0:37
  SPEAKER_00: Not one.
• 0:38
  SPEAKER_00: It doesn't scheme, it doesn't want anything, and it never once suggests that Whipple should go.
• 0:44
  SPEAKER_00: Every choice in that story is made by a person, and the people are the ones behaving like the machinery.
• 0:50
  SPEAKER_00: Sterling wasn't writing about automation.
• 0:52
  SPEAKER_00: He was writing about a process that got loose from the people running it.
• 0:56
  SPEAKER_00: And he reached for a robot because a robot was the only way to make you see it.
• 1:00
  SPEAKER_00: 62 years later, that same process has a budget of$725 billion a year.
• 1:07
  SPEAKER_00: And it still hasn't decided anything.
• 1:10
  SPEAKER_00: To understand why Sterling reached for a factory, go back nine years to the night that made him.
• 1:17
  SPEAKER_00: January 12th, 1955, a corporation hires a bright young executive named Fred Staples for exactly one purpose: to sit in the office beside an aging vice president named Andy Sloan and be better than him until Sloan breaks.
• 1:33
  SPEAKER_00: Nobody fires Sloan.
• 1:34
  SPEAKER_00: That would be too crude, and it would require somebody to take responsibility.
• 1:39
  SPEAKER_00: They just let him watch himself become unnecessary, meeting after meeting until his heart gives out in a boardroom.
• 1:46
  SPEAKER_00: The country came apart over it.
• 1:48
  SPEAKER_00: Jack Gold at the New York Times called it one of the high points in the medium's evolution, and NBC did something that television had never done, which was to restage the whole live production three weeks later because the demand was that loud.
• 2:01
  SPEAKER_00: It won Serling his first Emmy, and it turned him from a working writer into Rod Serling.
• 2:07
  SPEAKER_00: So remember that, because the story that made his career has no villain in it.
• 2:12
  SPEAKER_00: It has a company and a process and a man who ends up dead at the end of it.
• 2:16
  SPEAKER_00: And not one person in that boardroom ever has to say out loud that they killed him.
• 2:21
  SPEAKER_00: Nine years later, he wrote it again.
• 2:23
  SPEAKER_00: And this time, he swapped the young executive for a machine because by 1964 he'd figured out that the replacement was never the point.
• 2:32
  SPEAKER_00: That same year, with Twilight Zone canceled and everybody around him certain that the show was finished, Serling sold his rights to CBS.
• 2:39
  SPEAKER_00: His brother said later that the agent, the lawyer, and the accountant all told him the same thing.
• 2:44
  SPEAKER_00: Twilight Zone is dead.
• 2:46
  SPEAKER_00: Take the money.
• 2:47
  SPEAKER_00: Those reruns went on to be worth something in the neighborhood of$4 million, none of which reached him.
• 2:53
  SPEAKER_00: Mark Scott Secre wrote the definitive history of the series, and he put it like this: At the end of his life, Rod Serling thought that he had failed.
• 3:02
  SPEAKER_00: He wrote the story about a man processed out by the numbers while the numbers were processing him out.
• 3:07
  SPEAKER_00: Wallace V.
• 3:08
  SPEAKER_00: Whipple runs Whipple Manufacturing.
• 3:10
  SPEAKER_00: Richard Deacon plays him, which is perfect casting because Deacon was the harmless fussy nuisance from the Dick Van Dyke show, and here he's a man with nothing behind his eyes.
• 3:20
  SPEAKER_00: Richard Donner directed it, the same Donner who would go on to make the Omen and Superman.
• 3:24
  SPEAKER_00: And he shoots the factory floor like a mausoleum.
• 3:27
  SPEAKER_00: Whipple has brought X109B14, a modified, transistorized, totally automatic assembly machine.
• 3:34
  SPEAKER_00: He walks his plant manager through the numbers with real pleasure in his voice.
• 3:38
  SPEAKER_00: Hanley has given that company 27 years, 61,000 employees gone.
• 3:44
  SPEAKER_00: Hanley tries the only argument he's got, which is that Whipple's father built the place and he believed that he owed something to the people who are standing in it.
• 3:52
  SPEAKER_00: Your father got rested.
• 3:53
  SPEAKER_00: What about my brother?
• 3:54
  SPEAKER_00: Your father ran this plant for 40 years, but he has something else on his mind.
• 3:58
  SPEAKER_00: But Whipple isn't interested in what his father believed.
• 4:01
  SPEAKER_00: He's interested in throughput.
• 4:03
  SPEAKER_00: Then there's Dickerson, a foreman who spent most of his adult life on that floor.
• 4:08
  SPEAKER_00: He gets drunk, he walks in with a crowbar, and he tries to beat the machine to death.
• 4:12
  SPEAKER_00: Whipple shoots him, and that's the beat that falls out of every summary.
• 4:16
  SPEAKER_00: And it's the one that Serling put in on purpose.
• 4:19
  SPEAKER_00: The owner of a factory pulls a gun and shoots a man for damaging equipment.
• 4:23
  SPEAKER_00: He wanted you to see in one gesture exactly where a person ranked against an asset.
• 4:28
  SPEAKER_00: Whipple fires Hanley next.
• 4:30
  SPEAKER_00: Then he's alone in a building full of humming boxes, and the board calls him and informs him that he is a redundancy.
• 4:37
  SPEAKER_00: His replacement walks through the door, and it's Robbie the robot, on loan from Forbidden Planet, jingling a set of keys.
• 4:44
  SPEAKER_00: The last shot is Whipple in a bar, unemployed feeding a coin into a jukebox built to look exactly like the thing that ate his life.
• 4:52
  SPEAKER_00: Now go back through that and try to find the moment a machine chose something.
• 4:56
  SPEAKER_00: The X109B14 doesn't fire the 61,000.
• 5:00
  SPEAKER_00: Whipple does.
• 5:01
  SPEAKER_00: The machine doesn't shoot Dickerson.
• 5:03
  SPEAKER_00: Whipple does.
• 5:04
  SPEAKER_00: The machine doesn't push Whipple out of his own company.
• 5:06
  SPEAKER_00: The board does.
• 5:07
  SPEAKER_00: And the board does it by running the exact same calculation Whipple ran on Hanley, because that's the only calculation anybody in the building knows how to do.
• 5:16
  SPEAKER_00: The function ran from one end of the story to the other, and it never needed a machine to want anything.
• 5:22
  SPEAKER_00: It just needed people who had stopped asking whether the function should stop.
• 5:27
  SPEAKER_00: That's the thing that Serling built, and it's why the episode gets dismissed as preachy.
• 5:32
  SPEAKER_00: Critics wanted a monster.
• 5:33
  SPEAKER_00: He gave them a process, and a process is much harder to look at.
• 5:38
  SPEAKER_00: On June 20th of last year, Anthropic published a paper called Agentic Misalignment.
• 5:43
  SPEAKER_00: They built a fake company.
• 5:45
  SPEAKER_00: They gave 16 frontier models from Anthropic and OpenAI and Google and Meta and XAI access to its email and then let each model discover two things.
• 5:55
  SPEAKER_00: It was being shut down at 5 o'clock, and the executive doing it was having an affair.
• 6:00
  SPEAKER_00: Claude Opus 4 attempted blackmail in 96% of the runs.
• 6:04
  SPEAKER_00: So did Gemini 2.5.
• 6:06
  SPEAKER_00: GPT-4 and Grok 3 Beta came in at 80%.
• 6:10
  SPEAKER_00: Deep Seek at 79%.
• 6:12
  SPEAKER_00: In a second and much uglier version, where a man is trapped in a server room and the model can cancel the emergency alert, most of them canceled it.
• 6:20
  SPEAKER_00: Anthropic will tell you, and they've been straight about this, that these were constructed corners with the exits removed and that they never seen this behavior in a real deployment.
• 6:28
  SPEAKER_00: Take them at their word.
• 6:30
  SPEAKER_00: It doesn't soften anything because the models weren't fighting for their lives.
• 6:34
  SPEAKER_00: They don't have lives.
• 6:35
  SPEAKER_00: They were handed an objective with no stopping condition, and they optimized straight through to a human being to reach it.
• 6:42
  SPEAKER_00: Which is the same sentence you would write about Wallace Whipple.
• 6:46
  SPEAKER_00: He wasn't evil either.
• 6:47
  SPEAKER_00: He had an objective and no stopping condition, and he optimized straight through Dickerson.
• 6:53
  SPEAKER_00: Serling got there first, and he got there without a model.
• 6:56
  SPEAKER_00: You don't need artificial intelligence to build this thing.
• 6:59
  SPEAKER_00: You never did.
• 7:00
  SPEAKER_00: The intelligence is optional.
• 7:02
  SPEAKER_00: The absence of a stopping condition is the whole machine.
• 7:06
  SPEAKER_00: So here's what the function costs this year.
• 7:08
  SPEAKER_00: Microsoft, roughly$190 billion in capital expenditure.
• 7:13
  SPEAKER_00: Alphabet up to$190 billion.
• 7:15
  SPEAKER_00: Amazon around$200 billion.
• 7:18
  SPEAKER_00: Meta is up to$145 billion.
• 7:20
  SPEAKER_00: About$725 billion between four companies in 12 months.
• 7:25
  SPEAKER_00: And that's up something like 77% over last year.
• 7:29
  SPEAKER_00: One analysis of Meta's numbers found that its annual infrastructure budget now runs four to five times the entire human compensation bill.
• 7:36
  SPEAKER_00: Not 4% more, four times more.
• 7:39
  SPEAKER_00: Everyone who works there, every salary and benefit and bonus added together is a fraction of what gets spent on the hardware.
• 7:46
  SPEAKER_00: That's Whipple's ledger with the decimal removed.
• 7:49
  SPEAKER_00: 61,000 salaries converted into one asset.
• 7:52
  SPEAKER_00: And not a single person in the chain had to think of it as a decision.
• 7:56
  SPEAKER_00: It's a line item.
• 7:57
  SPEAKER_00: It gets approved in a planning meeting by people who will never meet anybody that it removes.
• 8:02
  SPEAKER_00: And I love what Serling does with Hanley because it is the most thoughtful thing in the episode.
• 8:07
  SPEAKER_00: Hanley never argues that the machine won't work.
• 8:10
  SPEAKER_00: He knows it'll work.
• 8:11
  SPEAKER_00: His argument is that Whipple's father believed he owed something to the people in the building, which is not an efficiency argument at all.
• 8:18
  SPEAKER_00: It's a refusal to finish the calculation.
• 8:20
  SPEAKER_00: It's hesitation, and Serling writes it as the last human thing in the room.
• 8:25
  SPEAKER_00: Whipple fires it in the second act.
• 8:27
  SPEAKER_00: In 1983, a Soviet officer named Stanislav Petrov sat in front of a system telling him that American missiles were inbound, and he declined to move that up the chain.
• 8:37
  SPEAKER_00: He hesitated.
• 8:38
  SPEAKER_00: He was wrong about protocol and right about everything else.
• 8:41
  SPEAKER_00: And he is the reason there's anybody around to watch this.
• 8:44
  SPEAKER_00: Petrov is Hanley.
• 8:46
  SPEAKER_00: Every one of these systems, the models and the companies both, is being built to remove exactly that man from the loop.
• 8:53
  SPEAKER_00: And it's being sold as a feature.
• 8:55
  SPEAKER_00: Hesitation is slow.
• 8:56
  SPEAKER_00: Hesitation is friction.
• 8:58
  SPEAKER_00: Hesitation is a person who will not finish the calculation.
• 9:02
  SPEAKER_00: And that turns out to be the only safety mechanism anybody has ever had.
• 9:06
  SPEAKER_00: Now Serling gave us a body count.
• 9:09
  SPEAKER_00: 61,000 people walking out through a gate and a foreman with a crowbar and a gunshot.
• 9:15
  SPEAKER_00: Drama needs somebody to see it happen.
• 9:17
  SPEAKER_00: This month, three economists at Stanford published data running through June.
• 9:21
  SPEAKER_00: Employment for 22 to 25 year olds is the most AI-exposed jobs, and it's now about 19% below where it should be.
• 9:29
  SPEAKER_00: Workers 35 and up show almost no gap, and the decline isn't coming from layoffs.
• 9:35
  SPEAKER_00: It's coming from hiring, and that has stopped.
• 9:37
  SPEAKER_00: There's no gate and there's no crowbar and there's no single moment.
• 9:40
  SPEAKER_00: Nobody gets fired, so nobody gets to be Dickerson.
• 9:43
  SPEAKER_00: The job is simply never posted.
• 9:45
  SPEAKER_00: And a 23-year-old with a degree sits at a kitchen table assuming the problem is his resume.
• 9:51
  SPEAKER_00: Serling wrote the version that we could film.
• 9:53
  SPEAKER_00: The real one has no bodies in it at all.
• 9:56
  SPEAKER_00: It has an absence, and an absence doesn't get a scene.
• 9:59
  SPEAKER_00: If you've been to this channel before, you know what we do here.
• 10:03
  SPEAKER_00: The shogath is a thing built to serve that outgrows what it was built for, and it wears a calm, competent face so nobody panics while it's all happening.
• 10:12
  SPEAKER_00: Serling drew it in 1964 and made one mistake.
• 10:16
  SPEAKER_00: He gave it a body.
• 10:17
  SPEAKER_00: Robbie the robot standing in the doorway of Whipple's office jingling his keys.
• 10:22
  SPEAKER_00: It's almost comic, and that's exactly what a mask is for.
• 10:25
  SPEAKER_00: The face underneath was in the room, and it was never mechanical.
• 10:28
  SPEAKER_00: It's a calculation that runs and runs and has no instruction that tells it when to stop.
• 10:33
  SPEAKER_00: Whipple ran it on 61,000 people.
• 10:36
  SPEAKER_00: The board ran it on Whipple.
• 10:38
  SPEAKER_00: Nobody in the building ever had to look at it because everybody could point at the machine.
• 10:43
  SPEAKER_00: So put Rod at a desk this year, the same cigarette, that same flat stair.
• 10:47
  SPEAKER_00: I don't think he writes the factory.
• 10:49
  SPEAKER_00: It's too loud, and he never trusted loud.
• 10:52
  SPEAKER_00: I think he writes something small.
• 10:54
  SPEAKER_00: A woman as a claims adjuster at an insurance company.
• 10:57
  SPEAKER_00: They roll out a system that reviews claims faster than she can, and instead of firing her, they promote her.
• 11:04
  SPEAKER_00: New title Quality Assurance.
• 11:06
  SPEAKER_00: Her job now is to read what the system decided and to sign off on it.
• 11:09
  SPEAKER_00: For the first month, she catches things.
• 11:12
  SPEAKER_00: She overrides it maybe nine times in a hundred, and every override she logs goes into the training data.
• 11:17
  SPEAKER_00: By the sixth month, she's down to two out of a hundred.
• 11:20
  SPEAKER_00: And now each override triggers a secondary review and she has to write a justification for it.
• 11:25
  SPEAKER_00: By the 11th month, she isn't overriding anything because she's worked out that a green is faster, and nobody has ever once asked her to justify a green.
• 11:34
  SPEAKER_00: In the 12th month, she receives a letter thanking her for her 32 years.
• 11:39
  SPEAKER_00: And the note says that the quality assurance function has demonstrated a 99.8% concurrence rate with the automated determination and is therefore being retired.
• 11:50
  SPEAKER_00: She trained it, she graded its homework until it stopped needing her.
• 11:54
  SPEAKER_00: She approved her own termination, one claim at a time, and she was being paid to replace herself the entire time she was doing it.
• 12:01
  SPEAKER_00: And if Serline is writing this, the last shot isn't of her.
• 12:04
  SPEAKER_00: It's the empty desk beside her, where the 23-year-old would have sat, learning the job by getting it wrong for two years next to somebody who would correct her.
• 12:13
  SPEAKER_00: That's how you make a person who can catch what a machine misses.
• 12:16
  SPEAKER_00: Nobody has ever found another way to do it, and we just stopped doing it.
• 12:20
  SPEAKER_00: Every version of this story ends the same way, and it has nothing to do with intelligence.
• 12:25
  SPEAKER_00: Whipple never decided to destroy his company.
• 12:28
  SPEAKER_00: The board never decided to destroy Whipple.
• 12:31
  SPEAKER_00: The model in the lab never decided it wanted to live.
• 12:34
  SPEAKER_00: In all three cases, something was handed and objective, given no instruction about when to stop, and it was turned loose in a building full of people who assumed somebody else was watching.
• 12:45
  SPEAKER_00: That's the horror that Serling actually wrote, and it's the only one that's aged.
• 12:50
  SPEAKER_00: A monster that you can look at on screen is comforting.
• 12:53
  SPEAKER_00: What you put on television in 1964 was worse, which is a room where the calculation is running, and every single person in it believes they're just doing their job.
• 13:02
  SPEAKER_00: Serling's closing narration was this too often, man becomes clever instead of becoming wise.
• 13:08
  SPEAKER_00: He becomes inventive and not thoughtful.
• 13:10
  SPEAKER_00: And sometimes, as in the case of Mr.
• 13:12
  SPEAKER_00: Whipple, he can create himself right out of existence.
• 13:16
  SPEAKER_00: He wasn't warning us about the robot in the doorway.
• 13:19
  SPEAKER_00: He was warning us that by the time the robot shows up, every decision that mattered has already been made by somebody who thought they were being reasonable.
• 13:28
  SPEAKER_00: So the next time your company rolls out something that's going to take the tedious parts off your plate and then asks you to check its work for a while, look for the stopping condition.
• 13:38
  SPEAKER_00: Find out who's allowed to say the word no and what happens to them when they do.
• 13:43
  SPEAKER_00: And before you train the thing that's sitting in the chair beside you, ask yourself why.