Latest / Found in the Machine / Entropy Hunters: Random Numbers and Chaos Machines
Transcript
- 0:22Daina Bouquin: You are walking home without an umbrella.
- 0:25Daina Bouquin: The forecast said 60%, and you did the math the way everybody does the math.
- 0:31Daina Bouquin: Which is to say that you didn't.
- 0:33Daina Bouquin: You looked at the sky and you decided that it would hold.
- 0:38Daina Bouquin: So now you are hurrying.
- 0:41Daina Bouquin: Shoulders up, and the rain is coming down in big, scattered droplets.
- 0:47Daina Bouquin: You watch it land on the sidewalk.
- 0:50Daina Bouquin: One drop.
- 0:52Daina Bouquin: Then a dozen.
- 0:54Daina Bouquin: Dark coins appearing on the pale concrete in no particular order.
- 0:58Daina Bouquin: You could not say where the next one will fall.
- 1:03Daina Bouquin: Nobody could.
- 1:05Daina Bouquin: Not you.
- 1:07Daina Bouquin: Not whoever wrote the forecast.
- 1:10Daina Bouquin: Not anyone who has ever lived.
- 1:13Daina Bouquin: And that, right there.
- 1:16Daina Bouquin: The randomness.
- 1:18Daina Bouquin: That is one of the last wild things.
- 1:22Daina Bouquin: And it's everywhere.
- 1:24Daina Bouquin: It is the exact fork of the lightning.
- 1:27Daina Bouquin: Drawn once across the dark and never again.
- 1:30Daina Bouquin: It is the freckles on your arm.
- 1:33Daina Bouquin: It is the hiss between two radio stations.
- 1:37Daina Bouquin: The world throws off randomness the way it throws off heat.
- 1:42Daina Bouquin: Constantly.
- 1:44Daina Bouquin: For free.
- 1:46Daina Bouquin: You cannot bottle it.
- 1:49Daina Bouquin: You cannot ask the storm to wait.
- 1:52Daina Bouquin: It falls and the randomness is gone.
- 1:56Daina Bouquin: Which would not matter at all if we didn't need it.
- 2:00Daina Bouquin: But we do need it.
- 2:04Daina Bouquin: We need it because it is how we try to see the future.
- 2:08Daina Bouquin: To determine whether the river comes over its banks tonight while you sleep.
- 2:14Daina Bouquin: Whether the funnel touches down on your street or one in the next town over.
- 2:20Daina Bouquin: To see the future, we build a little sky inside a machine.
- 2:26Daina Bouquin: We tell the sky everything we know about the air right now and about physics.
- 2:32Daina Bouquin: And then we let it run the sky forward, out ahead of the real weather.
- 2:37Daina Bouquin: But the air will not sit still to be copied.
- 2:40Daina Bouquin: Miss one gust of wind, one pocket of warmth too faint to measure, and your little digital sky evolves in the completely wrong direction.
- 2:50Daina Bouquin: So we do not run the simulation once.
- 2:54Daina Bouquin: We run it 50 times.
- 2:56Daina Bouquin: And each run starts with a tiny random nudge to stand in for everything we don't know.
- 3:04Daina Bouquin: Each nudge creates a slightly different tomorrow.
- 3:08Daina Bouquin: Then we count how many of those tomorrows end in rain.
- 3:12Daina Bouquin: And here is the thing about the machine dreaming up those tomorrows.
- 3:17Daina Bouquin: It cannot make a single one of those random nudges on its own.
- 3:22Daina Bouquin: We had to find the randomness somewhere and pour it in.
- 3:27Daina Bouquin: And the randomness we pour into nearly every forecast, every simulated flood, every imagined storm.
- 3:36Daina Bouquin: It is not real.
- 3:38Daina Bouquin: It's a counterfeit.
- 3:41Daina Bouquin: We faked it.
- 3:44Daina Bouquin: I'm Daina Bouquin, and this is Found in the M achine.
- 3:49Daina Bouquin: To you understand why anyone would fake randomness you have to understand how hard the real thing is to catch.
- 4:02Daina Bouquin: Go back to 1947.
- 4:04Daina Bouquin: To a low building in Santa Monica, close enough to the ocean that you could smell it if you opened a window.
- 4:11Daina Bouquin: Where a new outfit called RAND was doing mathematics for the Air Force.
- 4:17Daina Bouquin: Someone there needed random numbers.
- 4:20Daina Bouquin: Not a handful.
- 4:23Daina Bouquin: A million.
- 4:25Daina Bouquin: Clean ones.
- 4:27Daina Bouquin: With no human thumb on the scale.
- 4:29Daina Bouquin: Because you could never get a million random numbers out of a person.
- 4:34Daina Bouquin: Ask anyone to rattle off random digits and they will lean on some without realizing it.
- 4:40Daina Bouquin: They'll make little patterns without meaning to.
- 4:44Daina Bouquin: They'll say seven too much.
- 4:46Daina Bouquin: People are pattern machines.
- 4:50Daina Bouquin: It is one of the things we cannot stop ourselves from being.
- 4:54Daina Bouquin: And the people at RAND knew that.
- 4:56Daina Bouquin: So they built a chaos engine instead.
- 5:00Daina Bouquin: It was, more or less, an electronic roulette wheel.
- 5:05Daina Bouquin: A wheel with 32 slots spun by raw electrical noise.
- 5:10Daina Bouquin: The frantic static inside a gas tube, whipping through thousands of revolutions and landing on one number every second.
- 5:20Daina Bouquin: It clattered.
- 5:22Daina Bouquin: It clicked.
- 5:23Daina Bouquin: It punched its chaos into stiff paper cards hour after hour, day after day.
- 5:30Daina Bouquin: And it worked.
- 5:31Daina Bouquin: Sort of.
- 5:33Daina Bouquin: Because it turns out that building a thing with no habits at all is almost impossible.
- 5:38Daina Bouquin: The tubes degraded.
- 5:40Daina Bouquin: They were sensitive to the room's temperature.
- 5:43Daina Bouquin: They felt the grid's voltage flutter when the building's power dipped.
- 5:48Daina Bouquin: And slowly, quietly, a faint shadow of a pattern would creep back in.
- 5:55Daina Bouquin: So you would have to shut the machine down and tune it, and then it would behave for a while.
- 6:00Daina Bouquin: And then it would drift again.
- 6:03Daina Bouquin: Which meant someone had to check.
- 6:06Daina Bouquin: Someone had to take a million numbers and hunt through them for ghosts of a pattern.
- 6:11Daina Bouquin: Her name was Bernice Brown.
- 6:15Daina Bouquin: Before Rand, she had been in Ames, Iowa, at the statistics program that became the first statistical laboratory in the country.
- 6:24Daina Bouquin: In 1932, she became the second person ever to earn a master's degree in statistics there.
- 6:31Daina Bouquin: At RAND, once the machine had spat out its million digits.
- 6:35Daina Bouquin: Her job was to make sure they were completely meaningless.
- 6:40Daina Bouquin: So she counted how often each digit appeared.
- 6:45Daina Bouquin: Whether pairs showed up too often, whether runs ran too long, test after test, by hand and on IBM tabulating machines, feeding in tray after heavy tray of punched cards, day after day, for years.
- 7:04Daina Bouquin: Tedious, physical, invisible work.
- 7:09Daina Bouquin: And at the end of it all, after tests and retests and one final mathematical shuffle to scrub out the machine's last stubborn leanings, Bernice Brown signed off.
- 7:22Daina Bouquin: She wrote that nothing in her tests argued against calling these numbers random.
- 7:28Daina Bouquin: Not these are random.
- 7:32Daina Bouquin: No one can ever prove that.
- 7:34Daina Bouquin: Only I looked as hard as I know how to look and I could not catch them being anything else.
- 7:42Daina Bouquin: Her certified numbers were eventually printed and bound into a book.
- 7:47Daina Bouquin: A real book published in 1955 that you could order in the mail.
- 7:53Daina Bouquin: It is called A Million Random Digits with 100,000 Normal Deviates.
- 7:59Daina Bouquin: You can still buy a copy today.
- 8:02Daina Bouquin: And people did buy it.
- 8:04Daina Bouquin: Scientists, pollsters, lottery designers.
- 8:08Daina Bouquin: For years, if you needed real randomness, you did not make it.
- 8:13Daina Bouquin: You looked it up.
- 8:15Daina Bouquin: The book even came with instructions.
- 8:18Daina Bouquin: You were not supposed to start on page one.
- 8:21Daina Bouquin: You were told to open the book somewhere unpredictable and read off in an unpredictable direction.
- 8:28Daina Bouquin: Even the Book of Chaos needed you to bring a little chaos of your own.
- 8:33Daina Bouquin: So this is what randomness cost in 1955.
- 8:37Daina Bouquin: A machine that fought you.
- 8:40Daina Bouquin: A woman who spent years checking every digit.
- 8:43Daina Bouquin: A book of certified nonsense that you kept on a shelf.
- 8:47Daina Bouquin: Now, around that same time, a man was lying in a hospital bed playing cards.
- 8:53Daina Bouquin: His name was Stanisław Ulam, and he was a Polish-American mathematician.
- 9:00Daina Bouquin: In 1946, he had nearly died.
- 9:04Daina Bouquin: A sudden encephalitis, an emergency brain surgery.
- 9:08Daina Bouquin: And as he recovered, he played solitaire.
- 9:12Daina Bouquin: And somewhere in there he got curious.
- 9:16Daina Bouquin: What are the odds that a given hand of solitaire can be won at all?
- 9:20Daina Bouquin: He tried to work it out properly with pure mathematics.
- 9:25Daina Bouquin: And the calculations just ballooned beyond reach.
- 9:28Daina Bouquin: So he gave up on elegance and just played.
- 9:32Daina Bouquin: Lots of hands.
- 9:34Daina Bouquin: And he counted how often he won.
- 9:37Daina Bouquin: He figured, don't solve the problem.
- 9:40Daina Bouquin: Simulate it.
- 9:42Daina Bouquin: Run it over and over with the deck shuffled differently each time, and let the count become your answer.
- 9:48Daina Bouquin: Ulam brought that idea back to his colleagues and one of them saw immediately what it could do. His name was John von Neumann, a mathematician of terrifying range who played German marching music too loud in his office, and who was, at that moment, trying to understand what happens inside an exploding bomb.
- 10:11Daina Bouquin: You could write that problem down in theory.
- 10:14Daina Bouquin: Every neutron, every trajectory through a chunk of metal the size of a grapefruit.
- 10:20Daina Bouquin: But solving it would take longer than the universe has been alive.
- 10:25Daina Bouquin: Or you could do what Ulam had done with the cards.
- 10:28Daina Bouquin: Follow one imaginary neutron.
- 10:31Daina Bouquin: When it strikes a nucleus, roll the dice.
- 10:34Daina Bouquin: Does it bounce?
- 10:36Daina Bouquin: Is it absorbed?
- 10:38Daina Bouquin: Does it split the atom?
- 10:40Daina Bouquin: That random roll of the dice would determine the outcome.
- 10:44Daina Bouquin: And von Neumann needed millions of rolls.
- 10:48Daina Bouquin: More than any book could hold.
- 10:51Daina Bouquin: So he came up with a trick.
- 10:53Daina Bouquin: Take a number, square it, then reach into the middle of the answer and pull out a few digits.
- 11:00Daina Bouquin: That's your next number.
- 11:02Daina Bouquin: Now do it again and again.
- 11:05Daina Bouquin: Plain, fast, repeatable arithmetic.
- 11:09Daina Bouquin: And if you squint, the numbers it throws off look random.
- 11:13Daina Bouquin: They jump around and feel unpredictable.
- 11:16Daina Bouquin: They are not.
- 11:18Daina Bouquin: Of course they are not.
- 11:20Daina Bouquin: Feed the trick the same starting number, the same seed.
- 11:24Daina Bouquin: And it hands you the exact same sequence.
- 11:27Daina Bouquin: There is no more chance in it than in a times table.
- 11:31Daina Bouquin: And nobody knew that better than von Neumann.
- 11:35Daina Bouquin: He said it himself.
- 11:37Daina Bouquin: Anyone who uses arithmetic to produce random digits is, of course, in a state of sin.
- 11:45Daina Bouquin: For decades, the fakes were good enough.
- 11:49Daina Bouquin: Because for most of what we ask randomness to do, a good fake is fine.
- 11:54Daina Bouquin: For weather, for bombs, for the slow patient work of science, von Neumann's sin was pretty much good enough.
- 12:04Daina Bouquin: But then we started asking randomness to do something new.
- 12:08Daina Bouquin: Not to imagine the future, but to keep our secrets.
- 12:14Daina Bouquin: You see, when you send a message you do not want read, or when money moves, the locks that protect all of it are built from random numbers.
- 12:25Daina Bouquin: And a secret built on a fake is just a secret waiting for the right person to notice.
- 12:30Daina Bouquin: Like in 1995, two graduate students at Berkeley noticed.
- 12:36Daina Bouquin: They pulled apart the web browser Netscape, which was at the time the front door to the internet, and found that the quote, random numbers securing its traffic, were seeded with things like the time of day.
- 12:49Daina Bouquin: Not chaos, just a clock.
- 12:53Daina Bouquin: And so in minutes the locks came open.
- 12:56Daina Bouquin: And so, after half a century of getting away with it, we discovered that we still needed the real thing.
- 13:04Daina Bouquin: Genuine unpredictability, caught from the physical world.
- 13:09Daina Bouquin: Bernice Brown's kind.
- 13:11Daina Bouquin: Computer science has a word for it.
- 13:15Daina Bouquin: They call it entropy.
- 13:18Daina Bouquin: And we were sent back out to hunt for it.
- 13:21Daina Bouquin: Here is what we worked out.
- 13:25Daina Bouquin: To keep our secrets, we do not need a million real random numbers.
- 13:30Daina Bouquin: We only need the starting points, the seeds.
- 13:34Daina Bouquin: Once you have a truly unpredictable seed, the fast, cheap arithmetic can take it from there.
- 13:41Daina Bouquin: So the hunt became a hunt for seeds.
- 13:44Daina Bouquin: And once you go looking the mess is everywhere, the thermal noise inside a resistor, the decay of a radioactive atom, the jitter of the exact microsecond you happen to move your mouse.
- 14:01Daina Bouquin: Your computer is scavenging entropy off of you right now, gathering up your tiny accidents and pooling them like rainwater.
- 14:10Daina Bouquin: And in one building in San Francisco, a company called Cloudflare keeps a whole wall of lava lamps.
- 14:20Daina Bouquin: Blobs rising and folding and splitting and never taking the exact same shape twice.
- 14:26Daina Bouquin: A camera watches the wall, and a computer turns every pixel, its position, brightness, and color, into numbers.
- 14:39Daina Bouquin: The exact posture of every slow molten blob becomes a seed, feeding the cryptographic keys that secure web traffic for millions of sites.
- 14:49Daina Bouquin: If you walked in front of that wall, your shadow would shape the randomness too.
- 14:55Daina Bouquin: Some tiny fraction of the internet's locks would be forged in part from the outline of you.
- 15:04Daina Bouquin: We built machines that can do almost anything.
- 15:12Daina Bouquin: They can play out fifty tomorrows no problem.
- 15:17Daina Bouquin: They can follow a neutron through a bomb.
- 15:21Daina Bouquin: And lately they can talk.
- 15:24Daina Bouquin: You may have had a conversation with one recently.
- 15:27Daina Bouquin: Every time one of those machines chooses its next word, it rolls dice.
- 15:34Daina Bouquin: And they are von Neumann's dice.
- 15:37Daina Bouquin: Fed at the very start by a seed of real entropy scavenged from the physical world.
- 15:44Daina Bouquin: Because that is the one thing no machine can do.
- 15:48Daina Bouquin: The most powerful things we have ever built come to the physical world like beggars.
- 15:53Daina Bouquin: To the static.
- 15:55Daina Bouquin: To the lava.
- 15:57Daina Bouquin: The machines cannot make it.
- 16:02Daina Bouquin: Bernice Brown could spend years checking and never prove it.
- 16:06Daina Bouquin: Von Neumann could only fake it, and the sky is giving it away for free.
- 16:12Daina Bouquin: You feel it on the back of your neck as you hurry home.
- 16:18Daina Bouquin: I'm Daina Bouquin, and this is Found in the Machine.
- 16:25Daina Bouquin: If you enjoy these stories, please rate and review this podcast wherever you listen.