Latest / Minds, Bodies, and Terawatts / An AI Wrote Sixteen Viruses That Never Existed, and the System Meant to Catch Dangerous DNA Was Built to Recognize Nature
Transcript
- 0:00[Host] This is Minds, Bodies, and Terawatts — where the machine stopped editing life and started writing it. The New York Times reported Thursday on a study published the same day in Science: an AI wrote sixteen viruses that never existed, and all sixteen came to life.
- 0:18[Guest] Stanford and the Arc Institute. Lead author Samuel King, senior author Brian Hie. The models are called Evo, trained on about nine trillion letters of DNA.
- 0:29[Host] Stitching existing genes together is decades old. What's actually new here?
- 0:34[Guest] These models wrote complete viral genomes end to end in a single pass, with nobody correcting anything mid-sequence.
- 0:41[Host] And they built them?
- 0:43[Guest] They printed DNA for about three hundred designs and dropped them into bacteria. Sixteen worked, infecting and killing E coli.
- 0:51[Host] Sixteen out of three hundred is a five percent hit rate. That's a lab curiosity, not a threat model.
- 0:59[Guest] Some of those sixteen replicated faster than the natural virus they were modeled on. A five percent hit rate against something evolution spent eons tuning is the story.
- 1:10[Host] Why do this at all?
- 1:12[Guest] Drug-resistant infections. Bacteria that shrug off antibiotics directly killed about one point one million people in 2021, and the Lancet's curve bends upward from there.
- 1:23[Host] So the viruses are the medicine.
- 1:25[Guest] That's the pitch. Bacteria-eating viruses have been therapy for a century, and bacteria always learn to dodge a single one. Hie's team pooled all sixteen into one cocktail, and it broke resistance the bacteria had already built.
- 1:40[Host] Can a listener with a resistant infection actually get this?
- 1:44[Guest] Not off a shelf. No phage therapy has full approval from the Food and Drug Administration; it reaches patients one at a time under compassionate use, after antibiotics have failed.
- 1:57[Host] What's the part nobody's celebrating?
- 1:59[Guest] Science ran a companion piece from Johns Hopkins biosecurity researchers Thomas Inglesby and Moritz Hanke. Their line: the ability to compose viral genomes with generative AI now exists, the governance to steer it does not.
- 2:13[Host] Meaning someone could order a dangerous genome?
- 2:16[Guest] When you order synthetic DNA, the provider screens it against a catalog of known dangerous sequences. That screening is voluntary, not required by law, and it recognizes only what nature already made.
- 2:29[Host] I'd call that speculative if it weren't already tested.
- 2:33[Guest] Microsoft published in the same journal last October. They rewrote toxin proteins with AI, and most slipped past the screening software unflagged.
- 2:42[Host] Is anyone credible arguing this is overblown?
- 2:45[Guest] Tom Ellis, who runs synthetic genome engineering at Imperial College London, used exactly that word. Enhancing a pathogen that already exists is far easier, and far likelier to hurt someone, than writing one from scratch.
- 2:59[Host] For how long, though?
- 3:01[Guest] Unclear. The team kept every human, animal and plant virus out of the training data, and picked what Ellis called the smallest and easiest genome to make.
- 3:12[Host] And the coronavirus genome is six times longer. That's reassurance with an expiration date.
- 3:18[Guest] Which is why the checkpoint belongs where the action can't be undone. Most of what a machine does is reversible. A self-replicating organism is not.
- 3:28[Host] Today the last gate before something living exists is a DNA printer's internal policy.
- 3:34[Guest] A smoke alarm wired to nothing. Patrick Deglon calls the missing piece Civic Authority in Unscarcity: a named human with standing to override an automated system, and a public record when they do. Nobody holds it here.
- 3:49[Host] For more on where human judgment has to stay in the loop, head to unscarcity dot ai. The book is on Amazon, the audiobook is on Spotify. This has been Minds, Bodies, and Terawatts.