Latest / kill switch / What Could Possibly Go Wrong?
Transcript
- 0:04Speaker 1: Sleep Workers is a production of I Heart Radio and
- 0:07Speaker 1: Unusual Productions. I was on a patrol up in the
- 0:16Speaker 1: mountains of Afghanistan, and I was doing a reconnaissance patrol
- 0:20Speaker 1: with a very small ranger team, and I saw someone
- 0:23Speaker 1: approaching us, young man, maybe early twenties. That's Polar, a
- 0:29Speaker 1: former Army ranger, an elite special operative in the U. S. Military.
- 0:33Speaker 1: There were sort of a couple of possibilities that came
- 0:35Speaker 1: into my mind. One was that he was a goat hurter,
- 0:38Speaker 1: just out, you know, taking his goats out to eat grass.
- 0:41Speaker 1: Another was that he might be like a woodcutter that's
- 0:45Speaker 1: protecting his property. And another one might be that he
- 0:48Speaker 1: was someone who was had seen us. There wasn't a
- 0:51Speaker 1: lot of vegetation in the area, so we were pretty exposed,
- 0:53Speaker 1: and he was coming to kill us, And those all
- 0:56Speaker 1: seemed like very real possibilities. PULL knew of similar situations
- 1:01Speaker 1: where enemy fighters pretended to be civilians, concealing their weapons
- 1:05Speaker 1: until the last minute ambush. I fairly id degree of
- 1:08Speaker 1: confidence that, you know, if we got into a gunfight,
- 1:11Speaker 1: we could outmatch him or three of us, but if
- 1:14Speaker 1: you surprised us, he might have usially killed one of
- 1:16Speaker 1: us in the process first, so I wanted to maneuver
- 1:18Speaker 1: to a position where I could see him, and I
- 1:20Speaker 1: found him. He was sitting on the edge of a
- 1:22Speaker 1: cliff and looking out over this by valley, and he
- 1:25Speaker 1: had his back to me, and I settled into a
- 1:28Speaker 1: position where I could watch him very closely through my
- 1:30Speaker 1: sniper rifle. It was close enough that the wind carried
- 1:34Speaker 1: his voice towards me and I could hear him talking.
- 1:38Speaker 1: That alarmed me because I couldn't see who was talking to.
- 1:41Speaker 1: Paul didn't speak the local Afghan languages Dory or Pashtow,
- 1:45Speaker 1: so he couldn't understand what the man was saying. I
- 1:49Speaker 1: thought he might have had a radio and he could
- 1:50Speaker 1: be reporting back to maybe a group of fighters a nearby.
- 1:54Speaker 1: I was wearing that possibility versus maybe he's just you know,
- 1:58Speaker 1: talking to himself or talking to his goats or something
- 2:00Speaker 1: in And then eventually I heard him start singing, and
- 2:04Speaker 1: it struck me that if he was singing, you know,
- 2:06Speaker 1: singing out over the radio to someone in our position,
- 2:09Speaker 1: it seemed like a very strange thing for a fighter
- 2:12Speaker 1: to be doing. And the most like the explanation was
- 2:14Speaker 1: he was just an innocent go to hurd Um had
- 2:17Speaker 1: no idea that we were there, and he was singing
- 2:20Speaker 1: to himself just to pass the time, and so Paul
- 2:24Speaker 1: lowered his sniper rifle and he left, no provocation, no
- 2:29Speaker 1: harm done to either side. But that incident really stuck
- 2:34Speaker 1: with me because there was a period of time where
- 2:35Speaker 1: I didn't know whether he was, you know, an innocent
- 2:38Speaker 1: person or a fighter who might have been trying to
- 2:40Speaker 1: kill us Um, And the actions I would take were
- 2:43Speaker 1: very different in those two worlds. And now I look
- 2:46Speaker 1: back when I think about autonomous weapons and I think
- 2:49Speaker 1: what would a machine do? How could a machine understand
- 2:51Speaker 1: the context that I did, and sort of realize it
- 2:55Speaker 1: doesn't make sense that a person might be singing in
- 2:57Speaker 1: a tactical way that's some strange is probably just an
- 3:00Speaker 1: in person be able to do that. It's a profound question.
- 3:04Speaker 1: Paul poses what happens when something like a Predator drone
- 3:07Speaker 1: has as much autonomy as a self driving car and
- 3:11Speaker 1: can an AI system ever understand context, which can sometimes
- 3:15Speaker 1: mean the difference between life and death. In this episode
- 3:19Speaker 1: will examine AI on the battlefield and the future of
- 3:22Speaker 1: technology driven warfare. I'm as Velosen and this is Sleepwalkers.
- 3:40Speaker 1: So care last episode we talked about the future of
- 3:42Speaker 1: work and we focus on one big question, which was
- 3:45Speaker 1: what can AI not do and what Paul is talking about?
- 3:49Speaker 1: Identifying whether someone's a shepherd or an insurgent. Identifying targets
- 3:53Speaker 1: on the battlefield seems to be one of those things, sure,
- 3:56Speaker 1: But on the other hand, it's important for us to
- 3:58Speaker 1: ask what is AI good at. You know, good at
- 4:00Speaker 1: making predictions based on data about what might happen next,
- 4:03Speaker 1: It's good at seeing patterns. So it makes me think,
- 4:07Speaker 1: you know that with enough training data about battlefield interactions,
- 4:10Speaker 1: it could get just as good or better than humans
- 4:14Speaker 1: at this task. Yeah, and of course we don't have
- 4:16Speaker 1: the counter effectual to pull story. Sadly, there's probably many
- 4:19Speaker 1: stories where the army ranger doesn't wait to hear the
- 4:22Speaker 1: shepherd seeing before deciding what to do and just pulls
- 4:25Speaker 1: the trigger. And equally, there's probably many sad cases where
- 4:28Speaker 1: it does turn out to be an insurgent and an
- 4:30Speaker 1: ambush happens to the soldiers. So just from that story,
- 4:33Speaker 1: it's not necessarily clear to me that humans are always
- 4:35Speaker 1: or will always be better than algorithms that identifying targets.
- 4:39Speaker 1: You know, I do think it raises an important question.
- 4:41Speaker 1: We are increasingly comfortable outsourcing many parts of our lives
- 4:45Speaker 1: to technology. You know, who are we going to fall
- 4:47Speaker 1: in love with? How are we going to get to
- 4:48Speaker 1: our cousin's house? You know, that's decision making. Though, in
- 4:51Speaker 1: the world of war, we can also build tools to
- 4:54Speaker 1: do things that people don't want to do. A lot
- 4:57Speaker 1: of people have heard about Boston Dynamics. They have this
- 5:01Speaker 1: extremely terrifying video of this ford legged robodog aptly named Spot,
- 5:07Speaker 1: you know, that can run across bumpy ground. It can
- 5:11Speaker 1: go into places that aren't safe for human beings, you know,
- 5:13Speaker 1: And they've just announced this model with a claw on
- 5:16Speaker 1: the back of it that can open doors. There are
- 5:19Speaker 1: so many potential uses for this, from assisting military rates
- 5:23Speaker 1: to sending Spot into buildings that are unsafe for humans. Yeah, like,
- 5:27Speaker 1: a whole pack of Spots can actually pull a truck.
- 5:30Speaker 1: There's a video of it online. Look it up. It's frightening.
- 5:32Speaker 1: Teamwork is the dream work exactly? But no, like, what's
- 5:36Speaker 1: going to happen when that comes to the world of
- 5:39Speaker 1: war and we have packs of robodogs? Well, who knows?
- 5:42Speaker 1: Right the future is unclear, and that's really the question
- 5:44Speaker 1: of this episode. How will AI and robotics change the battlefield?
- 5:49Speaker 1: And how good of an insurance policy is it to
- 5:51Speaker 1: keep a human in the loop, to have somebody a
- 5:54Speaker 1: person controlling the pack of spots. We have from Paul
- 5:57Speaker 1: char at the beginning. He's now the director of Technology,
- 6:00Speaker 1: g and National Security at a bipartisan think tank called
- 6:03Speaker 1: the Center for a New American Security. He's recently written
- 6:06Speaker 1: a book called Army of None, Autonomous Weapons and the
- 6:09Speaker 1: Future of War. We're moving to a world where machines
- 6:14Speaker 1: may be making some of the most important decisions on
- 6:16Speaker 1: the battlefield about who lives and dies. And as Paul's
- 6:20Speaker 1: experienced in Afghanistan taught him, even elite military training isn't
- 6:24Speaker 1: always enough to tell who is and isn't likely to
- 6:27Speaker 1: be a threat. So understandably there's a great worry in
- 6:30Speaker 1: handing over target identification to a computer, especially as the
- 6:34Speaker 1: stakes are life and death. And as Paul tells us,
- 6:38Speaker 1: autonomous weapons are already being produced and sold around the world.
- 6:42Speaker 1: The best example today of fully autonomous weapon is a
- 6:46Speaker 1: drone built by Israel called the Harpy Drown and he's
- 6:49Speaker 1: been sold to a number of countries Turkey, India, China,
- 6:53Speaker 1: South Korea. It's an anti radar webbon that is lying
- 6:57Speaker 1: a switch pattern in the sky looking for enemy radars,
- 7:01Speaker 1: and when it finds one, it can then attack the
- 7:03Speaker 1: radar within any further human permission. And that processes the
- 7:07Speaker 1: line to an autonomous weapon that's able to go find
- 7:10Speaker 1: targets and then attack them all by itself. These are
- 7:13Speaker 1: not the autonomous killer robots of science fiction, setting their
- 7:17Speaker 1: own goals and killing it will. We still send them
- 7:20Speaker 1: into battle and tell them what to look for, but
- 7:22Speaker 1: we no longer control exactly what they do when they
- 7:25Speaker 1: get there. So by analogy, you might think about a
- 7:28Speaker 1: self driving car. Um, there are really degrees of how
- 7:31Speaker 1: much a car could be self driving. You could have
- 7:34Speaker 1: some like the Tesla autopilot today, where there's a steering
- 7:38Speaker 1: wheel and the human could intervene and grab control of
- 7:41Speaker 1: the vehicle. UM, you might have some like Google self
- 7:44Speaker 1: driving car that is no steering wheel and a person
- 7:47Speaker 1: just merely a passenger. But even in a totally self
- 7:51Speaker 1: driving car, the human is still choosing the destination. You're
- 7:54Speaker 1: not getting in your car just in car, you know,
- 7:56Speaker 1: take me where you want to go. So it's some
- 7:58Speaker 1: level humans are always involved, and it's going to be
- 8:01Speaker 1: the case in warfare. Um. The question is, you know,
- 8:04Speaker 1: when do we cross the threshold where the humans have
- 8:06Speaker 1: transfer control of some important and meaningful decisions two machines,
- 8:11Speaker 1: and then what are the legal or ethical complications of that.
- 8:15Speaker 1: It is a hugely important question. In the aftermath of
- 8:18Speaker 1: the Second World War, a hundred and ninety six countries
- 8:21Speaker 1: signed up to the Geneva Convention setting standards for behavior
- 8:25Speaker 1: in battle, But how do we enforce those standards if
- 8:28Speaker 1: the combatants are machines not people. Beyond having a human
- 8:32Speaker 1: in the loop, one important piece of the puzzle is
- 8:35Speaker 1: a healthy testing and review process, a clear understanding of
- 8:38Speaker 1: how a weapon works and the decisions it will make.
- 8:41Speaker 1: But according to Richard Danzig, a former secretary of the Navy,
- 8:45Speaker 1: that's easier said than done. One of the things that
- 8:48Speaker 1: concerns me is that the technologies are frequently highly classified.
- 8:54Speaker 1: So we're for self driving cars, we typically require that
- 8:59Speaker 1: there be millions of miles driven, and we insist that
- 9:03Speaker 1: external regulators review them for safety. In the military context,
- 9:08Speaker 1: we don't have millions of miles of experience before combat
- 9:13Speaker 1: and we don't typically have any kind of third party
- 9:17Speaker 1: review that says, wait a minute, here, the risks associated
- 9:20Speaker 1: with this system spinning out of control. We ought to
- 9:24Speaker 1: be using teams to say, hey, what could go wrong
- 9:27Speaker 1: if an adversary wants to attack these and subvert them,
- 9:31Speaker 1: or when they interact with other systems. This kind of
- 9:34Speaker 1: war gaming is valuable, but the best laid plans and
- 9:38Speaker 1: standards can crumble in the face of existential threats, real
- 9:42Speaker 1: or perceived. You only need to think about Hiroshima and
- 9:46Speaker 1: Nagasaki to understand how quickly restraint can give way to
- 9:50Speaker 1: the desire for victory his pool Again, as countries feel
- 9:55Speaker 1: that their national survival might be at stake, they're gonna
- 9:57Speaker 1: be willing to take more risk put up more experimental weapons.
- 10:00Speaker 1: The use of poison gas in World War One is
- 10:02Speaker 1: I think a terrible example of this happening and practice.
- 10:05Speaker 1: Germany was in a panic to find some kind of
- 10:08Speaker 1: wonder weapon that might break that stalemate. So a desire
- 10:12Speaker 1: to get an upper hand will clearly Historically we've seen
- 10:16Speaker 1: lead militarios to take risks and deploy more experimental technology.
- 10:21Speaker 1: This is one of the scariest things about war to
- 10:23Speaker 1: me Kara, particularly war involving new technology, the potential for
- 10:27Speaker 1: misunderstanding and unintended consequences. Paul mentions the almost accidental use
- 10:32Speaker 1: of poison gas in World War One, and then there
- 10:35Speaker 1: was a Cuban missile crisis where we almost stumbled into
- 10:38Speaker 1: a nuclear war. And all this potential for misunderstanding is
- 10:40Speaker 1: compounded exponentially in the world of AI because it's not
- 10:44Speaker 1: just humans who are trying to read each other and
- 10:46Speaker 1: make decisions. It's algorithms sort of loose in the wild,
- 10:49Speaker 1: interacting with one another. The Guardian actually had a great
- 10:53Speaker 1: story about this called Frank and Algorithms, The Deadly Consequences
- 10:57Speaker 1: of Unpredictable Code, and the article makes the point that
- 11:00Speaker 1: the stock market flash crash of was actually caused by
- 11:03Speaker 1: algorithms interacting with one another. You know, it's hard not
- 11:07Speaker 1: to think that this could happen in the wild, so
- 11:09Speaker 1: to speak. It's a scary thought, and it's made even
- 11:12Speaker 1: scarier because there's just so much potential all around for misunderstanding.
- 11:15Speaker 1: And that's something Richard Danzig is seriously concerned about. When
- 11:19Speaker 1: we talked about sending a ship on a mission, policy
- 11:22Speaker 1: makers by and large understand what that means and how
- 11:27Speaker 1: others will perceive it if the ship comes into their waters.
- 11:31Speaker 1: Whereas when we start talking about artificial intelligence, policy makers,
- 11:36Speaker 1: if there are five people in a room, may readily
- 11:38Speaker 1: envisioned five different things. We need the people making decisions
- 11:42Speaker 1: to understand both the situations they're dealing with and also
- 11:46Speaker 1: how the tools they're using actually work. And that's not
- 11:49Speaker 1: easy when it comes to AI. Part of the issue
- 11:51Speaker 1: is the so called black box problem. Currently, we understand
- 11:55Speaker 1: the principles of how a neural network uses probabilities to
- 11:58Speaker 1: reach a conclusion, but we can't interrogate the millions of
- 12:01Speaker 1: micro decisions it makes along the way. This is a
- 12:04Speaker 1: huge barrier to understanding weapons systems powered by AI. I
- 12:09Speaker 1: wanted to know how the research is developing new military
- 12:11Speaker 1: technology think about the black box problem. So I spoke
- 12:15Speaker 1: with Artie Prabaka, the former head of DARPA, the Defense
- 12:18Speaker 1: Advanced Research Projects Agency, and Arthie shared a story about
- 12:22Speaker 1: how the black box problem plays out. Many years ago, now,
- 12:26Speaker 1: there was a wonderful paper from Stanford that showed a
- 12:29Speaker 1: machine system that could label images. This was a girl
- 12:32Speaker 1: blowing out the candles on her birthday cake, or a
- 12:35Speaker 1: construction worker doing something so fairly complex analysis of what
- 12:39Speaker 1: was going on in this picture, and it would get
- 12:42Speaker 1: one right, and it would get ten right, and we
- 12:43Speaker 1: get a hunder right. And then there was a picture
- 12:46Speaker 1: that every human being would say, that's a baby holding
- 12:49Speaker 1: an electric truth brush, but the machine said it's a
- 12:52Speaker 1: small boy holding a baseball bat. And you know, you
- 12:55Speaker 1: just look at it and you think, what what what?
- 12:58Speaker 1: What were what were you thinking? And this I think
- 13:00Speaker 1: it's a great illustration of the black box nature of
- 13:03Speaker 1: these learning systems because they've been trained on all this
- 13:07Speaker 1: volume of data, but when you look inside to say, well,
- 13:11Speaker 1: what went wrong there, you know, you just see a
- 13:13Speaker 1: bunch of nodes with weights from being trained, and so
- 13:15Speaker 1: they're really opaque. Offi's example is kind of cute, but
- 13:21Speaker 1: think about it for a moment. The difference between a
- 13:23Speaker 1: baby holding an electric toothbrush and a small boy holding
- 13:27Speaker 1: a baseball bat could also be in Afghanistan, the difference
- 13:31Speaker 1: between Paul Shepherd and militant, in other words, the difference
- 13:35Speaker 1: between life and death. Yeah, and it's a bit daunting
- 13:39Speaker 1: that we are becoming more reliant on something that we
- 13:42Speaker 1: continue not to understand fully, don't you think absolutely and
- 13:46Speaker 1: Henry kissing you actually wrote a piece on this for
- 13:47Speaker 1: the Atlantic called how the Enlightenment Ends Big Stuff for Sure,
- 13:52Speaker 1: Hetty and what's kissing You? He argued that because we're
- 13:56Speaker 1: unable to interrogate the output of algorithms, as we rely
- 13:59Speaker 1: on them more immorti classify the world around us, we
- 14:01Speaker 1: may actually start to lose the ability to reason for ourselves.
- 14:04Speaker 1: It's not inevitable though, that AI will always be opaque.
- 14:08Speaker 1: The EU are actually working on this policy that decisions
- 14:11Speaker 1: made by AI need to be explainable to people they affect.
- 14:15Speaker 1: That may be a policy that's easier said than done.
- 14:18Speaker 1: Although the so called next wave of AI is all
- 14:21Speaker 1: about explainable AI, and it's actually a major initiative right
- 14:24Speaker 1: now at DAPPA. Here's off the again. Explainable AI has
- 14:29Speaker 1: been part of starting an entire new field of inquiry
- 14:33Speaker 1: and artificial intelligence to couple that kind of statistical power
- 14:37Speaker 1: that machine learning systems have with systems that explain how
- 14:42Speaker 1: they got the results that they got. In order for
- 14:44Speaker 1: us human users to be able to know when to
- 14:47Speaker 1: trust those machine learning systems and when not to trust them.
- 14:51Speaker 1: What authe is describing would be a huge breakthrough in AI.
- 14:55Speaker 1: Understanding how neural networks make their decisions would allow us
- 14:59Speaker 1: to honess the power the technology much more safely, and
- 15:02Speaker 1: not just on the battlefield. When we come back, we
- 15:06Speaker 1: look at how much of the technology we take for
- 15:07Speaker 1: granted in our everyday lives actually originated in the military.
- 15:17Speaker 1: So DARPA, the defense agency with an annual budget of
- 15:21Speaker 1: three point five billion dollars, its motto is to cast
- 15:25Speaker 1: a javelin into the infinite spaces of the future. What
- 15:29Speaker 1: you may not know is how much of the technology
- 15:32Speaker 1: we all use every day came right out of Darper.
- 15:36Speaker 1: I think about this every time I use my smartphone
- 15:39Speaker 1: because that's a beautiful, seamless integration of a whole host
- 15:43Speaker 1: of technologies that were sparked many many years ago by Darper.
- 15:48Speaker 1: So the chip in your cell phone that talks to
- 15:52Speaker 1: the cell tower is based on materials and electronics technology
- 15:56Speaker 1: that was developed for communications, and radar systems that up
- 16:00Speaker 1: that knows when you've rotated your phone is MEM's technology
- 16:03Speaker 1: that had huge early support from DARPA. But also Series
- 16:07Speaker 1: or other intelligent agents are based on the artificial intelligence
- 16:12Speaker 1: research that was done. But what fueled this wave of
- 16:15Speaker 1: incredible innovation at DAPPA. Well, actually, war DARPA is a
- 16:22Speaker 1: very American concept. In nineteen fifty seven, the Soviet Union
- 16:27Speaker 1: put the first artificial satellite on orbit. That was Sputnik.
- 16:31Speaker 1: There was a lot of excitement because human beings had
- 16:33Speaker 1: never done that before, but of course also quite a
- 16:36Speaker 1: shock for the United States at the height of the
- 16:38Speaker 1: CULD WARP. Sputnik was a reminder that in addition to
- 16:42Speaker 1: working on the problems that you knew you had, you
- 16:45Speaker 1: also needed to have people who came to work every
- 16:47Speaker 1: day to think about those kinds of technological surprises. And
- 16:51Speaker 1: so DARPA was started as a reaction to that technological
- 16:56Speaker 1: surprise of Sputnik. It's mission for sixty years has been
- 17:00Speaker 1: to create those kinds of technological surprises, and its history
- 17:05Speaker 1: is one in which it's accomplished that mission. DARPA is
- 17:09Speaker 1: known as the place that made the early stages of
- 17:13Speaker 1: each revolution and artificial intelligence, and of course must memorably
- 17:17Speaker 1: for starting the ARPA net and writing the protocols that
- 17:21Speaker 1: became the Internet that we have today. Think about that
- 17:25Speaker 1: the technology that forms the architecture of our daily lives.
- 17:28Speaker 1: In the twenty one century, the Internet was created by
- 17:32Speaker 1: a defense agency whose mission was to outthink the Soviet Union,
- 17:36Speaker 1: and in some sense all of the technologies we've looked
- 17:39Speaker 1: at so far in Sleepwalkers are the outgrowth of Dapper's work.
- 17:43Speaker 1: What really enabled this was DARPA's decision to allow their
- 17:46Speaker 1: technology into the US private sector and to let entrepreneurs
- 17:50Speaker 1: build on top of it. Absolutely as vital was that
- 17:56Speaker 1: were the companies and the entrepreneurs and the investors who
- 17:59Speaker 1: saw that you could turn those those raw research results
- 18:03Speaker 1: into this seamless, beautiful product that we've now we all
- 18:07Speaker 1: live with all the time. Characters. Amazing to think just
- 18:11Speaker 1: how much a Silicon Valley really stands on the shoulders
- 18:13Speaker 1: of DARPA. But even outside of what we think of
- 18:16Speaker 1: as the tech world, there's plenty of examples of military
- 18:19Speaker 1: technology living with us. For example, microwaves, which were an
- 18:22Speaker 1: accidental byproduct of radar technology, and then as good old Rumba,
- 18:26Speaker 1: which was originally developed a mind sweeping technology and is
- 18:30Speaker 1: still a mind sweeping technology in my house. Um. Yeah,
- 18:34Speaker 1: you know. There's this concept of dual use technology, which
- 18:37Speaker 1: we've talked about a few times. It's the idea that
- 18:40Speaker 1: technology developed for the military can have civilian applications and
- 18:44Speaker 1: vice versa. We talked about this with blink identity and
- 18:46Speaker 1: facial recognition. Do you remember last year the project may
- 18:51Speaker 1: even walk out? Yeah, Google, right, So that was a
- 18:54Speaker 1: project for the Pentagon. Over three thousand employees protested that
- 18:57Speaker 1: they didn't want to develop that technology. Google pulled the
- 19:00Speaker 1: plug on the project. The problem is though that you know,
- 19:03Speaker 1: you can say you're developing you know, AI and target
- 19:06Speaker 1: recognition for the military. All you can say you're developing
- 19:10Speaker 1: AI to recognize what's happening in images. But it's the
- 19:13Speaker 1: same technology and once it gets into the wild, anyone
- 19:16Speaker 1: who wants can use it. And that's actually something that
- 19:18Speaker 1: Arthur you spoke about about innovation traveling from DARPA to
- 19:22Speaker 1: the private sector. Yeah, and now DARPA actually has this
- 19:25Speaker 1: younger sibling called the Defense Innovation Unit d i u X,
- 19:30Speaker 1: whose job is actually to invest and incubate technologies from
- 19:33Speaker 1: the private sector that could be helpful for defense. So
- 19:36Speaker 1: this is basically the bridge from Silicon Valley to d C,
- 19:40Speaker 1: which is taking things from the consumer space and applying
- 19:44Speaker 1: them for military use. And one of these technologies is
- 19:46Speaker 1: called Halo. They're basically headphones that electrify your brain in
- 19:50Speaker 1: order to stimulate growth. That's right. So I went to
- 19:55Speaker 1: Connecticut to test them out with former Navy Seal John Wilson,
- 19:59Speaker 1: OH a seal for twelve years. I've served in Iraq
- 20:03Speaker 1: multiple times, Afghanistan, I went to Mogadishue, and then South America.
- 20:08Speaker 1: As you can imagine, drug warfare is still a really
- 20:10Speaker 1: big issue, so we have military units down there to
- 20:13Speaker 1: combat the cartels. We were gone three hundred days out
- 20:16Speaker 1: of the year training and then we were deployed from
- 20:19Speaker 1: once on end. So that's what we lived, breathed day
- 20:23Speaker 1: in and day out. We weren't going home at night.
- 20:25Speaker 1: These days, John is back with his family and he's
- 20:28Speaker 1: especially interested in how new technology can help seals past
- 20:31Speaker 1: and present. One such technology is the Halo headset, which
- 20:35Speaker 1: d I u X invested in. The headset uses an
- 20:38Speaker 1: electric current to prime the brain for so called neuroplasticity,
- 20:42Speaker 1: in other words, the ability to learn and learn quickly.
- 20:46Speaker 1: For us, I've recognized and when we do a pistol draw,
- 20:49Speaker 1: that movement is a repetitive movement that we've done thousands
- 20:52Speaker 1: and thousands and thousands of times over and over again.
- 20:55Speaker 1: And what this does is it primes the brain to
- 20:58Speaker 1: learn those repetitive movements faster? And have you genuinely knows
- 21:01Speaker 1: the difference. When I first came across this, I've got
- 21:04Speaker 1: a bunch of seals together and went out to the range.
- 21:06Speaker 1: We neuro primed and we started shooting. So we got
- 21:09Speaker 1: the baseline. Did this for a month, looked at our
- 21:11Speaker 1: scores and our scores were light years better. And light
- 21:15Speaker 1: years I mean milliseconds, right, But milliseconds on the battlefield
- 21:17Speaker 1: equates the life or death. I may be as far
- 21:20Speaker 1: away from being a military person as anyone could be,
- 21:24Speaker 1: but John has kindly agreed to lead me through a
- 21:26Speaker 1: Navy seal workout. So what we have here it looks
- 21:29Speaker 1: like a beats headset right with some strange noduals. Yeah,
- 21:33Speaker 1: so what we have on the top has mentioned were
- 21:35Speaker 1: these little nods. What those do? Or those are going
- 21:38Speaker 1: to send a current into the cortex or frontal cortex
- 21:42Speaker 1: into your brain? Is that safe? That's a great question.
- 21:47Speaker 1: I'm gonna bypass that question. It's safe. Turns out it
- 21:51Speaker 1: is safe. It's been tested by Dapper and others. So
- 21:54Speaker 1: I had to put it on and John agreed to
- 21:56Speaker 1: help me use the headset to neuro prime before putting
- 21:59Speaker 1: me through my pace is all right, let's let's crank
- 22:01Speaker 1: it up so you can. So it's probably a good
- 22:04Speaker 1: I don't know if you can feel a difference there,
- 22:05Speaker 1: but we've got twenty minutes of neuro priming. It feels
- 22:07Speaker 1: like something pinching in my head a bit. Yeah, it's not.
- 22:10Speaker 1: It's not a comfortable feeling, right, yeah, and you imagine, no,
- 22:14Speaker 1: you never do. But it's worth it, right, What is
- 22:17Speaker 1: that uncomfortable sensation? What's happening that? That's electricity? Yea, so
- 22:20Speaker 1: it's it's going into your brain right now, and it's
- 22:23Speaker 1: getting your brain into a state of neuroplasicity. Hyper Learning,
- 22:26Speaker 1: essentially is what that state allows you to do, and
- 22:28Speaker 1: it just allows you to learn faster and learn more information.
- 22:32Speaker 1: After a warm up, which was in fact a lot
- 22:35Speaker 1: more intense than my normal workout, two three, come on up,
- 22:39Speaker 1: drive up and hold right still the warm up, Yes,
- 22:44Speaker 1: it's still the warm up, it was time to take
- 22:46Speaker 1: the headset off and start the real thing. Or so
- 22:50Speaker 1: I thought, all right, it's already to keep going. You
- 22:58Speaker 1: can do twenty reps. So oh my god, oh god, ah,
- 23:09Speaker 1: those people's not do what hell weeks like I thinks
- 23:15Speaker 1: be worse than this. Yeah, why do you ask? John? Thankfully,
- 23:24Speaker 1: the workout came to an end and without any injury. Though,
- 23:28Speaker 1: to be honest, I couldn't tell if the neuropriming had
- 23:30Speaker 1: worked for me. Because halo enhances the brain's ability to learn,
- 23:34Speaker 1: Studies show best results when it's used over time. In
- 23:37Speaker 1: other words, if I wore the headset before every workout,
- 23:40Speaker 1: I might start to notice the difference in how quickly
- 23:42Speaker 1: I performed. But somehow I trusted John talking about the
- 23:46Speaker 1: draw time for his weapons. So the battle feels Afghanistan
- 23:51Speaker 1: rugs Syria. It's my happy place. Yeah, who can understand that?
- 23:58Speaker 1: It's my happy place because around people that I know
- 24:01Speaker 1: would do anything for me that I love me and
- 24:03Speaker 1: I love them for John. Being on the battlefield wasn't
- 24:07Speaker 1: the hardest part leaving. It was transition and is not
- 24:11Speaker 1: an easy thing. It's the hardest thing I've ever done.
- 24:14Speaker 1: When we transition, we do it by ourselves. We're trying
- 24:17Speaker 1: to solve a complex problem, which we love to do.
- 24:19Speaker 1: But normally when that takes place, you have your team
- 24:22Speaker 1: around you and you're going to figure it out because
- 24:25Speaker 1: you know you'll never let the person the left and
- 24:26Speaker 1: right of you down. When you're trying to do this
- 24:28Speaker 1: by yourself, you have nobody to talk to. When it
- 24:30Speaker 1: starts getting heart and you go dark is what we
- 24:32Speaker 1: call us. So we go into our shell. We we
- 24:34Speaker 1: kind of ostracize ourselves from society and and that's when
- 24:38Speaker 1: bad stuff starts happening. John recools a recent narrow escape
- 24:42Speaker 1: for one of his Sealed comrades. He was a Seal
- 24:46Speaker 1: Team six guy and um ended up going through divorce.
- 24:50Speaker 1: He had a newborn that he had to stay home
- 24:52Speaker 1: and take care of, so he went to a really
- 24:54Speaker 1: dark place. He just called me in unbeknownst to me,
- 24:56Speaker 1: it just put his son to bed and he was
- 24:57Speaker 1: sitting in the car with a pistol. I didn't know that.
- 25:00Speaker 1: I'm just picked up the phone and asked him how
- 25:02Speaker 1: he was doing, and he said he's doing okay, but
- 25:05Speaker 1: he needs some help. I said, we got your brother,
- 25:07Speaker 1: That's all I said. And that was enough for him
- 25:10Speaker 1: to put that gun away, go back inside and take
- 25:12Speaker 1: care of that little guy. Just me saying we got you.
- 25:15Speaker 1: That camaraderie saved John's friends life, but returning veterans need
- 25:20Speaker 1: something more than community. They need a purpose, a mission,
- 25:24Speaker 1: and that can be hard to find in civilian life.
- 25:26Speaker 1: You don't know you're fit, you don't know your rule
- 25:28Speaker 1: in the family, in your tribe, you don't know your
- 25:30Speaker 1: rule in society, and you're just trying to get by
- 25:33Speaker 1: to put food on the table. And there's there's a
- 25:34Speaker 1: void there now. And according to John, that's where Halo
- 25:39Speaker 1: comes in. Just because we're steals doesn't mean we all
- 25:41Speaker 1: want to end up doing security work. There's a lot
- 25:43Speaker 1: of people that wanted to maybe go in to finance
- 25:45Speaker 1: or be a lawyer. Halo allows us to succeed and
- 25:49Speaker 1: accelerate at that process. So if it's people want to
- 25:52Speaker 1: go back to school putting a Halo headset on before
- 25:54Speaker 1: you study, people maybe wanting to get a job that
- 25:58Speaker 1: requires multiple languages, you can throw on the halo and
- 26:02Speaker 1: pick up those language at an accelerated pace. Do you
- 26:04Speaker 1: think it's more powerful as something to believe in, like
- 26:08Speaker 1: if I put this headset on, like achieve my goals?
- 26:11Speaker 1: Is more powerful? Is a technological solution or is it
- 26:13Speaker 1: somewhere in between those two things? I think it's probably
- 26:16Speaker 1: both right. So our Strength and Conditioning coach and the
- 26:19Speaker 1: steel teams. He had a bottle p E is what
- 26:22Speaker 1: he wrote on it, which stood for placebo effect. It
- 26:26Speaker 1: was just water, but guys would come over and saying
- 26:29Speaker 1: their herd and he would just spare a little bit
- 26:30Speaker 1: of this water on them and they would every single
- 26:33Speaker 1: time would walk away like, oh I feel better, thanks, coach.
- 26:35Speaker 1: My point is is the research their supports that this
- 26:38Speaker 1: actually works. But who gives a ship even if it didn't,
- 26:40Speaker 1: because people are going to believe in themselves and that's part.
- 26:43Speaker 1: That's the bottle of my opinion. If it takes a
- 26:46Speaker 1: headset to get there, then great, but we know that
- 26:48Speaker 1: this headset works is going to help accelerate you atue
- 26:50Speaker 1: in that goal. We've talked about dual use in terms
- 26:54Speaker 1: of military technology that enters the civilian world and vice versa,
- 26:58Speaker 1: and Halo is just that a consumer product that is
- 27:01Speaker 1: also used by the armed forces, but it has a
- 27:04Speaker 1: much more profound dual use. It can save soldiers lives twice,
- 27:09Speaker 1: the first time on the battlefield where shaving milliseconds of
- 27:12Speaker 1: reaction time coming the difference between life and death, and
- 27:15Speaker 1: the second time when they return home. Haylo can help
- 27:19Speaker 1: them develop new skills and perhaps even more importantly, give
- 27:22Speaker 1: them the hope they need to keep going. When we
- 27:25Speaker 1: come back, we return to Darper and how to ensure
- 27:28Speaker 1: that we design new military technologies with worst case scenarios
- 27:32Speaker 1: top of mind. One of the central contentions of Sleepwalkers
- 27:44Speaker 1: is that our creations reflect us, and knowing this, we
- 27:47Speaker 1: need to be deliberate about how we tell them to
- 27:49Speaker 1: behave We're talking episode three of this series, The Watchman
- 27:53Speaker 1: about automation bias, the very human habit of treating the
- 27:57Speaker 1: output of computers as infallible even while ignoring the inputs
- 28:01Speaker 1: that we've given them. And recognizing this, Arthur made it
- 28:04Speaker 1: a central tenet of her tenure at Dapper to argue
- 28:07Speaker 1: that technology is not inevitable. There's a tendency to give
- 28:13Speaker 1: the active role to the technology. It's what the AI
- 28:16Speaker 1: will do to us. I want to keep bringing us
- 28:20Speaker 1: back to the fact that these technologies are our creations.
- 28:24Speaker 1: They're built by human beings. We have this enormous privilege
- 28:28Speaker 1: that we get to work on the powerful technologies that
- 28:31Speaker 1: can shape the progress of our societies. That privilege comes
- 28:36Speaker 1: with a responsibility to ask what could possibly go wrong?
- 28:40Speaker 1: What could possibly go wrong? It's a legitimate question, but
- 28:44Speaker 1: there's also a reason it's become a meme. It's notoriously
- 28:48Speaker 1: hard to answer. This is especially true in times of war,
- 28:52Speaker 1: when new technologies are often rushed into action without being
- 28:55Speaker 1: fully understood. Here's poor Shari again. Old War one is
- 29:00Speaker 1: a a wonderful, a terrible, um example of what can
- 29:04Speaker 1: happen when we see new technologies change warfare in ways
- 29:10Speaker 1: that policymakers were not prepared for. You know, the Industrial
- 29:14Speaker 1: Revolution brought not just you know, locomotives, but also um,
- 29:18Speaker 1: you know, cars, tanks, airplanes, machine guns that then were
- 29:23Speaker 1: used to industrialized warfare in a totally new way that
- 29:27Speaker 1: dramatically change this scale and the speed of killing that
- 29:31Speaker 1: was possible. The Gatling gun. People still had to crank
- 29:34Speaker 1: the gun, but then it automated the process of loading
- 29:37Speaker 1: and firing bullets. We began this episode talking about the
- 29:41Speaker 1: new dangers posed by automated weapons. Well, the Gatling gun
- 29:45Speaker 1: was actually one of the world's first, and as Paul
- 29:48Speaker 1: told us, its invention had a ripple effect that its
- 29:51Speaker 1: inventor could not have foreseen. The inventor, Richard Gatling, did
- 29:55Speaker 1: this to save lives. He was looking at um people
- 30:00Speaker 1: were coming back wounded and killed from the American Civil War.
- 30:03Speaker 1: He wanted to build a machine that could reduce the
- 30:06Speaker 1: number of soldiers that were needed on the battlefield as
- 30:09Speaker 1: a way to save lives. And that sounds like, you know,
- 30:12Speaker 1: a very well meaning idea and in practice, um as
- 30:16Speaker 1: the Gatlin gun involved into the machine gun. In World
- 30:19Speaker 1: War One, we saw a scale of killing that was
- 30:21Speaker 1: just unprecedented and in a whole a whole generation of
- 30:25Speaker 1: European man wiped out a battlefield. And so I think
- 30:29Speaker 1: it's it's an important cautionary tale for our ability to
- 30:32Speaker 1: predict how this technology will be used. The name of
- 30:36Speaker 1: this podcast, Sleepwalkers, is borrowed from a book called The Sleepwalkers,
- 30:41Speaker 1: How Europe Went to War in nineteen fourteen, written by
- 30:44Speaker 1: the historian Christopher Clark. And one of the big questions
- 30:47Speaker 1: I've been asking is, are we had a moment like
- 30:50Speaker 1: we were on the eve of World War One when
- 30:52Speaker 1: we haven't fully understood the implications of our new technology.
- 30:56Speaker 1: I asked Richard Danzig, the former Navy secretary, about the anels.
- 31:01Speaker 1: There is an analogy from World War One. European military
- 31:05Speaker 1: leaders developed mobilization plans to increase their own capabilities in
- 31:11Speaker 1: the event of an attack, and they underestimated the degree
- 31:16Speaker 1: to which that created rigidities and interactions, so that in
- 31:20Speaker 1: the end, the railroad timetables generated a war that perhaps
- 31:25Speaker 1: no one intended to be engaged in. People think that
- 31:28Speaker 1: they're driving the card, and in reality, the horses of
- 31:34Speaker 1: technology are frequently pulling us in directions that we don't
- 31:38Speaker 1: anticipate and can't control. So are we better place now
- 31:43Speaker 1: to understand the implications of AI and new technology for
- 31:46Speaker 1: global conflict than Europe was in ur I don't believe
- 31:51Speaker 1: our understanding of AI is greater than their understanding At
- 31:55Speaker 1: that point, we will make these mistakes too. I cannot
- 31:59Speaker 1: ask to make their significance or their frequency, but I'm
- 32:03Speaker 1: rather confident we will lose control, that we will make
- 32:07Speaker 1: mistakes of that kind and cause unintended consequences. So to me,
- 32:13Speaker 1: the interesting question is not can I predict their frequency?
- 32:18Speaker 1: The interesting question is what can I do in advance
- 32:22Speaker 1: if I recognize that it's one of them. Is well
- 32:25Speaker 1: represented by the darkast Safe Chaine project that government agency
- 32:31Speaker 1: is saying if people edit genes, but it turns out
- 32:34Speaker 1: they escape into the environment and proliferate. How do we
- 32:39Speaker 1: program them to begin with so that we can shut
- 32:42Speaker 1: them off? When it's so difficult to predict how new
- 32:46Speaker 1: technologies will be used and misused, it's hugely important that
- 32:50Speaker 1: we build precautions while they're still being researched and developed.
- 32:54Speaker 1: Is difficult, but we have to do our best to
- 32:56Speaker 1: anticipate the future dangers of a technology long before potential
- 33:00Speaker 1: deployment on the battlefield. Thankfully, that philosophy governed Arthur Prabaka's
- 33:05Speaker 1: work at DAPPER. What we developed was a way of
- 33:09Speaker 1: grappling with the ethical implications of these technologies. It started
- 33:13Speaker 1: by being open with ourselves, not just about our hopes
- 33:16Speaker 1: for the technology, but also our fears, and looking at
- 33:20Speaker 1: each other in the eye and saying, here's what we
- 33:22Speaker 1: think really is possible, but also here's what could really
- 33:25Speaker 1: go wrong. Were there any specific programs that you were
- 33:29Speaker 1: tempted by as a technologist, but in the end you
- 33:32Speaker 1: had to kill because they didn't meet your ethical standards.
- 33:36Speaker 1: I don't really have anything to say about that. The
- 33:38Speaker 1: answer is yes, but I can't give you an example
- 33:40Speaker 1: because it was classified. Karen, we've talked about the design
- 33:44Speaker 1: phase and thinking from r and d onwards about making
- 33:47Speaker 1: new weapons system safe. But it doesn't always work out
- 33:51Speaker 1: that way. Yeah, the genie does have a habit of
- 33:53Speaker 1: getting out of the bottle. Um. We've talked about dual
- 33:56Speaker 1: use before. Even seemingly benign technologies can be hugely destructive.
- 34:02Speaker 1: The one that blows my mind is the sort of
- 34:03Speaker 1: Arthur Galston, who was a plant biologist who discovered while
- 34:07Speaker 1: he was a graduate student, this compound that helps soybeans
- 34:10Speaker 1: flower faster. He also learned that if this compound were
- 34:13Speaker 1: applied in excess, that it would cause the plant to
- 34:16Speaker 1: shed its leaves. And when Galston discovered this defoliant effect,
- 34:21Speaker 1: that's what was abused by biological warfare scientists who would
- 34:25Speaker 1: then go on to develop Agent orange. I just got
- 34:28Speaker 1: back from a trip to Vietnam actually, where the effects
- 34:31Speaker 1: of Asian orange is still being felt. It's actually a
- 34:34Speaker 1: gene toxin which causes deformities through the generations. So that
- 34:37Speaker 1: is a truly horrific one, Kara, And it makes us
- 34:40Speaker 1: think it wasn't those chemists who were releasing agent orange
- 34:43Speaker 1: over Vietnam, it was the US military. So the idea
- 34:46Speaker 1: of the person who creates the technology gets to control
- 34:49Speaker 1: what happens to it is simply not the case, and
- 34:51Speaker 1: so we need to move forward with the assumption that
- 34:53Speaker 1: AI weapons will leave the laboratory and exists in the world.
- 34:57Speaker 1: And the central question is how helpful it to have
- 35:00Speaker 1: a human in the loop. Well, according to Richard Danzigg,
- 35:04Speaker 1: humans are of increasingly limited utility. I think there are
- 35:10Speaker 1: circumstances where human control is useful, but I don't think
- 35:14Speaker 1: that's the most useful approach. And the reason for that
- 35:18Speaker 1: is because the power is in the machine. So many
- 35:22Speaker 1: decisions that we care about are made at extraordinarily high speed,
- 35:27Speaker 1: and it just isn't time for the humans to assimilate
- 35:30Speaker 1: them and make correct judgments. Even the president declaring or
- 35:35Speaker 1: not nuclear war and responding might have fifteen minutes to
- 35:40Speaker 1: make a judgment. In other words, the whole idea of
- 35:44Speaker 1: a human in the loop making the final cool is
- 35:47Speaker 1: something of an illusion. At the very least, it relies
- 35:50Speaker 1: on us making wise decisions at lightning speed and under pressure.
- 35:54Speaker 1: And there's another problem. All of the information people like
- 35:57Speaker 1: the president used to make decisions has already been filtered
- 36:01Speaker 1: through several computer systems. So when the president reviews information
- 36:05Speaker 1: to make a tactical choice. He or she is already
- 36:08Speaker 1: relying on automation. He's extraordinarily dependent on what the machines
- 36:13Speaker 1: are telling him, what the sensors are interpreted to him,
- 36:17Speaker 1: and what the algorithms say the trajectories of missiles that
- 36:21Speaker 1: have been launched. So realistically, he's on the cart being
- 36:25Speaker 1: pulled by the horses of these technologies. UM. If that's
- 36:30Speaker 1: true for the president, think what it's like for the
- 36:32Speaker 1: person who's a sergeant in the field manning Patriot Missile Battalion. UM.
- 36:39Speaker 1: And it shows incoming missiles he has seconds or at
- 36:43Speaker 1: best minutes to respond and has to make decisions. We
- 36:47Speaker 1: know how fallible we are as decision makers, and we
- 36:51Speaker 1: know how dependent we already are on computer systems to
- 36:54Speaker 1: guide our decisions. So what can we do to prevent
- 36:57Speaker 1: ourselves from stumbling into a conflict that no one wants?
- 37:02Speaker 1: But I think we need to recognize that science is
- 37:05Speaker 1: now diffused around the globe, and we need a common
- 37:09Speaker 1: kind of understanding about how to reduce these risks, And
- 37:13Speaker 1: then we need some joint planning for the contingency that
- 37:17Speaker 1: these do escape. What do we do if a newly
- 37:20Speaker 1: engineered genetic system gets out there into the wild. Well,
- 37:26Speaker 1: that's not just a problem for the Chinese. If it
- 37:28Speaker 1: happens to happen in China, technology spreads, it gets modified, copied,
- 37:33Speaker 1: and hacked, and once something is out of the lab
- 37:36Speaker 1: is anyone's guess as to what happens. And countries are
- 37:39Speaker 1: slowly trying to establish standards for AI. But as Paul
- 37:43Speaker 1: Shari argues, creating a global framework governing AI in warfare
- 37:47Speaker 1: is a tool order. It's a very hard area to
- 37:50Speaker 1: think about. How do we mitigate that risk because countries
- 37:54Speaker 1: are not going to talk about the things that they're
- 37:56Speaker 1: doing in cyberspace and the fine angel sector. They've installed
- 38:01Speaker 1: things like circuit breakers that would take stocks offline if
- 38:04Speaker 1: the price moves too quickly. Well, there's no referee to
- 38:07Speaker 1: call time out in warfare. So if we're going to
- 38:10Speaker 1: manage those risks in the military space, does have to
- 38:13Speaker 1: be circuit breakers, uh if you will that people build
- 38:17Speaker 1: into our own weapons systems limits on them, ways to
- 38:20Speaker 1: interject human control to maintain control if things begin to
- 38:24Speaker 1: move in unexpected ways. And it's worth acknowledging really upfront
- 38:28Speaker 1: that there's a trade off there that every time that
- 38:32Speaker 1: a military puts guard rails on a weapon system or
- 38:37Speaker 1: inserts a human in the loop as a check. That's
- 38:40Speaker 1: potentially slowing down the effectiveness of their weapon. And there's
- 38:44Speaker 1: a risk that they are going to be afraid that
- 38:47Speaker 1: an adversary might not do that and might get an
- 38:49Speaker 1: edge on them. And that dynamic is really the crux
- 38:52Speaker 1: of the problem here. It's hard to get to a
- 38:55Speaker 1: place where countries um trust each other enough to engage
- 38:59Speaker 1: in mute all frustrain. But we may not have a choice.
- 39:03Speaker 1: Up until now, our defense policy has been based on
- 39:06Speaker 1: the assumption of technical superiority, and as our argues, we
- 39:10Speaker 1: can no longer rely on that. You have a model
- 39:13Speaker 1: that is based on owning all the technology and knowing
- 39:16Speaker 1: that no one else can have access to it for
- 39:18Speaker 1: two or three decades, and today those assumptions simply don't hold.
- 39:23Speaker 1: We are not the only people who can innovate right now.
- 39:27Speaker 1: The history of new technology and warfare is frankly disturbing.
- 39:31Speaker 1: When we create new weapons, we tend to use them.
- 39:34Speaker 1: We've talked about the atomic bomb in Japan, and about
- 39:37Speaker 1: poisonous gas in World War One, and even about the
- 39:40Speaker 1: Gatling gun, one of the world's first automated weapons designed
- 39:44Speaker 1: to reduce the number of combatants required to wage war.
- 39:47Speaker 1: It decimated an entire generation in Europe. We haven't yet
- 39:51Speaker 1: seen what happens when AI weapons systems begin to interact
- 39:54Speaker 1: with one another, but chances are we will in our lifetime.
- 39:59Speaker 1: So the pation in all of this can be to
- 40:01Speaker 1: desperately try to hit pools on new technology, but off,
- 40:05Speaker 1: y'all ues, that would be the wrong approach. Historically, we
- 40:09Speaker 1: are drawn forward by the enormous potential that these technologies
- 40:15Speaker 1: can enhance our lives, and at the same time we're
- 40:18Speaker 1: we're repelled by the consequences that we understand could be
- 40:24Speaker 1: fundamentally wrong. So I think that's the tension. But in
- 40:29Speaker 1: aggregate and over time, I do think that technology has
- 40:33Speaker 1: lifted us up, has advanced us. You know, when you
- 40:36Speaker 1: play the parlor game of asking your friends what period
- 40:39Speaker 1: in history they would rather live in. I might want
- 40:42Speaker 1: to visit, but there's no other time in history I
- 40:45Speaker 1: want to live in. And I think the future is
- 40:47Speaker 1: going to be fraught with problems, and it's still going
- 40:50Speaker 1: to be a better place than the one that we're in.
- 40:53Speaker 1: It's true that technology has made so many parts of
- 40:56Speaker 1: our lives easier, healthier, and safer, and it's also true
- 41:00Speaker 1: that the technology we create has the potential to be
- 41:03Speaker 1: ever more destructive. We've talked about dual use in this episode,
- 41:08Speaker 1: and as a matter of fact, many DARPA programs have
- 41:11Speaker 1: found their way into revolutionizing medicine. In the next episode,
- 41:15Speaker 1: we look at some of the incredible applications of AI
- 41:17Speaker 1: in the world of healthcare, from accurately predicting time of
- 41:21Speaker 1: death to decoding the human genome. I'm Ozveloshin, See you
- 41:26Speaker 1: next time. Sleepwalkers is a production of our Heart Radio
- 41:41Speaker 1: and unusual productions. For the latest AI news, live interviews,
- 41:45Speaker 1: and behind the scenes footage. Find us on Instagram, at
- 41:48Speaker 1: Sleepwalker's podcast or at sleepwalkers podcast dot com. Sleepwalkers is
- 41:54Speaker 1: hosted by me oz Veloshin and car hosted by me
- 41:57Speaker 1: Kara Price. Were produced by Julian Weller with help from
- 42:00Speaker 1: Jacopo Penzo and Taylor Chacogne. Mixing by Tristan McNeil and
- 42:04Speaker 1: Julian Weller. Our story editor is Matthew Riddle. Recording assistance
- 42:07Speaker 1: this episode from Chris Hambroke and Jackson Bierfeld. Sleepwalkers is
- 42:11Speaker 1: executive produced by me Osvaloschen and Mangesh Hattikiller. For more
- 42:15Speaker 1: podcasts from my Heart Radio, visit the I heart Radio app,
- 42:18Speaker 1: Apple Podcasts, or wherever you listen to your favorite shows.