Latest / kill switch / Sleepwalking
Transcript
- 0:01Speaker 1: Sleep Walkers is a production of I Heart Radio and
- 0:04Speaker 1: Unusual Productions. So I mean, let's just ground the conversation
- 0:10Speaker 1: for a second. There's two point two billion people who
- 0:13Speaker 1: use Facebook. It's about the size of Christianity. There's one
- 0:16Speaker 1: point nine billion people who use YouTube. It's about the
- 0:19Speaker 1: size of Islam. That's Tristan Harris. When I walk into
- 0:22Speaker 1: that Facebook room, you know, I'm walking into a room
- 0:25Speaker 1: that's designed to never make me leave with a thousand
- 0:28Speaker 1: engineers using supercomputers to calculate the perfect seductive thing to
- 0:32Speaker 1: put in front of my brain. And Tristan knows a
- 0:35Speaker 1: thing or two about seduction. I was a design ethosistic
- 0:38Speaker 1: Google and have spent a decade understanding some of the
- 0:41Speaker 1: invisible forces that shape the way that we see and
- 0:44Speaker 1: make sense of the world and choose in the world.
- 0:46Speaker 1: In case you're wondering they teach this stuff in school, well,
- 0:50Speaker 1: they do at Stanford. I studied at this lab called
- 0:53Speaker 1: the Stanford Persuasive Technology Lab that teaches engineering students about
- 0:57Speaker 1: the entire discipline of persuasion. Everything you know how to
- 1:00Speaker 1: persuade dogs with clicker training, So click click, you know
- 1:03Speaker 1: you've got the food. Click click, reward all the way
- 1:05Speaker 1: to casino design and slot machines, and how do you
- 1:07Speaker 1: change the lighting to get people to buy things? And
- 1:09Speaker 1: then you know supermarket design and choice architecture and putting
- 1:12Speaker 1: the candy in the final aisle, because that's the thing
- 1:14Speaker 1: that gets you to buy. Tristan and his classmates used
- 1:17Speaker 1: what they learned at the Persuasive Technology Lab to define
- 1:21Speaker 1: how we live online. My partners in that class, and
- 1:24Speaker 1: two thousands of sex at Stanford were the founders of Instagram.
- 1:27Speaker 1: Half my friends built some of these products and then
- 1:29Speaker 1: to the like button. Think about that for a moment.
- 1:32Speaker 1: The people who designed the apps we use the most
- 1:35Speaker 1: learned how to make them as appealing as possible by
- 1:38Speaker 1: borrowing the science that trains dogs and gets people hooked
- 1:42Speaker 1: on gambling. And now all of that is baked into
- 1:44Speaker 1: a device that's basically become an extension of our body.
- 1:48Speaker 1: We check our phones about eighty times a day, that's
- 1:51Speaker 1: the conservative number. And you know their incentive is to
- 1:54Speaker 1: calculate what is the perfect most seductive thing I can
- 1:57Speaker 1: show you next to the most seductive red color for
- 2:00Speaker 1: that notification, or the most seductive video that you know
- 2:03Speaker 1: you can't help but want to watch next. At a
- 2:06Speaker 1: time when technology is changing faster than our ability to
- 2:09Speaker 1: understand it and seeping into nearly every corner of our lives,
- 2:13Speaker 1: what kind of murky future are we sleepwalking into? What
- 2:17Speaker 1: can we do to take back some control? And how
- 2:19Speaker 1: is emerging technology changing our lives for the better. This
- 2:24Speaker 1: is Sleepwalkers, So welcome. I'mrs and I'm doing this show
- 2:39Speaker 1: because I'm fascinated with how we relate to the technologies
- 2:42Speaker 1: that they're changing our lives, whether they end up being
- 2:45Speaker 1: something like Dr Frankenstein's Monster or ai craft it seltzer Water.
- 2:49Speaker 1: In this episode, we look at how our technology gets
- 2:52Speaker 1: into our heads and we take on some distinctly modern monsters,
- 2:56Speaker 1: from the trick to successful online dating to deterring potential
- 3:01Speaker 1: terrorists with invisible technology. And I'll have some company along
- 3:05Speaker 1: the way. Hi. That's Kara Price. She's my friend and
- 3:10Speaker 1: she hosted a show called Talk Nerdy to Me for
- 3:13Speaker 1: the Huffington Post. Um. So, I saw this article on
- 3:15Speaker 1: the Times, the New York Times about how all of
- 3:19Speaker 1: these Silicon Valley exacts are taking away their kids screen time,
- 3:23Speaker 1: you know, telling their kids nanny's that the nanny can't
- 3:26Speaker 1: use screens. And there's actually this quote from Mark Zuckerberg's
- 3:30Speaker 1: former executive assistant, this woman Athena Tivaria. She says, I
- 3:35Speaker 1: am convinced the devil lives in our phones and is
- 3:38Speaker 1: wreaking havoc on our children. Is that like the devil
- 3:41Speaker 1: is in the details, or is it like the devil
- 3:43Speaker 1: who lives in hell? No? I think it's the red
- 3:45Speaker 1: devil who wears no clothes that guys in the phone. Yeah,
- 3:48Speaker 1: because you know what he does. It leaves people in temptation.
- 3:51Speaker 1: That's right, that's the devil's show. That's really right, and
- 3:53Speaker 1: it is have you ever seen a child on an iPad?
- 3:55Speaker 1: Have you ever seen me? Well, have you ever seen me? Yes? Mesmerized,
- 3:58Speaker 1: clickity clack, don't come back, actually showing Pocca, who's the
- 4:01Speaker 1: first president of Facebook, said God only knows what it's
- 4:05Speaker 1: doing to our children's brains. Got on the devil. Here's
- 4:09Speaker 1: all of these technology executives who have built basically what
- 4:14Speaker 1: we use every day to do everything from being in
- 4:17Speaker 1: touch with our friends to meeting our loves to getting
- 4:20Speaker 1: from A to B. And suddenly they're saying, well, you guys,
- 4:23Speaker 1: go ahead, but not for my kids. Yeah, yeah. I
- 4:26Speaker 1: think it's interesting that this feels very similar to the
- 4:29Speaker 1: conversation we have surrounding you know, junk food, sugar, tobacco, alcohol,
- 4:33Speaker 1: that these are things that your parents are supposed to
- 4:36Speaker 1: protect you from up until a certain point, whether it's
- 4:39Speaker 1: when you go to college or whatever. And now our
- 4:42Speaker 1: technology used, whether it be how much we're on social
- 4:44Speaker 1: media or how much time we're spending gaming on our screens,
- 4:48Speaker 1: is something that parents have to regulate. The problem is
- 4:51Speaker 1: one like I'm too old for my parents to regulate it,
- 4:53Speaker 1: so so what am I going to do? And also
- 4:55Speaker 1: like my parents use it, so it is sort of
- 4:57Speaker 1: like sugar in the sense it's like there are parents
- 4:59Speaker 1: that tell their kids not each sugar who have major
- 5:01Speaker 1: sugar addictions. We had those conversations in the past, and
- 5:03Speaker 1: now we're starting to have them about technology. But how
- 5:06Speaker 1: do we tell our kids to regulate their use of technology?
- 5:09Speaker 1: And we can't regulate our own And wants to say
- 5:11Speaker 1: to us that we can't regulate our own technology. His
- 5:17Speaker 1: Cara with a story of what happens when you add
- 5:19Speaker 1: service think they know everything about you, but actually get
- 5:23Speaker 1: it all wrong. I just wrote the whole thing in
- 5:30Speaker 1: like thirty minutes just you know, banging the keyboard, just
- 5:37Speaker 1: sobbing the whole time. Dear tech companies. Gillian is a
- 5:41Speaker 1: social media power user. She uses Twitter for work at
- 5:44Speaker 1: the Washington Post and Facebook for her social calendar. Even
- 5:47Speaker 1: her wedding is on YouTube, and in late she was
- 5:51Speaker 1: entering the final months of her pregnancy. She and her
- 5:53Speaker 1: husband Bobby were doing the normal what to expect when
- 5:56Speaker 1: you're expecting stuff, preparing for their newborn son to come
- 6:00Speaker 1: into their lives. I can remember about two days before
- 6:04Speaker 1: everything happened, soaking in the tub, and I was just thinking, God,
- 6:10Speaker 1: this has just gone perfectly, Like I've never been accidentally
- 6:14Speaker 1: pregnant despite not always being responsible, and we had no
- 6:20Speaker 1: problem getting pregnant when we wanted to, despite my being
- 6:24Speaker 1: thirty eight. So I was just like, wow, one and done.
- 6:28Speaker 1: This totally worked. A couple of days later, I was
- 6:32Speaker 1: feeling some pain, so I called the doctor's office and
- 6:36Speaker 1: I said, well, I haven't felt a move today, and
- 6:40Speaker 1: they said, okay, come in, and so I went in
- 6:42Speaker 1: and they put me on the sonogram, and I knew immediately.
- 6:48Speaker 1: I was just screaming no, no, no. A week or
- 6:55Speaker 1: so after Gillian's sun died. She was being haunted by
- 6:58Speaker 1: targeted advertising ad that assumed she had given birth to
- 7:01Speaker 1: a healthy baby boy. When I would scroll through Facebook
- 7:05Speaker 1: or Instagram, I would get maternity where ads, and so
- 7:09Speaker 1: I was like, okay, I have to teach it that
- 7:11Speaker 1: I'm not pregnant anymore. Gillian did the only thing people
- 7:14Speaker 1: can do with ads they don't want to see. She
- 7:17Speaker 1: clicked the three dots in the corner of the ad
- 7:19Speaker 1: and gave feedback. So I would say I don't want
- 7:22Speaker 1: to see this ad, and then it would say why,
- 7:26Speaker 1: and I would say, because it's not relevant to me,
- 7:29Speaker 1: which is like so hard to acknowledge. But Gillian learned
- 7:32Speaker 1: the hard way that the Facebook algorithm isn't programmed for
- 7:35Speaker 1: the outcome of a still birth. Then when I god,
- 7:38Speaker 1: when I got that experienced email, I just I can't
- 7:41Speaker 1: even like I just snapped finished registering your baby for
- 7:45Speaker 1: lifelong credit tracking. I just I was just like, you
- 7:49Speaker 1: have got to be kidding me. Gillian was angry, and
- 7:53Speaker 1: she knew she had a platform, so she wrote the
- 7:56Speaker 1: letter and posted it on Twitter. Dear tech companies, I
- 7:59Speaker 1: know you knew I was pregnant. You probably saw me
- 8:02Speaker 1: googling maternity plaid and baby safe crib paint, and I
- 8:07Speaker 1: bet Amazon dot Com even told you my due date
- 8:10Speaker 1: when I created that prime registry, and silly me, I
- 8:14Speaker 1: even clicked once or twice on the maternity where ads
- 8:17Speaker 1: Facebook served up. What can I say, I'm your ideal
- 8:20Speaker 1: engaged user, but didn't you also see me googling baby
- 8:25Speaker 1: not moving? And then the announcement posts with key where
- 8:28Speaker 1: it's like heartbroken and problem and stillborn and the two
- 8:32Speaker 1: hundred tear drop emoticons from my friends. Gillian's letters struck
- 8:37Speaker 1: a chord. It got retweeted twenty eight thousand times, and
- 8:41Speaker 1: shortly after Gillian posted her letter to Twitter, she received
- 8:44Speaker 1: a response tweet from Facebook's VP of Ads, Rob Goldman.
- 8:49Speaker 1: I'm so sorry for your loss, he said, and you're
- 8:52Speaker 1: painful experience with our products. We have a setting available
- 8:55Speaker 1: that can block ads about some topics people may find painful,
- 8:59Speaker 1: including parenting. It still needs improvement, but please know that
- 9:02Speaker 1: we're working on it and welcome your feedback. So I
- 9:05Speaker 1: turned it off, and within a few hours I got
- 9:09Speaker 1: an ad for adoption agencies, and the next day I
- 9:15Speaker 1: got an ad for um father's son matching one sees.
- 9:21Speaker 1: I've taken screenshots to while every time I get one,
- 9:24Speaker 1: I just take a picture of it, just like it's
- 9:27Speaker 1: not working. Yeah, the adoption one g f y. You know,
- 9:33Speaker 1: Rob Goldman's advice may have changed the ads, but it
- 9:35Speaker 1: didn't solve the fundamental problem. The algorithms couldn't stop reminding
- 9:39Speaker 1: Gillian of her loss. Other people were like, well, don't
- 9:43Speaker 1: be on Facebook at all, you know, don't do any
- 9:45Speaker 1: of those things, And first of all, I don't think
- 9:48Speaker 1: that's realistic, especially because for Gillian, Facebook was also providing
- 9:53Speaker 1: comfort through it all. It was helpful to have my
- 9:56Speaker 1: friends timing in and saying, we're so sorry, you know,
- 10:00Speaker 1: what can we do? And you know, a bunch of
- 10:02Speaker 1: people made an Uber eats fund for me and my
- 10:05Speaker 1: husband so we could just have food delivered. While when
- 10:07Speaker 1: we got home it's like, you know, the twenty one
- 10:10Speaker 1: century bringing over lasagna. And this was all organized on Facebook. Yeah,
- 10:16Speaker 1: it was on Facebook, and ironically it helped her connect
- 10:19Speaker 1: with people going through the same thing. A woman who
- 10:21Speaker 1: used to go to my church, she had a still
- 10:23Speaker 1: birth on Christmas Day a few weeks after I did,
- 10:26Speaker 1: and the memorial service for her baby was posted to Facebook,
- 10:30Speaker 1: I wouldn't have known about it, and I wouldn't have
- 10:33Speaker 1: gone if I hadn't checked Facebook. Gillian isn't planning to
- 10:39Speaker 1: delete social media. She just wishes it could be better.
- 10:42Speaker 1: She's still going to use it to keep in touch
- 10:44Speaker 1: with friends and family. But whereas she was once comfortable
- 10:47Speaker 1: with her wedding on YouTube, there are now something she
- 10:50Speaker 1: won't be comfortable sharing. And I have to say, now
- 10:54Speaker 1: having this experience, you know, I knew it was being tracked,
- 10:58Speaker 1: but having the tracking revealed to me in such a
- 11:01Speaker 1: garish display. If we do have a living child someday,
- 11:05Speaker 1: I think that's going to be actually really easy for
- 11:08Speaker 1: me to just be like, no Internet, you don't get
- 11:11Speaker 1: to have that. Even after the experience. Gillian doesn't hate Facebook.
- 11:24Speaker 1: At the same time, she wouldn't want her future children tracked,
- 11:28Speaker 1: a bit like the Silicon Valley execs we talked about
- 11:30Speaker 1: earlier taking their own children off social media. But what
- 11:34Speaker 1: if the same targeting technology that harm Gillian could help
- 11:37Speaker 1: others and keep people who are hurting from damaging themselves
- 11:41Speaker 1: and society. And what if it wasn't a broad group
- 11:44Speaker 1: like new mothers being targeted by ad bots, but a
- 11:47Speaker 1: specific group of people having their personal search results changed.
- 11:52Speaker 1: I heard about a programmer Alphabet, Google's parent company trying
- 11:55Speaker 1: to do just that, and I wanted to know more.
- 11:58Speaker 1: We'll get there after the brain. My name is Yasmin Green.
- 12:09Speaker 1: I am the director of Research and Development at Jigsaw.
- 12:13Speaker 1: We are sitting in one of our rooms in our
- 12:16Speaker 1: New York office. The name of the meeting room is
- 12:19Speaker 1: Smoke Signal Communication Technology. Yeah, they're all named after different
- 12:25Speaker 1: communication technologies. Jigsaw is a part of Alphabet and Google
- 12:29Speaker 1: that's focused on technology that addresses big security challenges. So
- 12:34Speaker 1: how did Jigsaw begin? Two decades ago? When we were
- 12:37Speaker 1: designing the platforms and apps, we were not really imagining
- 12:41Speaker 1: that repressive governments and criminals and terrorist groups or like
- 12:46Speaker 1: salivating and about innovating to use these platforms just as
- 12:50Speaker 1: just as well as everyone else. Um. And now we
- 12:52Speaker 1: realize that we really need to understand their goals and
- 12:55Speaker 1: their activities if we want to keep people safe online.
- 12:57Speaker 1: It's Yasmin's job to look at how those repressive regimes,
- 13:01Speaker 1: criminals and terrorist groups operate, find trends and try to
- 13:05Speaker 1: counter them. Our approaches to try to understand the human
- 13:08Speaker 1: journeys and to understand the role of technology and see
- 13:10Speaker 1: if we can build technology that stops people getting to
- 13:14Speaker 1: the point that we would consider them of ident extremist
- 13:16Speaker 1: or a terrorist. So if you want to understand terrorists,
- 13:20Speaker 1: where do you start. Well, to better understand extremism, Yasmin's
- 13:24Speaker 1: team use some somewhat extreme methods themselves. One of the
- 13:28Speaker 1: first things we did in two thousand and eleven was
- 13:30Speaker 1: we brought together eighty four former extremists and survivors of terrorism.
- 13:36Speaker 1: And we had isn't a mist people who's going to
- 13:38Speaker 1: find Afghanistan or al Shabab from Somalia, Nigerian isna miss militia,
- 13:43Speaker 1: but we also had a form of violent Israeli settler.
- 13:45Speaker 1: We had form of Christian militia. We've got them one
- 13:47Speaker 1: together on one place. Can you imagine the security concern
- 13:52Speaker 1: for Google in helping us convene everyone in one place.
- 13:55Speaker 1: We had snipers on the roof, We had six months
- 13:57Speaker 1: vetting for everyone. We cared about them being public and
- 14:00Speaker 1: associated with an engine to bring people out of those
- 14:03Speaker 1: extremist groups. And beyond gathering all the former terrorists in
- 14:07Speaker 1: one place, Yasmin's team also invited the victims of terrorism.
- 14:12Speaker 1: We had survivors, So we had people who celebrated nine
- 14:14Speaker 1: eleven and people who had lost family members in eleven.
- 14:17Speaker 1: We had a lady who said that she had woken
- 14:21Speaker 1: up in hospital with a name band on her risk
- 14:23Speaker 1: that said gender unknown because her body was like so mutilated.
- 14:27Speaker 1: The point of bringing everyone together was to say what
- 14:29Speaker 1: is common in the human radicalization path even when you're
- 14:33Speaker 1: looking across ideologies, and does technology have a role to play?
- 14:39Speaker 1: In other words, Yasmin wanted to understand how people become
- 14:42Speaker 1: terrorists and what role the internet plays. But Chicksaw's role
- 14:46Speaker 1: was never just to have summits and collect the information.
- 14:49Speaker 1: They wanted to take action, and ISIS was the obvious
- 14:53Speaker 1: place to start. In March of this year, ISIS actually
- 14:56Speaker 1: lost the last of its remaining territory, but when the
- 15:00Speaker 1: left fate was that it's height. Thousands of foreign fighters
- 15:03Speaker 1: were recruited online. They left their homes in places like Germany, England,
- 15:07Speaker 1: America for the battle fields of Syria. This trip that
- 15:11Speaker 1: we took to Iraq, where we spoke to defectors of ISIS,
- 15:15Speaker 1: was really instructive for us. We had these face to
- 15:17Speaker 1: face conversations with these young men who had left home,
- 15:20Speaker 1: gone to Syria, and Iraq trained with ISIS, did their
- 15:24Speaker 1: religious indoctrination with ISIS, got their postings, some of them
- 15:27Speaker 1: as suicide bombers, some of them as technical drivers, some
- 15:30Speaker 1: of them as night watchmen. And they had realized that
- 15:33Speaker 1: it was all a lie. So they're telling us about it,
- 15:35Speaker 1: and we say, if you knew the day that you
- 15:38Speaker 1: left everything that you know and now, would you still
- 15:40Speaker 1: have gone? And they invariably said that they would still
- 15:44Speaker 1: have gone. Honestly, I'd already finished, he asked me in
- 15:49Speaker 1: a sentence. In my head, I thought she was going
- 15:52Speaker 1: to say, they invariably said that they wouldn't have gone,
- 15:55Speaker 1: but in fact, knowing they were facing not just heroic martyrdom,
- 16:00Speaker 1: red cues, lack of medical care, splintered leadership, they still
- 16:04Speaker 1: would have left the comfort of their home countries again
- 16:07Speaker 1: places like America, England, Canada, to travel to Syria, an
- 16:12Speaker 1: active war zone. So Jackson needed to understand what what
- 16:16Speaker 1: ICE is doing to lure people in that was so
- 16:18Speaker 1: very powerful. We identified the recruitment narratives and they were
- 16:21Speaker 1: largely around people who thought that this was the devout, correct,
- 16:25Speaker 1: religous thing to do, that this wasn't mslim utopia than
- 16:28Speaker 1: was going to lead to a healthier, happier life than
- 16:31Speaker 1: remaining in the West. People who are interested in the
- 16:34Speaker 1: military conflated. So there were several and we generated a
- 16:37Speaker 1: targeting strategy to reach these people based on their online browsing,
- 16:43Speaker 1: specifically like their online searches take a moment to absorb that.
- 16:47Speaker 1: Based on online browsing history and searches, Jigsaw were able
- 16:51Speaker 1: to identify potential extremists and serve them adds to push
- 16:55Speaker 1: them towards alternative content. But wouldn't that raise alarm bells
- 16:59Speaker 1: for the people do in the searching Yasmin and her
- 17:02Speaker 1: team had to be subtle. If you were interested in
- 17:05Speaker 1: fact was about Jahard, religious udics about Johard, we would
- 17:09Speaker 1: give you those originally, It's just not the ones that
- 17:11Speaker 1: Isis was proposing, but alternative ones. Or if you're interested
- 17:14Speaker 1: to understand what life is like in the Caliphate, let's
- 17:16Speaker 1: show you citizen journalism of the long cueues for bread
- 17:20Speaker 1: or the state of the hospitals in the Caliphate. So
- 17:22Speaker 1: you're still getting something that addresses your interest. Um, it
- 17:26Speaker 1: would just be an alternative information source to the one
- 17:29Speaker 1: that you were looking for and it was really important
- 17:31Speaker 1: to us to make sure that we were targeting, you know,
- 17:34Speaker 1: and finding people who were really at risk as opposed
- 17:36Speaker 1: to just people who are interested in isis that's right.
- 17:39Speaker 1: Looking at browsing and search history, Jigsaw and Google can
- 17:42Speaker 1: look at two different people looking up fatoas online and
- 17:45Speaker 1: only serve redirecting ads to one. When you get the
- 17:49Speaker 1: level more granular, you can start to set up a
- 17:52Speaker 1: targeting strategy that really does differentiate mainstream interest in this
- 17:55Speaker 1: group to the people who are you know, sympathetic and
- 17:59Speaker 1: potential join us. It has turned out to be really
- 18:02Speaker 1: effective since my conversation with Yasmin. A terrorist attack on
- 18:07Speaker 1: two mosques in Christchurch, New Zealand killed fifty people and
- 18:11Speaker 1: focus the world's attention on the threat posed by far
- 18:14Speaker 1: right terror. I emailed with Yasmin and she told me
- 18:18Speaker 1: that she and her team are quote attending to the
- 18:20Speaker 1: far right threat with increased urgency. I think it's nice
- 18:26Speaker 1: that they're trying to fix things, but you know, it's
- 18:28Speaker 1: like the Anhauser Busch family funding a study on alcohol, right,
- 18:32Speaker 1: I guess, except we kind of no alcohol is bad,
- 18:34Speaker 1: whereas we can still hope that the internet is neutral,
- 18:38Speaker 1: although it is clear the Internet has become a key
- 18:40Speaker 1: method of radicalization for terrorists of all stripes, and so
- 18:43Speaker 1: for me at least, it's good to know that the
- 18:45Speaker 1: technology companies are acknowledging that and smart people like Yasmin
- 18:48Speaker 1: are working on it. Although it does also mean living
- 18:51Speaker 1: in a world where our main internet search providers also
- 18:54Speaker 1: edit the results. Do we want Google controlling what we
- 18:57Speaker 1: know about the world or recommending what else we should now? Right?
- 19:01Speaker 1: And then what if Google turned that immense power to
- 19:03Speaker 1: influence directly onto me or you? More on that after
- 19:09Speaker 1: the break, Tristan, we've been talking about chicksaw on their
- 19:18Speaker 1: manipulation when you look at elections and the way extremist
- 19:22Speaker 1: groups are using technology to radicalize and proliferate. Should tech
- 19:27Speaker 1: companies be trying to offset some of the damage they're
- 19:30Speaker 1: doing by intervening for good? Yeah, Well, this is an
- 19:33Speaker 1: incredibly nuanced topic because essentially the way to see what's
- 19:38Speaker 1: going on with technology today is there's a massive asymmetry.
- 19:41Speaker 1: It would be easy for you and I and he
- 19:43Speaker 1: has mean to say clearly isis is bad and terrorism
- 19:46Speaker 1: is bad. So let's redirect when you're searching for things
- 19:50Speaker 1: that look like terrorist videos. But if you suddenly then
- 19:53Speaker 1: open the door and say you're about to watch a
- 19:56Speaker 1: video on climate change, and people at Google, for whatever reason,
- 20:01Speaker 1: believe that climate change wasn't real and they said, we're
- 20:04Speaker 1: going to start redirecting you away from that. Again, who
- 20:07Speaker 1: would they be to say? And that's actually a critical
- 20:09Speaker 1: juncture that we're at right now, because there's kind of
- 20:12Speaker 1: a pluralism where we all believe and think different things,
- 20:15Speaker 1: and we want to say that's your truth and not
- 20:17Speaker 1: my truth, and so we have this collapse of well,
- 20:19Speaker 1: who is the moral authority on these topics? And after all,
- 20:23Speaker 1: we're all Americans, well not me, but a citizens of
- 20:27Speaker 1: a democracy. We have a voice in our diplomacy. What
- 20:31Speaker 1: about is uses as the Internet? I think it's important
- 20:33Speaker 1: that we not try to just have a philosophy cocktail
- 20:36Speaker 1: conversation and debate it. We have to actually recognize that
- 20:39Speaker 1: this is having real world consequences. But the difficult thing
- 20:43Speaker 1: to reckon with is that it all comes back to attention.
- 20:46Speaker 1: YouTube has a tilt. We're on the one side of
- 20:48Speaker 1: the spectrum you have the calm science Carl Siggin slowly explaining,
- 20:54Speaker 1: and on the other side of the spectrum. You have UFOs, Bigfoot,
- 20:57Speaker 1: conspiracy theories, and crazy Town. If I'm YouTube and I
- 21:01Speaker 1: want you to watch more, Let's say you start at
- 21:03Speaker 1: the science section. If I want you to watch more,
- 21:05Speaker 1: which direction between those two am I going to steer you?
- 21:08Speaker 1: I'm always going to steer you too. Crazy Town so
- 21:11Speaker 1: at scale, even in language that the engineers don't speak,
- 21:14Speaker 1: the algorithms had figured out that crazy Town is really
- 21:17Speaker 1: really good at getting people's attention. And we know the
- 21:20Speaker 1: effect isn't just on politics, what about regular people who
- 21:23Speaker 1: get pushed into joinning ISIS or taking other extreme positions.
- 21:27Speaker 1: If you start a team girl on a dieting video,
- 21:30Speaker 1: the YouTube algorithm recommends an arexia videos because it's calculating
- 21:34Speaker 1: away and figures out those are the things that are
- 21:36Speaker 1: really good at keeping people of that age demographic on YouTube.
- 21:39Speaker 1: And if you start someone on a Supember eleventh news
- 21:42Speaker 1: video of the planes crashing into the towers, the recommendations
- 21:45Speaker 1: are all going to be the nine eleven conspiracy theory videos.
- 21:48Speaker 1: And Alex Jones YouTube actually recommended fifteen billion times Alex
- 21:53Speaker 1: Jones videos, two billion of which were viewed, even if
- 21:57Speaker 1: only one out of a thousand of those people believed it,
- 21:59Speaker 1: So one out of a thousand people watching those two
- 22:01Speaker 1: billion views believe that that's like printing, you know, a
- 22:04Speaker 1: church of scientology called about you know once a month.
- 22:07Speaker 1: In terms of the scale, we are jacked into these systems,
- 22:11Speaker 1: We are jacked into these environments that are telling us
- 22:14Speaker 1: and steering us towards flows of attention and ways of
- 22:17Speaker 1: seeing the world that are inevitable. And the question is
- 22:20Speaker 1: what flows of attention do we want? And in the end,
- 22:24Speaker 1: it all comes down to who's steering the ship and
- 22:27Speaker 1: what they're steering you towards. Who watches the watchman he
- 22:32Speaker 1: has been argues that jakes Will takes ethics heavily into consideration,
- 22:36Speaker 1: but not all companies do. And Tristan actually has a
- 22:39Speaker 1: radical idea. He believes that we need to wean ourselves
- 22:43Speaker 1: as an economy and as a society from business models
- 22:47Speaker 1: that compete for our attention to sell us things. I
- 22:49Speaker 1: think we really underestimate that this is affecting every layer
- 22:53Speaker 1: of society. And when you have three or four tech
- 22:56Speaker 1: companies choosing what will show up in the minds of
- 22:59Speaker 1: two bill and people every day, you know, our minds
- 23:02Speaker 1: are the source of all of our actions, But don't
- 23:04Speaker 1: we bear some responsibility for our own actions? Isn't that
- 23:09Speaker 1: part of the American dream? After all? No one forces
- 23:14Speaker 1: you into a casino or to buy that bar of
- 23:16Speaker 1: chocolate as you're paying at the supermarket. Right. You know,
- 23:20Speaker 1: you're the one clicking on those YouTube videos. You're the
- 23:22Speaker 1: ones who are clicking on those Russian ads. You're the ones,
- 23:25Speaker 1: you know, checking your phones because of those light colors
- 23:27Speaker 1: that are shining up all the time. We're just giving
- 23:29Speaker 1: people what they want. You're responsible for your choices. What
- 23:32Speaker 1: we have to do is flip the table around. We're
- 23:35Speaker 1: not giving people what they want. We're giving people what
- 23:38Speaker 1: they can't help but watch and once we acknowledge that,
- 23:41Speaker 1: we can start to find some reasons to hope. We've
- 23:43Speaker 1: found by getting Apple and Google to launch both um
- 23:47Speaker 1: these digital well being initiatives, which take the blue light
- 23:50Speaker 1: out of your screens and do gray scale late at
- 23:53Speaker 1: night and show you ways of minimizing the time you
- 23:55Speaker 1: spend on your phone and things like that. It's a
- 23:57Speaker 1: baby step in the right direction. But that happened against
- 24:00Speaker 1: their own business interests because the engineers themselves started to
- 24:04Speaker 1: see it this way. Of course, this addiction economy is
- 24:07Speaker 1: fueling so much more, from heck democracy to radicalization, to
- 24:11Speaker 1: mental health issues and the epidemic of a loneliness. The
- 24:14Speaker 1: list of problems that we need to solve is much
- 24:17Speaker 1: bigger than just making our own gray skill, and that's
- 24:21Speaker 1: what has to happen next. Happily, not everything in life
- 24:25Speaker 1: that makes us feel good is bad for us, and
- 24:28Speaker 1: some target recommendations can make us very happy. Indeed, So
- 24:32Speaker 1: let's talk about love, because one of the ways that
- 24:36Speaker 1: you might have felt AI touched your life is through
- 24:39Speaker 1: online dating. Maybe the person you woke up next to
- 24:42Speaker 1: this morning was matched to you by a computer algorithm.
- 24:45Speaker 1: And according to a study released in January Stanford, straight
- 24:50Speaker 1: and six of LGBTQ couples now meet online. Tinder processes
- 24:56Speaker 1: two billion swipes per day. That's a lot of data,
- 25:00Speaker 1: and it feels pretty good to meet someone who like
- 25:02Speaker 1: no matter how it happens. The lgbt Q statistic makes
- 25:06Speaker 1: a lot of sense to me because we don't have
- 25:07Speaker 1: to come in contact with judgment, with hate speech, with
- 25:10Speaker 1: home whatever it may be, there's a lot less of
- 25:12Speaker 1: it when it's a peer to peer thing on your phone.
- 25:15Speaker 1: Hopefully the other thing is the heterosexual dating pool is
- 25:18Speaker 1: a pool. The in my case, lesbian dating pool is
- 25:21Speaker 1: a puddle, and that puddle at least can be amplified
- 25:25Speaker 1: on an app like Hinge and Tinder and whatever. I mean.
- 25:28Speaker 1: I have noticed a lot more gay couples in the
- 25:30Speaker 1: New York Times wedding section, which I read religiously. The
- 25:33Speaker 1: other thing that I notice is that a lot of
- 25:36Speaker 1: the couples, both straight and gay, meet on apps. It's
- 25:40Speaker 1: interesting to see that it's influenced the culture in that
- 25:42Speaker 1: way so much so that you know, X amount of
- 25:45Speaker 1: people per week are meeting on those apps. And actually
- 25:48Speaker 1: in the States right now, there's been quite a significant
- 25:50Speaker 1: uptick in interracial marriages. That's pretty cool and it's something
- 25:54Speaker 1: to really celebrate as well. I mean, I was on
- 25:56Speaker 1: Instagram a few days ago and I saw somebody who
- 25:59Speaker 1: uploaded it picture of their wedding cake which had the
- 26:01Speaker 1: Tinder logo on it. Um. So you know, people feel
- 26:04Speaker 1: real terms of gratitude and excitement about meeting their partner, obviously,
- 26:08Speaker 1: And one person had a successful Tinder experience is the
- 26:11Speaker 1: producer of the show Julian Weller. That's right. So I
- 26:14Speaker 1: met my girlfriend on mine I've actually been to a
- 26:16Speaker 1: couple of weddings also that they called Tinder Ella stories
- 26:19Speaker 1: if the iPhone case fits. Yeah, But you know, I
- 26:22Speaker 1: think in essence, the use of something like Tinder is
- 26:25Speaker 1: that it just makes your dating pool bigger. To Cara's point,
- 26:27Speaker 1: but there are other apps, right, there's other approaches where
- 26:30Speaker 1: people can enter lots more information in about themselves beyond
- 26:34Speaker 1: just this sort of casual way to meet. We wanted
- 26:37Speaker 1: to find out more about the data that drives who
- 26:39Speaker 1: we fall in love with, so we spoke to Helen Fisher.
- 26:43Speaker 1: I'm Dr Helen Fisher. I'm a biological anthropologist at the
- 26:47Speaker 1: Kinsey Institute. I've written six books on love, put people
- 26:51Speaker 1: in brain scanners, and actually I'm also the chief scientific
- 26:54Speaker 1: advisor to match dot com. We've been talking a lot
- 26:56Speaker 1: about computer algorithms influencing behavior in this episode Code, But
- 27:01Speaker 1: what motivates us in the first place, Well, there are
- 27:04Speaker 1: pathways and rules in the brain, not unlike a computer.
- 27:08Speaker 1: I developed a questionnaire some time ago that's now been
- 27:11Speaker 1: taken by fourteen million people in forty countries. Actually, and
- 27:14Speaker 1: there's patterns of behavior. I mean, we walk around with
- 27:17Speaker 1: algorithms in our head I mean, the brain is constantly
- 27:20Speaker 1: responding to all kinds of things, and it certainly is
- 27:23Speaker 1: a series of algorithms. So if the brain is like
- 27:26Speaker 1: a collection of computer algorithms but much more complicated, what
- 27:31Speaker 1: are the inputs what drives who we fall in love with?
- 27:35Speaker 1: There's four brain systems that each one of them is
- 27:38Speaker 1: linked with a constellation of biological traits, and they are
- 27:41Speaker 1: the dopamine, serotonin, testasterone, and estrogen systems. And so I
- 27:45Speaker 1: created a questionnaire to see what you know, how you
- 27:47Speaker 1: expressed the traits in each one of these systems. Once
- 27:50Speaker 1: Helen had developed the quiz, she validated it using a
- 27:53Speaker 1: brain scanner, and then I watched now at fourteen million people,
- 27:56Speaker 1: and Helen got an insight into the brain system that
- 28:00Speaker 1: makes us experience love in the first place. When we
- 28:03Speaker 1: put the people in the machine, I had expected that
- 28:05Speaker 1: brain readers, link with the emotions and cognitive processes, would
- 28:08Speaker 1: become active, and they do. But what everybody had in
- 28:11Speaker 1: common is activity in brain readers way at the base
- 28:14Speaker 1: of the brain link with drive, with craving, with focus,
- 28:18Speaker 1: with motivation, with energy. In other words, Helen found that
- 28:21Speaker 1: the ability to fall in love is just as deep
- 28:24Speaker 1: in the brain as other survival drives things we have
- 28:27Speaker 1: no control over, but it lies right near factories that
- 28:31Speaker 1: orchestrate thirst and hunger. Thirst and hunger keep you alive today.
- 28:35Speaker 1: Romantic love drives you to fall in love form of
- 28:38Speaker 1: pair bound and pass your DNA into tomorrow. That brain system,
- 28:43Speaker 1: the one that makes us feel that we need to eat,
- 28:45Speaker 1: or need to drink, or need to be with someone,
- 28:48Speaker 1: is also the one that drives addiction, and that has
- 28:51Speaker 1: implications for the technologies we use every day beyond just
- 28:55Speaker 1: dating apps, not only the substance addictions, but the behavioral
- 28:58Speaker 1: addictions like gambling or food addiction. That brain region became
- 29:02Speaker 1: activated not only among people who are madly and happily
- 29:06Speaker 1: in love, but also among people who were rejected in love,
- 29:10Speaker 1: and even in people who are in love long term.
- 29:12Speaker 1: And it is linked with the addiction centers in the brain.
- 29:16Speaker 1: And perhaps at some point we're going to come to
- 29:17Speaker 1: understand a much broader view of the word addiction. This
- 29:21Speaker 1: brings us right back to what Tristan was saying. Our
- 29:24Speaker 1: apps and smart devices are hijacking some of the deepest
- 29:27Speaker 1: and most powerful systems in our brain. The truth is
- 29:31Speaker 1: that Tinder apps social media validation. They all generate the
- 29:35Speaker 1: same feelings as romantic love. So of course we're prone
- 29:39Speaker 1: to be addicted. We want to look at somebody, to
- 29:41Speaker 1: hear somebody, to have somebody respond to us. If you're
- 29:44Speaker 1: an alien who came to Earth and he looked at
- 29:46Speaker 1: the way human touched their phone, always in their hand,
- 29:50Speaker 1: caressing it, reaching forward with a panic look in their eye,
- 29:54Speaker 1: responding to it with a smile, you would say, the
- 29:57Speaker 1: same thing is happening. Well, it's very different, but it may.
- 30:00Speaker 1: We used to me that some of the same brain systems.
- 30:02Speaker 1: I mean, you know when you feel fear, you feel fear.
- 30:04Speaker 1: As Helen found, love is fundamentally about the survival of
- 30:08Speaker 1: our species. So it's handled by the same part of
- 30:11Speaker 1: our brain as hunger, thirst, and addiction. And it's those
- 30:16Speaker 1: very brain centers that Twitter and Facebook on Instagram appeal
- 30:19Speaker 1: to using behavioral science to keep us engaged, to keep
- 30:23Speaker 1: us sharing. So when thousand Twitter users retweeted Gillian's open
- 30:28Speaker 1: letter to the technology companies, they did it because on
- 30:31Speaker 1: a very deep level, it triggered a survival response, and
- 30:35Speaker 1: in turn, that feedback loop is addictive. You know, I
- 30:38Speaker 1: did a study with Matt and I asked the singles
- 30:41Speaker 1: in America and do you feel that these machines are addictive?
- 30:44Speaker 1: And some like eight over said yes, And people said
- 30:48Speaker 1: that they would like to go back to dating without
- 30:50Speaker 1: any of them, and knowing how tempting it can be
- 30:53Speaker 1: to keep swiping, keep searching. Helen has some advice for
- 30:57Speaker 1: those of us looking for love. It's very well own
- 31:00Speaker 1: in this community that the more choices you have, the
- 31:04Speaker 1: less likely you are to choose anybody. So one of
- 31:07Speaker 1: the things that I say to people is, after you
- 31:09Speaker 1: meet nine people, stop and get to know at least
- 31:13Speaker 1: one of those people more. Because all the data show
- 31:16Speaker 1: that the more you get to know somebody, the more
- 31:18Speaker 1: you like them and the more that you think that
- 31:19Speaker 1: they're like you. You know, for millions of years, we
- 31:21Speaker 1: weren't doing this over the internet or even the telephone.
- 31:24Speaker 1: We were doing this in person. I mean, that's the
- 31:26Speaker 1: way people met, and the brain is built to meet
- 31:29Speaker 1: in person. Helen Fisher still believes in love. She just
- 31:34Speaker 1: doesn't want you to sleep walk into endlessly swiping, endless
- 31:38Speaker 1: date spurred by an addiction to see what's next, what's possible,
- 31:42Speaker 1: what's right around the corner. We know we're at a
- 31:45Speaker 1: dangerous crossroads and that we're susceptible to manipulation, and companies
- 31:50Speaker 1: know they can manipulate us for good and evil with
- 31:53Speaker 1: technology that touches us at our evolutionary roots. But the
- 31:57Speaker 1: future of those technologies isn't in vitable, and we still
- 32:01Speaker 1: have the power in our hands to decide what to
- 32:05Speaker 1: allow in our lives, because the ways we decide to
- 32:08Speaker 1: live with new technologies could have as much impact on
- 32:11Speaker 1: our lives as the Constitution or the New Deal. What
- 32:14Speaker 1: we decide to do next and how we do it
- 32:17Speaker 1: will have consequences. And on this series, we'll be interviewing
- 32:20Speaker 1: some of the world's greatest thinkers, that people who are
- 32:23Speaker 1: changing the future of our food, and the researchers helping
- 32:26Speaker 1: disabled people control machines with their minds. Together, we'll see
- 32:32Speaker 1: what we can do to pry our eyes open from
- 32:34Speaker 1: this dangerous sleepwalk I'm as veloshin see you next time.
- 32:50Speaker 1: Sleepwalkers is a production of our Heart Radio and unusual productions.
- 32:55Speaker 1: There's so much we don't have time for in our
- 32:57Speaker 1: episodes but that we'd love to share with you. So
- 33:00Speaker 1: the latest AI news, live interviews and behind the scenes
- 33:03Speaker 1: footage find us on Instagram, at Sleepwalker's Podcast or at
- 33:07Speaker 1: Sleepwalker's podcast dot com. Sleepwalkers is hosted by me Osloshin
- 33:11Speaker 1: and co hosted by me Kara Price. We produced by
- 33:14Speaker 1: Julian Weller, with audio editing by Jacopo Penzo, Taylor ship
- 33:18Speaker 1: Coin and mixing by Tristan McNeil. Our story editor is
- 33:21Speaker 1: Matthew Riddle. Recording assistance this episode from Chris Hambroke and
- 33:24Speaker 1: Jackson Bierfeld. Sleepwalkers is executive produced by me Ozveloshin and
- 33:28Speaker 1: Manges Ticketer. For more podcasts from my Heart Radio, visit
- 33:32Speaker 1: the I heart Radio app, Apple Podcasts, or wherever you
- 33:35Speaker 1: listen to your favorite shows.