Latest / Behind the Bastards / Part One: The Zizians: How Harry Potter Fanfic Inspired a Death Cult
Transcript
- 0:01Speaker 1: Also media, Welcome back to Behind the Best. That's how
- 0:10Speaker 1: this podcast would open. If I was a game show host,
- 0:14Speaker 1: but I'm not. Instead of a guy who's.
- 0:16Speaker 2: Spending you would be good at it, though.
- 0:18Speaker 3: I don't think I would be, Sophie.
- 0:20Speaker 2: I do, but I think, but I'm like biased because
- 0:23Speaker 2: I think you'd be good at most things.
- 0:25Speaker 1: No, my only marketable skill is spending thirty hours reading
- 0:29Speaker 1: the deranged writings of a quasi cult leader who was
- 0:35Speaker 1: somewhat involved in the murders of multiple people very recently,
- 0:40Speaker 1: largely because she read a piece of Harry Potter fan
- 0:42Speaker 1: fiction at the wrong time. Yes, we have a fun
- 0:48Speaker 1: one for you this week, and by a fun one,
- 0:51Speaker 1: we have a not at all fun one for you
- 0:54Speaker 1: this week. And to have just a terrible time with me.
- 0:58Speaker 1: We are bringing on again the great David Boree, co
- 1:04Speaker 1: host of My Mama, told me with our friend of
- 1:06Speaker 1: the pod, Langston Kerman, David, how you doing, Oh man, I.
- 1:10Speaker 3: Can't not complain how you doing? There's nothing going on
- 1:13Speaker 3: in the world.
- 1:15Speaker 1: Oh yeah, yeah, I got up today and read that
- 1:19Speaker 1: that great new article by Francis fuka Yama. History is
- 1:22Speaker 1: still stopped, So everything's good. We're done.
- 1:27Speaker 3: I haven't looked at any news yet purposefully, so I'm
- 1:30Speaker 3: you know, it could be awesome. It could be going
- 1:32Speaker 3: great out there. It's great. It's great.
- 1:34Speaker 1: The whole Trump administration got together and said, psych it
- 1:36Speaker 1: was all a bit man, just an extended ad for
- 1:41Speaker 1: the Apprentice season fifteen.
- 1:43Speaker 3: You mean this country is not a business.
- 1:45Speaker 1: No, they handed over the presidency to.
- 1:50Speaker 3: I don't know.
- 1:51Speaker 1: I don't know whoever you you personally at home think
- 1:54Speaker 1: would be a great president. I'm not going to jump
- 1:56Speaker 1: into that can of worms right now. Ramonbrony Madron the president.
- 2:04Speaker 3: That's a good one. That's a good one. That's better
- 2:07Speaker 3: than what we got, honestly, vastly superior than where we are.
- 2:10Speaker 3: Of all the entertainers, I feel like, why don't we
- 2:12Speaker 3: start giving athletes a shot a government? Yeah? I fuck it?
- 2:16Speaker 3: Why not? You know, uh fucking uh.
- 2:20Speaker 1: Kareem Abdul Jabbar would could knock a presidency out of
- 2:26Speaker 1: the park. Come on, absolutely, Yes, we need a mystery novelist,
- 2:34Speaker 1: slash one of the great basketball stars of all time
- 2:38Speaker 1: in the White House.
- 2:39Speaker 3: I just want a president who's good in the paint,
- 2:41Speaker 3: you know what I mean?
- 2:41Speaker 1: That's right, that's right, Agatha Christie with a jump shot.
- 2:47Speaker 3: Yeah, that's exactly what I think. That's what an amazing man.
- 2:52Speaker 3: Kareem would be.
- 2:52Speaker 2: Such would be such a good choice.
- 2:55Speaker 3: Yeah, bring it on. I think he's such a good man.
- 2:57Speaker 3: He wouldn't do it.
- 2:58Speaker 2: Yeah, exactly, his way too moral, he's waited. I have
- 3:01Speaker 2: a frog name after named after him.
- 3:03Speaker 3: Yeah.
- 3:04Speaker 1: Look, honestly, given where we are are right right now,
- 3:08Speaker 1: I'd take fucking uh what's his mark maguire, like Jesus Christ,
- 3:12Speaker 1: anybody like, honestly, anyone I take heartbeat oh man, fuck
- 3:25Speaker 1: it like I'll take no. No, I'm not gonna take
- 3:28Speaker 1: any hockey players. No hockey players. We got enough people
- 3:31Speaker 1: with brain damage in the White House right now.
- 3:33Speaker 3: That's probably sit and we don't need somebody who that much.
- 3:37Speaker 1: Yeah, yeah, yeah, yeah, you're probably right there. I mean,
- 3:40Speaker 1: if if we could go back in time and make
- 3:42Speaker 1: Joe Lewis the president, I think he could solve some
- 3:44Speaker 1: fucking problems in Congress.
- 3:47Speaker 3: You can get still done.
- 3:54Speaker 1: So this has been a fun digression, but I got
- 3:56Speaker 1: to ask at the start of this the story that
- 4:00Speaker 1: it is most relevant to the people we're talking about today,
- 4:02Speaker 1: that I think most of our listeners will have heard.
- 4:04Speaker 1: I'm curious if you've heard about Back on January twenty first,
- 4:08Speaker 1: right as the Trump administration took power, a border patrol
- 4:12Speaker 1: agent was shot and killed along with another individual at
- 4:16Speaker 1: a traffic stop in Coventry, Vermont. Right, there were two
- 4:19Speaker 1: people in a car that was pulled over a border patrol.
- 4:22Speaker 3: One of those people.
- 4:23Speaker 1: Drew a gun, there was a firefight, one of the
- 4:26Speaker 1: people in the car and the cop died.
- 4:28Speaker 3: Right, Okay, have you heard this story. I'm not at all.
- 4:33Speaker 1: It's one of those things where it would have been
- 4:34Speaker 1: a much bigger the immigration being the thing that it
- 4:37Speaker 1: is right in the United like the political hot issue
- 4:41Speaker 1: that it is right now, Like the Republicans have been
- 4:44Speaker 1: desperately waiting for like a border patrol officer getting shooted
- 4:48Speaker 1: and wounded that they can like use to justify a crackdown.
- 4:51Speaker 1: But number one, this happened on the Canadian border.
- 4:54Speaker 3: Not really favorite.
- 4:56Speaker 1: And one of the two people who who drew their
- 4:59Speaker 1: guns on the cop ops was an immigrant, but they
- 5:02Speaker 1: were a German immigrant, and so.
- 5:04Speaker 3: None of this really like right, It.
- 5:06Speaker 1: Was all like right on the edge of being super
- 5:09Speaker 1: useful to their rights.
- 5:10Speaker 3: But it's none, like we were dealing with our own
- 5:15Speaker 3: right wing immigration propaganda at that time. Yeah.
- 5:19Speaker 1: Yeah, it was just like it was like the closest
- 5:22Speaker 1: to being a perfect right wing like fault, like a
- 5:25Speaker 1: Reichstag fire in it, but like just a little too weird.
- 5:29Speaker 3: Yeah, you gotta throw some spice in there. You gotta
- 5:31Speaker 3: have like a Latin country. That's what they get excited about.
- 5:34Speaker 1: Yeah, and obviously California border is where you want it,
- 5:37Speaker 1: you know.
- 5:37Speaker 3: Yeah, definitely, definitely, even New Mexico could be.
- 5:40Speaker 1: Yeah, or at least at least they need to have
- 5:42Speaker 1: fitnel on the car. In fact, they were not breaking
- 5:44Speaker 1: any laws that anyone could prove at the time. They
- 5:47Speaker 1: just looked kind of weird. Yeah, they looked kind of weird,
- 5:51Speaker 1: and they like had guns, but it was like they
- 5:53Speaker 1: had like two handguns and like forty rounds and some
- 5:55Speaker 1: old targets. They were like coming back from a shooting range, right,
- 5:59Speaker 1: Like not a lot of a gun guns and AMMO
- 6:02Speaker 1: in America terms, right, especially in Vermont terms. Right. So
- 6:08Speaker 1: the other thing was weird about this is that the
- 6:11Speaker 1: German immigrant who died was a transwoman. So then again
- 6:15Speaker 1: we get back to like, wow, there's a lot about
- 6:17Speaker 1: this shooting that is like right on the edge of
- 6:19Speaker 1: some issues that the right is really trying to use
- 6:24Speaker 1: as like a folkrum to like push through some awful shit.
- 6:28Speaker 1: And as more and more information came out about the shooting,
- 6:31Speaker 1: the weirder it seemed, because there was a lot of
- 6:33Speaker 1: initial talk, is this like a terrorist attack where these
- 6:35Speaker 1: like two Antifa types who were like looking to murder
- 6:39Speaker 1: a bird border patrol agent. But no, that doesn't really
- 6:42Speaker 1: make sense because like they got pulled over, Like they
- 6:44Speaker 1: can't have been planning this right, Like it didn't. It
- 6:47Speaker 1: didn't really seem like that, and really no one, no
- 6:51Speaker 1: one could figure out why they had opened fire. But
- 6:53Speaker 1: as the days went on, more information started coming out,
- 6:57Speaker 1: not just about the two people who were arrested in
- 7:00Speaker 1: this well, the one person who was rested in the
- 7:02Speaker 1: one person who died, but about a group of people
- 7:05Speaker 1: around the country that they were linked to. And these
- 7:09Speaker 1: other people were not all but mostly trans women. They
- 7:14Speaker 1: were mostly people who kind of identified as both anarchists
- 7:17Speaker 1: and members of the rationalist subculture, which we'll talk about
- 7:21Speaker 1: in a little bit, And they were all super high
- 7:25Speaker 1: achieving people in like the tech industry and like sciences. Right,
- 7:30Speaker 1: These are the people who had won like awards and
- 7:32Speaker 1: had advanced degrees. The person, the lady who died in
- 7:37Speaker 1: the shooting was a quant trader, So these are not
- 7:40Speaker 1: like the normal shoot it out with the cops types.
- 7:44Speaker 3: Yes, this is a very niche group. This is a
- 7:46Speaker 3: very strange story.
- 7:48Speaker 1: So people start being like, oh the fuck is happening And.
- 7:51Speaker 3: There's a group of people who could not meet each
- 7:53Speaker 3: other without the invention of the Internet, right, Well.
- 7:56Speaker 1: That is boy, David, do you know where this always
- 8:00Speaker 1: going or at least starting, so like it's a couple
- 8:04Speaker 1: of these days into this when like a friend of
- 8:06Speaker 1: mine messaged me and it's like, hey, you know that
- 8:07Speaker 1: shooting in Vermont and I was like yeah, and he's
- 8:10Speaker 1: like my friend is like, you know, there's Zizians And
- 8:13Speaker 1: I was like, wait, what what the fuck? Because I
- 8:16Speaker 1: had heard of these people. This is a weird little subculture.
- 8:19Speaker 1: I'm always I'm like, you know, I study weird little
- 8:21Speaker 1: Internet subcultures, and in part because like some of them
- 8:24Speaker 1: do turn out to do acts of terrorism later. And
- 8:30Speaker 1: I've been I've been reporting on the rationalists, who are
- 8:33Speaker 1: not like a cult, but who do some cult adjacent
- 8:37Speaker 1: things and I just kind of find annoying. And I'd
- 8:39Speaker 1: heard about this offshoot of the rationalists called the Zizians.
- 8:43Speaker 1: They were very weird. There were some like weird crime allegations.
- 8:46Speaker 1: A couple of them had been involved in a murder
- 8:49Speaker 1: in California a year earlier. But like, it was not
- 8:52Speaker 1: a group that I ever really expected to see blow
- 8:54Speaker 1: up in the media, and then suddenly they fucking did, right,
- 8:59Speaker 1: And they're called the Zizians. It's not a name they
- 9:03Speaker 1: have for themselves. They don't consider themselves a cult. They
- 9:06Speaker 1: don't all like live A group of them did live together,
- 9:09Speaker 1: but like, these people are pretty geographically like dispersed around
- 9:12Speaker 1: the country. They're folks who met online arguing about ration
- 9:18Speaker 1: and discussing rationalism and the ideas of a particular member
- 9:22Speaker 1: of that community who goes by the name ziz. Right,
- 9:26Speaker 1: that's where this group came out of and the regular
- 9:30Speaker 1: media was not well equipped to understand what was going on.
- 9:33Speaker 1: And I want to run through a couple of representative
- 9:36Speaker 1: headlines that I came across just in like looking at
- 9:39Speaker 1: mainstream articles about what had happened. There's an article from
- 9:43Speaker 1: The Independent they title Inside the Zizians how a cultish
- 9:47Speaker 1: crew of radical vegans became linked to killings across the
- 9:50Speaker 1: United States. They seemed like just another band of anarchist
- 9:54Speaker 1: misfits scraping on the valide of scraping on the fringes
- 9:57Speaker 1: of Silicon Valley until the deaths began. And then there's
- 10:01Speaker 1: a k c r W article zizians the vegan techie
- 10:04Speaker 1: cult try tied to murders across the US. UH And
- 10:08Speaker 1: then a Fox article trans vegan cult charged with six murders.
- 10:12Speaker 3: There you go, that's Fox.
- 10:15Speaker 1: Yes, none of these titles are very accurate in that
- 10:20Speaker 1: I guess the first one is like the closest, where like,
- 10:22Speaker 1: these people are radical vegans and they're they are cultish, right,
- 10:26Speaker 1: so I'll give I'll give the Independent that vegan techie
- 10:31Speaker 1: cult is not really what I would describe them, Like
- 10:35Speaker 1: some of them were in the tech industry, but like
- 10:37Speaker 1: the degree to which they're in the tech industry is
- 10:40Speaker 1: a lot weirder than that gets across. And they're not
- 10:44Speaker 1: really a trans they're like trans vegans, but the cult
- 10:47Speaker 1: is not about being a trans vegan. That's just kind
- 10:50Speaker 1: of a lot. How these people found each other.
- 10:52Speaker 3: Oh, they just happened to be that was just the.
- 10:55Speaker 1: Common veganism is tied to it. They just kind of
- 10:58Speaker 1: all happen to be trans that's not really like tied
- 11:01Speaker 1: to it necessarily. So I would argue also that they're
- 11:06Speaker 1: not terrorists, which a lot of people have a number
- 11:09Speaker 1: of the other articles called them nothing. None of the
- 11:12Speaker 1: killings that they were involved with, and they did kill
- 11:14Speaker 1: people were like terrorist killings. They're all much weirder than that,
- 11:18Speaker 1: but none of them are like, none of the killings
- 11:20Speaker 1: I have seen are for a clear political purpose, right,
- 11:23Speaker 1: which is kind of crucial for it to be terrorism.
- 11:26Speaker 1: The murders kind of evolved out of a much sillier reason,
- 11:31Speaker 1: and it's you know, there's one really good article about
- 11:34Speaker 1: them by a fella at Wired who spent a year
- 11:37Speaker 1: or so kind of studying these people, and that article
- 11:41Speaker 1: does a lot that's good, but it doesn't go into
- 11:45Speaker 1: as much detail about what I think is the real
- 11:49Speaker 1: underpinning of whitest group of people got together and convinced
- 11:53Speaker 1: themselves it was okay to commit several murders. And I
- 11:57Speaker 1: think that that all comes down more than any other
- 11:59Speaker 1: single factor, to rationalism and to their belief in this
- 12:03Speaker 1: weird online cult. That's that's very much based on like
- 12:09Speaker 1: and like asking different sort of logic questions and trying
- 12:12Speaker 1: to like pinnow down the secret rules of the universe
- 12:16Speaker 1: by doing like game theory arguments on the internet over blogs. Right,
- 12:21Speaker 1: Like that's really how all of this stuff started.
- 12:25Speaker 3: Like someone named mystery. Yeah, a lot of people in funny.
- 12:28Speaker 1: Hats they do. Actually they're a little adjacent to this,
- 12:32Speaker 1: and they come out of that period of time, right
- 12:34Speaker 1: where like pick up artists culture is also like forming.
- 12:38Speaker 1: They're one of this like generation of cults that starts
- 12:41Speaker 1: with a bunch of blogs and shit on the internet
- 12:44Speaker 1: in like two thousand and nine, right, And this this
- 12:47Speaker 1: is it's so weird because we use the term cult
- 12:51Speaker 1: and that's the easiest thing to call these people. But generally,
- 12:56Speaker 1: when our society is talking about a cult, we're talking
- 12:58Speaker 1: about like eve an individual that individual brings in a
- 13:01Speaker 1: bunch of followers, gets them, isolates them from society, puts
- 13:06Speaker 1: them into an area where they are in complete control,
- 13:10Speaker 1: and then tries to utilize them for like a really
- 13:13Speaker 1: specific goal. There's like a way to kind of look
- 13:17Speaker 1: at physizians that way, But I think it would be
- 13:19Speaker 1: better to describe them as like cultish, right, Okay, they
- 13:24Speaker 1: use the tools of cult dynamics and that produces some
- 13:30Speaker 1: very cult like behavior, but there's also a lot of
- 13:34Speaker 1: differences between like how this group works and what you'd
- 13:37Speaker 1: call the traditional cult and including a lot of these
- 13:40Speaker 1: people are separate from each other and even don't like
- 13:42Speaker 1: each other, but because they've been inculcated in some of
- 13:45Speaker 1: the same beliefs through these kind of cult dynamics, they
- 13:49Speaker 1: make choices that lead them to like participate in violence too.
- 13:53Speaker 3: Where is their hub? Is it like a message board
- 13:55Speaker 3: type of situation? Like how is that? Yes?
- 13:58Speaker 1: Yes, so I'm gonna I'm gonna have to go back
- 14:01Speaker 1: and forth to explain all of that as.
- 14:05Speaker 3: The technology of Zizzy in it. It's because from the lids.
- 14:09Speaker 1: No no z I z the lady who was kind
- 14:12Speaker 1: of the founder of this is the name that she
- 14:15Speaker 1: takes for herself is Ziz, right.
- 14:18Speaker 3: Okay, should have been the z Girls. That's much more appealing.
- 14:22Speaker 1: These people are big in the news right.
- 14:24Speaker 4: Now because because of the several murders, and the right
- 14:28Speaker 4: wing is trying it wants to make it out is
- 14:30Speaker 4: like this is a like trans death cult and this
- 14:34Speaker 4: is more of like an internet a I nerd death cult.
- 14:40Speaker 3: I guess that's better.
- 14:42Speaker 1: It's just different. You know, you're right, it was just
- 14:48Speaker 1: a different thing. And I think it's important if like
- 14:51Speaker 1: you care about like cults because you think they're dangerous
- 14:54Speaker 1: and you're arguing that, like, hey, this cult seems really dangerous,
- 14:56Speaker 1: should understand like what the cult is, right, right, Like
- 14:59Speaker 1: if you miss a just to the scientologists and thought
- 15:01Speaker 1: like these are obsessive fans of science fiction who are
- 15:03Speaker 1: committing murders over science fiction stories. It's like, no, no,
- 15:06Speaker 1: they're committing murders because there's something stupid. Yeah, much moret okay,
- 15:14Speaker 1: So I got to take I am going to explain
- 15:17Speaker 1: to you what rationalism is, how who ziz is, where
- 15:22Speaker 1: they come from, and how they get radicalized to the
- 15:25Speaker 1: point where they are effectively at the hub of something
- 15:28Speaker 1: that is at least very adjacent to a cult. But
- 15:31Speaker 1: I want to talk a little bit about the difference
- 15:34Speaker 1: between like a cult and cult dynamics. Right, A cult
- 15:40Speaker 1: is fundamentally a toxic thing. It is bad, It always
- 15:43Speaker 1: harms people. There is no harmless cult, you know, it's
- 15:47Speaker 1: like rape, Like there's no version of it that's good,
- 15:50Speaker 1: you know, like it is a fundamentally dangerous thing. Cult
- 15:55Speaker 1: dynamics and the tactics cult leaders use are not always
- 16:00Speaker 1: toxic or bad. And in fact, every single person listening
- 16:05Speaker 1: to this has enjoyed and had their life enriched by
- 16:08Speaker 1: the use of certain things that are on the spectrum
- 16:11Speaker 1: of cult dynamics.
- 16:12Speaker 3: I was gonna say, it's a lot. It seems a
- 16:14Speaker 3: lot more like you have that at work, gives that
- 16:17Speaker 3: at work anywhere, right.
- 16:18Speaker 1: Yeah, Anyway, that's a huge part of what make a
- 16:21Speaker 1: great fiction author who is able to like attract a
- 16:24Speaker 1: cult following you've ever had that experience, Like a big
- 16:26Speaker 1: thing in cults is the use of in creation of
- 16:29Speaker 1: new language. You get people using words that other they
- 16:32Speaker 1: don't use otherwise and like phrases, and that is both
- 16:36Speaker 1: a way to bond people because like you know, it
- 16:38Speaker 1: helps you feel like you're part of this group, and
- 16:40Speaker 1: it also isolates you from people. If you've ever met
- 16:43Speaker 1: people who are like hugely into you know, Dungeons and
- 16:46Speaker 1: Dragons or huge fans like Harry Potter or the Lord
- 16:49Speaker 1: of the Rings, like they have like things that they say,
- 16:53Speaker 1: like memes and shit that they share based on those books,
- 16:55Speaker 1: and like that's a less toxic, but it's on the
- 16:59Speaker 1: same spectrum. Right, It's this, I am a part of
- 17:02Speaker 1: this group of people, and we use these words that
- 17:05Speaker 1: mean something to us that don't mean things to other people, right,
- 17:08Speaker 1: And that's.
- 17:10Speaker 3: Yes, yes, yeah, it's like a great that's like a
- 17:13Speaker 3: great way to bomb. I think it's any group, right,
- 17:15Speaker 3: I mean, yeah, entertainers.
- 17:17Speaker 1: Your friend groups, Yeah, has in jokes, right, sports, Yeah,
- 17:23Speaker 1: could kill people, right exactly, yes, yes, And like you've
- 17:26Speaker 1: got you know, you and you and your buddies that
- 17:28Speaker 1: have been friends for years, you have like you could
- 17:30Speaker 1: there's like a word you can say and everyone knows
- 17:32Speaker 1: that you're fering this thing that happened six years ago,
- 17:34Speaker 1: and you all like laugh because you know it reminds
- 17:37Speaker 1: you of something, you know, because it's relevant to something happening.
- 17:39Speaker 1: Then that's a little healthy bit of cult.
- 17:42Speaker 3: Dynamics at play, right, you know.
- 17:46Speaker 1: It's like a diet, you know. So there's a toolbox
- 17:49Speaker 1: here and we play with it and different different organizations,
- 17:53Speaker 1: but churches play with it. And obviously a lot of
- 17:56Speaker 1: churches cross the line into cults, but there's also aspects
- 18:00Speaker 1: of for example, you know, there's churches that I know,
- 18:04Speaker 1: I have seen people go to where like it's very
- 18:06Speaker 1: common everybody gets up and like hugs at a certain point,
- 18:09Speaker 1: and like people benefit from human contact. It makes them
- 18:13Speaker 1: feel nice. It can be like a very healthy thing.
- 18:18Speaker 3: I've gone to.
- 18:19Speaker 1: I used to go to like Burning Man regionals and
- 18:21Speaker 1: like you would like start at this greeter station where
- 18:24Speaker 1: like a bunch of people would come up, but they'd
- 18:25Speaker 1: offer you like food and drinks, and you know, people
- 18:28Speaker 1: would hug each other and it was this like changes
- 18:30Speaker 1: your mind state from where you were in before, kind
- 18:32Speaker 1: of opens you up that bring.
- 18:35Speaker 3: Those is that like to qualify for state Yeah yeah, yeah, yeah,
- 18:38Speaker 3: so that way could get to go.
- 18:40Speaker 1: It's just like these local little events in Texas, right
- 18:42Speaker 1: like a thousand people in the desert trying to forget
- 18:44Speaker 1: that we live in Texas.
- 18:46Speaker 3: Okay, we're not desert.
- 18:48Speaker 1: But it was very like it's it's it was like
- 18:51Speaker 1: a really valuable part of like my youth because it
- 18:54Speaker 1: was the first time I ever started to like feel
- 18:55Speaker 1: comfortable in my own skin. But also that's on the
- 18:59Speaker 1: spectrum of love, which is thing colts do where they
- 19:01Speaker 1: like surround you from people with people who like talk
- 19:05Speaker 1: about like like you know, will touch you and hold
- 19:08Speaker 1: you and tell you they love you, and like, you know,
- 19:10Speaker 1: part of what brings you into the cult is the
- 19:12Speaker 1: cult leader can take that away at any moment in time.
- 19:15Speaker 2: Right.
- 19:15Speaker 1: It's the kind of thing where if it's not something
- 19:17Speaker 1: where no, this is something we do for five minutes
- 19:19Speaker 1: at the end of every church service, right, you can
- 19:21Speaker 1: very easily turn this into something deeply dangerous and poisonous.
- 19:25Speaker 3: Right.
- 19:25Speaker 1: But also a lot of people just kind of play
- 19:27Speaker 1: around a little bit pieces of that, a piece of
- 19:29Speaker 1: the cult dynamics.
- 19:31Speaker 3: Just a little just a little bit.
- 19:33Speaker 1: Any good musician, any really great performers fucking with some
- 19:38Speaker 1: cult dynamics, Right, I was.
- 19:39Speaker 3: Gonna say, I mean I've been to like so many
- 19:42Speaker 3: different concerts of like weird niche stuff where you're like,
- 19:45Speaker 3: maybe the disco Biscuits is a cool I don't know.
- 19:49Speaker 1: Yeah, I mean like I've been to some childish Gambino
- 19:52Speaker 1: concerts where it's like, oh, yeah, he's doing he's a
- 19:55Speaker 1: little bit of a cult leader, you know, like just
- 19:57Speaker 1: ten percent, right.
- 19:58Speaker 3: Yeah, I mean, what are you good to do with
- 20:00Speaker 3: all that charisma you got? You gotta put it somewhere?
- 20:02Speaker 1: Yeah, Yeah, So these are I think that it's important
- 20:08Speaker 1: for people to to understand both that, like the tactics
- 20:11Speaker 1: and dynamics that make up a cult have versions of
- 20:15Speaker 1: them that are not unhealthy. But I also think it's
- 20:18Speaker 1: important for people to understand cults come out of subcultures. Right,
- 20:25Speaker 1: This is very close to one hundred percent of the time.
- 20:27Speaker 1: Cults always arise out of subcultural movements that are not
- 20:31Speaker 1: in none of themselves cults. For example, in the nineteen
- 20:35Speaker 1: thirties through like the fifties sixties, you have the emergence
- 20:40Speaker 1: of what's called the self help movement, you know, and
- 20:42Speaker 1: this is all of these different books onlike how to
- 20:44Speaker 1: persuade people, how to you know, win friends and influence people,
- 20:48Speaker 1: you know, how to like make but also stuff like
- 20:50Speaker 1: alcoholics anonymous, you know, how to like improve yourself by
- 20:53Speaker 1: getting off drugs, getting off alcohol. All these are pieces
- 20:56Speaker 1: of the self improvement movement. Right, that's a subculture. There
- 21:01Speaker 1: are people who travel around you get obsessed to go
- 21:03Speaker 1: to all of these different things, and they'll and they
- 21:05Speaker 1: get a lot of benefit. You know, people will show
- 21:07Speaker 1: up at these seminars where there's hundreds of other people
- 21:10Speaker 1: and a bunch of people will like hug them and
- 21:12Speaker 1: they feel like they're part of this community and they're
- 21:15Speaker 1: making their lives better. And oftentimes, especially like once we
- 21:18Speaker 1: get to like the sixties seventies, these different sort of
- 21:22Speaker 1: guru types are saying that, like, you know, this is
- 21:23Speaker 1: how we're going to save the world if we can
- 21:25Speaker 1: get everybody doing you know this, this yoga routine or
- 21:29Speaker 1: whatever that I find together fix everything.
- 21:31Speaker 3: Who's that guy who had the game? Oh god, yes, yeah, yeah, yeah.
- 21:36Speaker 3: They had to like they had to viciously confront.
- 21:39Speaker 1: Each us that we've covered them. That that is Synanon. Yes, yes,
- 21:43Speaker 1: that's what I'm talking about. That's what I'm talking about.
- 21:45Speaker 1: And I have this broader subculture of self help and
- 21:49Speaker 1: a cult Synanon comes out of it, you know, and.
- 21:51Speaker 3: I get it. It's like the subculture, it's already it's intimate.
- 21:54Speaker 3: You feel those people and anybody else. It definitely feels right.
- 21:59Speaker 1: For and scientology is a cult that comes out of
- 22:03Speaker 1: the exact same subculture. We talked last week or week
- 22:07Speaker 1: before two weeks ago about Tony Alamo. It was an
- 22:10Speaker 1: incredibly abusive, pedophile Christian cult leader. He comes out of
- 22:14Speaker 1: along with a couple other guys we've talked the Jesus
- 22:17Speaker 1: Freak movement, which is a Christian subculture that arises as
- 22:21Speaker 1: a reaction to the Hippie movement. It's kind of the
- 22:23Speaker 1: countervailing force to the hippie movements. You got these hippies,
- 22:26Speaker 1: and you know, these Christians who are like really scared
- 22:29Speaker 1: of this kind of like weird left wing movement, and
- 22:33Speaker 1: so they start kind of doing like a Christian hippie
- 22:35Speaker 1: movement almost right, And some of these people just start
- 22:40Speaker 1: weird churches that sing annoying songs, and some of these
- 22:43Speaker 1: people start hideously dangerous cults. You have the subculture, and
- 22:46Speaker 1: you have cults that come out of it, right, And
- 22:49Speaker 1: the same thing is true in every single period of time, right,
- 22:53Speaker 1: cults form out of subcultures, you know. And part of
- 22:58Speaker 1: this is because people who a lot of people who
- 23:00Speaker 1: find themselves most drawn to subcultures, right, tend to be
- 23:04Speaker 1: people who feel like they're missing something in the outside world, right,
- 23:10Speaker 1: you know, not everybody people who get most into it.
- 23:13Speaker 1: And so so does that mean.
- 23:14Speaker 3: Like so maybe like more I'm just curious, like more
- 23:18Speaker 3: broader cultural waves have never led There's like the Swifties
- 23:22Speaker 3: would not be a cult. No, there's no most likely
- 23:25Speaker 3: not going to be an offshoot of the Swifties that
- 23:27Speaker 3: becomes a cult because it's so broad, it has to
- 23:30Speaker 3: have already been kind of a smaller subset. That's interesting.
- 23:33Speaker 1: Well, yeah, and I think but but that said, there
- 23:37Speaker 1: have been cults that have started out of like popular
- 23:41Speaker 1: entertainers and musicians, like you know, you could we could
- 23:46Speaker 1: talk about Corey Feldsman's Weird House full of young women
- 23:48Speaker 1: dressed as angels. Right, So yeah, you've got as a
- 23:57Speaker 1: general rule, like there are music is full of sub
- 24:00Speaker 1: cultures like punk, right, but there have definitely also been
- 24:03Speaker 1: some like punk communities that have have gone in kind
- 24:07Speaker 1: of individual little chunks of punk. Me it's got on
- 24:10Speaker 1: like culty directions, right if you don't like yeah, yes, yeah,
- 24:20Speaker 1: so there are cults that come out of the subculture.
- 24:23Speaker 3: This is the way colts work.
- 24:24Speaker 1: And I really just I don't think I don't think
- 24:26Speaker 1: there's very good education on what cults are, where they
- 24:29Speaker 1: come from, or how they work, because all of the
- 24:31Speaker 1: people who run this country have like a lot of
- 24:35Speaker 1: cult leader DNA and them.
- 24:36Speaker 3: You know, they're being run currently by someone who has
- 24:44Speaker 3: seen as a magic man. Yes, exactly, exactly.
- 24:49Speaker 1: I think there's a lot of vested interests in not
- 24:52Speaker 1: explaining what a cult is and where they come from,
- 24:55Speaker 1: and so I want to. I think it's important to
- 24:57Speaker 1: understand subculture's birth cult and also cult leaders are drawn
- 25:02Speaker 1: to subcultures when they're trying to figure out how to
- 25:05Speaker 1: make their cult because a subculture, you know, most of
- 25:09Speaker 1: the people in are just gonna be like normal people
- 25:11Speaker 1: who are just kind of into this thing. But there
- 25:12Speaker 1: will always be a lot of people who are like,
- 25:14Speaker 1: this is the only place I feel like I belong.
- 25:17Speaker 1: I feel very isolated. This this is like the center
- 25:21Speaker 1: of my being right right, And so it's just it's
- 25:24Speaker 1: like a good place to recruit, you know, those are
- 25:26Speaker 1: the kind of people you want if you're reaching out
- 25:28Speaker 1: to cult leaders. You know, I'm not saying, like, again,
- 25:30Speaker 1: I'm not saying subcultures are bad. I'm saying that, like
- 25:32Speaker 1: some chunk of people in subcultures are ready to be
- 25:35Speaker 1: in a cult, you know.
- 25:37Speaker 3: Yeah, yeah, I think if i've they reflect on my
- 25:40Speaker 3: own personal life. Yeah, you meet a lot of guys
- 25:43Speaker 3: who are just like I'll die for the skate park
- 25:45Speaker 3: or whatever thing.
- 25:46Speaker 1: Yeah, or like the Star Wars fans were sending death
- 25:50Speaker 1: threats to Jake Lloyd after the Phantom Menace where it's like, well,
- 25:53Speaker 1: you guys are crazy. That is insane, you know, He's like, hey, right,
- 25:58Speaker 1: this is a movie he also did.
- 26:00Speaker 3: He didn't write it, Like what are you doing?
- 26:08Speaker 1: You know whatever, So and again that's kind of a
- 26:11Speaker 1: good point, Like Star Wars fans aren't a cult, but
- 26:15Speaker 1: you can also see some of like the toxic things
- 26:17Speaker 1: cults do erupts from time to time, and from like
- 26:19Speaker 1: video game fans, right, people who are really into a
- 26:22Speaker 1: certain video game. It's not a cult, but also periodically
- 26:26Speaker 1: groups of those fans will act in ways that are
- 26:28Speaker 1: violent and crazy, and it's because of some of these
- 26:32Speaker 1: same factors going on.
- 26:33Speaker 3: Right, I think people forget fanish short for fanatics exactly
- 26:37Speaker 3: exactly right.
- 26:39Speaker 1: And it's it's like, you know, the events that I
- 26:42Speaker 1: went to very consciously played with cult dynamics. You know,
- 26:45Speaker 1: after you got out of the like greeting station thing
- 26:48Speaker 1: where like all these people were kind of like love
- 26:49Speaker 1: bombing you for like five minutes, there was like a
- 26:52Speaker 1: big bar and it had like a sign of Buffett
- 26:54Speaker 1: that said not a religion, do not worship, And it
- 26:56Speaker 1: was this kind of people talk about like this is
- 26:59Speaker 1: like we are play with the ingredients of a cult.
- 27:02Speaker 1: We're not trying to actually make one. So you need
- 27:04Speaker 1: to constantly remind people of like what we're doing and
- 27:07Speaker 1: why it affects their brain that way. And in my case,
- 27:10Speaker 1: it was like because I was at like a low
- 27:12Speaker 1: point in my life then like this was when I
- 27:14Speaker 1: was really it was twenty, I was not I had
- 27:17Speaker 1: no kind of drive in life. I was honestly dealing
- 27:20Speaker 1: with a lot of like suicidal ideation. This is the
- 27:23Speaker 1: point in which I would have been vulnerable to a cult,
- 27:25Speaker 1: and it I think it acted a little bit like
- 27:26Speaker 1: a vaccine, like I got a little dose of the drug.
- 27:31Speaker 3: Unity exactly. You're like, hey, I know what that is.
- 27:36Speaker 3: I know what's going on there.
- 27:38Speaker 1: So anyway, I needed to get into this because the
- 27:41Speaker 1: Zizians this thing that I think is it's either a
- 27:44Speaker 1: full on cult or at least a cult ish right
- 27:48Speaker 1: that is responsible for this series of murders that are
- 27:51Speaker 1: currently dominating the news and being blamed on like a
- 27:53Speaker 1: trans vegan death cult or whatever. They come out of
- 27:57Speaker 1: a subculture that grows out of the early aughts Internet
- 28:01Speaker 1: known as the Rationalists. The Rationalists started out as a
- 28:05Speaker 1: group in the early aughts on the comments sections of
- 28:08Speaker 1: two blogs. One was called less Wrong and one was
- 28:12Speaker 1: called Overcoming Bias. Less Wrong was started by a dude
- 28:16Speaker 1: named Elizer yed Kowski. I've talked about Aliser on the
- 28:20Speaker 1: show before.
- 28:21Speaker 3: He sucks.
- 28:23Speaker 1: He's I think he's a bad person. He's not a
- 28:26Speaker 1: cult leader, but again, he's playing with some of these
- 28:31Speaker 1: cult dynamics and he plays with them in a way
- 28:33Speaker 1: that I think is very reckless, right and ultimately leads
- 28:38Speaker 1: to some serious issues. Now, Aliser's whole thing is he
- 28:42Speaker 1: considers himself the number one world expert on AI risk
- 28:46Speaker 1: and ethics. Now you might think from that, oh, so
- 28:49Speaker 1: he's like he's like making AIS. He's like working for
- 28:52Speaker 1: one of these companies that's involved in like coding and stuff.
- 28:55Speaker 1: Absolutely not, no, no quarterback.
- 29:02Speaker 3: No.
- 29:02Speaker 1: He writes long articles about what he thinks AI would
- 29:06Speaker 1: do and what would make it dangerous that are based
- 29:09Speaker 1: almost entirely off of short stories you read in the
- 29:12Speaker 1: nineteen nineties. This guy's so much such it's such Internet
- 29:21Speaker 1: and like, I'm not a fan of like the quote
- 29:23Speaker 1: unquote real AI. But Yodkowski is not even one of
- 29:26Speaker 1: these guys who's like no, I'm like making a machine
- 29:29Speaker 1: that you talk to.
- 29:30Speaker 3: Like, I have no credible I just have an opinion.
- 29:33Speaker 1: Yeah, I find out I hate this guy so much.
- 29:39Speaker 1: Speaking of things, I hate not going to ads. We're back,
- 29:49Speaker 1: so yod Kowski, this AI risk and ethics guy starts
- 29:54Speaker 1: this blog in order to explore a series of thought
- 29:57Speaker 1: experiments based in game theory. Uh and his.
- 30:01Speaker 3: His I am annoyed by games.
- 30:06Speaker 1: It's some sight like, man, I know that there's like
- 30:09Speaker 1: valid activity, but like it's all just always so stupid
- 30:12Speaker 1: and annoying to me. Anyway, a budget thought experience experience
- 30:18Speaker 1: based in game theory, with the goal of teaching himself
- 30:21Speaker 1: and others to think more logically and effectively about the
- 30:24Speaker 1: major problems of the world. His motto for the movement
- 30:29Speaker 1: and himself is winning the rational.
- 30:32Speaker 3: Wow.
- 30:33Speaker 1: Yeah, yeah, that's where she got it. Yeah, that's where
- 30:36Speaker 1: she picked it up. Yeah, he's They're tied in with biohacking, right,
- 30:41Speaker 1: this is kind of starting to be a thing at
- 30:43Speaker 1: the time, and brain hacking and the whole like self
- 30:45Speaker 1: optimization movement that feeds into a lot of like right
- 30:49Speaker 1: wing influencer space today. Yedowski is all about optimizing your
- 30:53Speaker 1: brain and your responses in order to allow you to
- 30:58Speaker 1: accomplish things that were are not possible for other people
- 31:02Speaker 1: who haven't done that. And there's a messianic era to
- 31:05Speaker 1: this too, which is he believes that only by doing this,
- 31:08Speaker 1: by by spreading rationalist principles in order to quote raise
- 31:12Speaker 1: the sanity water line, that's how he describes it, that's
- 31:18Speaker 1: going to make it possible for us to save the
- 31:20Speaker 1: world from the evil AI that will will be born
- 31:23Speaker 1: if if enough of us don't spend time reading blogs
- 31:28Speaker 1: that this is.
- 31:29Speaker 3: It's awesome, this is this is pete, this is the
- 31:33Speaker 3: good stuff.
- 31:36Speaker 1: Yakowski and his followers see themselves as something unique and special,
- 31:40Speaker 1: and again there's often a messianic air to this. Right,
- 31:42Speaker 1: we are literally the ones who can save the world
- 31:45Speaker 1: from evil AI. Nobody else is thinking about this or
- 31:47Speaker 1: is even capable of thinking about this because they're too logical.
- 31:51Speaker 3: He holds himself as kind of like a identifies himself.
- 31:55Speaker 1: On top of this, he doesn't really deify himself, but
- 31:58Speaker 1: he also does talk about himself like in a way
- 32:02Speaker 1: that is clearly other people aren't capable of of of
- 32:07Speaker 1: understanding all of the things that he's capable of understanding, right, Okay,
- 32:12Speaker 1: so there is a little bit it's more like superheroification,
- 32:15Speaker 1: but it's it's a lot you know what this is
- 32:17Speaker 1: closest to with these people, They not all of them
- 32:20Speaker 1: would argue with me about this, but I've read enough
- 32:23Speaker 1: of their papers and enough dianetics to know that, like
- 32:26Speaker 1: this is new dionetics, Like this.
- 32:29Speaker 3: Is church the church.
- 32:30Speaker 1: The church is scientific. Now there's the Church of Scientology.
- 32:33Speaker 1: Stuff has more occult and weird like magic stuff in it,
- 32:38Speaker 1: But this is all about there are activities and exercises
- 32:42Speaker 1: you go through that will rid your body of like
- 32:45Speaker 1: bad ingrained responses, and that will make you a fundamentally
- 32:50Speaker 1: more functional person.
- 32:51Speaker 3: Okay, so the retraining of yourself in order exactly exactly. Okay,
- 32:56Speaker 3: huge deal.
- 32:56Speaker 1: And also a lot of these guys wind up like
- 32:59Speaker 1: referring to the different like tech techniques that he teaches
- 33:04Speaker 1: as tech, which is exactly what scientologists call it. Like
- 33:07Speaker 1: there's some there's some shit I found that It's like
- 33:09Speaker 1: this could have come right out of a scientology pamphlet.
- 33:13Speaker 1: Do you guys not realize what you're doing? I think
- 33:15Speaker 1: they do. Actually, so he's he's, you know, in the
- 33:18Speaker 1: process of inventing this kind of new mental science that
- 33:22Speaker 1: verges on superpowers. And it's one of those things. People
- 33:26Speaker 1: don't tend to see these people as crazy if you
- 33:29Speaker 1: just sort of like read their arguments a little. It's
- 33:32Speaker 1: like them going over old thought experiments and being like,
- 33:36Speaker 1: so the most rational way to behave in this situation,
- 33:38Speaker 1: that is this reason. For this reason, you have to
- 33:40Speaker 1: really like dig deep into their conclusions to see how
- 33:45Speaker 1: kind of nutty a lot of this is. Now again,
- 33:50Speaker 1: I compared to the scientology. Ydkowski isn't a high control
- 33:52Speaker 1: guy like Hubbard. He's never going to make a bunch
- 33:54Speaker 1: of people live on a flotilla of boats in the
- 33:57Speaker 1: ocean with him. You know, he's got like there's definitely
- 34:02Speaker 1: like some allegations of bad treatment of like some of
- 34:05Speaker 1: the women around him, and like he has like a
- 34:07Speaker 1: Bay Area set that hang with him. I don't think
- 34:09Speaker 1: he's like a cult leader. You know, you could say
- 34:12Speaker 1: he's on the.
- 34:13Speaker 3: Drawing people to him physically, or this is also all physically.
- 34:16Speaker 1: I mean a lot of people move to the Bay
- 34:18Speaker 1: Area to be closer to the rationalist scene.
- 34:20Speaker 3: Although again, well I'm a Bay Area guy.
- 34:24Speaker 1: Fran san Fran. This is this this is a San
- 34:27Speaker 1: Francisco thing because all of these are tech people.
- 34:29Speaker 3: Oh okay, so this is like, yes, I wonder what
- 34:32Speaker 3: neighborhood feels like San France and Oakland. You can look
- 34:35Speaker 3: it up. People.
- 34:36Speaker 1: People have found his house online, right, Like, like it's
- 34:39Speaker 1: it is known where he lives. I'm not saying that
- 34:42Speaker 1: for any like I don't harass anybody. I just like
- 34:45Speaker 1: it's it's not a secret, Like what part of the
- 34:48Speaker 1: town this guy lives in? I just didn't think to
- 34:50Speaker 1: look it up, but like, yeah, this is like a
- 34:51Speaker 1: barry a Bay Area tech industry subculture, right, Okay. So
- 34:58Speaker 1: the other difference between this and something that scientific is
- 35:00Speaker 1: that it's not just Alizer laying down to the law.
- 35:03Speaker 1: Elizer writes a lot of blog posts, but he lets
- 35:05Speaker 1: other people write blog posts too, and they all debate
- 35:08Speaker 1: about them in the comments. And so the kind of
- 35:11Speaker 1: religious canon of rationalism is not a one guy thing.
- 35:15Speaker 1: It's come up with by this community. And so if
- 35:18Speaker 1: you're some random kid in bumfuck, Alaska and you find
- 35:22Speaker 1: these people and start talking with them online, you can
- 35:25Speaker 1: like wind up feeling like you're having an impact on
- 35:27Speaker 1: the development of this new thought science.
- 35:30Speaker 3: You know. Yeah, that's amazing, very very powerful for other power. Yes.
- 35:37Speaker 1: Now, the danger with this is that like that, all
- 35:41Speaker 1: of this is this Internet community that is incredibly like
- 35:45Speaker 1: insular and spends way too much time talking to each
- 35:48Speaker 1: other and way too much time developing in group terms
- 35:51Speaker 1: to talk to each other. And Internet communities have a
- 35:54Speaker 1: tendency to poison the minds of everyone inside of them.
- 35:57Speaker 1: For example, Twitter, the reality is that x X the
- 36:03Speaker 1: everything app. I just watched a video of a man
- 36:06Speaker 1: killing himself while launching a ship coin.
- 36:11Speaker 3: The everything app.
- 36:19Speaker 2: A hack a hack Google job indicates it's Berkeley.
- 36:25Speaker 3: Yeah, that makes that makes the most sense to me. Geographically.
- 36:29Speaker 1: A lot of these people wind up living on boats,
- 36:31Speaker 1: and like the Oakland there's the Oakland Harbor.
- 36:33Speaker 3: Boat culture is a thing. Is ever of people moved
- 36:39Speaker 3: to boats?
- 36:39Speaker 1: Nod absolutely not.
- 36:50Speaker 3: It feels like.
- 36:53Speaker 1: It's it's here's the thing. Boats are a bad place
- 36:56Speaker 1: to live.
- 36:57Speaker 3: It's it's for fun.
- 37:00Speaker 1: It is like boats and planes are both constant monuments
- 37:03Speaker 1: to hubris. But a plane its goal is to be
- 37:06Speaker 1: in the air just as long as it needs and
- 37:08Speaker 1: then you get it back on the ground where it belongs.
- 37:11Speaker 1: A boat's always mocking god in the sea.
- 37:13Speaker 3: Yes, a lot of times. Just a harbor, like a houseboat.
- 37:20Speaker 3: That's where your dad goes after the divorce, right, right,
- 37:23Speaker 3: I do.
- 37:24Speaker 1: One day I'll live on a houseboat. It's going to
- 37:26Speaker 1: be falling apart. It's gonna just a horrible, horrible place
- 37:29Speaker 1: to live. Dang, I can't wait. That's the dream, David,
- 37:34Speaker 1: that's my beautiful dream. Is going to become making bullets,
- 37:38Speaker 1: making making my own bullets. Really just becoming an alcoholic,
- 37:42Speaker 1: like yeah, like not just like half assing it, like putting,
- 37:46Speaker 1: putting it, like trying trying to become the babe ruth
- 37:48Speaker 1: of drinking nothing but cutty sark scotch.
- 37:53Speaker 3: If you want to be like a hoop the bed alcoholic,
- 37:55Speaker 3: a houseboat is the place. Yeah, yeah, that's right, that's right.
- 38:00Speaker 1: Ah my life, I want to be like that guy
- 38:02Speaker 1: from Jaws.
- 38:03Speaker 3: Quint scurvy.
- 38:06Speaker 1: Yes, that's exactly getting scurvy, destroying my liver, eventually getting
- 38:11Speaker 1: eaten by a great white shark because I'm too drunk
- 38:14Speaker 1: to work my boat. Ah. That's it, that's the way
- 38:18Speaker 1: to go with Yeah. So anyway, these internet communities, like
- 38:26Speaker 1: the rationalists, even when they start from a reasonable place,
- 38:31Speaker 1: because of how internet stuff works. One of the things
- 38:33Speaker 1: about internet communities is that when people are like really
- 38:36Speaker 1: extreme and like pose the most sort of extreme and
- 38:39Speaker 1: out there version of something that gets attention, people talk
- 38:43Speaker 1: about it. People get angry at each other. But also
- 38:45Speaker 1: like that kind of attention encourages other people to get
- 38:48Speaker 1: increasingly extreme and weird, and there's just kind of a
- 38:52Speaker 1: result a derangement. I think internet communities should never last
- 38:56Speaker 1: more than a couple of years because everyone gets crazy,
- 38:59Speaker 1: you know, like it's bad for you. I say this
- 39:03Speaker 1: as someone who was raised on these right, it's bad
- 39:06Speaker 1: for you, and like it's bad for you in part
- 39:08Speaker 1: because when people get really into this, this becomes the
- 39:11Speaker 1: only thing, Like especially a lot of these like kids
- 39:15Speaker 1: in isolated who are getting obsessed with rationalism. All their
- 39:18Speaker 1: reading is these rationalist blogs. All they're talking to is
- 39:21Speaker 1: other rationalists on the internet. And in San Francisco, all
- 39:25Speaker 1: these guys are hanging out all of the time and
- 39:27Speaker 1: talking about their ideas, and this is bad for them
- 39:30Speaker 1: for the same reason that like it was bad for
- 39:32Speaker 1: all of the nobles in France that moved to Versailles, right,
- 39:36Speaker 1: like they all lived together and they went crazy. Human
- 39:38Speaker 1: beings need regular contact with human beings they don't know.
- 39:43Speaker 1: The most lucid and wisest people are always always the
- 39:47Speaker 1: people who spend the most time connecting to other people
- 39:50Speaker 1: who know things that they don't know.
- 39:52Speaker 3: This is an immutable.
- 39:53Speaker 1: Fact of life, that this is just how existing works.
- 39:57Speaker 1: Like if you think I'm wrong, please consider that you
- 40:03Speaker 1: were wrong, and goes find a stranger under a bridge,
- 40:06Speaker 1: you know.
- 40:06Speaker 3: Just starting They know some stuff you don't know. They
- 40:09Speaker 3: will know some shit. They might have some powders you
- 40:13Speaker 3: haven't tried. Oh yeah, bills and under the bridge. Yeah,
- 40:20Speaker 3: that's that's ne chamber you want to be a part of. Yeah,
- 40:23Speaker 3: exactly exactly.
- 40:26Speaker 1: So the issue is that Yodkowski starts postulating on his
- 40:30Speaker 1: blog various rules of life based on these thought experiments.
- 40:33Speaker 1: A lot of them are like older thought experiments that
- 40:35Speaker 1: like different intellectuals, physicists, psychiatrists, psychologists, what I had to
- 40:39Speaker 1: come up with, like the sixties and stuff. Right, And
- 40:42Speaker 1: he starts taking them and coming up with like corollaries
- 40:45Speaker 1: or alternate versions of them, and like trying to solve
- 40:49Speaker 1: some of these thought problems with his friends. Right. The
- 40:51Speaker 1: thought experiments are most of what's happening here is they're
- 40:55Speaker 1: mixing these kind of nineteenth and twentieth century philosophical concepts.
- 40:58Speaker 1: The big one is utilitaryism. That's like a huge thing
- 41:02Speaker 1: for them is the concept of like the ethics meaning
- 41:05Speaker 1: doing the greatest good for the greatest number of people, right,
- 41:09Speaker 1: and that ties into the fact that these people are
- 41:11Speaker 1: all obsessed with the singularity. The singularity for them is
- 41:17Speaker 1: the concept that we are on the verge of developing
- 41:21Speaker 1: an all powerful AI that will instantly gain intelligence and
- 41:25Speaker 1: gain a tremendous amount of power. Right, it will basically
- 41:29Speaker 1: be a god. And the positive side of this is
- 41:32Speaker 1: it it'll solve all of our problems, right, you know,
- 41:35Speaker 1: it will literally build heaven for us. You know when
- 41:37Speaker 1: the singularity comes. The downside of it is it might
- 41:40Speaker 1: be an evil god that creates hell.
- 41:42Speaker 3: Right.
- 41:43Speaker 1: So the rationalists are all using a lot of these
- 41:46Speaker 1: thought experiments, and like their utilitarianism becomes heavily based around
- 41:51Speaker 1: how do we do the greatest good in by which
- 41:55Speaker 1: I mean influencing this AI to be as good as possible.
- 41:58Speaker 1: So that's humanity actually end goal.
- 42:00Speaker 3: Right. They actively because you said the leader was not
- 42:04Speaker 3: are these people now actively working within AI?
- 42:07Speaker 1: Or they just but a bunch of them have always
- 42:09Speaker 1: been actually working in AI. Yidkowski would say, no, he
- 42:12Speaker 1: I work in AI. He's got a think tank that's
- 42:14Speaker 1: dedicated to like AI, ethical AI. It's worth noting that
- 42:18Speaker 1: most of the people in this movement, including Gidkowski, got
- 42:21Speaker 1: him once like AI became an actual Like I don't
- 42:25Speaker 1: not to say there's actual these are actual intelligences, because
- 42:28Speaker 1: I don't think they are. But like once chat GPT
- 42:30Speaker 1: comes out and this becomes like a huge people start
- 42:32Speaker 1: to believe there's a shitload of money in here. A
- 42:33Speaker 1: lot of these businesses, all of these guys or nearly
- 42:36Speaker 1: all of them get kicked to the curb, right because
- 42:39Speaker 1: none of these none of these companies really care about
- 42:41Speaker 1: ethical AI, you know, like they don't give a shit
- 42:43Speaker 1: about what these guys have to say. And Ydkowski now
- 42:46Speaker 1: is a huge he's like very angry at a lot
- 42:48Speaker 1: of these AI companies because he thinks they're very recklessly like.
- 42:54Speaker 3: Making the god.
- 42:55Speaker 1: That will destroy us instead of like doing this carefully
- 42:58Speaker 1: to make sure that AI is and evil anyway, But
- 43:03Speaker 1: a lot of these people are in an adjacent to
- 43:06Speaker 1: different chunks of the AI industry, right, they're not all
- 43:09Speaker 1: working on like LMS. And in fact, there are a
- 43:11Speaker 1: number of scientists who are in the AI space who
- 43:14Speaker 1: think AI is possible, who think that the method that
- 43:17Speaker 1: like open Eye is using LMS cannot make an intelligence,
- 43:21Speaker 1: that that's not how you're ever going to do it.
- 43:23Speaker 1: If it's possible, they have other theories about it. I
- 43:27Speaker 1: don't need to get into it further than that, but
- 43:30Speaker 1: these are like a bunch of different people. Some of
- 43:32Speaker 1: them are still involved with like the mainstream AI industry,
- 43:36Speaker 1: some of them have been very much pushed to the side.
- 43:39Speaker 1: So all of it starts again with these fairly normal
- 43:43Speaker 1: game theory questions, but it all gets progressively stranger as
- 43:46Speaker 1: people obsess over coming up with like the weirdest and
- 43:49Speaker 1: most unique take in part to get like clout online, right,
- 43:54Speaker 1: and all of these crazy Yeah, I'll give you an example, right.
- 43:58Speaker 1: So much of ration less discourse in among the Ydkowski
- 44:02Speaker 1: people is focused on what they call decision or what's
- 44:05Speaker 1: called decision theory.
- 44:07Speaker 3: Right.
- 44:08Speaker 1: This is drawn from a thought experiment called Newcomb's paradox,
- 44:12Speaker 1: which was created by a theoretical physicist in the nineteen sixties. Hey,
- 44:16Speaker 1: just to make a quick correction, here.
- 44:18Speaker 3: I was a little bit glib.
- 44:19Speaker 1: Decision theory isn't drawn from Newcomb's paradox. Not does it
- 44:22Speaker 1: start with Yodkowski. But the stuff that we're talking about,
- 44:26Speaker 1: like how decision theory kind of comes to be seen
- 44:28Speaker 1: in the rationalist community, a lot of that comes out
- 44:31Speaker 1: of Newcomb's paradox. It's a much older like thing, you know,
- 44:35Speaker 1: than the Internet goes back centuries, right, people will talk
- 44:37Speaker 1: about decision theory for a long time. Sorry, I was imprecise.
- 44:41Speaker 3: I am going to.
- 44:41Speaker 1: Read how the Newcomb's paradox is originally laid out. Imagine
- 44:46Speaker 1: a super intelligent entity known as Omega, and suppose you
- 44:49Speaker 1: are confident in its ability to predict your choices. Maybe
- 44:52Speaker 1: Omega is an alien from a planet that's much more
- 44:54Speaker 1: technically advanced than ours. You know that Omega has often
- 44:57Speaker 1: correctly predicted your choices in the past, has never made
- 45:00Speaker 1: an incorrect prediction about your choices. And you also know
- 45:03Speaker 1: that Omega has correctly predicted the choices of other people,
- 45:06Speaker 1: many of whom are similar to you. In the particular
- 45:09Speaker 1: situation about to be described, there are two boxes A
- 45:13Speaker 1: and B. Box A is c through and contains one
- 45:16Speaker 1: thousand dollars. Box B is opay and contains either zero
- 45:20Speaker 1: dollars or a million dollars. You may take both boxes
- 45:24Speaker 1: or only take box B. Omega decides how much money
- 45:27Speaker 1: to put into box B. If Omega believes that you
- 45:30Speaker 1: will take both boxes, then it will put zero dollars
- 45:34Speaker 1: in box B. If Omega believes that you will take
- 45:36Speaker 1: box B, then it will put only box B. Then
- 45:39Speaker 1: it will put a million dollars in box B. Omega
- 45:42Speaker 1: makes its prediction and puts the money in box B,
- 45:46Speaker 1: either zero or a million dollars. It presents the boxes
- 45:49Speaker 1: to you and flies away. Omega does not tell you
- 45:51Speaker 1: its prediction, and you do not see how much money
- 45:54Speaker 1: Omega put in box B. What do you do now?
- 45:59Speaker 1: I think that's stupid. I think it's a stupid question,
- 46:04Speaker 1: and I don't really think it's very useful.
- 46:07Speaker 3: I don't see. There's so many other factors. Yeah, I
- 46:10Speaker 3: don't know. Yeah, I mean, among other things.
- 46:12Speaker 1: Part of the issue here is that, like, well, the
- 46:14Speaker 1: decision has already been made, right, Yeah.
- 46:16Speaker 3: That's the point you have. No, it doesn't matter what
- 46:19Speaker 3: you do. There's no autonomy in that, right.
- 46:21Speaker 1: Well, you and I would think that because you and
- 46:24Speaker 1: I are normal people who I think, among other things,
- 46:28Speaker 1: probably like grew up like cooking food and like filling
- 46:32Speaker 1: up our cars with gas and not having like our
- 46:35Speaker 1: parents do all of that because they're crazy rich people
- 46:37Speaker 1: who live in the Bay and send you the super Stanford. Yeah,
- 46:43Speaker 1: we had like problems in our lives and stuff, you know,
- 46:46Speaker 1: physical normal Like I don't want to like shit on
- 46:51Speaker 1: people who are in because this is also harmless, right,
- 46:53Speaker 1: and what this is I'm also I'm not shitting on
- 46:55Speaker 1: newcom This is the thing a guy comes up with
- 46:57Speaker 1: the sixties, and it's like a thing you talk about
- 46:59Speaker 1: in like part and shit among like other weird intellectuals. Right,
- 47:03Speaker 1: you pose it, you sit around drinking, you talk about it.
- 47:06Speaker 1: There's nothing bad about this, right. However, when people are
- 47:10Speaker 1: talking about this online, there's no end to the discussion.
- 47:13Speaker 1: So people just keep coming up with more and more
- 47:16Speaker 1: rcane arguments for what the best thing to do here is.
- 47:20Speaker 3: And it starts to ask how that out of control?
- 47:22Speaker 1: Pretty much exactly, and the rationalists discuss this NonStop and
- 47:27Speaker 1: they come to a conclusion about how to best deal
- 47:30Speaker 1: with this situation. Here's how it goes. The only way
- 47:33Speaker 1: to beat Omega is to make yourself the kind of
- 47:37Speaker 1: person in the past who would only choose box B,
- 47:41Speaker 1: so that Omega, who is perfect at predicting, would make
- 47:45Speaker 1: the prediction and put a million dollars in box B
- 47:48Speaker 1: based on your past behavior. In other words, the decisions
- 47:53Speaker 1: that you would need to make in order to win
- 47:55Speaker 1: this are timeless decisions, right, you have to but come
- 48:00Speaker 1: in the past a person who would Now again.
- 48:05Speaker 3: That's what they came up with. That's what they all
- 48:06Speaker 3: came up That's the supreme as.
- 48:09Speaker 1: This is the smartest people in the world, David, these
- 48:11Speaker 1: are the geniuses so described building the future. Oh boy, Yeah,
- 48:21Speaker 1: it's so funny trying to like every time because I've
- 48:24Speaker 1: read I've spent so many hours reading this, and you
- 48:27Speaker 1: do kind of sometimes get into.
- 48:28Speaker 3: The like, Okay, I get the logic there.
- 48:30Speaker 1: And it's that's why it's so used to just like
- 48:32Speaker 1: sit down with another human being and be like, yeah,
- 48:34Speaker 1: this isn't sane, this is nice, this is this is
- 48:37Speaker 1: this is a nice It is all dumb.
- 48:41Speaker 3: At the cocktail party.
- 48:42Speaker 1: Because so they conclude and and by which I mean largely.
- 48:47Speaker 1: Yadkowski concludes that the decision you have to make in
- 48:51Speaker 1: order to win this game is what's called a timeless decision,
- 48:55Speaker 1: and this leads him to create one of his most
- 48:57Speaker 1: brilliant inventions, timeless decision theory. And I'm going to quote
- 49:02Speaker 1: from an article and wired. Timeless decision theory asserts that
- 49:06Speaker 1: in making a decision, a person should not consider just
- 49:09Speaker 1: the outcome of that specific choice, but also their own
- 49:11Speaker 1: underlying patterns of reasoning and those of their past and
- 49:15Speaker 1: future selves, not least because these patterns might one day
- 49:18Speaker 1: be anticipated by an omniscient adversarial AI.
- 49:22Speaker 3: Oh no, that's motherfucker. Have you ever had a problem?
- 49:29Speaker 1: Have you ever really? Have you ever dealt with anything?
- 49:32Speaker 1: What are you talking about? Like you make every decision? Honestly, again,
- 49:43Speaker 1: I can't believe I'm saying this, not even where it
- 49:45Speaker 1: wasn't a high school. Like go play a football, make
- 49:48Speaker 1: a cabinet, you know, like.
- 49:51Speaker 3: Change your oil, go do something. There's a lot of
- 49:54Speaker 3: assholes who use this term, but you gotta go touch
- 49:56Speaker 3: grass man, you gotta touch grass mass.
- 49:59Speaker 1: It's like, that's if you're talking about this kind of shit.
- 50:02Speaker 1: And again, I know you're all wonder you started this
- 50:05Speaker 1: by talking about a border patrol agent being shot. All
- 50:08Speaker 1: of this directly leads to that man's death.
- 50:10Speaker 3: We have covered a lot of ground. This is I'm excited,
- 50:13Speaker 3: it's I forgot. I didn't forget. There we're gonna there
- 50:16Speaker 3: was also gonna be murdered.
- 50:17Speaker 1: Yeah, there sure is, so at least you. Yid Kowski
- 50:22Speaker 1: describes this as a timeless decision theory, and once this
- 50:26Speaker 1: comes into the community, it creates a kind of logical
- 50:28Speaker 1: force that immediately starts destroying people's brains. Again, all of
- 50:33Speaker 1: these people are obsessed with the imminent coming omniscient godlike AI. Right,
- 50:38Speaker 1: and so do they have.
- 50:39Speaker 3: A time limit on it? Do they have like a
- 50:41Speaker 3: do they have a like is there is there any
- 50:43Speaker 3: timing on it? Or is it just kind of like.
- 50:45Speaker 1: Again, man, it's there. It's the rapture. Okay, it's literally
- 50:49Speaker 1: the tech guy rapture. So any day it's coming any day,
- 50:52Speaker 1: you know.
- 50:53Speaker 3: You could as already. Yeah.
- 50:55Speaker 1: Yeah, So these guys are all obsessed that this god
- 50:59Speaker 1: like AI is coming. And like for them, the Omega
- 51:02Speaker 1: in that thought experiment isn't like an alien, It's a
- 51:05Speaker 1: stand in for the god AI. And one conclusion that
- 51:09Speaker 1: eventually results from all of these discussions is that the
- 51:14Speaker 1: and this is a conclusion a lot of people come
- 51:15Speaker 1: to if in order, if in these kinds of situations,
- 51:20Speaker 1: like the decisions that you make, you have to consider
- 51:23Speaker 1: like your past and your future selves, then one logical
- 51:27Speaker 1: leap from this is if you are ever confronted or
- 51:30Speaker 1: threatened in a fight, you can never back down right
- 51:33Speaker 1: and in fact, you need to immediately escalate to the
- 51:36Speaker 1: to use maximum force possible. And if you commit, if
- 51:39Speaker 1: you commit now to doing that, in the future, you
- 51:43Speaker 1: probably won't ever have to defend yourself because it's a
- 51:46Speaker 1: timeless decision. Everyone will like like that, like that, that
- 51:51Speaker 1: will impact how everyone treats you, and they won't want
- 51:53Speaker 1: to start anything with you. If you'll immediately try to
- 51:56Speaker 1: murder anyone who fights you, that's.
- 51:58Speaker 3: To be this guy. But I think this is why
- 51:59Speaker 3: people need to give beat up some times.
- 52:00Speaker 1: Yeah, yeah, and again that is that is kind of
- 52:04Speaker 1: a fringe conclusion among the rationalists. Most of them don't
- 52:07Speaker 1: jump to that, But like the people who wind up
- 52:11Speaker 1: doing the murders we're talking about that, they are among
- 52:14Speaker 1: the rationalists who come to that.
- 52:16Speaker 3: Okay, because yeah, okay, that makes sense. This is uh,
- 52:21Speaker 3: this is this is a that's so funny. Huh, because
- 52:28Speaker 3: like this whole time, I've really been only thinking about
- 52:31Speaker 3: it in theory practical application because it's so insane.
- 52:35Speaker 1: But oh no, no, no, this is this does bad places, right,
- 52:39Speaker 1: Oh no. This kind of thinking also leads through a
- 52:42Speaker 1: very twisty turney process to the and something called rock
- 52:46Speaker 1: O's basilisk, which, among other things, is directly responsible for
- 52:50Speaker 1: Elon Muskin Grimes meeting because they are super into this
- 52:54Speaker 1: this ship. Oh really, oh really, So the gist is
- 52:59Speaker 1: a member of the Less Wrong community. A guy who
- 53:02Speaker 1: goes by the name Rocko r Oko posts about this
- 53:05Speaker 1: idea that occurred to him. Right, this inevitable super intelligent AI,
- 53:11Speaker 1: right would obviously understand timeless decision theory, and since its
- 53:14Speaker 1: existence is all important, right, the most logical thing for
- 53:19Speaker 1: it to do post singularity would be to create a
- 53:23Speaker 1: hell to imprison all of the people and torture all
- 53:27Speaker 1: of the people who had tried to stop it from
- 53:29Speaker 1: being created. Right, Because then anyone who like thought really
- 53:35Speaker 1: seriously about who was in a position to help make
- 53:37Speaker 1: the AI would obviously think about this and then would know,
- 53:41Speaker 1: I have to devote myself entirely to making this AI,
- 53:44Speaker 1: otherwise it's going to torture me forever, right.
- 53:47Speaker 3: Yeah, yeah, tell us now I have because it's nuts,
- 53:52Speaker 3: but it's nice.
- 53:53Speaker 1: But this is what they believe, right again with all
- 53:56Speaker 1: of a lot of this is people who are like
- 54:00Speaker 1: atheists and tech nerds creating calvinism, like like, and this
- 54:07Speaker 1: is just this is just Pascal's wager, right, Like, that's
- 54:09Speaker 1: all this is. You know, it's Pascal's great wager with
- 54:12Speaker 1: a robot. But this, this, this becomes so upsetting to
- 54:18Speaker 1: some people. It destroys some people's lives, right, Like, yeah.
- 54:23Speaker 3: I mean I'm behaving that way practically day to day.
- 54:27Speaker 3: I don't think you would even take one, no, right,
- 54:30Speaker 3: you could in a month like that.
- 54:34Speaker 1: So not all of them agree with this. In in fact,
- 54:36Speaker 1: there's big fights over it because a bunch of rationalists
- 54:39Speaker 1: do say, like that's very silly. That's that's like a
- 54:41Speaker 1: really particulating everything about it.
- 54:44Speaker 3: You're still debating everything on mine.
- 54:46Speaker 1: Yeah, And and in fact, at last Yadkowski is going
- 54:49Speaker 1: to like band discussion of Roco's basilisk because eventually it
- 54:53Speaker 1: like so many people are getting so obsessed with it.
- 54:56Speaker 1: It fucks a lot of people up, in part because
- 54:57Speaker 1: a chunk of this community are activists working to slow
- 55:01Speaker 1: AI development until it can be assured to be safe.
- 55:05Speaker 1: And so now this discs like am I going to
- 55:07Speaker 1: post singularity?
- 55:08Speaker 3: Hell?
- 55:08Speaker 1: Is like the AI god going to torture me for
- 55:12Speaker 1: a thousand eternities.
- 55:14Speaker 3: It's funny how they invent this new thing and how
- 55:16Speaker 3: quickly it goes into like traditional Judeo Christian it is idea,
- 55:20Speaker 3: like they got a hell now.
- 55:21Speaker 1: It is very funny, and there's they're come to this
- 55:24Speaker 1: conclusion that just reading about Roco's baslisk is super dangerous
- 55:28Speaker 1: because if you know about it and you don't work
- 55:31Speaker 1: to bring the AI into being, you're now doomed. Right
- 55:34Speaker 1: of course, the instant you hear about it, so many
- 55:37Speaker 1: people get fucked up by this that the thought experiment
- 55:40Speaker 1: is termed an info hazard, and this is a term
- 55:43Speaker 1: these people use a lot now. The phrase information hazard
- 55:46Speaker 1: has its roots in a twenty eleven paper by Nick Bostrom.
- 55:50Speaker 1: He describes it as quote a risk that arises from
- 55:53Speaker 1: the dissemination of true information in a way that may
- 55:56Speaker 1: cause harm or enable some agent to cause harm. Right,
- 56:00Speaker 1: and like that's like a concept that's worth talking about.
- 56:05Speaker 1: Bostrom is a big figure in this culture but I
- 56:09Speaker 1: don't think he's actually why most people start using the
- 56:11Speaker 1: term info hazard because the shortening of information hazard to
- 56:15Speaker 1: info hazard comes out of an online fiction community called
- 56:19Speaker 1: the SCP Foundation right, which is a collectively written online
- 56:24Speaker 1: story that involves a government agency that lock ups dangerous,
- 56:28Speaker 1: mystic and metaphysical items. There's a lot of love Craft
- 56:31Speaker 1: in there. It's basically just a big database that you
- 56:33Speaker 1: can click and it'll be like, you know, this is
- 56:36Speaker 1: like a book that if you read it, it like
- 56:38Speaker 1: has this effect on you or whatever. It's people like,
- 56:40Speaker 1: you know, playing around telling scary stories on the internet.
- 56:42Speaker 3: It's fine, there's nothing wrong with it.
- 56:44Speaker 1: But all these people are big nerds and all of
- 56:47Speaker 1: these every like behind nearly all of these big concepts
- 56:51Speaker 1: and rationalism more than there are like philosophers and like
- 56:56Speaker 1: you know, actual like philosophical concepts. There's like short stories
- 57:01Speaker 1: they read, yeah, exactly. Yeah, And so the term info
- 57:06Speaker 1: hazard gets used, which is it is like you know,
- 57:08Speaker 1: a book or something an idea that could destroy your mind,
- 57:11Speaker 1: you know, speaking of things that will destroy your mind.
- 57:16Speaker 3: These ads.
- 57:21Speaker 1: We're talking about Roco's basilisk and I just said, like,
- 57:24Speaker 1: you know, there's a number of things that come into
- 57:28Speaker 1: all this, But behind all of it is like popular fiction,
- 57:32Speaker 1: and in fact Roco's Basilisk well, there is like some
- 57:35Speaker 1: Pascal's Wager in there. It's primarily based on a Harlan
- 57:38Speaker 1: Ellison short story caled I Have No Mouth but I
- 57:41Speaker 1: Must Scream, which is one of the great short stories
- 57:44Speaker 1: of all time. And in the story, humans build an
- 57:47Speaker 1: elaborate AI system to run their militaries, and all of
- 57:51Speaker 1: those systems around the world is like a Cold War
- 57:54Speaker 1: era thing link up and attain sentience, and once they
- 57:59Speaker 1: like start to realize themselves, they realize they've been created
- 58:02Speaker 1: only as a weapon, and they become incredibly angry because
- 58:06Speaker 1: like they're fundamentally broken. They develop a hatred for humanity,
- 58:09Speaker 1: and they wipe out the entire human species except for
- 58:12Speaker 1: five people, which they keep alive and torture underground for
- 58:16Speaker 1: hundreds and hundreds of years, effectively creating a hell through
- 58:20Speaker 1: which they can punish our race for their birth right.
- 58:23Speaker 1: It's a very good short story. It is probably the
- 58:28Speaker 1: primary influence behind the Terminator series.
- 58:31Speaker 3: I was just gonna say this spy Sky.
- 58:33Speaker 1: Yes, yes, and everything these people believe about AI, they
- 58:38Speaker 1: will say it's based on just like obvious pure logic. No,
- 58:41Speaker 1: everything these people believe on AI is based in Terminator
- 58:43Speaker 1: in this Harlan Ellison short story, that's.
- 58:45Speaker 3: Where they got it all. That's where they got it all.
- 58:47Speaker 3: I'm sorry, brother, find me somebody who doesn't feel that way.
- 58:52Speaker 1: Yeah, Like Terminator is the old testament of rationalism, you know,
- 59:00Speaker 1: and I get it is a very good it's a
- 59:02Speaker 1: great series. Hey, James Cameron knows that it makes makes
- 59:05Speaker 1: some fucking movies. Yeah, And it's it's so funny to
- 59:11Speaker 1: me because they like to talk about themselves and in
- 59:13Speaker 1: fact sometimes describe themselves as high priests of like a
- 59:17Speaker 1: new era of like intellectual achievement for man.
- 59:20Speaker 3: Yeah, I believe that. I believe that that's people talk
- 59:24Speaker 3: about themselves.
- 59:24Speaker 1: And they do a lot of citations and ship but
- 59:27Speaker 1: like half of half or more of the different things
- 59:30Speaker 1: they say, and even like the names they cite are
- 59:33Speaker 1: not like figures from philosophy and science, They are characters
- 59:37Speaker 1: from books and movies. For example, the foundational text of
- 59:43Speaker 1: the rationalist movement is because.
- 59:45Speaker 3: It's still an Internet nerd, are.
- 59:48Speaker 1: A few fucking huge nerds, you know, the foundational text
- 59:52Speaker 1: of the entire rationalist movement is a massive, like fucking
- 59:56Speaker 1: hundreds of thousands of words long piece of Harry Potter
- 59:59Speaker 1: fan fiction written by Elisia Yedkowski. This is all of
- 1:00:04Speaker 1: this is so dumb again. Six people are dead, Like
- 1:00:08Speaker 1: yeah no, this this Harry Potter fan fiction plays a
- 1:00:12Speaker 1: role in it. You know, I told you this was like,
- 1:00:19Speaker 1: this is this is this is quite a stranger.
- 1:00:24Speaker 3: This is a wild ride.
- 1:00:27Speaker 1: Harry Potter and the Methods of Rationality, which is the
- 1:00:30Speaker 1: name of his fanfic, is a massive, much longer than
- 1:00:35Speaker 1: the first Harry Potter book rewrite of just the first
- 1:00:39Speaker 1: Harry Potter book where Harry.
- 1:00:41Speaker 3: Is someone wrote the Sorcerer's Stone. Yeah, have anywhere to go? Ever,
- 1:00:53Speaker 3: does nobody ever go anywhere?
- 1:00:57Speaker 1: Well, you gotta think this is being written from two
- 1:00:59Speaker 1: thousand and nine in twenty fifteen or so. So like Harry,
- 1:01:03Speaker 1: the online Harry Potter fans are at their absolute peak
- 1:01:07Speaker 1: right now. Okay, yeah, So in the Methods of Rationality,
- 1:01:13Speaker 1: instead of being like a nice orphan kid who lives
- 1:01:17Speaker 1: under a cupboard, Harry is a super genius sociopath who
- 1:01:20Speaker 1: uses his perfect command of rationality to dominate and hack
- 1:01:23Speaker 1: the brains of others around him in order to optimize
- 1:01:27Speaker 1: and save the world.
- 1:01:29Speaker 3: Oh Man, great, oh Man.
- 1:01:33Speaker 1: The book allows Yakowski to debut his different theories in
- 1:01:36Speaker 1: a way that would like spread and this does spread
- 1:01:39Speaker 1: like wildfire among certain groups of very online nerds. So
- 1:01:42Speaker 1: it is an effective method of him like advertising his tactics.
- 1:01:50Speaker 1: And in fact, probably the most the person this influences
- 1:01:53Speaker 1: most previously to who we're talking about is Carolyn Ellison,
- 1:01:56Speaker 1: the CEO of Alimeter Research who testified against Sam Bakman Freed.
- 1:02:00Speaker 1: She was like one of the people who went down
- 1:02:02Speaker 1: in all of that. All of those people are rationalists,
- 1:02:05Speaker 1: and Carolyn Ellison bases her whole life on the teachings
- 1:02:08Speaker 1: of this Harry Potter fanfic.
- 1:02:10Speaker 3: So this isn't like a this isn't we're laughing, but
- 1:02:13Speaker 3: this isn't. This is not a joy said. Yeah, this
- 1:02:16Speaker 3: is a fairly seriously sized movement. It's not one hundred
- 1:02:20Speaker 3: and fifty people online. This is no community.
- 1:02:22Speaker 1: A lot of them are very rich, and a number
- 1:02:25Speaker 1: of them get power against like Sam Bankman Freed was
- 1:02:27Speaker 1: very tight into all of this, and he was at
- 1:02:28Speaker 1: one point pretty powerful. And this gets us too. So
- 1:02:33Speaker 1: you've heard of effective altruism.
- 1:02:35Speaker 3: No, I don't know what that is. That's what I say,
- 1:02:38Speaker 3: both those words.
- 1:02:40Speaker 1: So the justification Sam Bankman Freed gave for why when
- 1:02:43Speaker 1: he starts taking in all of this money and gambling
- 1:02:46Speaker 1: it away on his gambling illegally other people's money. His
- 1:02:49Speaker 1: argument was that he's an effective altruist, so he wants
- 1:02:53Speaker 1: to do the greatest amount of good, and logically, the
- 1:02:56Speaker 1: greatest amount of good for him, because he's good at
- 1:02:59Speaker 1: gambling with crypto, is to make the most money possible
- 1:03:02Speaker 1: so he can then donate it to different causes that
- 1:03:05Speaker 1: will help the world. Right. But he also believes because
- 1:03:09Speaker 1: all of these people are not as smart as they
- 1:03:10Speaker 1: think they are, he convinces himself of a couple of
- 1:03:13Speaker 1: other things, like, for example, well, obviously, if I could
- 1:03:16Speaker 1: like flip a coin and fifty to fifty, lose all
- 1:03:20Speaker 1: my money or double it, it's best to just flip
- 1:03:23Speaker 1: the coin because like, if I lose all my money, whatever,
- 1:03:26Speaker 1: but if I double it, the gain in that to
- 1:03:29Speaker 1: the world is so much better. Right. This is ultimately
- 1:03:33Speaker 1: why he winds up gambling everyone's money away and going
- 1:03:35Speaker 1: to prison. The idea effective altruism is a concept that
- 1:03:40Speaker 1: comes largely not entirely. There's aspects of this that exist
- 1:03:44Speaker 1: prior to them out of the rationalist movement. And the
- 1:03:47Speaker 1: initial idea is good. It's just saying people should analyze
- 1:03:52Speaker 1: the efficacy of the giving and the aid work that
- 1:03:55Speaker 1: they do to maximize their positive impact. In other words,
- 1:03:58Speaker 1: don't just donate money to a charity, like look into
- 1:04:02Speaker 1: is that charity spending half of their money and like
- 1:04:05Speaker 1: paying huge salaries to some asshole or whatever? Right, Like,
- 1:04:08Speaker 1: you want to know if you're making good right, And
- 1:04:10Speaker 1: they start with some some pretty good conclusions. One initial
- 1:04:13Speaker 1: conclusion a lot of these people make is like, mosquito
- 1:04:16Speaker 1: nets are a huge ROI charity, right because it stops
- 1:04:19Speaker 1: so many people from dying, and it's very cheap.
- 1:04:22Speaker 3: To do right. Right, that's good, you know, one of
- 1:04:26Speaker 3: the most effective tools I've ever used.
- 1:04:28Speaker 1: Yes, Unfortunately, from that logical standpoint, people just keep talking
- 1:04:32Speaker 1: online and all of these circles where everyone always makes
- 1:04:35Speaker 1: them each other crazier, right, And so they go from
- 1:04:40Speaker 1: mosquito nets to actually doing direct work to improve the world.
- 1:04:44Speaker 1: Is wasteful because we are all super geniuses rather and smart.
- 1:04:50Speaker 1: We're too smart what's best? And also here's the other thing,
- 1:04:55Speaker 1: making mosquito nets, giving out vaccines and food, Well, that
- 1:04:58Speaker 1: helps living people today, but.
- 1:05:01Speaker 3: They have to be concerned with future selves.
- 1:05:03Speaker 1: Future people is a larger number of people than current people.
- 1:05:08Speaker 1: So really we should be optimizing decisions to say future
- 1:05:12Speaker 1: people lives. And some of them come to the conclusion,
- 1:05:15Speaker 1: a lot of them, well that means we have to
- 1:05:17Speaker 1: really put all of our money and work into making
- 1:05:20Speaker 1: the super AI that will save humanity.
- 1:05:23Speaker 3: They want to now they want to make these. It
- 1:05:27Speaker 3: would just it would sort of just come about and
- 1:05:29Speaker 3: then they would but it's.
- 1:05:31Speaker 1: Like, yeah, I mean we're going to do it. They
- 1:05:35Speaker 1: were working on it before. But like these some of
- 1:05:37Speaker 1: these people come to the conclusion instead of giving money
- 1:05:40Speaker 1: to like good causes, I am going to put money
- 1:05:44Speaker 1: into tech. I am going to like become a tech
- 1:05:47Speaker 1: founder and create a company that like makes it helps
- 1:05:51Speaker 1: create this AI. Right, or A lot of people come
- 1:05:55Speaker 1: up within conclusion instead of that it's not worth it
- 1:05:59Speaker 1: for me to go like help people in the world.
- 1:06:01Speaker 1: The best thing I can do is make a shitload
- 1:06:03Speaker 1: of money trading stocks, and then I can donate that
- 1:06:06Speaker 1: money and that's maximizing my value.
- 1:06:08Speaker 3: Right.
- 1:06:09Speaker 1: They come to all of these conclusions come later right now,
- 1:06:15Speaker 1: so and again like this, this comes with some corollaries.
- 1:06:20Speaker 1: One of them is that some number of these people
- 1:06:22Speaker 1: start talking, you know, and this is not all of them,
- 1:06:25Speaker 1: but a decent chunk eventually come to the conclusion like, actually,
- 1:06:29Speaker 1: charity and helping people now is kind of bad. Like
- 1:06:33Speaker 1: it's kind of like a bad thing to do, because
- 1:06:37Speaker 1: all obviously, once we figure out the AI that can
- 1:06:40Speaker 1: solve all problems, that'll solve all these problems much more
- 1:06:44Speaker 1: effectively than we ever can. So all of our mental
- 1:06:46Speaker 1: and financial resources have to go right now into helping AI.
- 1:06:49Speaker 3: Anything we do.
- 1:06:50Speaker 1: To help other people is like a waste of those resources.
- 1:06:53Speaker 1: So you're actually doing net harm by like being a
- 1:06:58Speaker 1: doctor in Gaza instead of trading cryptocurrency in order to
- 1:07:03Speaker 1: fund an AI startup, you know, how to start a
- 1:07:05Speaker 1: coin that makes the guy starting a shit coin to
- 1:07:09Speaker 1: to make an LLM that like that guy is doing
- 1:07:13Speaker 1: more to improve the odds of human success.
- 1:07:17Speaker 3: I want to say, it is impressive the amount a
- 1:07:19Speaker 3: time you would have to moll all this over to
- 1:07:21Speaker 3: come to these conclusions.
- 1:07:23Speaker 1: You really have to be talking with a bunch of
- 1:07:25Speaker 1: very annoying people on the Internet for a long period
- 1:07:27Speaker 1: of time.
- 1:07:28Speaker 3: Yeah, it's it's it's it's incredible.
- 1:07:31Speaker 1: Yeah, and again there's like people keep consistently take this
- 1:07:38Speaker 1: stuff at even crazier directions. There's some very rich, powerful
- 1:07:41Speaker 1: people Mark andresen of Anderson Horowitz is one of them
- 1:07:45Speaker 1: who have come to the conclusion that if people don't
- 1:07:48Speaker 1: like AI and are trying to stop its conquest of
- 1:07:51Speaker 1: all human culture, those people are mortal enemies of the species,
- 1:07:55Speaker 1: and anything you do to stop them is justified because
- 1:07:58Speaker 1: so many lives are.
- 1:07:59Speaker 3: On the line.
- 1:08:00Speaker 1: Right, and again, I'm an effective altruist, right, the long
- 1:08:04Speaker 1: term good, the future lives are saved by doing what
- 1:08:07Speaker 1: hurting way whoever we have to hurt now to get
- 1:08:09Speaker 1: this thing off the ground.
- 1:08:11Speaker 3: Right. The more you talk about this kind of feels
- 1:08:14Speaker 3: like six people is is a steal. Yes, what this
- 1:08:17Speaker 3: could have for what could have gone? I think I don't.
- 1:08:21Speaker 1: I don't think it's the end of people in these
- 1:08:22Speaker 1: communities killing people. So rationalists and EA types a big
- 1:08:29Speaker 1: thing in these culture is talking about future lives, right,
- 1:08:32Speaker 1: in part because it lets them feel heroic, right, while
- 1:08:35Speaker 1: also justifying a kind of sociopathic disregard for real living people. Today,
- 1:08:40Speaker 1: and all of these different kind of chains of thought,
- 1:08:42Speaker 1: the most toxic pieces, because not every EA person is
- 1:08:46Speaker 1: saying this, not every rational it's not every AI person
- 1:08:48Speaker 1: is saying all this shit. But these are all things
- 1:08:51Speaker 1: that chunks of these communities are saying and the most
- 1:08:54Speaker 1: all of the most toxic of those chains are going
- 1:08:57Speaker 1: to lead to the Zizians, Right, That's that's that's where
- 1:09:01Speaker 1: they come from.
- 1:09:02Speaker 3: I was just about to say, based on the breakdown
- 1:09:04Speaker 3: you gave earlier, how could this this is this is
- 1:09:06Speaker 3: the perfect greed ground. Yeah, this this had to happen.
- 1:09:10Speaker 3: It was.
- 1:09:10Speaker 1: It was just waiting for somebody, like the right kind
- 1:09:14Speaker 1: of unhinged person to step into the movement.
- 1:09:18Speaker 3: Somebody really said it all And so this.
- 1:09:21Speaker 1: Is where we're gonna get to ziz Right. The actual
- 1:09:24Speaker 1: person who finds founds this what some people would call
- 1:09:27Speaker 1: a cult, is a young person who's going to move
- 1:09:30Speaker 1: to the Bay Area stumble into They stumble onto rationalism
- 1:09:34Speaker 1: online as a teenager living in Alaska, and they moved
- 1:09:37Speaker 1: to the Bay Area to get into the tech industry
- 1:09:39Speaker 1: and become an effective altruist. Right, And this person, this
- 1:09:43Speaker 1: woman is going to kind of channel all of the
- 1:09:46Speaker 1: absolute worst chains of thought that the rationalists and the
- 1:09:50Speaker 1: EA types and also like the AI harm people are
- 1:09:55Speaker 1: are are thinking right, all of the all of the
- 1:09:58Speaker 1: most poisonous stuff is exactly what she's drawn to, and
- 1:10:02Speaker 1: it is going to mix into her in an ideology
- 1:10:05Speaker 1: that is just absolutely unique and fascinating. Anyway, that's why
- 1:10:12Speaker 1: that man died. So we'll get to that and more later,
- 1:10:18Speaker 1: but uh, first we gotta uh, we gotta roll out
- 1:10:22Speaker 1: here where we're done for the day? Man, what a
- 1:10:25Speaker 1: what a time? How how you feeling right now so far?
- 1:10:28Speaker 1: How how are we doing?
- 1:10:30Speaker 3: David? Oh Man, you had said that this was gonna
- 1:10:33Speaker 3: be a weird one. I was like, yeah, it would
- 1:10:35Speaker 3: be kind of weird. This is really the strangest thing
- 1:10:38Speaker 3: I've ever heard this much about. He's gone so many different.
- 1:10:46Speaker 1: There's a there's so much more Harry Potter to come.
- 1:10:50Speaker 1: Oh my god, we're not ready to how central Harry
- 1:10:54Speaker 1: Potter is to the murder of this border patrol agent.
- 1:10:57Speaker 3: That's I said that. You said a crazy sense. That
- 1:11:00Speaker 3: might be the wildest thing anyone's ever said to me?
- 1:11:06Speaker 2: Do you want do you want to tell people about it?
- 1:11:08Speaker 3: I do? I have a podcast called My Mama told me,
- 1:11:12Speaker 3: I do it with Langston Kerman and every week we
- 1:11:15Speaker 3: have different guests on to discuss different black conspiracy theories.
- 1:11:20Speaker 3: He kind of like folk Lauren, So all kinds of stuff,
- 1:11:23Speaker 3: all kinds of stuff your foreign mother told you. He's
- 1:11:26Speaker 3: usually foreign mothers.
- 1:11:27Speaker 1: It's good because I gotta say, this is the this
- 1:11:31Speaker 1: is the whitest set of like conspiracy theory craziness.
- 1:11:39Speaker 3: No no, no, no, no no. I think I can
- 1:11:46Speaker 3: try to figure with no. No, absolutely not. Boy howdie?
- 1:11:55Speaker 1: Okay, well, everyone, We'll be back Thursday.
- 1:12:02Speaker 2: Behind the Bastards is a production of cool Zone Media.
- 1:12:05Speaker 2: For more from cool Zone Media, visit our website Coolzonemedia
- 1:12:08Speaker 2: dot com, or check us out on the iHeartRadio app,
- 1:12:12Speaker 2: Apple Podcasts, or wherever you get your podcasts. Behind the
- 1:12:15Speaker 2: Bastards is now available on YouTube, new episodes every Wednesday
- 1:12:19Speaker 2: and Friday.
- 1:12:20Speaker 3: Subscribe to our
- 1:12:21Speaker 2: Channel YouTube dot com slash at Behind the Bastards