Latest / Behind the Bastards / Part One: Tech Bros Have Built A Cult Around AI
Transcript
- 0:02Speaker 1: Media, Well, come back to Behind the Bastards. I don't
- 0:08Speaker 1: know why I did that, kind of like it was
- 0:09Speaker 1: like I was doing a Halloween opening. Didn't work at all,
- 0:12Speaker 1: horrible idea. But I'm very happy to announce our guest
- 0:17Speaker 1: today back after a long hiatus from this show, but
- 0:20Speaker 1: not from our hearts, Iffy and whatdy Wall.
- 0:24Speaker 2: How's it going going to be back?
- 0:27Speaker 1: Yeah? Oh so happy to have you back. If he
- 0:30Speaker 1: you are a significant part of the dropout, a wonderful
- 0:34Speaker 1: channel on YouTube that is the survivor of college humor,
- 0:38Speaker 1: which is kind of like we're ken in the comedy
- 0:41Speaker 1: internet comedy world.
- 0:42Speaker 3: Yeah, and you guys have been doing some really cool
- 0:45Speaker 3: stuff lately, like some of the funnest, like most interesting
- 0:48Speaker 3: like quasi game show comedy bits like I've watched hours
- 0:53Speaker 3: of it.
- 0:53Speaker 2: Yeah, yeah, I was, you know, I was talking to
- 0:57Speaker 2: Sam and Dave's the kind of like higher ups there,
- 1:01Speaker 2: which is, you know, which is a testament to how
- 1:05Speaker 2: cool the company is, because no, I haven't spoke to
- 1:07Speaker 2: the higher ups at ICC or any of the other companies,
- 1:11Speaker 2: but I was like, oh yeah, this is like where
- 1:13Speaker 2: like Panel Comedy lives and now after Midnight's back. But
- 1:18Speaker 2: I feel like Americans run away from panel comedy shows
- 1:21Speaker 2: and I like an excuse to riff and goof with friends.
- 1:24Speaker 1: Yes, I think, and I think that YouTube and the
- 1:27Speaker 1: kind of what people get out of a lot of
- 1:29Speaker 1: like streaming stuff too, like not like streaming TV, but like,
- 1:33Speaker 1: you know, streamers is that goofing with friends thing. Like
- 1:36Speaker 1: I watch red letter media stuff for a lot of
- 1:38Speaker 1: the same reason, and I feel like there's a way
- 1:41Speaker 1: to save that stuff. It's just not putting it on
- 1:43Speaker 1: television at eleven thirty at night necessarily.
- 1:47Speaker 2: Yeah, yeah, yeah, people should be a little more lucid
- 1:50Speaker 2: when they're taking in that kind of media. But yeah,
- 1:54Speaker 2: where else are you gonna watch? You know, a block
- 1:58Speaker 2: trying to think of the name of the show it was.
- 2:01Speaker 2: It was the one with the guy he has the
- 2:03Speaker 2: it's not a top hat, it's like a fedora almost,
- 2:07Speaker 2: and he's a detective and all dads love it.
- 2:10Speaker 1: Bosh Yes, oh god, I don't even use the tools
- 2:17Speaker 1: that Bosh makes. They love Bosh the Bosh heads. Yeah,
- 2:24Speaker 1: I would laugh. But I just got into Reacher, which
- 2:27Speaker 1: is like it's, you know, it's the stupidest thing on TV,
- 2:29Speaker 1: but I love it. It's like, it's like I used
- 2:32Speaker 1: to watch a lot of Walker Texas Rangers again the
- 2:34Speaker 1: inheritor of that, but not racist or as racist, I
- 2:38Speaker 1: guess exactly say not at all.
- 2:40Speaker 2: Look, that's why I'm not even going to judge, because
- 2:42Speaker 2: I remember one time, me and em we were up
- 2:44Speaker 2: in the cabin in right Wood and we needed to
- 2:48Speaker 2: kill Tom and we were like, let's watch this nine
- 2:50Speaker 2: to one one show whatever, just see and we were
- 2:53Speaker 2: like seven episodes in locked. You're like, hold on, this
- 2:56Speaker 2: is this? This kind of goes Angela Bassid know what
- 2:59Speaker 2: she's doing.
- 3:00Speaker 1: Mm hm oh yeah, no, she's she's a pro. And
- 3:02Speaker 1: you know, you can't get work like that or work
- 3:05Speaker 1: like you and your colleagues do at the dropout without
- 3:08Speaker 1: human beings actually doing things. Which is why today we're
- 3:11Speaker 1: here to talk about AI, and particularly we're going to
- 3:14Speaker 1: talk about how a lot of the conversation and a
- 3:17Speaker 1: lot of the fandom around AI has turned into more
- 3:20Speaker 1: or less occult. So that's that's that's the premise of
- 3:24Speaker 1: this episode. Iffie, I want to start by going back
- 3:28Speaker 1: to a place I was about a week ago as
- 3:30Speaker 1: we record this, the Consumer Electronics Show. Every year they've
- 3:34Speaker 1: been holding it for a long time now, and it's
- 3:37Speaker 1: kind of how the tech industry talks about itself and
- 3:40Speaker 1: what it has planned for the future. A lot of
- 3:42Speaker 1: it's hype, you know, they're kind of talking up what's
- 3:44Speaker 1: coming out that they're hoping we'll get buzzed, we'll make money,
- 3:47Speaker 1: but you also get an idea of like what do
- 3:49Speaker 1: you think we want and what are you trying to
- 3:51Speaker 1: get us excited about? And I think the most revealing
- 3:54Speaker 1: product that I saw this year was the Rabbit R
- 3:57Speaker 1: one and it's it's a little square shaped gadgets a screen,
- 4:00Speaker 1: it's got a little camera that can swivel, and it's
- 4:03Speaker 1: an AI that basically you talk to it like you
- 4:07Speaker 1: would an Alexa, but it can use your apps and
- 4:09Speaker 1: it's supposed to reduce friction in your life by basically
- 4:12Speaker 1: routing every move you make online through this machine intelligence.
- 4:17Speaker 1: So you tell it what you want to do and
- 4:18Speaker 1: it does it instead of like you using like physically
- 4:22Speaker 1: using your smartphone as much. You still have to click
- 4:24Speaker 1: it sometimes. And I want to play you a clip
- 4:27Speaker 1: of this where this is the CEO Jesse Lu's keynote speech.
- 4:31Speaker 4: Our smartphones has become the best device to kill time.
- 4:35Speaker 4: Instead of saving them. It's just harder for them to
- 4:38Speaker 4: do things. Many people before us have tried to build
- 4:44Speaker 4: a simpler and more intuitive computers with AI. A decade ago,
- 4:48Speaker 4: companies like Apple, Microsoft, and Amazon made Siri, Contana and Alixa.
- 4:55Speaker 4: With these smart speakers, often they either don't know what
- 5:00Speaker 4: you're talking about or failed to accomplish the past. We
- 5:04Speaker 4: ask for recent achievements in large language models, however, or LMS,
- 5:10Speaker 4: a type of AI technology, have made it much easier
- 5:14Speaker 4: for machines to understand you. The popularity of LM chatbots
- 5:20Speaker 4: over the past years has shown that the natural language
- 5:23Speaker 4: based experience is the pass forward.
- 5:27Speaker 1: Now. I don't know that I entirely agree with that,
- 5:31Speaker 1: because I think the biggest influence that these chatbots have
- 5:33Speaker 1: had on me is that whenever I try to deal
- 5:35Speaker 1: with like an airline or something, I get stuck on
- 5:37Speaker 1: chat GPT and it's a pain in the as to
- 5:40Speaker 1: do anything.
- 5:42Speaker 2: What's so funny about the rise in AI right now
- 5:46Speaker 2: is like, if we really think about it, and god
- 5:49Speaker 2: damn it, Robert, you threaded the needle right there. When
- 5:52Speaker 2: you really think about it, all AI is is just
- 5:56Speaker 2: the evolution of the shittiest part of calling. Yes, yes, all,
- 6:02Speaker 2: the one thing that we do as soon as we
- 6:04Speaker 2: call is like zero zero zero, let me get straight
- 6:07Speaker 2: to a human.
- 6:07Speaker 1: Let me talk to a human.
- 6:09Speaker 2: And the and these these like eggheads were like, what
- 6:11Speaker 2: if we did more of that? What if we remove
- 6:14Speaker 2: your solace from this sad eyes of your life?
- 6:22Speaker 1: And it's it's the kind of thing he seems so
- 6:25Speaker 1: off from my experience where he's like the problem with
- 6:28Speaker 1: phones is that it's too hard to do things. No,
- 6:30Speaker 1: it's too easy for me to order a bunch of
- 6:32Speaker 1: junk food and have a stranger deliver it. That's been
- 6:35Speaker 1: a problem for me, right, Oh yeah, it's too easy
- 6:38Speaker 1: for me to waste six hours on Twitter, Like that's
- 6:40Speaker 1: what the issue is.
- 6:42Speaker 2: Do you know how much the easiness of everything has
- 6:47Speaker 2: made me wake up the next morning with cold food
- 6:49Speaker 2: on my porch that I never touched.
- 6:51Speaker 1: Yes, because it's too easy, It was too easy.
- 6:54Speaker 2: Sometimes we need those those those like bumps in the
- 6:58Speaker 2: road to keep drunk stone diffy from ordering a like
- 7:04Speaker 2: triple double burger that I'm hoping gets to me and
- 7:07Speaker 2: before I fall asleep, it never does.
- 7:09Speaker 1: I've had so many problems as with my phone, but
- 7:11Speaker 1: I don't think I've ever had the problem of like
- 7:13Speaker 1: this thing's just too hard to use. Yeah, that's just
- 7:16Speaker 1: not a problem I know that anyone has. But but
- 7:20Speaker 1: Jesse complains that, you know, there's too much friction with
- 7:24Speaker 1: smartphones and his device. That rabbit is going to let you,
- 7:28Speaker 1: Like you can just tell it book me a flight
- 7:29Speaker 1: or a hotel on Expedia and you don't even have
- 7:32Speaker 1: to know, like it'll just pick a hotel for you
- 7:35Speaker 1: a lot of the time, or like what flight you
- 7:37Speaker 1: know it thinks is the most efficient. Jesse's goal is
- 7:40Speaker 1: to basically create AI agents for customers, which like live
- 7:44Speaker 1: in this little device you wear and act as you
- 7:46Speaker 1: online to handle tasks you normally use your phone to do. So,
- 7:50Speaker 1: you can tell your rabbit to book you an uber,
- 7:52Speaker 1: you can have a book you a flight, or you
- 7:53Speaker 1: can have it plan your trip to a foreign country.
- 7:56Speaker 1: Nobody sounds really bad. It sounds so fucking bad.
- 8:01Speaker 5: Rabbit's like, hey, how would you like a middle speech
- 8:03Speaker 5: seed on.
- 8:06Speaker 1: Sufficient as hell? Yeah, spirits so cheap. Now you can
- 8:11Speaker 1: you can direct it more. But then that just seems like, well, yeah,
- 8:14Speaker 1: that's what I'm already doing on my computer. Why is
- 8:16Speaker 1: it easiest just to like work through a vocal chatbot
- 8:18Speaker 1: that might not understand me, or at least will be
- 8:21Speaker 1: as much friction as like, Yeah, when I touch my
- 8:24Speaker 1: phone and it hits the wrong thing, right, I just
- 8:26Speaker 1: don't see that I'm saving much here. No one also
- 8:28Speaker 1: seems to know how Rabbit's going to integrate with all
- 8:31Speaker 1: these apps, because that means their device has to have
- 8:35Speaker 1: access to them for you, and that's kind of a
- 8:37Speaker 1: big ask for all of these different companies. That said,
- 8:40Speaker 1: and no one knows, by the way, how secure it's
- 8:41Speaker 1: going to be. But no one at CES was listening either,
- 8:45Speaker 1: because the first ten thousand pre order models that opened
- 8:47Speaker 1: at CES sold out instantly. How does it mean? That
- 8:51Speaker 1: doesn't mean a lot of normal people are going to
- 8:53Speaker 1: buy it? It means a lot of tech freaks wanted
- 8:55Speaker 1: this thing. Yeah, that is the thing.
- 8:58Speaker 2: Too, is like, yeah, if you're at c you're already
- 9:01Speaker 2: you're already drinking the kool aid. Yes, I you know,
- 9:03Speaker 2: And I'm very much It's so funny because I'm very
- 9:07Speaker 2: much that guy, or I was very much that guy
- 9:09Speaker 2: who wanted to be on that cusp of technology. And
- 9:13Speaker 2: I feel like, you know, in my early twenties, it
- 9:15Speaker 2: seems so cool because you're like, yeah, I want to
- 9:17Speaker 2: be iron man, I want to just have full control.
- 9:21Speaker 2: And then you kind of get to the point where
- 9:24Speaker 2: you start if you have enough self reflection, you notice
- 9:27Speaker 2: that you're just kind of you're using technology to do
- 9:31Speaker 2: things that you could just do for much simpler and cheaper, Like,
- 9:34Speaker 2: for example, like when you get these apps and then
- 9:38Speaker 2: I'm like sitting in a photo editor for like fifty
- 9:41Speaker 2: minutes just to make it look like it was shot
- 9:43Speaker 2: on film, And I was like, I can buy a
- 9:44Speaker 2: disposable camera like that exists. And what's great is when
- 9:50Speaker 2: you now when you develop them, they put it, they
- 9:53Speaker 2: email it to you so it can go on Instagram.
- 9:55Speaker 2: It's going to take longer, but arguably you might get
- 9:58Speaker 2: some post flip clarity that pick that didn't look good
- 10:01Speaker 2: isn't now on the internet, or you know, you can
- 10:05Speaker 2: like spread it out. But yeah, I am getting.
- 10:08Speaker 1: Very you are, like, you are so much more thoughtful
- 10:12Speaker 1: in that than like anybody involved in this product has
- 10:15Speaker 1: been over the course of their entire life. Now, a
- 10:18Speaker 1: couple of skeptics who have given reviews have already noted problems.
- 10:21Speaker 1: Richard Lawler of the verbs was like, this thing is
- 10:24Speaker 1: not built for left handed people to use, Like they
- 10:26Speaker 1: forgotten that left handed people existed, and so they designed
- 10:29Speaker 1: it in a way that's specifically a pain in the ass. Which, yes,
- 10:34Speaker 1: there's also they brag they have this camera that can
- 10:36Speaker 1: like move on its own, so we can cover stuff
- 10:38Speaker 1: in front of it or behind it, And a commenter
- 10:41Speaker 1: on Lawler's article was like, it's a pretty fundamental design
- 10:44Speaker 1: principle that you don't add moving parts if you don't
- 10:46Speaker 1: need them. And there's plenty of space in this for
- 10:49Speaker 1: a camera in the front and the back, which is
- 10:50Speaker 1: one less point of failure, one less thing for shit
- 10:53Speaker 1: to get gunked up in. This is actually bad design.
- 10:55Speaker 1: They're bragging about this, but it's a bad idea.
- 10:57Speaker 2: Yeah.
- 10:58Speaker 1: Yeah, there's a couple of other issues in there. You know,
- 11:00Speaker 1: we'll see it looks like it's going to be a
- 11:01Speaker 1: lot thicker than a smartphone. I just don't know the
- 11:04Speaker 1: degree to which a regular it's the same Google glass issue, Right,
- 11:07Speaker 1: do you want a second thing that you have to
- 11:09Speaker 1: keep on you like alongside your you know.
- 11:12Speaker 2: Just going to be my question. So I'm glad, So
- 11:14Speaker 2: is this a something that should be replacing your phone
- 11:17Speaker 2: or is this another thing that you are supposed to
- 11:20Speaker 2: be holding on to.
- 11:22Speaker 1: I think the goal is for it to eventually replace it,
- 11:25Speaker 1: but at this point you will still need to have both,
- 11:28Speaker 1: so like carry another thing, you know.
- 11:31Speaker 2: You know, walking around like a drug dealer. You have
- 11:33Speaker 2: two different It's kind of bit.
- 11:35Speaker 1: It's a big device and it's it's not tiny and
- 11:37Speaker 1: it has a big screen. So it's just like, well,
- 11:39Speaker 1: you just made a different kind of smartphone. Again, what
- 11:42Speaker 1: am I gaining? Yeah? What he's holding in this video? Correct? Yeah?
- 11:46Speaker 2: Yeah, yeah, yeah, okay, well and what ye what more
- 11:50Speaker 2: is like that? On top of tech person, it's definitely
- 11:54Speaker 2: the person who carries a power bank with them. So
- 11:56Speaker 2: that is a thirst and that's me. So that's three
- 12:00Speaker 2: things you're rocking with. I know I have so many
- 12:04Speaker 2: power banks and have and ADHD has blocked every single
- 12:08Speaker 2: one of them from being useful because you do, I
- 12:10Speaker 2: forget to charge them or I forget to bring them.
- 12:14Speaker 1: It also just doesn't look comfortable. It's bigger than his hand.
- 12:18Speaker 1: Oh yes, he's not a teenage We'll get a better
- 12:20Speaker 1: look at in a second, because I want to show
- 12:22Speaker 1: you when he's talking he's trying to make the case
- 12:24Speaker 1: for this and one of like, he spends a significant
- 12:27Speaker 1: portion of his not very long keynote on him Rick
- 12:29Speaker 1: rolling himself in the most iffy You've gotta fucking watch this.
- 12:33Speaker 1: It is so painful.
- 12:36Speaker 4: R One has an eye, an onboard camera designed for
- 12:39Speaker 4: advanced computer vision. It can analyze surroundings and take actions
- 12:44Speaker 4: in real time. To activate the eye, just double tap
- 12:48Speaker 4: the button. Oh funny seeing you here, Rick.
- 12:56Speaker 1: It's a picture of Rick Astley that he points it at.
- 13:00Speaker 6: Let me take a look. I'm never gonna get you off.
- 13:12Speaker 1: Enjoy what am I getting? Rip roll in my own keynotes?
- 13:20Speaker 2: The next one okay tech keynotes spe to take impromt.
- 13:27Speaker 1: Class one like and I don't recommend that to normal people.
- 13:33Speaker 2: Because like you're you're like, no, selling your own joke,
- 13:37Speaker 2: just like what you're not even laughing at it? Why
- 13:42Speaker 2: am I gonna laugh?
- 13:43Speaker 1: I will say this that was scripted almost exactly the
- 13:46Speaker 1: way Tim Robinson would have written it. Oh man, But
- 13:52Speaker 1: I bet Sam Richardson could have delivered that bit better.
- 14:00Speaker 1: So that is very funny. But I find this next
- 14:02Speaker 1: clip more disturbing because it shows this kind of desire
- 14:05Speaker 1: that the people that are the early adopters here have
- 14:08Speaker 1: not just for more convenience, but to hand over like
- 14:11Speaker 1: the power to choose to a robot that's basically just
- 14:14Speaker 1: pulling the first advertised result from Google Like it's kind
- 14:18Speaker 1: of messed up.
- 14:20Speaker 4: Ooh, I can also use our one to order foot
- 14:24Speaker 4: get me a twelve inch pizza from Pizza Huts. Denvers
- 14:27Speaker 4: will hear the most ordered option on the app.
- 14:29Speaker 6: Is fine ordering a twelve inch pizza from Pizza Hut.
- 14:33Speaker 6: Since you mentioned that the most ordered option is fine,
- 14:35Speaker 6: I will select that for you. I just created an
- 14:41Speaker 6: order for a twelve inch pizza. It's going to be
- 14:44Speaker 6: hand tossed with a classic marinara sauce and topped with
- 14:47Speaker 6: regular cheese. Please confirm your order.
- 14:51Speaker 4: That sounds really good. I just come from an order.
- 14:53Speaker 1: He has to click it again, just like on a smartphone.
- 14:55Speaker 1: He guess, like, look at the device and click it.
- 14:57Speaker 2: Here's a freebie for any of even Richard Lawlor, who
- 15:02Speaker 2: has been in the game for a long time, but
- 15:05Speaker 2: like any of you tech bloggers, I just do a
- 15:08Speaker 2: side by side with this video and physically do everything
- 15:12Speaker 2: he's doing and the real time, because a pizza would
- 15:17Speaker 2: have been ordered way faster if you would have just
- 15:20Speaker 2: pulled out your phone.
- 15:21Speaker 1: Well and you could get the pizza you want. Yeah,
- 15:23Speaker 1: I like the twelve.
- 15:25Speaker 5: Inch Classic marinera most ordered pizza.
- 15:28Speaker 2: I want this shit. I actually like that's so weird.
- 15:31Speaker 1: Yeah yeah. Also, who orders a twelve inch pizza from
- 15:35Speaker 1: Pizza Hut?
- 15:35Speaker 2: Nobody? Yeah?
- 15:38Speaker 1: Then no way? Is that the most ordered product from
- 15:41Speaker 1: Pizza Hut. I don't believe it.
- 15:43Speaker 2: It was definitely paid nonsense.
- 15:45Speaker 1: Yes, yeah, it's just like yeah, and they're the next clip.
- 15:49Speaker 1: I don't think we'll actually play it, but like it is,
- 15:51Speaker 1: it's him saying, hey, plan out like a three day
- 15:53Speaker 1: vacation in London for me, And as far as I
- 15:56Speaker 1: can tell, the AI goes for like the first top
- 15:59Speaker 1: ten list of things to do in London that it finds,
- 16:01Speaker 1: which was probably written by an AI, and then makes
- 16:05Speaker 1: an itinerary based on those and it's like, first off,
- 16:08Speaker 1: are you that basic? Second, planning a vacation is fun?
- 16:12Speaker 1: Is that not a thing that you want to do?
- 16:14Speaker 2: Yeah? You're so right? Why would you? Because I look,
- 16:18Speaker 2: the reason you would go to like a travel agent
- 16:22Speaker 2: is because they are experts at it. They're gonna find
- 16:24Speaker 2: the most fun thing for you outside of that, Yeah,
- 16:27Speaker 2: I want to plan the cool stuff I'm gonna do,
- 16:29Speaker 2: you know, And and yeah, what about people with fears,
- 16:32Speaker 2: you know? Or people without skills, which is definitely going
- 16:35Speaker 2: to be a large margin of people who do this.
- 16:38Speaker 2: So you you're in London, now you're you're, you're, you're,
- 16:42Speaker 2: And then it takes you on a trip to Malta
- 16:44Speaker 2: to go scuba diving. You don't even know how to swim,
- 16:47Speaker 2: and now you sit in therey like you already paid
- 16:50Speaker 2: for bro, Yeah.
- 16:51Speaker 1: You let your fuck for you. It's on you. It's silly, right,
- 16:56Speaker 1: and I don't want to be I'm gonna say this
- 16:58Speaker 1: is not the most direct parallel to cult shit will have,
- 17:01Speaker 1: But watching this, I couldn't help but think about a
- 17:03Speaker 1: cult that was like the subject of our second episode
- 17:06Speaker 1: for this year, The Finders, And it was one of
- 17:08Speaker 1: those things. The guy Marion Petty who ran it was
- 17:10Speaker 1: like running games is the way he framed it. And
- 17:13Speaker 1: people would join the cult and give up their agency,
- 17:16Speaker 1: and he'd tell them go take a job in this city,
- 17:18Speaker 1: or like go follow this guy and take notes on
- 17:21Speaker 1: him for a year, or like have a kid and
- 17:23Speaker 1: raise it. This way, and this is stuff like this
- 17:26Speaker 1: is really common within cults. One of the appeals of
- 17:28Speaker 1: a cult to a lot of people is that you
- 17:30Speaker 1: both get a sense of purpose by following the cult
- 17:33Speaker 1: and whatever things that says it going to do, and
- 17:36Speaker 1: you give up the burden of having to choose a
- 17:38Speaker 1: life for yourself. And this is such a common thing
- 17:40Speaker 1: in cult dynamics that psychologist Robert Lifton, who's kind of
- 17:44Speaker 1: one of the foundational minds and studying cults, described it
- 17:47Speaker 1: as voluntary self surrender, and it's a major characteristic of
- 17:51Speaker 1: a cult. Many of the finders, we're not you know,
- 17:54Speaker 1: these are not dumb people. These are not like rubes.
- 17:57Speaker 1: These are not hillbillies as they're often portrayed in our
- 18:00Speaker 1: popular media. A lot of the finders had Ivy League degrees.
- 18:03Speaker 1: One of them owned an oil company, and these guys
- 18:06Speaker 1: still handed their lives over to a cult leader. Haruki Murakami,
- 18:10Speaker 1: writing about ohm Shinriko, which is the cult that set
- 18:13Speaker 1: off a bunch of poison gas in the Tokyo subway,
- 18:16Speaker 1: noted that many of its members were doctors or engineers
- 18:18Speaker 1: who quote actively sought to be controlled. I found a
- 18:22Speaker 1: lot of this really information on the fundamental characteristics of
- 18:25Speaker 1: what makes something a cult In an article by Zoe
- 18:27Speaker 1: Heller published for The New Yorker back in twenty twenty one.
- 18:30Speaker 1: At the time, she was kind of looking at QAnon
- 18:33Speaker 1: and trying to decide, there's not like a clear guy
- 18:36Speaker 1: and that's the cult leader, and there's not like a
- 18:38Speaker 1: geographic center to this, and usually there is with cults
- 18:41Speaker 1: in history. Does this still qualify? And I think a
- 18:44Speaker 1: lot of people would agree that, like Yad does. I
- 18:45Speaker 1: think a lot of experts tend to agree that Yead does.
- 18:48Speaker 1: And when she was looking at the QAnon movement as
- 18:50Speaker 1: a cult, Heller noted this. Robert Lifton suggests that people
- 18:54Speaker 1: with certain kinds of personal history are more likely to
- 18:56Speaker 1: experience such a longing, those with quote an early sense
- 19:00Speaker 1: of confusion or dislocation, or at the opposite extreme, an
- 19:03Speaker 1: early experience of unusually intense family milieu control. But he
- 19:07Speaker 1: stresses that the capacity for totalist submission lurks in all
- 19:10Speaker 1: of us and is probably rooted in childhood, the prolonged
- 19:13Speaker 1: period of dependence during which we have no choice but
- 19:15Speaker 1: to attribute to our parents and exaggerated omnipotence. And I
- 19:20Speaker 1: found particularly the bit where he's talking about like, yeah,
- 19:22Speaker 1: if you an early sense of confusion or dislocation makes
- 19:25Speaker 1: people crave this kind of to give up this kind
- 19:28Speaker 1: of control and responsibility. The people running these AI companies
- 19:31Speaker 1: and maybe not necessarily the very top, because I think
- 19:34Speaker 1: those tend to be pretty cynical, realistic human beings. But
- 19:37Speaker 1: like a lot of the people who are in them,
- 19:38Speaker 1: and a lot of the people who are latching onto
- 19:40Speaker 1: AI as a fandom online are people whose childhoods and adolescences,
- 19:44Speaker 1: like all of ours, were shaped by nine to eleven,
- 19:46Speaker 1: the dislocation and change that that caused, and their young adulthoods.
- 19:49Speaker 1: A lot of these people, like us, will have come
- 19:51Speaker 1: of age around the time of the two thousand and
- 19:52Speaker 1: eight crash. Many of the people who are younger in
- 19:55Speaker 1: the AI fan base are you know, maybe zoomers and stuff,
- 19:58Speaker 1: and you know, a lot of them are people who
- 20:01Speaker 1: have really ugly ideas about like artists shouldn't charge for
- 20:04Speaker 1: shit or whatever. Yes, but also these are people who
- 20:07Speaker 1: a lot of them came into their careers went into
- 20:10Speaker 1: stem fields because they were told coming up the tech
- 20:12Speaker 1: industry is the safest place to make, you know, a
- 20:15Speaker 1: good living for yourself and that all fell apart a
- 20:17Speaker 1: couple of years ago, right, it started to at least
- 20:19Speaker 1: tech laughs began so again dislocation, chaos, the sense that
- 20:23Speaker 1: like what else am I going to entrust my life to?
- 20:27Speaker 1: I thought I had a plan and it fell apart.
- 20:29Speaker 2: Yeah, you know, I this is this is where if
- 20:32Speaker 2: he's going to get real, it's philosophical and big brereer.
- 20:36Speaker 2: But I just finished All about Love by Bell Hooks,
- 20:39Speaker 2: and you know she often talks about like the wandering
- 20:43Speaker 2: life with lovelessness and that, and that's searching for it
- 20:47Speaker 2: and not having having it. And I feel like that
- 20:49Speaker 2: goes hand in hand with what you're saying right where
- 20:52Speaker 2: it's like I want a sense of belonging and I
- 20:55Speaker 2: want to feel like I'm a part of people, and
- 20:57Speaker 2: whether that is running into target trampling people for Stanley cups,
- 21:01Speaker 2: or it's being a part of like what you perceive
- 21:04Speaker 2: to be the next big thing. Like I think that
- 21:06Speaker 2: is the biggest kind of selling point for a lot
- 21:10Speaker 2: of these AI people who's like this is the future,
- 21:12Speaker 2: Like that is almost every person who starts a fifty
- 21:17Speaker 2: tweet thread with shitty examples of why AI rocks starts
- 21:21Speaker 2: itting with this is the future and you just got
- 21:23Speaker 2: to get over it. And there's so many people who
- 21:26Speaker 2: just want to be on the ground floor of that.
- 21:27Speaker 2: They want to be the people who were on it.
- 21:30Speaker 2: Because how many times even I, you know, when you
- 21:33Speaker 2: have that like time machine question, you're like, oh, Stock
- 21:36Speaker 2: and Starbucks, ooh uh an Apple. You just want to
- 21:39Speaker 2: be there before it gets big. So when it really
- 21:43Speaker 2: at the end of the day, it all comes down
- 21:45Speaker 2: to commerce, you want to be at the top when
- 21:47Speaker 2: it all shifts. And that is actually the danger in
- 21:50Speaker 2: this for me is the commerce. I think about it
- 21:53Speaker 2: often because you know, like you're saying it, like orders
- 21:58Speaker 2: the top Google search. Google is kindrently in courts right
- 22:01Speaker 2: now fighting against you know, basically shaking down companies to
- 22:06Speaker 2: see who would be the top one. So like the
- 22:09Speaker 2: future of this being actually you know, a useful app
- 22:14Speaker 2: kind of lives now in that case because if Google
- 22:17Speaker 2: wins and they can put whoever's on top, that's only
- 22:19Speaker 2: going to make it more valuable where they place who's
- 22:22Speaker 2: on top. Because people are using these weird rabbits, you know, yeah, exactly,
- 22:26Speaker 2: it's yeah, it is to them. They see the beginning
- 22:30Speaker 2: of the futures, and I feel like, to me, I'm
- 22:35Speaker 2: just looking at all the ways it can be abused,
- 22:37Speaker 2: because if we just look at everything that has come
- 22:39Speaker 2: before us, we have to think of the ways that
- 22:42Speaker 2: it has been abused.
- 22:43Speaker 1: And all the ways it'll be a worse future, you know.
- 22:46Speaker 1: And I think I really liked that you brought up
- 22:48Speaker 1: the panic they try to inciteen the rest of us,
- 22:51Speaker 1: the like the fomo where it's like this is the future,
- 22:54Speaker 1: get on board or you're gonna get left behind, y right?
- 22:57Speaker 1: That is that is the cult recruitment tactic, right, And
- 23:01Speaker 1: what they're trying to do. I just brought up that
- 23:03Speaker 1: a lot of the people who are most vulnerable to
- 23:06Speaker 1: this are the folks who like, yeah, they have this
- 23:09Speaker 1: sense of like insecurity, dislocation, and they see getting on
- 23:12Speaker 1: board with this early they feel like a sense of
- 23:14Speaker 1: security there. And by saying you're going to get left behind,
- 23:17Speaker 1: this is the only way forward, you won't be competitive
- 23:20Speaker 1: if you don't embrace this stuff that they're trying to
- 23:22Speaker 1: induce that sense of fear and dislocation to make people vulnerable.
- 23:26Speaker 1: And I want to read another quote from that art
- 23:28Speaker 1: from that New Yorker article, The Less control we feel
- 23:32Speaker 1: we have over our circumstances, the more likely we are
- 23:34Speaker 1: to entrust our fates to a higher power. A classic
- 23:37Speaker 1: example of this relationship was provided by the anthropologist Bronislam
- 23:40Speaker 1: Molina Whisky, who found that fishermen in the Trobyan Islands
- 23:44Speaker 1: off the coast of New Guinea engaged in more magic
- 23:46Speaker 1: rituals the further out to see they went. And I
- 23:49Speaker 1: think we all feel like we're getting further out to
- 23:52Speaker 1: see these days, right, Like, it's not hard to see why.
- 23:56Speaker 1: I like, yeah, I'm near the shore or what. I
- 23:57Speaker 1: don't believe in anything but what's right in front of me.
- 23:59Speaker 1: And then like you can't say anything but water, and
- 24:02Speaker 1: you're like, no, there's a god and I can keep
- 24:03Speaker 1: them happy.
- 24:07Speaker 2: Yes, yes, indeed, it's it's tough. Yeah, everyone's just kind
- 24:11Speaker 2: of grasping at what they can to just bolster themselves.
- 24:15Speaker 2: And sometimes yeah, you're grasping at some weird stuff.
- 24:21Speaker 1: Yeah yeah, yeah, And it's you know, it's noted often
- 24:24Speaker 1: by I think a lot of particularly atheists on the Internet,
- 24:26Speaker 1: that like church attendance is down people who identify as
- 24:29Speaker 1: part of an organized religion like that that is at
- 24:32Speaker 1: its lowest level basically. Ever, and this is true. These
- 24:36Speaker 1: are real trends and they have real effects. But I
- 24:38Speaker 1: don't think the fact that less people are religious in
- 24:41Speaker 1: the traditional sense means they're less superstitious or spiritual than
- 24:44Speaker 1: they ever. It's just that what they invest with that
- 24:46Speaker 1: belief has changed, in part because they've seen the world
- 24:50Speaker 1: dislocate so far out of what most priests and another
- 24:54Speaker 1: sort of like religious heads are capable of sort of
- 24:56Speaker 1: explaining or comforting them over right, It's like, oh, religion
- 24:59Speaker 1: is less comforting in a world as advanced as ours
- 25:03Speaker 1: for most people. Now, this may seem like a reach
- 25:07Speaker 1: still to kind of call what's going on around AI
- 25:09Speaker 1: a cult, and I get that. I ask you to
- 25:10Speaker 1: bear with me here, and I do want to note
- 25:12Speaker 1: there's nothing wrong with the inherent technology that we often
- 25:16Speaker 1: call AI, or at least not with all of it.
- 25:18Speaker 1: That's A because it's used as such a wide banner
- 25:20Speaker 1: term for stuff is very just like a text recognition
- 25:23Speaker 1: program that can listen to human voice and create an
- 25:26Speaker 1: on the fly transcription. That's an AI. That's an example
- 25:30Speaker 1: of that kind of technology, right like it gets folded
- 25:33Speaker 1: in there. That's one of the things in AI has
- 25:34Speaker 1: to do recognizing language in like facial recognition too, recognizing faces.
- 25:39Speaker 1: If you're ever going to have an actual artificial intelligence,
- 25:41Speaker 1: those are two of the baseline capabilities that it needs.
- 25:44Speaker 1: Chatbots obviously are a big part of this, along with
- 25:47Speaker 1: like the Sundry tools that are being used now to
- 25:49Speaker 1: clone voices, to generate deep fakes and fuel our now
- 25:52Speaker 1: constant trip into the Uncanny Valley. Cees featured some real
- 25:56Speaker 1: products that actually did harness the promise of machine learning
- 25:59Speaker 1: in ways that I thought, we're cool as I noted
- 26:01Speaker 1: it could happen here. There's like this telescope. It uses
- 26:03Speaker 1: machine learning to like basically clean up images that you
- 26:07Speaker 1: take with it at night when there's like a lot
- 26:09Speaker 1: of light pollutions so you can see more clearly. And
- 26:11Speaker 1: I'm like, yeah, that's dope. That's great, But that lived
- 26:13Speaker 1: alongside a lot of nonsense, you know. Chat GPT for
- 26:16Speaker 1: dogs was a real sin I saw, and like, there
- 26:19Speaker 1: was an AI assisted fleshlight to help you not be
- 26:22Speaker 1: a premature.
- 26:25Speaker 2: Because of course that's the one that popped on my tongueline.
- 26:27Speaker 2: It's like and it was like and then they gamified
- 26:31Speaker 2: it where you go to different planets, you defeat the planet.
- 26:34Speaker 2: So I'm like, what you You keep talking about beating
- 26:37Speaker 2: the planets? So how do I lose? Is it when
- 26:40Speaker 2: I bust about bussing loss? Because you're now introducing shame
- 26:45Speaker 2: to sex again and I thought we finally got out
- 26:48Speaker 2: moving best that. Yeah, I can't beat.
- 26:50Speaker 1: Level those kind of bad ideas. That's all par for
- 26:55Speaker 1: the course for CEES. But what I saw this year,
- 26:58Speaker 1: in last year, not just at CEES, just over the
- 27:00Speaker 1: year in the tech industry from futurist fanboys and titans
- 27:03Speaker 1: of industry like Mark Andersson, is a kind of unhinged
- 27:06Speaker 1: messianic fervor that compares better that to scientology than it
- 27:11Speaker 1: does to the iPhone. And I mean that literally. Mark
- 27:14Speaker 1: Andreesen is the co founder of Netscape and the capital
- 27:17Speaker 1: firm Andresen Horowitz. He is one of the most influential
- 27:20Speaker 1: investors in tech history, and he's put more money into
- 27:22Speaker 1: AI's startups than almost anyone else. Last year, he published
- 27:26Speaker 1: something called the Techno Optimist Manifesto on the Andresen Horowitz website.
- 27:31Speaker 1: On the surface, it's a pean to the promise of
- 27:33Speaker 1: AI and an exhortation to embrace the promise of technology
- 27:37Speaker 1: and disregard pessimism. Plenty of people called the Peace Out
- 27:40Speaker 1: for its logical fallacies. For example, it ignores that a
- 27:43Speaker 1: lot of tech pessimism is due to real harm caused
- 27:46Speaker 1: by some of the companies Andresen invested in, like Facebook.
- 27:49Speaker 1: What's attracted less attention is the messianic overtones of everything.
- 27:53Speaker 1: Andresen believes quote, we believe artificial intelligence can save lives
- 27:57Speaker 1: if we let it. Medicine, along Manye with many other fields,
- 28:01Speaker 1: is in the Stone age compared to what we can
- 28:02Speaker 1: achieve with joined human and machine intelligence working on new cures.
- 28:06Speaker 1: There are scores of common causes of death that can
- 28:08Speaker 1: be fixed with AI, from plane crashes to pandemics to
- 28:11Speaker 1: wartime friendly fire. Now he's right that there's some medical
- 28:15Speaker 1: uses for AI. It's being used right now to help
- 28:17Speaker 1: improve the ability to recognize certain kinds of cancer, and
- 28:20Speaker 1: there's the potential for stuff like in home devices that
- 28:22Speaker 1: let you scan your skin to see if you're developing
- 28:24Speaker 1: a melanoma. And there's debate still over how useful it's
- 28:28Speaker 1: going to be in medical research. I've talked to recently
- 28:31Speaker 1: some experts and I've read some stuff that like there
- 28:34Speaker 1: are some reasons for caution too, for some of the
- 28:36Speaker 1: same reasons we should have caution with this everywhere. There's
- 28:39Speaker 1: also disinformation that spread medically with AI, even to doctors,
- 28:43Speaker 1: and some of the patterns that using this stuff gets
- 28:45Speaker 1: medical professionals into can make them discount certain diagnoses as well.
- 28:49Speaker 1: So I don't say that to like say, there's not
- 28:51Speaker 1: going to be some significant uses for some of the
- 28:53Speaker 1: way this technology works medically. Some aspects of AI will
- 28:57Speaker 1: save lives. It's just the evidence right now doesn't see
- 29:00Speaker 1: just it's going to completely revolutionize medical science. It's another
- 29:03Speaker 1: advancement that will be good in some ways, and there
- 29:05Speaker 1: will be some negative aspects of it too.
- 29:07Speaker 2: Right.
- 29:08Speaker 1: It's also very much not fair to say that, like
- 29:10Speaker 1: we're going to reduce deaths for human beings as a
- 29:14Speaker 1: result of AI, because right now the nation of Israel
- 29:16Speaker 1: is using an AI program called the Gospel to assist
- 29:19Speaker 1: it in aiming its air strikes, which have been widely
- 29:22Speaker 1: condemned for their out exceptional outstanding, in many cases genocidal
- 29:27Speaker 1: level of civilian casualties. Yes, it's just outrageous.
- 29:31Speaker 2: Yeah, oh, one hundred percent, And you know, you know
- 29:34Speaker 2: that's exactly what's going on as a genocide, and you
- 29:37Speaker 2: know the language and a lot of these speeches says
- 29:39Speaker 2: that say as much fair, yeah, even more so. Yeah,
- 29:43Speaker 2: like like you're saying another thing I want to point out,
- 29:46Speaker 2: which you might have been about to say, and I'm
- 29:49Speaker 2: already jumping ahead. Is how I think it was chet
- 29:52Speaker 2: GPT that has quietly switched their terms of service to
- 29:57Speaker 2: say that it wouldn't be used for like weapons and.
- 30:00Speaker 1: Oh yeah, to hurt people, and that's for sure.
- 30:03Speaker 2: Yeah, and now now it has it has been quietly
- 30:06Speaker 2: scrubbed from those terms of service, and we do we
- 30:09Speaker 2: need to talk about that, Yeah, because there's just so
- 30:12Speaker 2: many things that we have grown accustomed to with tech
- 30:17Speaker 2: that I think is dangerous as we get into things
- 30:20Speaker 2: that have more room for error. Because we're used to
- 30:24Speaker 2: updated terms of services on our iPhone, right every time
- 30:26Speaker 2: we grab an eye an update, it's like, here's a
- 30:28Speaker 2: new terms of service and you just kind of scroll
- 30:30Speaker 2: through it and you go yeah, because you're like, yeah,
- 30:33Speaker 2: you know, this is just a phone. It's not gonna,
- 30:35Speaker 2: you know, be used for anything weird. Yet uh so
- 30:39Speaker 2: you're you're comfortable. But like when you're doing the same
- 30:41Speaker 2: thing with these chat GPT machine learning situations where you're
- 30:46Speaker 2: you're agreeing, and you're agreeing, Okay, I will help this
- 30:50Speaker 2: thing learn, and now you are just actively helping it
- 30:55Speaker 2: learn how to be an assassin. Like what happens there?
- 31:01Speaker 1: Yeah, And it's again it's this back and forth where
- 31:05Speaker 1: on one hand, there is some technology like AI enabled
- 31:08Speaker 1: robots that can go run onto a battlefield and pick
- 31:10Speaker 1: up an injured soldier. I have no desire to see
- 31:12Speaker 1: some random private bleed to death in a foreign country,
- 31:15Speaker 1: fine with that. Or anti missile missiles right, using AI
- 31:19Speaker 1: to intercept and stop a missile from blowing up in
- 31:21Speaker 1: a civilian area sounds fine, Like I don't. I don't
- 31:24Speaker 1: want random people to die from missiles, But it's also
- 31:26Speaker 1: going to be used to target those missiles. And to say, like,
- 31:29Speaker 1: based on some shit we analyzed on Twitter or whatever,
- 31:32Speaker 1: we think wiping out this grid square of apartment buildings
- 31:35Speaker 1: will really get a lot of the bad guys, and based.
- 31:38Speaker 2: On we should blow them up exactly. It's crazy.
- 31:43Speaker 1: It's just it's there's certainly it's certainly not fair to
- 31:46Speaker 1: say there won't be benefits, but it's absolutely unclear in
- 31:49Speaker 1: every field of endeavor whether or not they will outweigh
- 31:51Speaker 1: the harms, right, And even if they do, to what extent,
- 31:55Speaker 1: you know, because a lot of what I'm saying suggests
- 31:56Speaker 1: that even if the benefits outweigh the harms in a
- 31:58Speaker 1: lot of fields, it's still I'm not going because of
- 32:01Speaker 1: the extent of the harms. In part, it's still not
- 32:03Speaker 1: going to be a massive sea change.
- 32:05Speaker 2: Right.
- 32:05Speaker 1: There are a lot of reasons for caution, but Mark
- 32:08Speaker 1: has no time for doubters. In fact, to him, doubting
- 32:11Speaker 1: the benefits of AGI artificial general intelligence is the only
- 32:16Speaker 1: true sin of his religion. Quote. We believe any deceleration
- 32:20Speaker 1: of AI will cost lives deaths that were preventable by
- 32:24Speaker 1: the AI that was prevented from existing. Is a form
- 32:27Speaker 1: of murder. And that's fucked up. That's really dangerous to
- 32:33Speaker 1: start talking like that. Oh yeah, and this is the
- 32:36Speaker 1: more direct cult comment here. I want you to compare
- 32:39Speaker 1: the claim Mark made above that slowing down AI is
- 32:42Speaker 1: identical to murder. I want you to compare that to
- 32:45Speaker 1: the claims the Church of Scientologies makes. Because the Church
- 32:48Speaker 1: of Scientology, they have this list of practices and the
- 32:51Speaker 1: beliefs that they call tech, right, and they believe that
- 32:54Speaker 1: by taking on tech, by engaging with it, people can
- 32:57Speaker 1: become clear of all of their flaws, and and by
- 33:00Speaker 1: doing that you can help you can fix all of
- 33:02Speaker 1: the problems in the world. Right, the Church of Scientology
- 33:04Speaker 1: on his websites claims that its followers will quote rid
- 33:07Speaker 1: the planet of insanity, war and crime, and in its
- 33:10Speaker 1: place create a civilization in which sanity and piece exist.
- 33:13Speaker 1: How is that in any way different from Mark Andresen
- 33:16Speaker 1: saying all of the shit that he's saying, right, that
- 33:19Speaker 1: it's going to like create this this We're going to
- 33:22Speaker 1: revolutionize medicine, We're going to like d friendly fire, We're
- 33:24Speaker 1: going to cure pandemics, we're going to stop car crash.
- 33:27Speaker 1: Asks what is the difference? Right and Scientology uses that
- 33:32Speaker 1: claim that scientology tech is so necessary it's going to
- 33:35Speaker 1: fix all these problems. So anyone who gets in the
- 33:38Speaker 1: way of the Church of Scientology and the deployment of
- 33:41Speaker 1: this tech for mankind's benefit is subject to what they
- 33:44Speaker 1: call fair game. A person declared fair game quote may
- 33:47Speaker 1: be deprived of property or injured by any means by
- 33:50Speaker 1: any Scientologist. And again, Mark Andersson has not said that
- 33:54Speaker 1: in his Techno Optimist manifesto. In fact, he makes some
- 33:56Speaker 1: claims about like none of no people are our enemies.
- 33:59Speaker 2: Right.
- 34:00Speaker 1: If you're saying you're a murderer for slowing this down,
- 34:03Speaker 1: it's not her to see how some people might adopt
- 34:06Speaker 1: a practice like fair game eventually, right, that's how where
- 34:09Speaker 1: else does this go?
- 34:10Speaker 2: Is my way? What do we do with murderers? What
- 34:12Speaker 2: does I feel like the general rule across all creeds? Yeah,
- 34:15Speaker 2: across all beliefs is typically murderers are bad and should die.
- 34:20Speaker 1: That is at least to be punished. Right, there's a
- 34:22Speaker 1: punishment for murders. Most people agree. Yeah, speaking of murder,
- 34:28Speaker 1: you know who has never committed a murder?
- 34:31Speaker 2: You cannot say that, like Blake. Okay, all of our ads.
- 34:36Speaker 1: You know who, I can't prove we're involved in any murders,
- 34:40Speaker 1: just like I have no evidence that Jamie Loftis had
- 34:43Speaker 1: any role with Okay, Okay.
- 34:45Speaker 5: What I'm saying one one, my girl is innocent, and
- 34:49Speaker 5: two you can't say that about ours about this, Okay, Well,
- 34:53Speaker 5: we don't pick them.
- 34:55Speaker 1: If he By the way, we're spreading a rumor online
- 34:57Speaker 1: that Jamie Loftis was possibly involved in a series of
- 35:00Speaker 1: murders in Grand Rapids, Michigan. It's a bit, it's it's
- 35:04Speaker 1: it's a good bits.
- 35:08Speaker 5: So you know who knows innocent?
- 35:13Speaker 2: Uh huh.
- 35:14Speaker 1: Anyway, here's here's some ads. Oh We're back. So the
- 35:25Speaker 1: more you dig into Anderson's theology, the more it starts
- 35:29Speaker 1: to seem like a form of techno capitalist Christianity. AI
- 35:33Speaker 1: is the savior in the cases of devices like the Rabbit,
- 35:35Speaker 1: it might literally become our own personal Jesus. And who
- 35:39Speaker 1: you might ask, is God. Quote. We believe the market
- 35:43Speaker 1: economy is a discovery machine, a form of intelligence, an exploratory,
- 35:48Speaker 1: evolutionary adaptive system. Now God, through this concept of reality
- 35:55Speaker 1: capitalism itself and capitalize the sea there because it's a deity.
- 35:59Speaker 1: Hassen to bring artificial general intelligence into being. All the
- 36:04Speaker 1: jobs lost, all the incoherent flats and choking our Internet,
- 36:07Speaker 1: all the Amazon drop shippers using chat GPT to write
- 36:10Speaker 1: product descriptions, these are but the market expressing its will.
- 36:14Speaker 1: Artists have to be plagiarized. Children need to be presented
- 36:17Speaker 1: with hours of procedurally generated slop and lies on YouTube
- 36:21Speaker 1: so that we one day can reach the promise land
- 36:25Speaker 1: of artificial general intelligence. Iffy isn't it worth it.
- 36:29Speaker 2: Oh my god, it's so isn't And it's I didn't know.
- 36:32Speaker 4: You know.
- 36:33Speaker 2: One of the biggest criticism with AI is that it
- 36:36Speaker 2: you know, it is one of the effects of when
- 36:38Speaker 2: you know, creativity and commerce meets commerce will always try
- 36:42Speaker 2: and kill creativity because it is commerce is more concerned
- 36:47Speaker 2: with the the the the the buck than it is
- 36:50Speaker 2: the outcome or what it takes to get set buck.
- 36:53Speaker 2: And that was that was going to be a whole thing.
- 36:56Speaker 2: I was going to drop at some point, and they
- 36:58Speaker 2: just said it for me. They just send like like
- 37:00Speaker 2: they I didn't. I thought it was more veiled. I
- 37:02Speaker 2: thought it was more hidden. But you know, that is
- 37:05Speaker 2: that is why you can you can try and say
- 37:09Speaker 2: that it is ethical to take from artists because we're
- 37:12Speaker 2: making it easier for you. Your fingie's hurt doing all that drawing.
- 37:16Speaker 2: But if it learns from you, and and and and
- 37:19Speaker 2: and and you know, uh, don't ask how you're gonna
- 37:22Speaker 2: get paid, But if it learns from you, we can.
- 37:25Speaker 2: We can give the people what they want without causing
- 37:28Speaker 2: you all this labor. You know, but who gets the money.
- 37:31Speaker 2: It's it's always the dork behind the computer who did
- 37:34Speaker 2: the code that is just essentially stealing from all of
- 37:38Speaker 2: these people and learning from them and then just producing
- 37:42Speaker 2: this amalgation of everything they've done.
- 37:46Speaker 1: Yeah. Yeah, absolutely. Also, I should know I'm trying to
- 37:50Speaker 1: be consistent about this. I wrote it down and then
- 37:52Speaker 1: I think slipped into it. It's Andres and Mark Andrees
- 37:54Speaker 1: and andresen Horowitz. Uh, it's just a weird name that
- 37:57Speaker 1: I'm not used to say. I wrote this down and
- 38:00Speaker 1: then immediately forgot to correct myself at the start of
- 38:03Speaker 1: the podcast. Again, folks, hack and a fraud. But you
- 38:06Speaker 1: know who can own well, actually, I won't say only
- 38:08Speaker 1: humans can be hacks and frauds like that. Because the
- 38:11Speaker 1: AI is absolutely mispronounced shit and get shit wrong too.
- 38:15Speaker 1: I guess that maybe they are getting conscious. Can they
- 38:20Speaker 1: build an AI that's as much a hack and a
- 38:22Speaker 1: fraud as I am. We'll see. So no, thank you, Sophie,
- 38:27Speaker 1: I appreciate it. AGI is treated as an inevitability by
- 38:31Speaker 1: people like Sam Altman of open Ai, who need it
- 38:33Speaker 1: to be at least perceived as inevitable so their company
- 38:36Speaker 1: can have the largest possible IPO. Right, there's a lot
- 38:39Speaker 1: of money on the line and in the people with
- 38:41Speaker 1: money believing all of the promises that Andresen is making.
- 38:45Speaker 1: This messianic fervor has also been adopted by squadrons of
- 38:48Speaker 1: less influential tech executives who simply need AI to be
- 38:51Speaker 1: real because it solves a financial problem. Venture capital funding
- 38:55Speaker 1: for big tech collapsed in the months before chat GPT
- 38:57Speaker 1: hit public consciousness. The reason cees was packed with so
- 39:01Speaker 1: many random AI branded products was that sticking those two
- 39:04Speaker 1: letters on a new company is like they treat it
- 39:06Speaker 1: like a talisman, right, It's this ritual to bring back
- 39:09Speaker 1: the rainy season. You know, if you throw AI in
- 39:11Speaker 1: your shit, people might buy it. Yeah, And it's you know,
- 39:14Speaker 1: there's versions of this, like laptop makers are throwing AI
- 39:17Speaker 1: in everything they do now just because like laptop sales
- 39:20Speaker 1: soared during the start of the pandemic, but they plummeted
- 39:22Speaker 1: because people, for one thing, don't need to buy laptops
- 39:25Speaker 1: all the fucking time. Most people wear them out right, yes, exactly.
- 39:29Speaker 1: And again this comes in. If you can get people
- 39:31Speaker 1: in the cold, if you can get them scared that
- 39:33Speaker 1: they're going to fall behind without AI, then maybe they'll
- 39:35Speaker 1: buy a new AI and I have lap cup top
- 39:37Speaker 1: because they're like, well, this is what I got to
- 39:38Speaker 1: do to stay competitive. You know, the terminology that these
- 39:41Speaker 1: rich tech executives use around AI is generally more grounded
- 39:45Speaker 1: than Andreson's prophesying, right, but it's just as irrational. The
- 39:49Speaker 1: most unhinged thing I heard in person at CES was
- 39:52Speaker 1: from Bartley Richardson, an AI infrastructure manager at Nvidia, who
- 39:56Speaker 1: opened a panel on deep fakes by announcing, I think
- 40:00Speaker 1: everybody has a co pilot. Everybody's making a co pilot.
- 40:02Speaker 1: Everybody wants a co pilot. Right, there's going to be
- 40:05Speaker 1: a Bartley co pilot maybe sometime in the future. That's
- 40:08Speaker 1: just a great way to accelerate us as humans, right.
- 40:11Speaker 1: And it's funny he's named Bartley. If you if you
- 40:15Speaker 1: know your old Star Trek and you can remember Barkley,
- 40:17Speaker 1: the the Sad insign. He sounds like that guy and
- 40:23Speaker 1: resembles him.
- 40:26Speaker 2: Oh man, What's what's funny about that speech is it
- 40:30Speaker 2: sounds like he's trying to convince himself to that Yeah, yeah,
- 40:36Speaker 2: we were not wasting our time, are we?
- 40:38Speaker 5: Yeah?
- 40:39Speaker 1: Yeah again. Later in a separate panel, in Nvidia in
- 40:42Speaker 1: house council Nikki Pope, who's like the only skeptic they
- 40:45Speaker 1: let On cited internal research showing consumer trust and brands
- 40:50Speaker 1: fell whenever they used AI. This gels with research published
- 40:54Speaker 1: last December that found around twenty five percent of customers
- 40:57Speaker 1: trust decisions made by AI less than those made by people.
- 41:01Speaker 1: No one on stage bothered to ask Bartley. It was like, Okay,
- 41:05Speaker 1: you want to use this thing. We know your own
- 41:08Speaker 1: company has data that it makes companies less trustworthy. Are
- 41:11Speaker 1: you worried that if you use it people won't trust you?
- 41:13Speaker 5: Like?
- 41:15Speaker 1: Is that not in your head? And that's that was
- 41:17Speaker 1: kind of a pattern at CEES all of the benefits
- 41:20Speaker 1: of AI, with some very very specific exceptions. Most of
- 41:23Speaker 1: the benefits of AI were touted in vague terms. It'll
- 41:26Speaker 1: make your company nimble, it'll make it more efficient, you know,
- 41:29Speaker 1: it'll accelerate you harms though, while they were discussed less often,
- 41:33Speaker 1: they were discussed with a terrible specificity that stood out
- 41:36Speaker 1: next to the vagueness. One of the guys in the
- 41:38Speaker 1: deep Fake panel was Ben Coleman, and he's the CEO
- 41:41Speaker 1: of Reality Defender, which is a company that detects artificially
- 41:45Speaker 1: generated media. Right their job is like, let you know
- 41:47Speaker 1: if something's AI generated. And he claims that his company
- 41:51Speaker 1: expects half a trillion dollars in fraud worldwide this year
- 41:57Speaker 1: just from voice cloning AI. Not fraud from AI, just
- 42:02Speaker 1: the fake voice AI happy trillion dollars.
- 42:06Speaker 2: Yeah. I here's the thing too that I think is
- 42:09Speaker 2: the scariest part of AI that I don't think we've
- 42:11Speaker 2: talked about yet is that everyone can use it. You know,
- 42:15Speaker 2: like it's not this isn't a thing that is like,
- 42:18Speaker 2: oh well, it's it's you know, these companies is too expensive.
- 42:21Speaker 2: People are priced out, and we just got to hope
- 42:23Speaker 2: that everyone's good. You're getting like SpongeBob rapping Kendrick Lyrics
- 42:28Speaker 2: on TikTok. You know, we my buddy Bennieam jokingly like
- 42:32Speaker 2: promoted his show and made it look like he was
- 42:35Speaker 2: having a FaceTime with Obama, and it was like pretty good.
- 42:38Speaker 2: The only reason you knew it was it was fake
- 42:40Speaker 2: was because of just the nature of the video. But like,
- 42:44Speaker 2: at what point is someone going to stop and go, hey,
- 42:47Speaker 2: we shouldn't have technology where someone can impersonate world leaders.
- 42:53Speaker 1: Yeah, it's and you know, to be honest, that's not
- 42:57Speaker 1: even because just because like I think everyone is ready
- 43:00Speaker 1: for the idea that like, yeah, people are faking Obama
- 43:03Speaker 1: or by because we've done little versions of that for
- 43:05Speaker 1: years now. I think the scariest thing is people aren't
- 43:08Speaker 1: ready for their loved ones to be imitated by AI.
- 43:11Speaker 1: And that is a thing that is happening in twenty
- 43:13Speaker 1: twenty three. And this has happened in a lot to
- 43:16Speaker 1: a lot of people. There was a specific case that
- 43:17Speaker 1: kind of went viral of this mother who got a
- 43:19Speaker 1: call from what sounded like her kidnapped daughter and like,
- 43:24Speaker 1: the AI generated the voice of her daughter, and then
- 43:26Speaker 1: a guy was like, give us money or will fucking
- 43:28Speaker 1: murder her? Right, and her kid was never kidnapped. She
- 43:31Speaker 1: very nearly sent them money because who wouldn't write yea
- 43:34Speaker 1: like if you don't know that that's a thing that
- 43:36Speaker 1: can do. Who would not y like, that's a that's
- 43:41Speaker 1: a rock and it's the AI was able to clone
- 43:44Speaker 1: her daughter's voice because her daughter has a TikTok, right,
- 43:46Speaker 1: it doesn't take that much, you know. And this is
- 43:49Speaker 1: why by the way that people are talking about ways
- 43:50Speaker 1: to mitigate this, I think one of them is like
- 43:52Speaker 1: have a family password or something where it's like, all right,
- 43:55Speaker 1: if I'm fucking kidnapped, I'm going to say the password
- 43:57Speaker 1: you know, so that you know some random person with
- 44:00Speaker 1: your TikTok won't know it or at least has to
- 44:02Speaker 1: try harder to guess it. So great, thanks to AI,
- 44:04Speaker 1: now we have to have passwords for our families in
- 44:07Speaker 1: real life. Cool.
- 44:08Speaker 2: Yeah, if you want to see that Thanksgiving, you got
- 44:11Speaker 2: to know the password.
- 44:12Speaker 1: Yeah. Fucking great. At CEES and at the substacks and
- 44:18Speaker 1: newsletters of all these AI cultists, there's no time to
- 44:21Speaker 1: dwell on problems like these. Full steam ahead is the
- 44:24Speaker 1: only serious suggestion they make. You should all be excited.
- 44:28Speaker 1: Google's VP of Engineering Bashad Bazzati tells us during a
- 44:31Speaker 1: panel discussion with McDonald's executive if you're not using AI,
- 44:35Speaker 1: bishod warned, you're missing out. And I heard versions variations
- 44:40Speaker 1: of the same sentiment over and over again. Right, not
- 44:42Speaker 1: just this stuff is great, but like you're kind of
- 44:43Speaker 1: doomed if you don't use it, And I will give
- 44:46Speaker 1: Nicky Pope was the only skeptic really who had a
- 44:50Speaker 1: speaking role in CEES. It is not coincidental that she
- 44:53Speaker 1: was an academic and a black woman, because her background
- 44:57Speaker 1: is studying algorithmic bias in the justice system. Yes, and
- 45:01Speaker 1: so she she she had some really good points about
- 45:05Speaker 1: like the actual dangers this stuff had. She was on
- 45:07Speaker 1: this the panel, she was almost governing AI risk and
- 45:10Speaker 1: kind of her like the partner on the panel. The
- 45:11Speaker 1: guy she was talking with was Adobe VP Alexandrew Costin,
- 45:16Speaker 1: and she urged the audience, I want you to think
- 45:18Speaker 1: about the direct harm algorithmic bias could do to marginalized communities. Quote,
- 45:23Speaker 1: if we create AI that desperately treats one group tremendously
- 45:27Speaker 1: in favor of another group, the group that has disadvantaged
- 45:29Speaker 1: or disenfranchised, that's an existential threat to that group. And
- 45:33Speaker 1: she was specifically like people talk about the existential threat
- 45:36Speaker 1: of an AI going crazy and killing us all, but
- 45:38Speaker 1: like that's not as realistic as what we know will happen.
- 45:41Speaker 2: Yes, oh yeah. When you have these banks that like
- 45:45Speaker 2: automatically you know, are using AI to try and approve
- 45:50Speaker 2: you know, loans, and Deonte sends his name in and
- 45:53Speaker 2: they're like not approved.
- 45:54Speaker 1: Yeah exactly.
- 45:55Speaker 2: He's like nah, good, And.
- 45:58Speaker 1: I am glad she was there. She again she still
- 46:01Speaker 1: you know, works for a company it's gonna make money
- 46:02Speaker 1: off of this. She's not like a doomer on it,
- 46:05Speaker 1: but like at least one person was being like, could
- 46:07Speaker 1: we please acknowledge there are dangerous I.
- 46:10Speaker 2: Know, because here's the thing is and I truly believe this,
- 46:14Speaker 2: And you were basically saying this earlier that AI as
- 46:18Speaker 2: a tool is fine. You know, yeah, when you win,
- 46:20Speaker 2: it is. And a tool is something that is always
- 46:23Speaker 2: held and used by a human that there's the checks
- 46:27Speaker 2: and balances. It is only as evil as the person
- 46:30Speaker 2: who's using it. And that is just any item, physical
- 46:34Speaker 2: or digital, will ever, you know, will always be under
- 46:37Speaker 2: But the moment you're like, I'm going to give you
- 46:40Speaker 2: free reign based on information, and how many times has
- 46:45Speaker 2: an article gone online that was like, it's scanned Reddit
- 46:50Speaker 2: or it's scanned Twitter and it's racist. Now you know
- 46:53Speaker 2: there's and we still like went full steam ahead with
- 46:56Speaker 2: producing this and thinking we're right and we know, especially
- 47:00Speaker 2: when you see a lot of these tech leaders being
- 47:03Speaker 2: predominantly white men, and we know that in general, most
- 47:07Speaker 2: white men don't care about protecting marginalized people. They care
- 47:12Speaker 2: about getting their bottom dollar. They don't see they see
- 47:14Speaker 2: it as a as a rare occurrence because they don't
- 47:18Speaker 2: live that existence. They don't have the data pun intended
- 47:22Speaker 2: to build something to defend against it because it's not
- 47:26Speaker 2: a real problem to them because they don't see it
- 47:28Speaker 2: because and that is beyond just them being them and
- 47:31Speaker 2: more into as humans. A lot of times, if you
- 47:34Speaker 2: don't do the work to see it and understand what
- 47:37Speaker 2: happens to other people outside of your perspective, you're just
- 47:41Speaker 2: gonna believe that it's it's not real and or people
- 47:45Speaker 2: are exaggerating, or it's this and it's that. And when
- 47:47Speaker 2: you are a gung ho and you have drunk the
- 47:49Speaker 2: kool aid that is the AI kool aid, and you
- 47:53Speaker 2: are telling people that this is the future, we have
- 47:55Speaker 2: to do it, you're gonna push ahead. But like we've
- 47:59Speaker 2: literally have seen a clear cut example of what happens
- 48:04Speaker 2: when you push past safety and and you just do
- 48:08Speaker 2: what you want to do just because you have a
- 48:10Speaker 2: whole bunch of money and a mad Catz controller, Like,
- 48:13Speaker 2: it gets dangerous.
- 48:15Speaker 1: So as you started talking about like the dangers of
- 48:19Speaker 1: certain tools, right and how they the value of the tools,
- 48:22Speaker 1: I literally looked over at the gun on my table, right,
- 48:25Speaker 1: and we all agree, even people who really like them,
- 48:28Speaker 1: there should be regulation. And I think the vast majority
- 48:31Speaker 1: like agree more regulation, but they are like, again, not
- 48:35Speaker 1: to say that it's sufficient, but there are a lot
- 48:37Speaker 1: of laws about like where you can carry a gun legally,
- 48:40Speaker 1: how you can buy a gun, right, and because people
- 48:44Speaker 1: understand that, like, yeah, if a tool is that powerful,
- 48:47Speaker 1: there should be limitations and things and things that you
- 48:51Speaker 1: can do that get them taken away from you forever.
- 48:54Speaker 4: Right.
- 48:54Speaker 1: Yes, I don't know how we do that with AI,
- 48:57Speaker 1: but I don't think that's a reason not to try. Yeah,
- 49:02Speaker 1: you do what.
- 49:02Speaker 2: In that movie Hackers, and it's like you're just being
- 49:05Speaker 2: from the Internet till you graduate at high school or
- 49:07Speaker 2: whatever it was.
- 49:08Speaker 1: Yeah. Yeah, Now, Costin claimed that the biggest issue again,
- 49:13Speaker 1: so nicky Pope is like, yeah, I think this stuff
- 49:16Speaker 1: could really hurt marginalized communities, and Alexandrew Costin from Adobe
- 49:21Speaker 1: responded that like, well, I agree, but the biggest risk
- 49:24Speaker 1: of generative AI isn't fraud or plagiarism. It's not using AI.
- 49:28Speaker 4: Right.
- 49:29Speaker 1: He claims, like this is as big as the Internet,
- 49:31Speaker 1: and we all just have to get on board. And
- 49:33Speaker 1: then I'm gonna read verbatim how he ends this particular statement.
- 49:38Speaker 1: I think humanity will find a way to tame it
- 49:41Speaker 1: to our best interest. Hopefully great, cool, no way, why awesome, awesome,
- 49:52Speaker 1: And the whole week was like that again, these really specific,
- 49:55Speaker 1: devastating harms and then vague claims of like, yeah, we're
- 49:58Speaker 1: all just gonna have to debt. And I brought up
- 50:01Speaker 1: scientology earlier. But when I think about touting like vague
- 50:04Speaker 1: claims of world saving benefits alongside, and it's going to
- 50:07Speaker 1: hurt too, when you have to accept the pain, I
- 50:10Speaker 1: think of Keith Ranieri, right, the next Sium guy. We
- 50:12Speaker 1: all remember Keith. You know, like most cult leaders, Ranieri
- 50:16Speaker 1: promised his mostly female followers, you'll get all these benefits.
- 50:19Speaker 1: I'm going to like heal you. You'll be extra productive,
- 50:21Speaker 1: you'll be super good in your business, super good in
- 50:24Speaker 1: your career. But you have to follow my commands because
- 50:26Speaker 1: they have to retrain you on some stuff, and so
- 50:28Speaker 1: it's going to be uncomfortable, right, And the end result
- 50:31Speaker 1: of this is a bunch of them branded them their
- 50:32Speaker 1: flesh and partook in sex trafficking. You know, the techs,
- 50:37Speaker 1: these tech executives are not Ranieri, but I think they
- 50:40Speaker 1: see money in aping some of his tactics. Right, the
- 50:43Speaker 1: benefits are so good, we just have to accept some pain.
- 50:45Speaker 1: You know I got to hurt you to rebuild you better. Now,
- 50:49Speaker 1: all of the free money right now is going to AI,
- 50:52Speaker 1: and these guys know the best way to chase it
- 50:54Speaker 1: is to throw logic to the wind and promise the
- 50:56Speaker 1: masses that if we just let this technology run roughshod
- 50:59Speaker 1: over every field of human endeavor, it will be worth
- 51:02Speaker 1: it in the end. This is rational for them, because
- 51:05Speaker 1: they're going to make a lot of money, but it
- 51:07Speaker 1: is an irrational thing for us to let them do.
- 51:10Speaker 1: Why would we want to put artists and illustrators who
- 51:12Speaker 1: we like out of a job. Why would we accept
- 51:15Speaker 1: a world where it is impossible to talk to a
- 51:17Speaker 1: human when you have a problem, and you're instead thrown
- 51:19Speaker 1: to a churning swarm of chatbots. Why would we let
- 51:22Speaker 1: Sam Altman hoover up the world's knowledge and resell it
- 51:25Speaker 1: back to us. We wouldn't, and we won't unless he
- 51:28Speaker 1: can convince us that doing so is the only way
- 51:31Speaker 1: to solve the problems that scare us. Climate change, the
- 51:34Speaker 1: cure for cancer, and into war, or at least and
- 51:36Speaker 1: into the fear that we will all be victimized by
- 51:39Speaker 1: crime or terrorism. All of these have been touted as
- 51:41Speaker 1: benefits of the coming AI age if we can just
- 51:44Speaker 1: reach the AI Promise Land, and we're going to talk
- 51:48Speaker 1: about some of the people who believe in that promised
- 51:51Speaker 1: land and what they think it'll be like. But first, Iffy,
- 51:53Speaker 1: you know, it is the real promise Land, the only
- 51:56Speaker 1: actual paradise any of us will ever know. What by
- 52:00Speaker 1: from the sponsors of this show, of course, all right,
- 52:06Speaker 1: here's an ad All right, we're back. So I want
- 52:16Speaker 1: to talk about Silicon Valley's latest subculture, emphasis on the
- 52:20Speaker 1: cult Effective Accelerationism or E slash acc e AC, I
- 52:25Speaker 1: think is probably how you could pronounce it. The gist
- 52:28Speaker 1: of this movement fits with Mark Andrewson's manifesto AI development
- 52:32Speaker 1: must be accelerated without restriction, no matter the cost. E
- 52:35Speaker 1: act has been covered by a number of journalists, but
- 52:37Speaker 1: most of that coverage misses how very spiritual some of
- 52:40Speaker 1: it seems. One of the inaugural documents of the entire
- 52:43Speaker 1: belief system opens with the statement accelerationism is simply the
- 52:47Speaker 1: self awareness of capitalism, which has scarcely begun. Again, we
- 52:51Speaker 1: see a statement that AI has somehow enmeshed itself with
- 52:54Speaker 1: capitalism's ability to understand itself. It is some way intelligent
- 52:58Speaker 1: and can know itself. I don't know how else you
- 53:00Speaker 1: interpret this, but as belief in a god built by
- 53:03Speaker 1: atheists who like money a lot. The argument continues that
- 53:06Speaker 1: nothing matters more than extending the quote light of consciousness
- 53:10Speaker 1: into the stars, a belief elon Musk himself is championed.
- 53:13Speaker 1: AI is the force the market will use to do this,
- 53:16Speaker 1: and quote this force cannot be stopped. This is followed
- 53:20Speaker 1: by wild claims that next generation life forms will be
- 53:23Speaker 1: created inevitably by AI, and then a few sentences down
- 53:27Speaker 1: you get the kicker. Those who are first to usher
- 53:29Speaker 1: in and control the hyper parameters of AI slash techno
- 53:32Speaker 1: capital have immense agency over the future of consciousness. So
- 53:36Speaker 1: AA is not just a god. It's a god we
- 53:38Speaker 1: can build, and we can use it to shape our future,
- 53:40Speaker 1: the future of our reality, to our own whims. And again,
- 53:43Speaker 1: some of these guys will acknowledge maybe it'll kill all
- 53:45Speaker 1: of us, but as long as it makes a technology
- 53:48Speaker 1: that spreads to the stars, that's worth it, because we've
- 53:50Speaker 1: kept the light of consciousness alive. Wow, that's not I
- 53:53Speaker 1: don't think the mainstream view, but you can definitely find
- 53:57Speaker 1: people saying that shit and they'll be like, if you
- 54:00Speaker 1: attempt to slow this process down, there are risks, and
- 54:03Speaker 1: they're saying the same thing, andres you stop it from
- 54:05Speaker 1: doing all these wonderful things. But also I do kind
- 54:08Speaker 1: of view that as a veiled threat, right, because if
- 54:11Speaker 1: AI is the only way to spread the light of
- 54:13Speaker 1: consciousness to the void, and that is the only thing
- 54:16Speaker 1: that matters, what do you do to the people who
- 54:18Speaker 1: seek to stop you, right, who seek to stop AI?
- 54:21Speaker 1: I actually am fine with extending the light of consciousness
- 54:23Speaker 1: into space. I'm a big fan of Star Trek. I
- 54:26Speaker 1: just don't believe that the intelligent, hyper aware capitalism is
- 54:30Speaker 1: the thing to do it. Again, too much of a
- 54:34Speaker 1: Star Trek guy for that. When I look at the
- 54:36Speaker 1: people who want to follow Mark Andresen's vision, who find
- 54:39Speaker 1: what these each people are saying is not just compelling
- 54:42Speaker 1: but inspiring. I think of another passage from that New
- 54:45Speaker 1: Yorker article by Zoe Heller quote, not passive victims, they
- 54:48Speaker 1: themselves sought to be controlled, Hiki Murakami wrote of the
- 54:52Speaker 1: members of om Shinriko, the cult Hu's seren gas attack
- 54:55Speaker 1: on the Tokyo subway in nineteen ninety five killed thirteen people.
- 54:58Speaker 1: In his book Underground Murka, he describes most own members
- 55:01Speaker 1: as having deposited all their precious personal holdings of selfhood
- 55:05Speaker 1: in the spiritual bank of the cults leader Shoko Asahara,
- 55:08Speaker 1: submitting to a higher authority, to someone else's account of
- 55:11Speaker 1: reality was, he claims their aim. Now the EAC Manifesto
- 55:15Speaker 1: newsletter thing use the term techno capital in conjunction with AI.
- 55:19Speaker 1: This is a word that you can find a few
- 55:21Speaker 1: different definitions on because it's it's a wonky, like weird
- 55:25Speaker 1: academia philosophy term, and there's a number of folks who have,
- 55:29Speaker 1: you know, will argue about how it ought to be described.
- 55:32Speaker 1: But this is broadly kind of the same thing that
- 55:34Speaker 1: Andresen is referring to when he talks about the market
- 55:37Speaker 1: as this intelligent discovery organism. Right, And while there are
- 55:41Speaker 1: a few different ways you'll see this defined, the EAC
- 55:43Speaker 1: people and Andresen himself are thinking about how philosopher Nick Land,
- 55:46Speaker 1: who's the guy who's generally credited with like popularizing the
- 55:50Speaker 1: term technocapitalism, defines it. Land is one of many advocates
- 55:54Speaker 1: of the idea of a technological singularity, the point where
- 55:58Speaker 1: technological growth driven by improvements in computing becomes irreversible, the
- 56:02Speaker 1: moment at which a super intelligent machine begins inventing more
- 56:06Speaker 1: and more of itself and expanding tech in a way
- 56:08Speaker 1: that humans can't. As one of Gland's fans summarized in
- 56:12Speaker 1: a medium post, a runaway reaction of self improvement loops
- 56:16Speaker 1: will almost instantaneously create a coherent superintelligent machine. It is
- 56:20Speaker 1: man's last invention. The most notable of industries AI, nanotechnology, femtotechnology,
- 56:26Speaker 1: and genetic engineering will erupt with rapid advancements, quickly exceeding
- 56:29Speaker 1: human intelligence. Now, obviously the way Land writes is again
- 56:34Speaker 1: kind of worth reading, but dense, perhaps two dents for
- 56:38Speaker 1: an entertainment podcast. So I'm going to read again from
- 56:41Speaker 1: a sub stack called Regress Studies by a writer named
- 56:44Speaker 1: Santi Ruiz, kind of talking about this idea of techno
- 56:47Speaker 1: capitalism that Land has from more critical standpoint, quote Nick Land,
- 56:52Speaker 1: who coined the term is a misanthrope. He doesn't like
- 56:54Speaker 1: humans much. So the idea that there could be an
- 56:56Speaker 1: entity coming, already being born, drawing itself into existence by
- 57:00Speaker 1: hyperstitionally preying on the dreams of humanity cannibalizing their desires.
- 57:04Speaker 1: Wearing the invisible hand is an ideological skin. He's into
- 57:08Speaker 1: that technoeconomic interactivity crumble social order in autosophisticating machine runway,
- 57:13Speaker 1: as he would put it. And that's good. You're being
- 57:16Speaker 1: colonized by an entity that doesn't care about you, except
- 57:19Speaker 1: insofar as you make a good host. We'll talk about
- 57:22Speaker 1: hyperstition in a little bit here. So Land is the
- 57:25Speaker 1: guru of accelerationism. You might not be surprised to learn
- 57:28Speaker 1: that he has a devoted following among the far right.
- 57:30Speaker 1: This is because he is quite racist, anti democratic, and
- 57:33Speaker 1: obsessed with eugenics. Now, his eugenics are not your gram
- 57:37Speaker 1: Pappy's eugenics. For him, it involves gene editing, which will
- 57:40Speaker 1: be available to greater extents than every thanks to AI.
- 57:44Speaker 1: Land claims to disnet like white nationalists and conventional racists
- 57:48Speaker 1: because they don't see the whole picture. Quote and this
- 57:51Speaker 1: is me quoting from one of Land's publications, Racial identarianism
- 57:55Speaker 1: and visages a conservation of comparative genetic isolation, generally to
- 58:00Speaker 1: by boundaries corresponding to conspicuous phenotypic variation. It is race
- 58:04Speaker 1: realist in that it admits to seeing what everyone does
- 58:07Speaker 1: in fact see, which is to say, consistent patterns of
- 58:10Speaker 1: striking correlated multidimensional variety between human populations or subspecies. Its
- 58:15Speaker 1: unrealism lies in its projections. That's pretty racist. Land is
- 58:21Speaker 1: listed by name and Andresen's manifesto as someone you should
- 58:24Speaker 1: read for a better understanding of the wonderful, optimistic future
- 58:27Speaker 1: he and his illke plan for us. He cites extensively
- 58:31Speaker 1: Grigory Cochrane, who posits that space travel spreading to the
- 58:35Speaker 1: stars will solve our race problem because it's a natural filter,
- 58:39Speaker 1: basically saying some races won't make it into space, so
- 58:42Speaker 1: we don't need to be to be violent, like, we
- 58:45Speaker 1: just have to spread to space and that will do
- 58:47Speaker 1: our eugenics part of it for us. So that's cool.
- 58:52Speaker 2: Yeah, you know, I'm stuck on this, like, you know,
- 58:57Speaker 2: journey to the Stars through f thing, because I don't know, Robert,
- 59:02Speaker 2: do you play Warhammer forty two?
- 59:04Speaker 1: Oh? God if he ify, of course I play. I've
- 59:08Speaker 1: been playing Warhammer forty K most of my life.
- 59:11Speaker 2: Okay, because this is sound a very adeptis mechanics, Yeah right, yes, absolutely,
- 59:17Speaker 2: And I'm like, I'm like, what is going on here,
- 59:20Speaker 2: I'm deep and well trader, and now I'm like, no,
- 59:22Speaker 2: this is them.
- 59:24Speaker 1: What is fun is that like Warhammer forty thousand, the
- 59:27Speaker 1: deep Fluff envisions a society that it's like a hybrid
- 59:29Speaker 1: between the Federation and Star Trek, and what these ai
- 59:33Speaker 1: Eyak people dream of that it is this utopia for
- 59:37Speaker 1: like ten thousand years because they developed thinking machines and
- 59:40Speaker 1: then all of the thinking machines turn on them and
- 59:42Speaker 1: murder everybody. And so in the future we just lobottomize
- 59:46Speaker 1: people who commit crimes and turn them into computers for
- 59:49Speaker 1: us because we can't have intelligent machines anymore.
- 59:53Speaker 2: So we're just we're going that's what it looks like.
- 59:56Speaker 2: We're marching towards with these folks.
- 59:58Speaker 1: Yeah, And obviously the thing that the Warhammer people are
- 1:00:01Speaker 1: are inspired by is like the but Larry and g
- 1:00:04Speaker 1: Hot and Dune, which is the more artful version of
- 1:00:07Speaker 1: that story with less orcs, which makes it inferior in
- 1:00:11Speaker 1: my mind. But I do love Dune.
- 1:00:12Speaker 2: So you need more red because the everything Yeah.
- 1:00:16Speaker 1: Red makes it go faster.
- 1:00:17Speaker 2: Yeah.
- 1:00:18Speaker 1: So Land concludes by imagining both racists and anti racists
- 1:00:23Speaker 1: binding together in defense of the concept of race. Right,
- 1:00:26Speaker 1: that's what the result of AI is going to be.
- 1:00:28Speaker 1: The racists need race. You know, we're going to get
- 1:00:30Speaker 1: so good at gene editing, the racists will get angry
- 1:00:33Speaker 1: and the anti racists will get angry because they're so
- 1:00:35Speaker 1: in love with the concept of race. Well, we're just
- 1:00:37Speaker 1: going to improve people annihilate racial differences through moving to
- 1:00:42Speaker 1: the stars and the natural filter that that implies. By
- 1:00:46Speaker 1: the way, the name of the article Land wrote all
- 1:00:48Speaker 1: this and is called hyper racism. So cool guy Glad
- 1:00:52Speaker 1: Mark Andresen cites him in his manifest were Glad the
- 1:00:54Speaker 1: biggest venture capital guy in the country. I was like, yeah,
- 1:00:57Speaker 1: read this, dude. Yeah, that's the sequel to Flom's hyperrealism.
- 1:01:01Speaker 1: So that's yeah, it is interesting. And these guys don't
- 1:01:04Speaker 1: tend to cide it as much. I think you get
- 1:01:06Speaker 1: in some of the deeper stuff. They're all talking about
- 1:01:07Speaker 1: these technocapitalist concepts that Nick Land plays with. They don't
- 1:01:11Speaker 1: talk about what I think is actually one of his
- 1:01:12Speaker 1: most sort of insightful points, which's about a concept called hyperstition.
- 1:01:16Speaker 1: And in brief, hyperstition is like creating things in fiction
- 1:01:21Speaker 1: that become real and the process by which that happens.
- 1:01:24Speaker 1: I think about that a lot when I think about
- 1:01:25Speaker 1: things like the bootlearry and jihad, the war against the
- 1:01:27Speaker 1: Intelligent Machines and the do in Dune, or you know
- 1:01:30Speaker 1: what happened in the Warhammer forty thousand universe. But I
- 1:01:32Speaker 1: also think about how part of why these people are
- 1:01:35Speaker 1: targeting creators, writers, actors, musicians, artists like pen and paper,
- 1:01:43Speaker 1: you know, painting artists and stuff, is because the only
- 1:01:46Speaker 1: way out of this future they have envisioned is in
- 1:01:49Speaker 1: imagining a better one and then making it real, right like,
- 1:01:53Speaker 1: and that is a thing that creatives have a role
- 1:01:56Speaker 1: in doing. So if you can kill that ability, hand
- 1:01:58Speaker 1: it over to the machines that you can control, maybe
- 1:02:00Speaker 1: you can stop them from this path of resistance. Motherfuckers,
- 1:02:07Speaker 1: I know.
- 1:02:08Speaker 2: They're on there with They're like, you want something better,
- 1:02:10Speaker 2: We got to take it away from it?
- 1:02:11Speaker 1: Yeah, fuck you. So anyway, I think that's going to
- 1:02:17Speaker 1: end it for us. In part one, you know, this
- 1:02:19Speaker 1: this whole investigation in much more condensed form, just kind
- 1:02:23Speaker 1: of really focusing specifically on the argument there's cult dynamics
- 1:02:26Speaker 1: of the fandom is being published in an article on
- 1:02:28Speaker 1: Rolling Stone. I'll probably edit in like the title or
- 1:02:31Speaker 1: something here so you can find it. But check that out.
- 1:02:34Speaker 1: That's kind of the more easily shareable version, more condensed, iffy.
- 1:02:38Speaker 1: Where should people check out you and your stuff?
- 1:02:40Speaker 6: Oh?
- 1:02:40Speaker 2: Man, I'm if you wide away on Twitter and Instagram,
- 1:02:43Speaker 2: you know, so definitely peep me there. Listen to our
- 1:02:47Speaker 2: relationship pod with if you and Emmy if you want
- 1:02:50Speaker 2: to hear us talk about relationship stuff and uh, yeah,
- 1:02:54Speaker 2: you have Max Film for movies, but if you go
- 1:02:57Speaker 2: to if you widy Way, you'll find all that stuff.
- 1:02:59Speaker 2: And of course watch drop something absolutely has been to
- 1:03:03Speaker 2: be announced next week.
- 1:03:05Speaker 1: Yes, watch drop Out something cool is coming soon and
- 1:03:08Speaker 1: it's also an extremely human endeavor. Yes, yes, just like
- 1:03:15Speaker 1: this show is, so go with. Uh, I don't know
- 1:03:18Speaker 1: whatever god you worship or the machine god you plan
- 1:03:22Speaker 1: to meme into being Goodbye.
- 1:03:28Speaker 6: Behind the Bastards is a production of cool Zone Media.
- 1:03:31Speaker 6: For more from cool Zone Media, visit our website Coolzonemedia
- 1:03:35Speaker 6: dot com, or check us out on the iHeartRadio app,
- 1:03:38Speaker 6: Apple Podcasts, or wherever you get your podcasts.