Latest / Ctrl-Alt-Speech / The Internet is (Still) for Porn, with Yoel Roth

Transcript

The Internet is (Still) for Porn, with Yoel Roth · Ctrl-Alt-Speech

• 0:00
  Mike Masnick: So we are increasingly digging deep, um, finding prompts to start this podcast.
• 0:06
  Mike Masnick: But in the words of the popular task site, Thumbtack, what's on your to do list this week, Yoel?
• 0:14
  Yoel Roth: This week and every week, I am trying to figure out what does or doesn't count as a very large online platform under the Digital Services Act.
• 0:23
  Yoel Roth: Mike, what's on your to do list?
• 0:25
  Mike Masnick: Well, right now it's trying to record a podcast, without Ben and, and having you, you here instead, which is fun.
• 0:33
  Mike Masnick: But you know, I sometimes rely on Ben to handle some of this stuff.
• 0:36
  Mike Masnick: And so keeping up on.
• 0:38
  Mike Masnick: I'm keeping this podcast going is, is on my to do list right now.
• 0:42
  Yoel Roth: I'll do my best make it as painless for you as possible.
• 0:53
  Mike Masnick: Hello, and welcome to Ctrl-Alt-Speech, your weekly roundup of the major stories about online speech, content moderation, and internet regulation.
• 1:02
  Mike Masnick: This week's episode is brought to you with financial support from the Future of Online Trust and Safety Fund.
• 1:08
  Mike Masnick: I am Mike Masnick from Techdirt, and once again, We are without a British accent on the podcast as Ben is busy, as I just noted.
• 1:17
  Mike Masnick: Uh, however, we have secretly replaced your usual co host with trust and safety expert, Yoel Roth, who somewhat famously, ran trust and safety at the, I will say now deceased Twitter platform and currently runs trust and safety for Match Group.
• 1:36
  Mike Masnick: Which is the company behind a few different dating sites, including Tinder and Match and Basically,
• 1:44
  Yoel Roth: Hinge and OkCupid and just keep naming them and probably their match group.
• 1:49
  Mike Masnick: yes, yes.
• 1:50
  Mike Masnick: So if you are dating, thanks to the internet, you have UL to thank for keeping you safe.
• 1:58
  Yoel Roth: Doing our best.
• 1:59
  Mike Masnick: Excellent.
• 2:00
  Mike Masnick: Excellent.
• 2:01
  Mike Masnick: so we have a bunch of stories this week and,, some of them are quite fun and I'm happy that we have you here as an expert, so I'm going to jump right in with our first big story.
• 2:14
  Mike Masnick: Which I want to hear your thoughts about, which is, this is a story from TechCrunch, which noted that X, which is the, uh, The platform formerly known as Twitter, where you used to work, has apparently tweaked its rules to formally allow adult content.
• 2:36
  Mike Masnick: And so, uh, can you help me out here?
• 2:39
  Mike Masnick: Because I was under the impression that Twitter, somewhat famously, always allowed adult content.
• 2:46
  Mike Masnick: So what, what's happening here?
• 2:48
  Mike Masnick: Yeah.
• 2:53
  Yoel Roth: part of it, because it just sort of is what the status quo has always been.
• 2:58
  Yoel Roth: You're right, like, Twitter has, somewhat famously in the world of social media, always had a stance of, If not actively encouraging, then at minimum turning a sort of knowing blind eye to the subject of adult content and nudity.
• 3:16
  Yoel Roth: personally, that was one of the things that attracted me to working at Twitter in the first place, that the company had a more sensible approach to this type of content.
• 3:24
  Yoel Roth: Then at the time, Facebook was mired in these endless debates about nipples and breastfeeding.
• 3:31
  Yoel Roth: And it just felt like Twitter had landed somewhere more sensible.
• 3:35
  Yoel Roth: Which is why I was somewhat surprised this week to read that the company triumphantly has decided that it's okay with adult content and that they quote believe in the autonomy of adults to engage with and create content that reflects their own beliefs, desires and experiences, including those related to sexuality, which has to be just about the least erotic way to talk about porn I have ever read.
• 4:03
  Yoel Roth: But like, it's just a little confusing because I think my experience and the experience of anybody who's ever used Twitter is that you don't have to dig very far to find adult content.
• 4:15
  Mike Masnick: Yeah.
• 4:16
  Mike Masnick: and so, I mean, the suggestion in the news reporting is that there is some sort of major change in terms of like formally allowing it within the rules, but it was always allowed in the rules, right?
• 4:29
  Mike Masnick: There was, is there any real change here?
• 4:32
  Yoel Roth: It's hard to say.
• 4:33
  Yoel Roth: And this is where, you know, I think you have to position what X is doing against a backdrop of less and less transparency about their operations, their rules, and even the basic mechanics of the product.
• 4:48
  Yoel Roth: There have been longstanding broken windows when it comes to how adult content works on social media generally, and also on Twitter, right?
• 4:57
  Yoel Roth: There are questions around age gating and age assurance.
• 5:01
  Yoel Roth: Big, thorny, messy, unsolved questions, but open questions.
• 5:05
  Yoel Roth: There's questions about how to label that content.
• 5:08
  Yoel Roth: And if you give content creators the ability to self label adult content, or if you rely on machine learning to do it,
• 5:14
  Mike Masnick: Right.
• 5:15
  Yoel Roth: it's not really clear what changed here.
• 5:18
  Yoel Roth: Is it that now this content can be monetized and, X is moving in the direction of trying to explicitly compete with only fans?
• 5:27
  Yoel Roth: That was certainly something that the previous administration at Twitter considered, and then now famously, after some of these documents were leaked, the company decided not to pursue these plans because it felt it couldn't do so safely.
• 5:41
  Yoel Roth: have they now felt that they've solved that problem, and, and that they can monetize adult content?
• 5:46
  Yoel Roth: Like, maybe that's the subtext here, but it's really not.
• 5:51
  Yoel Roth: What is different now than a year ago, or frankly, than 10 years ago?
• 5:56
  Mike Masnick: I mean, I find the suggestion that the current administration of that platform has thought through any of this in terms of can they do something safely feels unlikely to be happening within the, uh, the current folks there, but, maybe that's just my, uh, my outside view of, how the, platform is currently being run.
• 6:20
  Mike Masnick: I mean, there was talk about this when Elon first took over that he obviously needs to find a business model you know, especially considering how he's driven away, half the advertising effectively, and he wanted to explore other business models.
• 6:34
  Mike Masnick: So there is that question of maybe this is a business model thing where he thinks that, Monetizing and, doing something along the OnlyFans model is their way to make up some of the lost revenue, but that's, that's just guessing at this point for us, right?
• 6:52
  Yoel Roth: really hard to say.
• 6:54
  Yoel Roth: I mean, I think what we know and what we've, what you can observe on Twitter is that a lot of adult content creators are using the platform.
• 7:03
  Yoel Roth: But right now, most of them are using it as a way to redirect traffic to other sites like OnlyFans.
• 7:09
  Yoel Roth: This is something that Twitter studied and understood years ago, right?
• 7:13
  Yoel Roth: Like, we saw that a significant portion of, media results in search were adult content, and most of the accounts posting that adult content were saying, Hey, look at this trailer for content you can find on my OnlyFans account.
• 7:28
  Yoel Roth: And there is a robust ecosystem there of Discovery and interaction on Twitter, redirecting to content consumption and monetization on OnlyFans is this very symbiotic thing, except that Twitter wasn't making any money from it.
• 7:42
  Yoel Roth: And so, there is a rational case to say, you should vertically integrate these things and actually have monetization on Twitter.
• 7:49
  Yoel Roth: The difference Is that OnlyFans have invested extraordinarily heavily in trust and safety to make sure that when they are offering monetization capabilities tied to adult content, they're doing it in a way that assures that performers are producing consensual content, that people are over the age of 18, that everything is above board legally.
• 8:13
  Yoel Roth: if you talk to the folks who work at OnlyFans, I'll tell you, like, a majority of the staff at the entire company are working on trust and safety issues.
• 8:21
  Yoel Roth: Like, their entire business is rooted in trust and safety.
• 8:25
  Yoel Roth: I don't know that we're seeing that same level of rigor and diligence coming from the new administration at X.
• 8:32
  Mike Masnick: That's a, a diplomatic way, way of putting it.
• 8:35
  Mike Masnick: Uh, I mean, there is a part of me that wonders if, this was not really mentioned in the story, but Elon likes to see himself as this, freedom loving, freedom supporting person and his, his whole reason for purchasing Twitter in the first place was to allow freedom of speech.
• 8:54
  Mike Masnick: I almost wonder if this is just like.
• 8:56
  Mike Masnick: he's trying to get that story out there that adult content is okay because he's, you know, wants to continue to present himself as this, freedom supporting person.
• 9:07
  Yoel Roth: Look, I, if that's the stance that X want to take, and this is a fight that they want to have, I think it's a fight worth having.
• 9:15
  Yoel Roth: I think we've, for many, many years, had the biggest voices in speech governance through technology taking a pretty broadly anti porn and anti nudity stance.
• 9:25
  Yoel Roth: You had, In the early days of the App Store, Steve Jobs saying that he wanted to give consumers freedom from porn on the iPhone.
• 9:32
  Yoel Roth: You've had Mark Zuckerberg taking a very pointedly anti nudity stance on Facebook and sort of creating policies that pretty comprehensively restrict this.
• 9:43
  Yoel Roth: I'm glad that there are sites that take a different viewpoint.
• 9:47
  Yoel Roth: I think there was a strategy to not drawing attention to this issue, and I suppose the word of warning I will offer here is, as the guy who on a couple of occasions dealt with, threats to have the Twitter app kicked out of the app store due to the presence of adult nudity, allow me to just say that perhaps drawing attention to this particular issue may be picking an unwinnable fight.
• 10:13
  Mike Masnick: Ah, very interesting.
• 10:14
  Mike Masnick: Well, I know I will note, I will call back to a New York times piece that you wrote soon after you left Twitter and which you noted that there are some regulating forces on how.
• 10:27
  Mike Masnick: Speech is, handled on different platforms.
• 10:29
  Mike Masnick: And one of them that you very clearly noted was the app stores often do have, perhaps problematically and, and in many ways, I think problematically an awful lot of say here.
• 10:41
  Mike Masnick: And so I'll go further than what you were just saying.
• 10:44
  Mike Masnick: it is possible that Apple and or Google could, in theory, using this news, start to push back on, X and threaten to do something.
• 10:55
  Yoel Roth: Yeah, I mean, we've seen this play out with perhaps less prominent platforms before.
• 11:01
  Yoel Roth: We've seen Tumblr sort of go through a whole series of contortions with the App Store, ultimately leading the platform to ban adult content altogether.
• 11:11
  Yoel Roth: we've seen that, OnlyFans have generally opted not to take an app based approach at all.
• 11:17
  Yoel Roth: We've seen that most actual porn sites are totally unable to offer an app based experience.
• 11:23
  Yoel Roth: And again, we can question the legitimacy of the underlying policy there.
• 11:27
  Yoel Roth: Like should adults be able to view legal content through apps on their phones in a native experience?
• 11:34
  Yoel Roth: My opinion is yes, but given the ecosystem we all live in and the governors of that ecosystem and their policies on porn and adult content, You sort of have to dance with the one that brought you and if you're going to operate an app that is used by hundreds of millions of people who are accessing it primarily through an app store, testing the boundaries of that doesn't seem like the best business strategy.
• 12:01
  Mike Masnick: All right.
• 12:02
  Mike Masnick: Well, it will be a story to follow.
• 12:04
  Mike Masnick: Certainly.
• 12:05
  Mike Masnick: Uh, let us move on to our next story, which is not about, the platform formerly known as Twitter.
• 12:12
  Mike Masnick: Uh, but rather this story sort of broke, more or less like five minutes before we started recording last week.
• 12:19
  Mike Masnick: Uh, and so we mentioned it very, very briefly in last week's, but we wanted to go a little deeper here, which was that, the, the Timu, the sort of suddenly out of nowhere, incredibly popular Chinese based, shopping app, is looking like it is, I guess, being declared a, a flop, very large online platform facing all sorts of additional scrutiny on its moderation practices under the EU's DSA.
• 12:45
  Mike Masnick: and.
• 12:46
  Mike Masnick: It struck me as generally interesting because there's also Shein, which is another, you know, Chinese based shopping app that also, um, this was announced a little bit earlier.
• 12:58
  Mike Masnick: That, in my head, the sort of framing that I had is that we have these two new European regulations, the DSA digital services act and the DMA, the digital markets act.
• 13:08
  Mike Masnick: And I sort of mentally was putting e commerce related stuff into the DMA.
• 13:13
  Mike Masnick: That's, you know, Digital Markets Act.
• 13:14
  Mike Masnick: That's about e commerce.
• 13:16
  Mike Masnick: That's where these kinds of things are going to be regulated.
• 13:18
  Mike Masnick: And the DSA was always about social media.
• 13:21
  Mike Masnick: And yet we're seeing now Timu and Xi'an are being included under the DSA and are going to face regulatory scrutiny under that law.
• 13:31
  Mike Masnick: And so, Yoel, you had some thoughts about kind of where this is heading and what's happening over there?
• 13:37
  Mike Masnick: Yeah.
• 13:41
  Yoel Roth: and.
• 13:42
  Yoel Roth: I had to wonder, are we scrutinizing Timu and Xian for the same reasons that TikTok is drawing an enormous amount of scrutiny by regulators, which is like, these are giant apps used by lots of people around the world that happen to be based in China.
• 13:57
  Yoel Roth: And I think you can ask whether that's legitimate, given some of the opacity about labor practices, which has emerged as one of the big driving concerns here.
• 14:08
  Yoel Roth: But also like.
• 14:10
  Yoel Roth: Lots of European and American companies engage in exploitative labor practices to produce cheap fashion.
• 14:16
  Yoel Roth: And so it's not clear to me that these things are unique.
• 14:19
  Yoel Roth: But then, like, more generally, like, if you set aside the, do we care about these because they're Chinese, you're left to this question of like, Is one law that is built to govern TikTok, and Twitter, and YouTube, and Facebook, and Instagram, and also Teemu, and Shein, and the App Store, and Amazon.
• 14:39
  Yoel Roth: com, like, can one law really do a good job with all of those services?
• 14:45
  Yoel Roth: Because they look extraordinarily different.
• 14:48
  Yoel Roth: Um, I'll say from, from my own experience, having gone from working at one of the, uh, You know, what Kate Connick calls the big speech platforms, the platforms that primarily are focused on what people are saying and how they're expressing themselves to now working on dating apps, which, certainly have trust and safety complications.
• 15:07
  Yoel Roth: Nobody is saying that you have a foundational right to free expression on Tinder.
• 15:12
  Yoel Roth: Like the stakes are just a bit different.
• 15:15
  Yoel Roth: And, and so you have to think like, are these laws that are built for sort of omnibus regulation of the internet?
• 15:22
  Yoel Roth: Going to be able to account for the diversity of all of these different services and that's.
• 15:28
  Yoel Roth: Sort of a tricky proposition.
• 15:30
  Mike Masnick: So, I mean, are there particular aspects of the, of the DSA that you think don't really match with the kinds of things that, say a Timu are doing?
• 15:40
  Yoel Roth: I mean, I think there's some elements that do match up and that I think are worth interrogating.
• 15:46
  Yoel Roth: Right?
• 15:46
  Yoel Roth: So the we've seen in some of the early commentary coming from the commission that what they're really what they're most worried about are things like dark patterns, and they're worried about, um.
• 15:56
  Yoel Roth: Some of the interface design and algorithmic components that perhaps are encouraging people to buy all sorts of crap.
• 16:02
  Yoel Roth: They don't really need, and that may be obfuscating or obscuring, the origins of products that might not be doing enough to protect people from counterfeit goods like.
• 16:13
  Yoel Roth: All of that feels like a legitimate consumer centric, set of concerns.
• 16:19
  Yoel Roth: Let me bracket for a moment that, like, we're using a new term, dark patterns, to describe exactly the kind of behavioral marketing that people have been engaged in for decades.
• 16:30
  Yoel Roth: Like, if you, Walk down the aisles of a supermarket.
• 16:33
  Yoel Roth: The experience you are having is arguably a dark pattern.
• 16:37
  Yoel Roth: You are, your eyes are being drawn to the cereals and the mayonnaise brands that marketers want you to buy.
• 16:43
  Yoel Roth: And by the way, they've done a ton of research about the most effective ways to make you buy them.
• 16:48
  Yoel Roth: And so like, if that happens in an app, all of a sudden we like lose our minds with concern over it.
• 16:53
  Yoel Roth: These aren't like necessarily new things.
• 16:57
  Yoel Roth: So it's, it's worth like.
• 16:58
  Yoel Roth: Backing out of this presentist moment.
• 17:00
  Mike Masnick: Yes.
• 17:01
  Yoel Roth: Those things I think line up.
• 17:03
  Yoel Roth: What I'm less clear on are some of the things like transparency requirements.
• 17:07
  Yoel Roth: Um, like that's one of the flagship parts of the DSA.
• 17:11
  Yoel Roth: And if you look at it from the perspective of platforms that aren't the big speech services like Instagram or TikTok, things start to feel a little bit murkier.
• 17:23
  Mike Masnick: Yeah.
• 17:23
  Mike Masnick: And, and I mean, I, I, I guess I kind of wonder where this ends up because it increasingly, and this has always been my complaint with the DSA and I know, like I get some pushback on, because I'm always complaining about the DSA on this podcast, and, and to be clear, right.
• 17:39
  Mike Masnick: I think that certainly compared to internet regulations elsewhere, I do think that the DSA is a much more thoughtful approach than, I mean, what we're kind of used to seeing in the U S which is just, you know, complete.
• 17:52
  Mike Masnick: Nonsense, completely disconnected from reality.
• 17:55
  Mike Masnick: So there, there is some thinking and there is this intent to, you know, how can we create a relatively flexible regulation that is trying to minimize bad stuff that is absolutely happening online.
• 18:12
  Mike Masnick: My DSA has always been that, Some of what you were talking about, which is like, some of this is just things that, we've been dealing with in other contexts for a really long time.
• 18:23
  Mike Masnick: And, I'm not sure that just because they've gone digital, that they're suddenly as horrible as some people make them out to be, but also that like how you define the internet changes the way you think about these things and we, we went through this sort of 10 year, maybe 15 year period where people sort of started to define the internet as just being about those large speech platforms and that, you know, the, this simplest way of saying that was like, the internet is Facebook.
• 18:49
  Mike Masnick: And for those of us who believe that the internet is a lot more than Facebook and should be, and hopefully will continue to be a lot more than Facebook in the future, I've worried about that.
• 18:59
  Mike Masnick: And, and one particular aspect of that is that when the conception that you have of the internet as being Facebook and that you have to regulate.
• 19:08
  Mike Masnick: The internet as Facebook, you actually turn the internet more into Facebook because you're saying Facebook has to do these things to be safe in the minds of, European regulators.
• 19:22
  Mike Masnick: And then you sort of.
• 19:23
  Mike Masnick: Start to force everybody else into that, those, those patterns.
• 19:27
  Mike Masnick: You need to follow these best practices.
• 19:29
  Mike Masnick: You need to have these transparency efforts.
• 19:31
  Mike Masnick: You need to have these, you know, appeal processes and all of that, that kind of thing.
• 19:35
  Mike Masnick: And of course, Meta will comply with the DSA and then everybody will feel that they have to do the same thing that Meta does because, okay, Meta did X, Y, and Z, and that made them okay under this.
• 19:49
  Mike Masnick: And so do we lead to a world where.
• 19:51
  Mike Masnick: and Sheehan, even though they're totally different kinds of platforms.
• 19:55
  Mike Masnick: And then everybody else as well starts to look more and more like Facebook.
• 20:01
  Mike Masnick: Does that make sense?
• 20:02
  Mike Masnick: Am I, or
• 20:03
  Yoel Roth: Yeah, no, I mean this in a way connects back to the first topic we discussed, which is like, So much of what the policy and regulatory landscape around the internet looks like is informed by our monomaniacal focus on the biggest social media platform.
• 20:22
  Yoel Roth: And obviously Facebook matters because there are billions of people who use it.
• 20:27
  Yoel Roth: But also I think the internet is magical precisely because it's diverse.
• 20:33
  Yoel Roth: And when the internet starts to seem more homogenous, especially when it comes to its governance, I think that's a big Bad thing.
• 20:42
  Yoel Roth: you know, you and I spent some time this week at a convening, that was looking at policy and governance issues for threads.
• 20:49
  Yoel Roth: And on one hand, like, I'm glad that the team over at meta are being so thoughtful about these issues.
• 20:55
  Yoel Roth: I'm glad that they're engaging on them.
• 20:56
  Yoel Roth: They're being really principled and I'm glad that they're building towards integration with activity pub and the protocols that power a lot of the Fediverse.
• 21:05
  Yoel Roth: But also I have to ask, like, Part of what made Twitter great was that it wasn't Facebook, and that there was this other corner of the social web that wasn't controlled by the same company with basically the same policies.
• 21:20
  Yoel Roth: And what we're now seeing is That corner of social media is starting to look more like Facebook too.
• 21:27
  Mike Masnick: Yeah.
• 21:28
  Mike Masnick: Yeah.
• 21:29
  Mike Masnick: it'll be, it's going to be interesting to see how that all plays out, but that is actually a really good lead into our next story, which is somewhat about Facebook, which, uh, is a story from 404media, that was interesting about, uh, I mean, the, the title was that, Facebook's Taylor Swift fan page is taken over by animal abuse, porn, and scams, and, uh,
• 21:58
  Yoel Roth: author sort of starts the story by describing something I do every day, which is going on Facebook and typing Katy Perry into the search bar, which is how I started my morning.
• 22:08
  Yoel Roth: Um, but, you know, on some levels, you read the story.
• 22:13
  Yoel Roth: which, sort of describes the, the kind of very obvious scammy stuff about how you, go on a page that seems like it's about your favorite pop musician.
• 22:23
  Yoel Roth: And then all of a sudden it's like, ta da, hardcore porn.
• 22:26
  Yoel Roth: Um, and on 1 level, you read that and, can say is like, oh, another instance of the Masnick impossibility theorem.
• 22:34
  Yoel Roth: Like, content moderation is really hard.
• 22:37
  Yoel Roth: And that's true, but I think there's like two nuances to this story that I found really interesting.
• 22:43
  Yoel Roth: the first one is that it's poking at this ecosystem of very, very old accounts on Facebook.
• 22:50
  Yoel Roth: Um, you think back to the earliest days of the service and the ways that, you know, we would express some of our interests on our profiles and, and, you know, I would say like, Hi, I'm, I'm Yoel.
• 23:01
  Yoel Roth: I like.
• 23:02
  Yoel Roth: The Rolling Stones and then that would link out to a page for the Rolling Stones and some of what we're seeing in this article is that some of those oldest pages that were like maybe set up automatically as like the hub for people who said they were into the Rolling Stones now have been hacked or taken over or compromised in some way and have been overrun with like bestiality content, um, which is sort of a like, You know, things on the Internet don't ever really go away.
• 23:33
  Yoel Roth: They just change forms and usually they get hacked and turned into spam.
• 23:37
  Yoel Roth: So there's kind of an interesting link rot, an Internet rot dimension to all of that.
• 23:43
  Yoel Roth: But then the other bit of it that was so interesting to me is that This is also a product of just how big and complicated Facebook is.
• 23:50
  Yoel Roth: Um, you know, we, when Facebook rebranded as meta, they were signaling in a lot of ways that they are not just one app.
• 23:57
  Yoel Roth: They're not the blue app anymore.
• 23:59
  Yoel Roth: They're Instagram and they're WhatsApp and they're, you know, they're VR products.
• 24:03
  Yoel Roth: But we've also seen that within Facebook, Facebook isn't just Facebook anymore.
• 24:08
  Yoel Roth: It started as a news feed, and now it's groups and communities and shopping and dating and all of these other surfaces.
• 24:17
  Yoel Roth: And those things become incredibly difficult to govern effectively because you have to build like at the basic mechanical level of trust and safety, you have to build moderation systems that remember that there are all of these different parts of your product.
• 24:31
  Yoel Roth: And by the way, you have to moderate all of them.
• 24:34
  Yoel Roth: Um, and that's just a hard proposition for any company, even one at scale.
• 24:39
  Mike Masnick: Yeah.
• 24:40
  Mike Masnick: Yeah.
• 24:40
  Mike Masnick: And it's, it's incredible how, I mean, I've joked in the past that like not joked, but sort of told the reality, which is that if you have any platform that allows any sort of, user speech or uploads in any way possible, you have a trust and safety issue because people will abuse it.
• 24:55
  Mike Masnick: We, we had discovered this and I don't think I've spoken about this.
• 24:58
  Mike Masnick: We had discovered this maybe a year ago that, someone had figured out we, just on Techdirt.
• 25:04
  Mike Masnick: for commenters, if you set up a profile, you could upload like a user image, and someone, some organization, group of people or whatever, had figured out how to sort of abuse that process to upload.
• 25:19
  Mike Masnick: A ridiculous amount of spam content.
• 25:22
  Mike Masnick: And then they were somehow connecting it to like weird LinkedIn pages.
• 25:27
  Mike Masnick: And so we were suddenly getting these things that were like pulling from, TechDirt hosted images that were appearing on Skype.
• 25:33
  Mike Masnick: GAMI, LinkedIn, it was like this whole ecosystem of stuff that was all happening behind the scenes.
• 25:38
  Mike Masnick: And we wouldn't have noticed it at all, except that somebody found something on LinkedIn and connected it back, detected and alerted us.
• 25:45
  Mike Masnick: We had to go through this whole process to find it, but you see it in like.
• 25:49
  Mike Masnick: in this article, it's, it's a fun read because you know, there are all these descriptions and I'm just going to read a little bit of this and it goes on for a while, but it's like on Facebook, a user can post, or they can create a page or a group, which are two different things.
• 26:01
  Mike Masnick: The pages can post images or they can post posts, or you can post in groups, which can be public or private, a user or a group or a page can all create an events, which have their own posts, images and comments sections.
• 26:13
  Mike Masnick: And it goes on and on and on like that.
• 26:14
  Mike Masnick: And there are these different layers and having to understand and police and follow all of those things and how they can be abused.
• 26:22
  Mike Masnick: And, you know, if they fall into other hands or they're set up by scammers in the first place, and it's just, you know, you begin to realize how overwhelming the challenge of all of this is, especially when you have, I mean, I guess Google shuts down products like crazy, but most companies, once you have features that some people actually do rely on, it's very difficult to shut down those features.
• 26:44
  Mike Masnick: And so, you know, if they're still prone to abuse, they're going to be abused.
• 26:48
  Mike Masnick: And on something like, Facebook at massive scale, yeah.
• 27:00
  Yoel Roth: a lot about this at Google, where it's like, you know that it's promotion season for product managers when you see this proliferation of new features that sort of seem like things that exist, but now they're different and they have a new name.
• 27:13
  Yoel Roth: And by the way, Gchat is now called Meet, and Meet is now called Hello, and Hello is called Talk.
• 27:18
  Yoel Roth: And, you know, like, You know, we all kind of like roll our eyes and laugh at these things, but, one, like, I always find it interesting to think about the organizational dynamics that lead to that.
• 27:29
  Yoel Roth: Like, what are the incentives that lead these giant corporations to have these proliferations of features?
• 27:36
  Yoel Roth: But then also, like, just not through malice, not even through bad intent, like you just can end up with moderation that doesn't work because all of a sudden your product is too complicated for any one human to reasonably understand.
• 27:52
  Yoel Roth: And when you're building and designing these systems, somebody has to understand how all the pieces fit together so that you can make sure that the weird, scammy, bestiality stuff doesn't end up on the Taylor Swift fan pages.
• 28:05
  Mike Masnick: Yeah.
• 28:06
  Mike Masnick: Yeah.
• 28:07
  Mike Masnick: I mean, I think there is the other element to this story, which is that, and this is, there is a, a genre of these kinds of stories, which is, reporter goes on random platform searches, find something bad, and writes about it.
• 28:20
  Mike Masnick: and always part of that story is then like, you know, Yeah.
• 28:23
  Mike Masnick: Then we alerted the company and then that bad stuff disappeared leading to a bunch of people saying, well, why, why doesn't the platform itself just do the same thing that the reporter did?
• 28:33
  Mike Masnick: And it's like, well, you know, I, well, I would love to hear your take on it.
• 28:36
  Mike Masnick: My
• 28:37
  Yoel Roth: I mean, actually, like, by the way, platforms, like, if you're listening, like, y'all should be doing that.
• 28:43
  Yoel Roth: And if you want to dress it up in fancy terms, call it red teaming, like, call it whatever you want.
• 28:48
  Yoel Roth: But like, just if you're, if you're thinking about what are going to be the best ways to avoid PR risk.
• 28:54
  Yoel Roth: Consider doing what the reporters do, which is like, use your own products and search for stuff, and then make sure that there are people who are doing that every single day.
• 29:03
  Yoel Roth: I
• 29:04
  Mike Masnick: So, well, here's my question then you know, from your standpoint, many companies are doing that?
• 29:08
  Mike Masnick: Cause my assumption was basically that a lot of companies actually are, but that the, the issue is so large, right?
• 29:15
  Mike Masnick: I mean, you can do this, you know, for Taylor Swift or Katy Perry, but there are a million other people that you also would have to be searching for as well.
• 29:25
  Yoel Roth: mean, this is, this gets us to, the stories about Google AI search and, um, Putting glue on pizza and Google's response of like, these are very uncommon searches.
• 29:37
  Yoel Roth: And like, these are people who are just trolling us and it's not representative of the product experience.
• 29:42
  Yoel Roth: And, Google got roasted for that response because really your search engine shouldn't be telling people to eat rocks and glue.
• 29:50
  Yoel Roth: Like that seems like a reasonable and trenchant critique.
• 29:54
  Yoel Roth: Um, but the flip side of it is like, yeah, there is a little bit of trolling here.
• 29:58
  Yoel Roth: Like we're not using these products organically.
• 30:01
  Yoel Roth: That said, I think typing Katy Perry into the search bar of Facebook is using the product organically.
• 30:07
  Yoel Roth: And so, I'll say first, like, I don't know that companies are doing enough of this.
• 30:13
  Yoel Roth: I think tech companies can sometimes be a little bit too fancy for their own good.
• 30:17
  Yoel Roth: And people will say, like, we need to build the machine learning model that will detect this at scale that is universal and generalizable, and they'll build a thing and it has, you know, 80 percent recall and 99 percent precision.
• 30:31
  Yoel Roth: And that's great, except it's not performance on the thing that a reporter does in 30 seconds, which is type Katy Perry into the search bar.
• 30:38
  Yoel Roth: So I think you've got to do both.
• 30:40
  Yoel Roth: Um, and, And it's not always about the technologically satisfying solution.
• 30:46
  Yoel Roth: It's about the pragmatic solution.
• 30:48
  Yoel Roth: And I think, some of these big companies in the name of scale will not always do the pragmatic thing.
• 30:55
  Yoel Roth: I'll just footnote this by saying like, that solves a class of problems that is about PR exposure.
• 31:03
  Yoel Roth: primarily in the United States, this is not actually a solution to moderation.
• 31:07
  Yoel Roth: Like, there's no way that that thing scales outside of mitigating the risk of some American reporters writing embarrassing articles.
• 31:18
  Mike Masnick: Yes.
• 31:18
  Mike Masnick: An excellent, an important point.
• 31:20
  Mike Masnick: so now our next story, we're going to move back to Twitter.
• 31:23
  Mike Masnick: I swear.
• 31:24
  Mike Masnick: We did not just pick Twitter stories because you, you
• 31:27
  Yoel Roth: happened to be one of those weeks.
• 31:28
  Mike Masnick: One of those weeks where interesting Twitter stories came up that we thought it would be interesting to hear you comment on as well.
• 31:36
  Mike Masnick: But there was a really interesting study that came out in Nature.
• 31:39
  Mike Masnick: And there was also a Washington Post article about it as well, and some other discussions elsewhere.
• 31:44
  Mike Masnick: And it, was looking at the post January 6th de platforming of misinformation accounts, mostly around sort of, you know, QAnon conspiracy theory related stuff and how effective that was in terms of decreasing the reach of misinformation.
• 32:05
  Mike Masnick: And so as someone who was there and was a part of that, what is your take on this particular study?
• 32:13
  Yoel Roth: it's an interesting study because it looks at a particular moment in time where Twitter changed its policies to ratchet up the severity of enforcement of a long standing policy.
• 32:28
  Yoel Roth: So let me, let me give a little bit of context for folks who maybe weren't following this as closely at the time.
• 32:34
  Yoel Roth: Twitter, sort of well before January 6th had introduced a set of policies that restricted the circulation.
• 32:41
  Yoel Roth: Of what we called coordinated harmful activity, but that was really just a proxy term for behaviors like QAnon.
• 32:49
  Yoel Roth: And the basic intuition here is like, we've had policies about extremist groups and dangerous organizations.
• 32:57
  Yoel Roth: Terrorism is pretty easy to ban, um, as a policy matter.
• 33:00
  Yoel Roth: Like, if you are a member of Al Qaeda, like, Twitter was going to ban you, but something like QAnon was a little bit more nebulous, because it wasn't always something that had that kind of really clear group identity, it was more like this nebulous kind of universe of conspiracy theories that people sometimes subscribe to, sometimes they were just asking questions, sometimes You would see people peripherally share or engage with themes that were QAnon adjacent, but you didn't really know, like, are they actually a dyed in the wool QAnon believer?
• 33:32
  Yoel Roth: Or are they just, you know, asking a question about this, like, child protection issue?
• 33:37
  Yoel Roth: It was messy.
• 33:38
  Yoel Roth: It was deeply, deeply messy.
• 33:40
  Yoel Roth: and so Twitter's approach was to look for a couple of things.
• 33:44
  Yoel Roth: One of them was the sort of networked behavior of it.
• 33:47
  Yoel Roth: So, are there Groups of people who behave in a coordinated fashion to advance these kinds of conspiracies and especially are there swarms of behavior that go after particular targets, right?
• 33:59
  Yoel Roth: So like Chrissy Teigen was targeted a couple of times by this activity.
• 34:03
  Yoel Roth: Large brands like Wayfair and Walmart were targeted by this kind of activity.
• 34:08
  Yoel Roth: Kooky conspiracies about how like you could Order a cabinet on Wayfair that was mispriced by a bug.
• 34:14
  Yoel Roth: And that mispricing was a signal that inside the cabinet, there was a trafficked child.
• 34:19
  Yoel Roth: Um, and so you would see these like moments where it was truly a swarm of users amplifying that conspiracy.
• 34:27
  Yoel Roth: And Twitter decided that it could target that behavior in a way that allowed for intervention.
• 34:33
  Yoel Roth: And so before January the 6th, Twitter's approach was to broadly de amplify and reduce the circulation of that content.
• 34:41
  Yoel Roth: The intuition behind that, the goal, was to Was, you know, not to drive this content underground, not to try to make it so that this whole thing became, topics you could never, ever, ever talk about, but rather to say, we're not going to recommend it, we're not going to amplify it, we're going to make it harder to find, but we're not going to run this risk of, like, aggressive de platforming that has a giant backlash effect that ultimately drives more attention to these kooky conspiracies.
• 35:10
  Yoel Roth: You can question whether that was the right call, and I still do question whether that was the right call, but QAnon was weird and complicated and it was not always obvious what the right intervention here was going to be, and so that's where Twitter was pre January the 6th.
• 35:27
  Yoel Roth: On January the 6th, we all saw very clearly that QAnon stopped behaving like this nebulous universe of conspiracy theories and started behaving more like a plain old extremist group.
• 35:39
  Yoel Roth: And so, Twitter took exactly the same detections it had been using for months already and said, Alright.
• 35:46
  Yoel Roth: We're going to start banning these users, and carried out a set of large scale content moderation actions to ban.
• 35:53
  Yoel Roth: At first, uh, it was about 50, 000 users.
• 35:56
  Yoel Roth: It grew to 70, 000.
• 35:58
  Yoel Roth: And the interesting thing that's not in the nature article is that this network kept coming back again and again and again and again, and in the weeks after January the 6th, Twitter ended up suspending nearly 150, 000 of these accounts because the network just kept reconstituting.
• 36:15
  Yoel Roth: And
• 36:16
  Mike Masnick: as
• 36:16
  Yoel Roth: a long,
• 36:17
  Mike Masnick: the same people.
• 36:19
  Yoel Roth: generally, yes, what we saw was not that there were 150, 000 people who believed in QAnon.
• 36:25
  Yoel Roth: It's that there was a much smaller number of people who had lots of accounts.
• 36:30
  Yoel Roth: So it'd be like one person with like 15 Twitter accounts.
• 36:33
  Yoel Roth: And then also when you would take away those 15 Twitter accounts, they would just.
• 36:37
  Yoel Roth: Sign up new ones and they'd get banned again and they come back again and get banned again.
• 36:42
  Yoel Roth: And so in a way that the number, the 70, 000 or the 150, 000 is misleading because it makes this sound like it's a bigger network than it actually is.
• 36:52
  Yoel Roth: And I'm not saying that to trivialize the problem.
• 36:54
  Yoel Roth: I'm just saying like, understanding the behaviors here is important.
• 36:59
  Yoel Roth: Which kind of brings us to the, the nature study, which is super interesting.
• 37:04
  Yoel Roth: because they find that the large scale de platforming effort reduced the prevalence of certain types of misleading information.
• 37:13
  Yoel Roth: Now I'll note, they're not saying that it reduced the circulation necessarily of the QAnon conspiracies themselves.
• 37:21
  Yoel Roth: Like Twitter believes that that content.
• 37:24
  Yoel Roth: Substantially reduced in volume, and that was what we found.
• 37:27
  Yoel Roth: But the article says, look, we found that other low quality domains started to circulate less.
• 37:34
  Yoel Roth: So if you say this domain, this website is strongly correlated with misinformation.
• 37:39
  Yoel Roth: There was less of that available after Twitter carried out this action.
• 37:43
  Yoel Roth: That's an interesting finding.
• 37:44
  Yoel Roth: They also found, and this was the real kicker.
• 37:47
  Yoel Roth: There were people that Twitter didn't ban.
• 37:50
  Yoel Roth: Who stopped using the platform as much, or at least they stopped posting as much.
• 37:55
  Yoel Roth: Um, and so I said like, there's actually by disrupting these networks and taking away the source of content, there's this like really interesting behavior where actually some people who have historically spread misinformation will stop doing so.
• 38:10
  Yoel Roth: And they speculate a bit about what some of the causes of that are.
• 38:13
  Yoel Roth: Those are interesting findings about this, like, most controversial of things, which is like, does deplatforming actually work?
• 38:21
  Mike Masnick: Yeah.
• 38:22
  Mike Masnick: It's interesting to see.
• 38:23
  Mike Masnick: It's interesting to see there's been some research on this before, but this, this is a pretty, you know, a pretty big study and a pretty big look at it.
• 38:32
  Mike Masnick: And, the thing that I'm sort of Curious about, which I don't think the study gets to is, did the effect really, exist past outside of Twitter, right?
• 38:44
  Mike Masnick: Did, did all of this just move somewhere else?
• 38:47
  Mike Masnick: Right.
• 38:47
  Mike Masnick: And we've seen, and we've had other discussions in the past where, de platforming on one platform works some extent and may reduce that misinformation on that platform.
• 38:57
  Mike Masnick: But does it just reconstitute elsewhere?
• 38:59
  Mike Masnick: I mean, you talked about it reconstituting.
• 39:01
  Mike Masnick: Within Twitter.
• 39:02
  Mike Masnick: And then it became this sort of whack a mole game, but does it just reconstitute elsewhere?
• 39:06
  Mike Masnick: And if it does, is it in a different form?
• 39:09
  Mike Masnick: and and that
• 39:10
  Yoel Roth: know, this is what Rene Diresta has called, like, platform regulation arbitrage.
• 39:15
  Yoel Roth: It's, you know, if you get banned on Twitter, then you move to Telegram or to Rumble or, or whatever.
• 39:21
  Yoel Roth: And by the way, you also then, like, have this new grievance, which is that you got banned on Twitter, which is a rallying cry.
• 39:28
  Yoel Roth: Um, and I think there's a lot of merit to that argument, right?
• 39:31
  Yoel Roth: Like you, we don't, we shouldn't understand these things platform by platform.
• 39:35
  Yoel Roth: We should understand them as ecosystem level dynamics.
• 39:39
  Yoel Roth: It is, in my opinion, still worth thinking about.
• 39:42
  Yoel Roth: Deplatforming on specific platforms as an intervention that matters, right?
• 39:46
  Yoel Roth: Twitter mattered, at least historically, because it was where conversations on the Internet intersected with media and cultural and political elites.
• 39:56
  Yoel Roth: you would see that the conversations on Twitter drove the conversations in the news that day.
• 40:02
  Yoel Roth: And so, what happens on Twitter and the prevalence of harmful content and conspiracies on Twitter matters because it, it played a role in defining public discourse.
• 40:12
  Yoel Roth: And so, fixing Twitter, even if the underlying behavior migrates elsewhere, like, journalists weren't lurking on Telegram the same way that they were obsessively looking at the trending topics page on Twitter, and that matters.
• 40:25
  Mike Masnick: Yeah.
• 40:26
  Mike Masnick: Yeah.
• 40:26
  Mike Masnick: That makes sense, but also works as a really good lead into our next story, uh, which there's a, New York times story about how Israel is secretly targeting us lawmakers with influence campaigns around, Gaza, Palestine, Israel issues.
• 40:43
  Mike Masnick: and, you know, basically it sounds like they're doing what we've heard of in lots of other contexts where they have sort of, you know, secretly.
• 40:52
  Mike Masnick: Organized and paid for, influence efforts, uh, using a variety of different social media platforms and trying to push pro Israel messaging.
• 41:01
  Mike Masnick: my first reaction on seeing this was, you know, of course, like this is What happens, you know, we've had Russian organized efforts.
• 41:10
  Mike Masnick: We've had Iranian organized efforts.
• 41:13
  Mike Masnick: There have been, as has been exposed US organized efforts as well.
• 41:18
  Mike Masnick: but, uh, was there anything that struck you as, different or noteworthy in, in this particular story?
• 41:24
  Mike Masnick: ha
• 41:25
  Yoel Roth: is like the classic example of how, you know, we use big words like disinformation campaign and influence operation to describe what are fundamentally just these amateur hour, like, sort of keystone cops efforts.
• 41:40
  Yoel Roth: Let me, let me read one of the, one of my favorite bits of the Times piece.
• 41:44
  Yoel Roth: It says, quote, in at least two instances, accounts with profile photos of black men posted about being a quote, middle aged Jewish woman.
• 41:53
  Yoel Roth: On 118 posts in which the fake accounts shared pro-Israel articles, the same sentence appeared.
• 42:00
  Yoel Roth: Quote, I gotta reevaluate my opinions due to this new information.
• 42:06
  Yoel Roth: In a way, we, uh, we, we have to remember to put these things in context, and there's two pieces of context.
• 42:12
  Yoel Roth: One of them is like, some of this is incredibly shoddy.
• 42:16
  Yoel Roth: Uh, and that's not to say there aren't more sophisticated.
• 42:20
  Yoel Roth: better done disinformation campaigns out there.
• 42:22
  Yoel Roth: There absolutely are, but some of them just, just are absolutely abject.
• 42:27
  Yoel Roth: and this one was clearly an amateur hour operation.
• 42:30
  Yoel Roth: The second is how effective is any of this stuff, right?
• 42:34
  Yoel Roth: If you, if you see these types of messages, even if you are, uh, you know, a member of Congress exposed to this and you're like, I'm on social media to hear from my constituents, my constituents who have profile photos of black men who claim to be middle aged Jewish women, um, like.
• 42:49
  Yoel Roth: Even if you see that, is that, like, does that change your mind?
• 42:52
  Yoel Roth: Are you going to vote differently as a representative because you saw that?
• 42:56
  Yoel Roth: Or, as an American holding an opinion about the conflict, if you saw some rando posting nonsense generated by ChatGPT on Twitter, Are your opinions different?
• 43:08
  Yoel Roth: And a lot of times we talk about disinformation as if exposure to it drives a difference of viewpoint and one of the trends I've been really glad to see lately is that we're seeing talented, smart researchers in the space say.
• 43:24
  Yoel Roth: We shouldn't take that as an assumption for granted.
• 43:27
  Yoel Roth: It doesn't mean we don't care about disinformation.
• 43:29
  Yoel Roth: It's just that we shouldn't give it power.
• 43:31
  Yoel Roth: It doesn't actually have.
• 43:33
  Mike Masnick: Yeah.
• 43:33
  Mike Masnick: I think that's really important.
• 43:35
  Mike Masnick: there is another study in nature this week, which we had decided we weren't going to discuss in depth in the podcast, but it's relevant here.
• 43:42
  Mike Masnick: So I'm going to bring it up, which sort of gets a little bit at that and just talking about how, the study of how far does mis and disinformation flow and found that Within the context of the study perhaps was not as effective at convincing people it was useful and sort of rallying the troops who already believed in certain stuff, but it wasn't, it's sort of like the, uh, The whole story of like cops and fentanyl where this belief that like any exposure to it anywhere, like, you know, causes them to go into shock or whatever, a lot of people get exposed to some mis and disinformation, how many it actually impacts seems to be according to a lot of research.
• 44:20
  Mike Masnick: Fairly minimal.
• 44:21
  Mike Masnick: The effectiveness of this is, is not a strong, that's not to say it has no impact and certainly on the margins.
• 44:27
  Mike Masnick: I think there are examples that you can point to, and obviously people are coming to believe mis and disinformation somehow, but the idea that, its existence alone is this automatic poison that if you touch it, you will, go into convulsions like, like the police and fentanyl, you know,
• 44:46
  Yoel Roth: Yeah, no, I think that's right.
• 44:48
  Yoel Roth: Like, there's been sort of a, an overheated reaction for the last few years that's been rooted in debunked theories of media effects, right?
• 44:57
  Yoel Roth: Like, if you go back to the 1950s, when we were talking about, you know, TV and radio.
• 45:01
  Yoel Roth: There was this idea that of hypodermic media influence, like ideas are injected into you like a syringe into your arm and researchers found that like that's not true and that's not how the brain works and that's not how media works and it's not how ideas are formed at all.
• 45:18
  Yoel Roth: and we're going through that cycle again with the Internet, but it doesn't change that.
• 45:24
  Yoel Roth: I actually still believe platforms need to be taking action against this type of content, even if you don't buy some of these overheated arguments about media effects, right?
• 45:34
  Yoel Roth: Like the reason that.
• 45:36
  Yoel Roth: Platforms should be removing these types of fake accounts isn't because they're persuasive.
• 45:40
  Yoel Roth: They should be removing them because they make platforms feel crappy to use, right?
• 45:45
  Yoel Roth: Like it's a bad user experience to come across these obviously fake and manipulative accounts.
• 45:51
  Yoel Roth: And if you're a platform that wants to be attractive to users and a credible space for conversation, then You need to be governing this, whether or not you believe it's going to have a deleterious effect on democracy.
• 46:05
  Mike Masnick: Yeah, yeah, absolutely.
• 46:07
  Mike Masnick: All right.
• 46:08
  Mike Masnick: Well, that takes us to our final story, I think this week, which is about Twitch.
• 46:13
  Mike Masnick: And, in the past week they terminated all the members of their safety advisory council, uh, which were a group of, supposedly experts in the field who were supposed to provide some advice being an advisory council about, uh, keeping Twitch.
• 46:30
  Mike Masnick: safe.
• 46:31
  Mike Masnick: And so know that lots of companies have these kinds of, advisory panels and, and groups and, and organizations.
• 46:39
  Mike Masnick: I know Twitter had them for a while and other platforms have.
• 46:43
  Mike Masnick: And so I was kind of curious what your take is on, on Twitch's decision to end that.
• 46:49
  Yoel Roth: Yeah, you know, I think we don't know a lot about what's going on within Twitch at the moment.
• 46:55
  Yoel Roth: We, we know over the last few months they've laid off a lot of their trust and safety staffers, seemingly as part of a broader industry trend of cutting back in these areas.
• 47:04
  Yoel Roth: Um, I think that's broadly not a good thing.
• 47:07
  Yoel Roth: I think it's, it's worse for the companies and worse for their users.
• 47:11
  Yoel Roth: But we, we don't really know the specifics of what led to this.
• 47:15
  Yoel Roth: We can look at what Twitch said, though, which is that in place of their, safety advisory council, they want to move in the direction of having a new advisory council made up of, what they call Twitch ambassadors, um, which I gather to be sort of prominent streamers and users of Twitch.
• 47:33
  Yoel Roth: And there's a certain logic to that, right?
• 47:36
  Yoel Roth: Right.
• 47:36
  Yoel Roth: On one level, I buy the idea that members of a community should be involved in its own governance.
• 47:44
  Yoel Roth: If I had a criticism of, the advisory council we had at Twitter, it's that it didn't have a whole lot of like, it didn't aspire to be representative of the Twitter platform.
• 47:56
  Yoel Roth: And you can ask whether that's ever going to be possible.
• 48:00
  Yoel Roth: Like, can you reasonably represent hundreds of millions of people in this kind of way?
• 48:04
  Yoel Roth: And I, I generally don't know that there are great direct democratic solutions to that problem.
• 48:10
  Yoel Roth: But I, I understand where Twitch are coming from.
• 48:13
  Yoel Roth: They want to make governance decisions in a way that is more inclusive of their community, but you need both, right?
• 48:20
  Yoel Roth: Like you want the perspectives of your community represented and also safety advisory councils have typically been made up of people with actual expertise, like people who have dedicated their life to studying and understanding these complex issues with non obvious trade offs and dynamics.
• 48:40
  Yoel Roth: I have said sometimes, like, opinions about content moderation are like elbows.
• 48:45
  Yoel Roth: Everybody's got them.
• 48:47
  Yoel Roth: and that's true.
• 48:47
  Yoel Roth: Everybody can offer an opinion about governance, but that doesn't mean it's an informed opinion.
• 48:52
  Yoel Roth: And I think platforms need both the expert perspectives and the community perspectives.
• 48:57
  Yoel Roth: And we're seeing Twitch shift pretty strongly in one direction there.
• 49:01
  Mike Masnick: Yeah, I mean, I think, it's one of these things where they're, they're different perspectives, right?
• 49:06
  Mike Masnick: And each of them are valuable in their own way, right?
• 49:08
  Mike Masnick: Because oftentimes the, the user perspective on safety things may pick up on certain specific nuances about how The particular app works or certain affordances that are different than somebody who isn't an, uh, you know, active and regular user wouldn't realize that this is how this, plays out in reality, but on the flip side, where you have experts in other areas or academics who have spent time understanding the deeper nuances of some of the other stuff that we talked about, about like.
• 49:38
  Mike Masnick: You know, do certain kinds of interventions actually work.
• 49:41
  Mike Masnick: I mean, I've had conversations with users of platforms who insist that, you know, certain interventions absolutely must work based on their own experience as a user who have no idea how poorly those interventions actually work in practice.
• 49:55
  Mike Masnick: And so it feels like, It would make sense to have a balance of people who actually do understand the platform deeply, but also understand the power and impact of different interventions deeply, rather than overcorrecting on one side or the other, and it feels like maybe Twitch is switching from one extreme to the other.
• 50:13
  Yoel Roth: Yeah, and again, there's merit in both of those, but I would, I would argue you want to have that balance.
• 50:19
  Yoel Roth: Like, I, uh, a little while after I left Twitter, I wrote piece in Lawfare that was sort of making, I thought, a provocation for platforms to have a public editor.
• 50:31
  Yoel Roth: Where there was somebody whose job it was to like explain governance decisions and be the voice of the community in those governance decisions.
• 50:39
  Yoel Roth: And I still think there's value in that and that there's an element of that that is, if you put it in the most positive light, what Twitch are doing here, but I don't think you can just have one, uh, in the same way that I don't think you can make big governance decisions by, oh, I don't know, fielding a poll on Twitter.
• 51:00
  Mike Masnick: Just randomly chose an example.
• 51:02
  Mike Masnick: Yes.
• 51:02
  Yoel Roth: I don't know why that one came to mind, but, um, the point is like these there's tools here.
• 51:07
  Yoel Roth: There's lots of different approaches you can take to inclusive governance.
• 51:11
  Yoel Roth: It should be a yes and not an either or.
• 51:15
  Mike Masnick: Yeah.
• 51:15
  Mike Masnick: Yeah.
• 51:16
  Mike Masnick: Oh, that makes sense.
• 51:16
  Mike Masnick: That makes sense.
• 51:18
  Mike Masnick: Well, I think that brings us to the end of this particular episode of Ctrl-Alt-Speech, you, well, it was great to have you on the podcast.
• 51:25
  Mike Masnick: You're, uh, you know, knowledge and insight on this is, is, uh, super valuable and I think, uh, people will have really enjoyed it.
• 51:34
  Yoel Roth: My pleasure with, with apologies for not bringing the, the usual British accent to this conversation.
• 51:40
  Yoel Roth: Um, I, uh, it was, it's always fun talking through the news of the week.
• 51:46
  Mike Masnick: Yeah.
• 51:46
  Mike Masnick: Yeah.
• 51:47
  Mike Masnick: And, you know, and, and getting at the nuances and different challenges, but, uh, thanks again and, thanks to everyone for listening as well.
• 51:56
  Yoel Roth: See ya.
• 51:59
  Announcer: Thanks for listening to Ctrl-Alt-Speech.
• 52:02
  Announcer: Subscribe now to get our weekly episodes as soon as they're released.
• 52:06
  Announcer: If your company or organization is interested in sponsoring the podcast, contact us by visiting ctrlaltspeech.Com.
• 52:13
  Announcer: That's C T R L Alt Speech.
• 52:15
  Announcer: com.
• 52:16
  Announcer: This podcast is produced with financial support from the Future of Online Trust and Safety Fund, a fiscally sponsored multi donor fund at Global Impact that supports charitable activities to build a more robust, capable, and inclusive trust and safety ecosystem.