Latest / Ctrl-Alt-Speech / New Blocks On The Kids

Transcript

New Blocks On The Kids · Ctrl-Alt-Speech

• 0:00
  Ben Whitelaw: So this week, Mike, I've been flexing my creative muscles, um, which I do have, you'll be pleased to know.
• 0:07
  Ben Whitelaw: Um, I've been trying to design a logo for a new everything in moderation series about the trust and safety jobs industry.
• 0:14
  Ben Whitelaw: I'll include a link to the show notes, but there's lots of cool stuff that Alice Hunsberger and I have been coming up with and.
• 0:19
  Ben Whitelaw: I went to Canva to do this well-known, design tool.
• 0:24
  Ben Whitelaw: And Canva now has an AI function that allows you to kinda write what you want, describe what you want to create, and it does it for you.
• 0:31
  Ben Whitelaw: And I thought the prompt was a great, great opening for us today in control speech.
• 0:35
  Ben Whitelaw: so I, I posed to you the Canva prompt, which is, describe your idea and I'll bring it to life.
• 0:45
  Mike Masnick: Oh my goodness.
• 0:46
  Mike Masnick: Uh, what?
• 0:47
  Ben Whitelaw: don't be held back.
• 0:48
  Ben Whitelaw: Let your imagination run wild.
• 0:51
  Mike Masnick: Well, as you know, I've done a bit of vibe coding myself, and I'm, I'm working on a project right now, which I'm not ready to talk about, so I'm not, not gonna do that, but, but I like this idea of like human vibe, coding.
• 1:02
  Mike Masnick: If I describe my idea and Ben will bring it to life.
• 1:06
  Mike Masnick: Okay.
• 1:07
  Mike Masnick: this one I didn't prepare ahead of time.
• 1:09
  Mike Masnick: Normally some of these prompts, I, I, so this one is just on the fly.
• 1:13
  Mike Masnick: I'm gonna say, I would like for you to make it so that when, people like Elon Musk talk about content moderation, and trust and safety and free speech, they actually have some clue as to what it is that they're talking about.
• 1:30
  Mike Masnick: Can, can you, can you.
• 1:31
  Mike Masnick: Can you bring that to life, Ben?
• 1:33
  Ben Whitelaw: that's actually one step too far for me and for any AI tool, I think.
• 1:39
  Ben Whitelaw: Um, yeah, I mean, I
• 1:41
  Mike Masnick: what a disappointment.
• 1:42
  Ben Whitelaw: sorry, so soon in the episode as well.
• 1:45
  Ben Whitelaw: I would probably say similar to you that I, I would imagine a world I would, like for.
• 1:51
  Ben Whitelaw: A world in which grifters and charlatans and assholes don't control some of the world's biggest platforms or have millions of followers that they can kind of manipulate, others to their will.
• 2:03
  Ben Whitelaw: I'm not asking a lot, Mike.
• 2:05
  Ben Whitelaw: I'm really not asking a lot.
• 2:07
  Mike Masnick: Well, let's, let's bring it to life.
• 2:18
  Ben Whitelaw: Hello and welcome to Control Alt Speech, your weekly roundup of the major stories about online speech, content moderation, and internet regulation.
• 2:26
  Ben Whitelaw: It's November the sixth, 2025, and this week's episode is brought to you in partnership with Safer by Thorn, a purpose-built CSA and Child sexual exploitation solution.
• 2:36
  Ben Whitelaw: Powered by trusted data and thorn's issue expertise.
• 2:39
  Ben Whitelaw: Safer, helps trust and safety teams proactively detect CSA and child sexual exploitation message.
• 2:45
  Ben Whitelaw: This week we're talking about why you'll never stop kids from chatting to their friends.
• 2:49
  Ben Whitelaw: Twitter's involvement in last year's UK riots and academic slop.
• 2:54
  Ben Whitelaw: My name is Ben Whitelaw.
• 2:55
  Ben Whitelaw: I'm the founder and editor of Everything in Moderation, and I'm with Mike Masnick, who is not only, experienced and knowledgeable, but he has a lot of online followers and therefore it is not very cool.
• 3:09
  Mike Masnick: I am.
• 3:10
  Mike Masnick: I am so uncool.
• 3:12
  Ben Whitelaw: You're so uncool.
• 3:13
  Ben Whitelaw: I, I'm, of course referring to this new New Yorker piece, Mike, that we both read this week, and which would include in the show notes about how the number of followers you have is no longer a sign of your relevance in clout.
• 3:25
  Ben Whitelaw: And as somebody who has quite a lot of blue sky followers, there's is bad news for you.
• 3:31
  Mike Masnick: Yeah, I'm, I'm done.
• 3:32
  Mike Masnick: I mean, this presumes that there was ever any point when I was cool.
• 3:36
  Mike Masnick: Okay.
• 3:38
  Ben Whitelaw: In, in some corners of the internet,
• 3:41
  Mike Masnick: Yeah, I don't know.
• 3:42
  Mike Masnick: I did like this piece.
• 3:43
  Mike Masnick: It was kind of fun just talking about like, it's becoming, it's becoming cool to, you know, use social media in, in a more narrowly focused way.
• 3:51
  Mike Masnick: And I, I actually like that idea.
• 3:53
  Mike Masnick: I actually on the Tech Dirt podcast this week, I had, Corbin behold on as a guest, and we just kind of had this.
• 3:59
  Mike Masnick: discussion about like how social media is changing.
• 4:01
  Mike Masnick: And part of it was that, it's not all about just influencers and everything.
• 4:05
  Mike Masnick: And people are sort of looking for different, kinds of meaning, different kinds of conversations and different, different parts of the internet.
• 4:10
  Mike Masnick: And we all shouldn't have the same experience.
• 4:12
  Mike Masnick: And I think this New Yorker piece was a little bit of that same, thing by, but I, the title is great that it's cool to have no followers now.
• 4:20
  Mike Masnick: So
• 4:21
  Ben Whitelaw: Which is great news for me, I would say.
• 4:23
  Ben Whitelaw: 'cause I, I
• 4:23
  Mike Masnick: you have followers.
• 4:24
  Ben Whitelaw: I have a modest five and a half thousand followers compared to, compared to your, let me just check the latest LIFEST number, 195,800 followers
• 4:36
  Mike Masnick: I know.
• 4:36
  Mike Masnick: I can't get over 200 K though.
• 4:38
  Ben Whitelaw: if you reached a plateau.
• 4:40
  Mike Masnick: I'm, I'm stuck at this.
• 4:41
  Mike Masnick: I've been right around, yeah.
• 4:43
  Mike Masnick: 1, 1 90 to 1 95 for quite some time.
• 4:46
  Ben Whitelaw: this is not something we were gonna talk about, but I, I think I might have the reason why
• 4:50
  Mike Masnick: oh.
• 4:51
  Mike Masnick: Go for
• 4:52
  Ben Whitelaw: When you, when you search Mike in the, search bar of Blue Sky, at least for me, you are not the first, not the second, not e, not even the third Mike, to come up
• 5:01
  Mike Masnick: what,
• 5:02
  Ben Whitelaw: in this search.
• 5:03
  Ben Whitelaw: You are the fourth mic to, to come up, and that is somebody who, as somebody who, you know, I engage with a lot, you know, I have a podcast with maybe, you know, obviously you're on the border of blue sky, ding, ding, ding.
• 5:15
  Mike Masnick: I, I
• 5:16
  Ben Whitelaw: Could you sort that out?
• 5:17
  Mike Masnick: I need to, to put my, thumb on the scale and make sure when people are, are searching, Mike, that I am at the top.
• 5:24
  Ben Whitelaw: Exactly.
• 5:25
  Ben Whitelaw: That's what I'm suggesting.
• 5:26
  Mike Masnick: that feels like a very Elon style move and that that is not my nature.
• 5:32
  Ben Whitelaw: Yeah.
• 5:33
  Ben Whitelaw: It, it isn't.
• 5:34
  Ben Whitelaw: No, but it is, it is appropriate for today's episode, I would say.
• 5:37
  Ben Whitelaw: I'll leave you with that, speak to, speak to the powers that be at Blue Sky.
• 5:41
  Ben Whitelaw: well, talking of kind of other wins for me this week, we actually got a, a, really nice review, Mike,
• 5:48
  Mike Masnick: On Blue Sky.
• 5:49
  Ben Whitelaw: on Blue Sky.
• 5:50
  Ben Whitelaw: bringing together two worlds there, which I want to read out and just get your kind of, reaction to.
• 5:55
  Ben Whitelaw: is quite long.
• 5:56
  Ben Whitelaw: it's from an anonymous user, so I'll, I'll just read it out.
• 6:00
  Ben Whitelaw: it says I source my podcast anonymous, so I need to write my review on Blue Sky.
• 6:05
  Ben Whitelaw: I love control speech.
• 6:06
  Ben Whitelaw: Ben is great.
• 6:07
  Ben Whitelaw: Mike's good too.
• 6:11
  Mike Masnick: I love it.
• 6:14
  Ben Whitelaw: is kind of like, come for Ben, stay for the mic, whom I once publicly addressed as Mick.
• 6:19
  Ben Whitelaw: Apparently that's bad news for you again.
• 6:24
  Mike Masnick: I'm so memorable.
• 6:26
  Ben Whitelaw: it's, it goes
• 6:27
  Mike Masnick: you search for Mick, I would come up earlier.
• 6:31
  Ben Whitelaw: yeah, exactly.
• 6:31
  Ben Whitelaw: Maybe I'm spelling it wrong.
• 6:34
  Ben Whitelaw: Um, anyway, it goes on to say, we hear time and time again about the dangers of social media and the internet, and they're very easy.
• 6:41
  Ben Whitelaw: I know it.
• 6:41
  Ben Whitelaw: When I see it.
• 6:42
  Ben Whitelaw: It's obviously a no brainer solutions that everyone has thought about, that take, you know, whole minutes to come up with.
• 6:48
  Ben Whitelaw: The thing is, there are others who have spent literally years researching and writing about these problems and who can debunk all of those easy solutions while asleep.
• 6:55
  Ben Whitelaw: Mike Masnick and Ben Miot are just two of them, and their discussions or control al speed are informative, thoughtful and nuanced.
• 7:01
  Ben Whitelaw: Always nuanced.
• 7:02
  Ben Whitelaw: Like the show could be called Control Alt Nuance, which I.
• 7:06
  Ben Whitelaw: I think it's a good gag.
• 7:07
  Ben Whitelaw: Um, it goes on to kind of say, you know, subscribe wherever you get your podcasts.
• 7:11
  Ben Whitelaw: So first of all, thank you to this user for the Reviewer tool.
• 7:14
  Ben Whitelaw: Thank you for, suggesting that I contribute more to this podcast than Mike Masnick.
• 7:19
  Ben Whitelaw: And we all know that that's not true.
• 7:22
  Mike Masnick: It is a 50 50 partnership pen.
• 7:25
  Ben Whitelaw: I'm, I'm here for it anyway.
• 7:26
  Ben Whitelaw: Um, and again, great to have reviews.
• 7:30
  Ben Whitelaw: Very happy to take them on Blue Sky if you want to stay anonymous.
• 7:33
  Ben Whitelaw: But also please do go to your podcast platform of choice listeners and leave a rating review so we can be discovered and, reach more, more listeners like yourself.
• 7:42
  Ben Whitelaw: we have a lot to get through today, not least because Mike, we have a great bonus chat with thorn's.
• 7:48
  Ben Whitelaw: Pailes Halai about the positive application of AI to detect child sexual abuse material at scale, and also why safety by design principles matter more than ever.
• 7:58
  Ben Whitelaw: so we will go to that at the end of today's podcast.
• 8:01
  Ben Whitelaw: for now, we are gonna, jet set to Australia, for our first story today where we have a bit of an update on a, a kind of big story that's approaching.
• 8:13
  Ben Whitelaw: like a juggernaut.
• 8:14
  Ben Whitelaw: I would say, Mike, the December the 10th deadline, for the teen social media ban is hurtling towards us.
• 8:21
  Ben Whitelaw: We've talked about it on the podcast before and there's a bit of an update this week, which you found interesting.
• 8:26
  Mike Masnick: Yeah, I mean as we get closer and closer to the social media ban for those under 16, they keep expanding what is included.
• 8:34
  Mike Masnick: And, you know, a couple months ago they added YouTube to the list.
• 8:38
  Mike Masnick: Which I thought was kind of crazy because YouTube for many kids is effectively TV and I couldn't imagine just like an out and out ban on TV for kids.
• 8:48
  Mike Masnick: like you can have limits and things like that, but out now ban.
• 8:51
  Mike Masnick: But now they've added both Reddit and Kick.
• 8:54
  Mike Masnick: To the social media ban as well.
• 8:56
  Mike Masnick: And it's basically, more and more places that kids go are gonna get blocked from anyone under 16 in Australia.
• 9:04
  Mike Masnick: and I find this to be somewhat silly.
• 9:07
  Mike Masnick: ki I can somewhat understand just because there, there have been some discussions about.
• 9:13
  Mike Masnick: The lack of effective trust and safety efforts on that platform, you could say.
• 9:19
  Mike Masnick: Uh, and it is popular among children, and so I sort of understand where that is coming from.
• 9:25
  Mike Masnick: Reddit to me just seems like, again, this kind of overkill situation.
• 9:29
  Mike Masnick: There is lots of really, really useful information.
• 9:32
  Mike Masnick: On Reddit, and the nature of Reddit is that you have all these subreddits and sub-communities, and some of them I imagine are, really useful for many kids for a lot of reasons.
• 9:42
  Mike Masnick: And the idea of a blanket ban for all kids.
• 9:47
  Mike Masnick: From Reddit just seems crazy and just seems like a complete over, you know, there are tools within Reddit, like every subreddit has their own moderation tools and you have things where they can put restrictions on it.
• 10:00
  Mike Masnick: If there are concerns about like, I mean already I believe.
• 10:04
  Mike Masnick: I'm not a big Reddit user.
• 10:05
  Mike Masnick: I shouldn't say, but like, there are forums on Reddit that are not safe for work and that have restrictions for, I think it's for over 18.
• 10:14
  Mike Masnick: I came across that when we, we were.
• 10:16
  Mike Masnick: Looking at, or I don't even remember if we talked about the story about grok generating not safe for work images.
• 10:22
  Mike Masnick: And there was a, discussion on, on Reddit, and I had a show that I was over 18 just to go to that subreddit.
• 10:28
  Mike Masnick: you know, so there are, tools and ways to do it and it should be on a community by community basis rather than doing a blanket ban.
• 10:34
  Mike Masnick: And it just, it strikes me as, just another of these things where for years people have complained about the fact that kids have fewer and fewer places.
• 10:44
  Mike Masnick: third spaces, places that they can go that are not school and are not home, where they can, spend time with each other and hang out and, interact where they're not being watched by parents or teachers.
• 10:58
  Mike Masnick: And it used to be.
• 10:59
  Mike Masnick: The mall or the park or whatever.
• 11:03
  Mike Masnick: But there's been like such a fear of like letting kids be kids that, we sort of don't allow that as much anymore.
• 11:11
  Mike Masnick: And there have been lots of efforts to try and bring that back, but it just, it hasn't really been coming out.
• 11:16
  Mike Masnick: And, and that's why I think so many kids end up going to social media because it is kind of a third space.
• 11:22
  Mike Masnick: And maybe it's not the best.
• 11:23
  Mike Masnick: Maybe it would be better if there were more physical spaces that people could go to.
• 11:27
  Mike Masnick: And so this just strikes me as another, you know, kids are going to these places because they want to communicate and they want to spend time with each other and just completely blocking.
• 11:37
  Mike Masnick: It just seems so silly.
• 11:38
  Mike Masnick: Which leads me to a story that I wrote this week, which I think sort of gets included with this.
• 11:43
  Mike Masnick: you're gonna interrupt here.
• 11:45
  Ben Whitelaw: Well, I guess I wanted to kind of just point out the, the kind of difficulties of preventing under sixteens access to Reddit everywhere, because I was thinking about how Reddit.
• 11:55
  Ben Whitelaw: Is increasingly showing up in Google search results.
• 11:58
  Mike Masnick: Yes.
• 11:58
  Ben Whitelaw: it ranks really well because of the kind of authority of the information on Reddit.
• 12:03
  Ben Whitelaw: So, you don't even have to go kind of halfway down the page on, on a lot of, search engine result pages to see a Reddit link or a link to a subreddit.
• 12:11
  Ben Whitelaw: And I, you know, I wonder how, Google is also going to Manage this process for under 16 users.
• 12:17
  Ben Whitelaw: if, this is to be blanket as, I'm sure the eaf commission would like.
• 12:21
  Mike Masnick: Yeah.
• 12:21
  Mike Masnick: Well, I think it's, it's even crazier than that because like a lot of people now will go to Google and, specifically search Reddit because they know, and, and in fact like Google added, I was trying to find it really quickly.
• 12:32
  Mike Masnick: Like they added a feature that basically searches through Reddit.
• 12:36
  Mike Masnick: If you do the web search.
• 12:38
  Mike Masnick: which, it looks at places where you're likely to get more information, like Reddit, YouTube, Yelp.
• 12:44
  Mike Masnick: whenever I'm in the middle of trying to fix some, home appliances and the combination of Reddit and YouTube are basically like the answers to everything.
• 12:52
  Mike Masnick: so people now like, go and add site.
• 12:55
  Mike Masnick: reddit.com to their Google searches.
• 12:57
  Mike Masnick: And Google actually added this web search thing, which specifically looks on Reddit, and then to, block that entirely from kids.
• 13:05
  Mike Masnick: Just it seems like such overkill.
• 13:08
  Ben Whitelaw: Yeah, there might be like, hundreds of thousands of kids who have been like searching of how to do household chores or, you know, or fix their bike that no longer will be able to do so in Australia because of this band.
• 13:23
  Ben Whitelaw: There might be a kind of plague of rusty bikes,
• 13:26
  Mike Masnick: yeah.
• 13:27
  Mike Masnick: I mean, I, I'm, I'm assuming it's more like, how to build something in Minecraft or like, things like that.
• 13:35
  Mike Masnick: that kids are using, put like.
• 13:36
  Mike Masnick: There's a lot of really useful information on Reddit and honestly, like, I actually think Reddit is kind of a useful tool for, you know, something that I talk about a lot, which is sort of the media literacy thing, right?
• 13:48
  Mike Masnick: Like learning what is good and bad information.
• 13:50
  Mike Masnick: and I find going through Reddit threads to be really useful for that because you have like a whole discussion on whatever topic you're looking at, and oftentimes.
• 14:00
  Mike Masnick: it's very useful.
• 14:01
  Mike Masnick: Like we're working on a project which is not announced yet, so I can't even talk about it yet, but I was looking for recommendations for like a vendor that could help us do something.
• 14:11
  Mike Masnick: And Reddit was incredible'cause there were multiple discussions on this and back and forth and it's like, why this particular vendor is good and why that one is, not so good.
• 14:20
  Mike Masnick: And it got into like, nuances of like why different people are good for different things.
• 14:26
  Mike Masnick: And it's incredible how much you can get into nuance here on control alt nuance, uh, from like a discussion on Reddit.
• 14:35
  Mike Masnick: And it just seems like such a, a weird thing to just say, we're gonna ban it entirely for everyone under 16.
• 14:42
  Mike Masnick: don't understand it.
• 14:43
  Ben Whitelaw: Yeah, I mean this, this is what critics take umbrage with about the law generally.
• 14:47
  Ben Whitelaw: Right.
• 14:47
  Ben Whitelaw: You know, which we had talked about this time last year, which has obviously had a year to, come into play and they keep adding platforms and the justification, I'm sure there is some for it, but the justification feels a bit weak.
• 14:58
  Ben Whitelaw: you weren't gonna talk about the kind of workaround or, or how, how kids can be clever, uh, in doing this.
• 15:04
  Ben Whitelaw: Like, do you wanna talk about the post you wrote on this week?
• 15:07
  Mike Masnick: Yeah.
• 15:07
  Mike Masnick: So I, I think, are a few different things.
• 15:10
  Mike Masnick: So part of it's just like.
• 15:11
  Mike Masnick: people always joke about like, kids will find a way, and kids will find a way about around almost anything.
• 15:16
  Mike Masnick: And so I had just randomly heard a podcast that revealed one example of it and it reminded me of another one.
• 15:23
  Mike Masnick: So I wrote, this piece that first talks about, a story from 2019.
• 15:28
  Mike Masnick: So going way back about how kids in schools were turning Google Docs into like their own private social media network, which I just
• 15:35
  Ben Whitelaw: Nice.
• 15:36
  Mike Masnick: Fascinating.
• 15:37
  Mike Masnick: And because a lot of schools use Google Docs as, you know, you do all your assignments there and, project announcements are there.
• 15:46
  Mike Masnick: And so what the kids were doing was they would take an official document from a teacher, like, here's your assignment.
• 15:52
  Mike Masnick: And they were making a duplicate of it, which is something you can do in Google Docs.
• 15:55
  Mike Masnick: And then using the comment feature.
• 15:57
  Mike Masnick: So if anyone like came and looked over their shoulder, it looked like they were looking at the assignment page or the scoring rubric or whatever it was, and they were just commenting on it and you can comment on it no problem.
• 16:08
  Mike Masnick: But like they were using that to have the communication sort of hide their communication and.
• 16:14
  Mike Masnick: Then if, if it ever got to the point where somebody was looking closely, you can just click and resolve and it just goes away.
• 16:19
  Mike Masnick: And it's just like, oh, these kids are amazing.
• 16:22
  Mike Masnick: Right?
• 16:22
  Mike Masnick: They're like figuring out ways.
• 16:24
  Mike Masnick: And so the story that I heard that was new this week and I heard it on, an NPR podcast where they were interviewing someone who's like social media manager for, different NPR podcast, the TED Radio Hour, and she was saying one of her jobs is to monitor the comments on Spotify and all of a sudden she was seeing like a rash of comments on a podcast from years ago she talked about one from 2022.
• 16:49
  Mike Masnick: But there were a few of these and there were all these comments that were like.
• 16:52
  Mike Masnick: Weirdly outta context.
• 16:54
  Mike Masnick: They had certainly had nothing to do with the actual podcast itself.
• 16:57
  Mike Masnick: And there was clearly some other discussion that had occurred beforehand because a lot of them, they were very, kid speak and a lot of it was like, you're so pretty.
• 17:06
  Mike Masnick: Oh, don't listen to them.
• 17:07
  Mike Masnick: don't believe that you're so pretty.
• 17:09
  Mike Masnick: Like that was the discussion.
• 17:10
  Ben Whitelaw: Right.
• 17:11
  Mike Masnick: So she was investigating and she said that she was talking to some of the other social media managers and they were seeing a similar thing on a bunch of other NPR podcasts.
• 17:19
  Mike Masnick: That old podcasts would suddenly, for a day be flooded with, you know, between 20 and 50 comments.
• 17:26
  Mike Masnick: I think there was one that was like 90 comments and what they were assuming, and it was all sort of kids, it was clearly kids, and they were all clearly not referencing the podcast, but they were talking about something else.
• 17:37
  Mike Masnick: And what she believed was that.
• 17:39
  Mike Masnick: It was probably a group of school kids or a group of friends somewhere who had put together a playlist of podcasts because they could probably access Spotify for podcasts at school.
• 17:51
  Mike Masnick: And NPR podcasts are, you know, that's upstanding.
• 17:55
  Mike Masnick: There's nothing wrong with that.
• 17:56
  Mike Masnick: You're, you know, you're listening to the TED Radio hour, you're getting educated and stuff.
• 18:00
  Mike Masnick: Nobody's gonna be checking the comments from a random.
• 18:03
  Mike Masnick: episode from 2022 on leadership, which was like the one that I saw.
• 18:09
  Mike Masnick: And, and so they believe that they were putting together a playlist that was basically like each day, this is where our conversation is.
• 18:16
  Mike Masnick: No adult is ever gonna find it.
• 18:17
  Mike Masnick: No one is ever going to realize.
• 18:20
  Mike Masnick: And it's just this recognition that Kids wanna communicate, like the reason kids are using these services is because they do wanna communicate and they do wanna share, and they do wanna talk to people and they do wanna experience culture.
• 18:30
  Mike Masnick: And if you block them, you know, it's getting back to that discussion I was having about third spaces.
• 18:34
  Mike Masnick: They're gonna find the third spaces and they're not gonna be as prepared for it as well.
• 18:40
  Mike Masnick: Guarded or, or, you don't have trust and safety watching the, the Spotify comments on TED Radio hour for like, maybe you have an NPR social media manager who's like looking at it, but you're sort of driving them into these other spaces.
• 18:54
  Mike Masnick: They're going to find a way.
• 18:56
  Mike Masnick: And, there's an element of like, that's cool and it's kind of funny and it's, an interesting cultural moment.
• 19:01
  Mike Masnick: But like, wouldn't it be.
• 19:04
  Mike Masnick: Better if we just like took the spaces that we had and, tried to make them better, rather than just saying like, outright ban on kids.
• 19:10
  Ben Whitelaw: Yeah, I mean, it's, it's really interesting.
• 19:12
  Ben Whitelaw: I mean, I, I love, situations like this where.
• 19:15
  Ben Whitelaw: a group of users are being innovative and determined and motivated.
• 19:18
  Ben Whitelaw: Can you even imagine what the teacher would've been thinking?
• 19:21
  Ben Whitelaw: Like, little Jimmys, getting genned up on leadership so he can go into the corporate world, like poor teacher.
• 19:27
  Ben Whitelaw: and, and so this, I love this story.
• 19:29
  Ben Whitelaw: I suppose like, critics might say, people might say, you know, well there are apps designed for kids or for teenagers.
• 19:37
  Ben Whitelaw: we've featured some of them.
• 19:37
  Ben Whitelaw: We've talked about some of them.
• 19:39
  Ben Whitelaw: and they don't often do a good job of, ensuring that people can communicate in the way that they want to.
• 19:45
  Ben Whitelaw: so it, it begs the question like, is it actually achievable?
• 19:48
  Ben Whitelaw: for young people to communicate in ways that aren't underneath NPR podcast.
• 19:53
  Ben Whitelaw: It, you know, it is all well and good that this kind of probably one class in the states has managed to do this, but it doesn't seem to work at scale, does it?
• 20:03
  Mike Masnick: Well, I mean it depends, like this is the nature of community and sort of learning to some extent.
• 20:08
  Mike Masnick: For a while, we had this period of time where it felt like the belief was that there should be one giant community, the one giant chat room that everybody's in.
• 20:15
  Mike Masnick: and more and more people realized like, maybe that's not, not great.
• 20:18
  Mike Masnick: And maybe having smaller, targeted, narrower communities is actually better and beneficial.
• 20:24
  Mike Masnick: And it's why you have so many, chat groups that are, just like a small group of people that is, there are no outsiders in there.
• 20:32
  Mike Masnick: or you have, you know.
• 20:34
  Mike Masnick: Discord groups or, or whatever.
• 20:36
  Mike Masnick: You have more and more of that showing up, and you have more things that are more community driven.
• 20:40
  Mike Masnick: I mean, even Reddit is an example of that, right?
• 20:43
  Mike Masnick: I mean, it's all based on building a whole bunch of different communities, and so I think that.
• 20:48
  Mike Masnick: that's an element of, society reacting to this period of time where we thought everything was like one giant shared chat room and then this realization like maybe, you know, maybe that's good for certain purposes, but we should also have more private, more condensed spaces where communities can grow.
• 21:05
  Mike Masnick: And I think that's just a natural thing that happens.
• 21:08
  Mike Masnick: People want.
• 21:10
  Mike Masnick: Community.
• 21:10
  Mike Masnick: You want to have culture, you want to share it with other people.
• 21:14
  Mike Masnick: and so that is going to happen.
• 21:15
  Mike Masnick: And this, focus on banning, I just feel is like, is not a good way to do it.
• 21:20
  Mike Masnick: But like I think once you get past the idea of just banning, then you can have a much better conversation about how do we build good, safe places for different communities, and not just for kids, but certainly for kids, but also for for other people too.
• 21:35
  Mike Masnick: Right?
• 21:35
  Mike Masnick: I mean, you keep hearing all these stories of like the loneliness, epidemic, what was the, the book Bowling Alone, right?
• 21:41
  Mike Masnick: Like, there are all these things about loneliness and, and people not communicating with each other at a time when we have tools for all sorts of community and, getting together and all this stuff.
• 21:50
  Mike Masnick: and yet, I think we've sort of overreacted to the like, well, there are some bad things that happen and therefore we have to like, stomp out the badness.
• 21:58
  Mike Masnick: rather than focusing on like, how do we make the good parts better?
• 22:00
  Ben Whitelaw: Yeah.
• 22:01
  Ben Whitelaw: No, it's interesting.
• 22:02
  Ben Whitelaw: I think.
• 22:03
  Ben Whitelaw: these kinds of stories bring to light the need for certainly kind of children to have these spaces and, and how often they can be kind of left out of the conversation about what that looks like.
• 22:13
  Ben Whitelaw: which is probably not what we can get into today.
• 22:15
  Ben Whitelaw: But, it is definitely, important.
• 22:17
  Ben Whitelaw: I'm gonna move us on now to a platform that, the eSafety Commission has listed in one of its nine platforms that are, are not allowed for, under sixteens as part of the ban in a month's time, X slash Twitter.
• 22:29
  Ben Whitelaw: how I always refer to it.
• 22:30
  Ben Whitelaw: I will never.
• 22:31
  Ben Whitelaw: Refer to it purely as X.
• 22:33
  Ben Whitelaw: Um, this is, I think, an interesting story.
• 22:35
  Ben Whitelaw: I don't think many folks would've heard about this, Mike.
• 22:38
  Ben Whitelaw: Some of our listeners, are based in the uk, but you have to be pretty, pretty in the weeds of UK politics to, to be doing what I did today, which is listened to and watch three hours of testimony from x slash Twitter's global head.
• 22:52
  Ben Whitelaw: Global Affairs.
• 22:54
  Ben Whitelaw: woman called Deanna Ramina Kanko, who I'd never heard of before.
• 22:59
  Ben Whitelaw: today's, testimony, at the moment there's a, a big inquiry happening in the UK called the Southport Inquiry.
• 23:05
  Ben Whitelaw: In response to a story we talked about on the podcast last year, the UK riots that happened in Southport after a.
• 23:14
  Ben Whitelaw: Young man, a 17-year-old called Axel Rues Cabana, stabbed and killed three young children at a Taylor Swift, dance class in Southport near Liverpool in July last year.
• 23:27
  Ben Whitelaw: it led to a series of riots, after.
• 23:30
  Ben Whitelaw: People online, kind of misidentified, Ruda Kabana, and believed he was somebody else.
• 23:35
  Ben Whitelaw: And that misinformation spiral caused days and days and days of violence, police, aggression and, really, became a big political story.
• 23:45
  Ben Whitelaw: Listeners from, back last year will remember this inquiry has kind of gone into the detail about why that happened.
• 23:51
  Ben Whitelaw: what was the causes of, those riots.
• 23:53
  Ben Whitelaw: And as part of, they called, Kako for testimony.
• 23:56
  Ben Whitelaw: And that happened earlier this week for me, having watched it all today, the appearance is kind of like a really good, clear example of, of what free speech and online safety means to x and Elon Musk, and we've talked about it obviously at length, and we, talk about Musk's comments, but she is.
• 24:13
  Ben Whitelaw: Probably one of the most senior, staff members responsible for policy in the company.
• 24:18
  Ben Whitelaw: And so I wanted to kind of unpack a little bit about what she said and, get your thoughts.
• 24:22
  Ben Whitelaw: It's worth saying this is a long testimony.
• 24:24
  Ben Whitelaw: so if you get a chance, go and listen.
• 24:26
  Ben Whitelaw: I'm not able to cover all of it.
• 24:28
  Ben Whitelaw: And also to say that this event obviously happened last year before the online Safety Act came to play and the child's safety duties came into play.
• 24:35
  Ben Whitelaw: So, Twitter didn't actually have to Do anything in terms of preventing, 17 year olds like, Ruda Kabana from doing anything more than enter a birthday.
• 24:46
  Ben Whitelaw: and that's, that was a big topic of conversation.
• 24:47
  Ben Whitelaw: So a couple of things that stood out for me.
• 24:49
  Ben Whitelaw: first of all, it's the fact that the team at Twitter, we, we know there's been lots of trust and safety cuts.
• 24:54
  Ben Whitelaw: do you wanna guess, Mike?
• 24:55
  Ben Whitelaw: How many people there are in the public policy team at Twitter right now for its 600 million global users?
• 25:02
  Mike Masnick: I, I'm afraid to guess, and I would, I would put the number probably under five, but.
• 25:07
  Ben Whitelaw: I, I was a bit surprised as well.
• 25:10
  Ben Whitelaw: There's 14, 15 people.
• 25:12
  Ben Whitelaw: I was surprised that it wasn't, yeah, three people and their dog.
• 25:16
  Ben Whitelaw: Um, but then, also there's probably 15 people working for mentoring in public policy in London alone, or in Washington alone.
• 25:25
  Ben Whitelaw: So it gives you a sense of, you know, how those cuts have affected parts of the, the company more than others.
• 25:31
  Ben Whitelaw: and so she, she kinda makes that clear in the start.
• 25:33
  Ben Whitelaw: In some of her comments, she outlines, X slash Twitter's mission.
• 25:37
  Ben Whitelaw: When it comes to speech as well, she talks about the importance of truth seeking and the kind of, uncomfortableness of speech sometimes.
• 25:44
  Ben Whitelaw: And, she says that, free speech is the only way that humanity moves forwards, which, is, uh, straight, straight out of gonna be Elon Musk, podcast episode.
• 25:54
  Ben Whitelaw: I think.
• 25:55
  Ben Whitelaw: So, so there's, there's a lot of I guess, posturing about, that.
• 25:58
  Ben Whitelaw: she's asked about age verification.
• 26:00
  Ben Whitelaw: The, the kind of interesting point about Rudy Kano is that he searched for a video of, a bishop who was stabbed in Australia last year.
• 26:09
  Ben Whitelaw: Again, this is a story we talked about.
• 26:11
  Ben Whitelaw: So it brings together a few different threads that we've already discussed.
• 26:15
  Ben Whitelaw: he searched for the video on Twitter.
• 26:17
  Ben Whitelaw: it was a, violent stabbing, in which, Bishop Murray, Murray Emmanuel was attacked.
• 26:22
  Ben Whitelaw: he wasn't killed.
• 26:24
  Ben Whitelaw: But the video remained up for reasons that we'll kind of go onto.
• 26:28
  Ben Whitelaw: And Ruda Cabana searched for it six minutes before ordering a taxi to go to the event where, he stabbed these young children.
• 26:36
  Ben Whitelaw: So the inquiry today was talking about whether Twitter felt responsible or what it could have done to avoid that happening.
• 26:43
  Ben Whitelaw: and you can imagine that she was kind of distancing herself from that, making it clear that, there's no necessarily causal link just'cause it happened.
• 26:51
  Ben Whitelaw: doesn't mean that Twitter slash X is responsible.
• 26:54
  Ben Whitelaw: she also mentioned that there was only, about 198,000 Twitter users, x users under 18 on the platform.
• 27:01
  Ben Whitelaw: which again is, a small number in 600 million is also not very.
• 27:06
  Ben Whitelaw: Robust because users can select any date of birth that they want.
• 27:10
  Ben Whitelaw: but the kind of points she made around vage verification and, and the downsides of it, the privacy concerns that, can emerge if you get everyone to upload their IDs, is, was a kind of sensible part of, I thought the deposition and, and what she said less so was what she said about the Sydney attack, in my opinion.
• 27:26
  Ben Whitelaw: So you remember that Twitter slash x resisted the takedown?
• 27:30
  Ben Whitelaw: of the content, globally.
• 27:32
  Ben Whitelaw: This, so the eSafety commission, Australia's regulator, took Exeter to court, about taking this content down globally.
• 27:40
  Ben Whitelaw: Twitter pushed back, in many people's eyes for good reason.
• 27:44
  Ben Whitelaw: the questions were about, you know, do you think this piece of content violates.
• 27:49
  Ben Whitelaw: Your policy on, graphic content and gory content and, and there was some lines read out from that policy.
• 27:55
  Ben Whitelaw: If you've seen the video, you'll know that it, probably does, in many people's reading of the policy.
• 28:00
  Ben Whitelaw: But she made great pains to say that actually, you know, it didn't do so.
• 28:05
  Ben Whitelaw: the knife wasn't visible, it wasn't glorifying.
• 28:07
  Ben Whitelaw: There was kind of newsworthy protections.
• 28:10
  Ben Whitelaw: and it goes to show the kind of nuances and the difficulties that come in making calls about whether a piece of content fits a policy.
• 28:17
  Ben Whitelaw: It's worth noting that Meta and Google and TikTok and others did take, copies of the video down for reasons obviously, that they felt, cause of their policies maybe being slightly different to Twitter's.
• 28:27
  Ben Whitelaw: Anyway, the point is, some sensible things were said about age verification.
• 28:31
  Ben Whitelaw: I would say some kind of, I would say, swerving of the responsibility was, made around maybe why, the Bishop Murray attack video was not taken down.
• 28:40
  Ben Whitelaw: and it felt like a bit of a doubling down really on that decision because so much was made at the time.
• 28:46
  Ben Whitelaw: But again, fascinating insight into, several stories, Mike, that we've talked about on the podcast over the last year.
• 28:51
  Mike Masnick: Yeah.
• 28:52
  Mike Masnick: And, and there are a few interesting things to talk about here.
• 28:55
  Mike Masnick: so one, you mentioned you watched the entire video and, suggested other people could do that.
• 29:01
  Mike Masnick: I was unable to watch it.
• 29:02
  Mike Masnick: and as of right now, at this moment, I think no one is able to watch it because you sent me the link, before we were recording today, and I went and checked it out and that video is gone.
• 29:13
  Mike Masnick: It is set to private on the account of the Southport inquiry.
• 29:17
  Mike Masnick: We have no idea why.
• 29:18
  Mike Masnick: could speculate, but the video that you got to watch, you got to watch something.
• 29:22
  Mike Masnick: That that is secret and no one else can see it.
• 29:24
  Mike Masnick: We suspect maybe it'll come back in a redacted State.
• 29:27
  Mike Masnick: we're assuming that maybe there was something included in that testimony that, shouldn't have been or whatever.
• 29:33
  Mike Masnick: so I, could not see it.
• 29:34
  Mike Masnick: I heard your report on it.
• 29:36
  Mike Masnick: and there is an article in the Independent, which seems to cover most of it, that I did think was very interesting.
• 29:42
  Mike Masnick: But I, think you're right that this is, interesting in that it actually.
• 29:46
  Mike Masnick: Does display the, the real complexities here and the bishop attack in particular in Australia was a challenging situation and I understand why.
• 29:56
  Mike Masnick: Many platforms took it down and they say it's a violent attack.
• 29:58
  Mike Masnick: And you have, you know, a lot of platforms, especially since the shooting in Christchurch years back have decided that any of these kinds of attacks they're going to take down.
• 30:08
  Mike Masnick: And she made the case that she views that content differently and in fact.
• 30:15
  Mike Masnick: that the bishop has said that wants the video, to be out there and that he forgave the person who stabbed him and even apparently while he was being stabbed, like.
• 30:26
  Mike Masnick: Said that he forgave him.
• 30:27
  Mike Masnick: And so she was saying that she sort of viewed it as a kind of miracle and inspiring in some way.
• 30:33
  Mike Masnick: and what that gets to is how much context really matters.
• 30:37
  Mike Masnick: And this is something that I think gets lost in so many of the content moderation, debates, where for some people it's an inspiration to an attack.
• 30:45
  Mike Masnick: And with, Ru Kabana, it appears that that was the way that he viewed it.
• 30:49
  Mike Masnick: And for somebody else it may be viewed as inspirational in some ways.
• 30:52
  Mike Masnick: And we've had this discussion going back, a decade and a half where we talked about the demands to take down terrorist content on YouTube, where.
• 31:04
  Mike Masnick: The exact same content that was being used and described as terrorist content was also being used by human rights groups to document war crimes and atrocities.
• 31:14
  Mike Masnick: And the context matters, but it can be the exact same video that is viewed in different ways.
• 31:19
  Mike Masnick: And then there's a question of how do you deal with that from a trust and safety standpoint.
• 31:24
  Mike Masnick: There is no easy answer.
• 31:25
  Mike Masnick: And so as much as I criticize X and I think a lot of what they say is self-serving nonsense and not really connected to free speech, and they wrap this sort of cloak of free speech around it, which I think is obnoxious and often wrong, I, I actually do feel.
• 31:41
  Mike Masnick: She's right about some of this, that this is complex and the idea, and it's easy for politicians and certainly the media to come in afterwards and say like, well, clearly this guy, he watched this video and then he went and he killed kids.
• 31:51
  Mike Masnick: The video is the problem.
• 31:52
  Mike Masnick: Why didn't you take on the video?
• 31:53
  Mike Masnick: It's entirely your fault, And, you know, I, I don't buy that, right?
• 31:57
  Mike Masnick: You know, like this person was obviously very disturbed, wanted a reason to go and do some horrific act, he was going to find a reason.
• 32:05
  Mike Masnick: The fact that this video was or was not available on this one platform, I don't think was going to change the situation.
• 32:14
  Mike Masnick: And I think it's a little bit.
• 32:15
  Mike Masnick: a little bit ridiculous to say like, oh, it's somehow this platform's fault because they didn't take down this one video from Australia.
• 32:22
  Ben Whitelaw: Yeah, I mean, the only, the only point I made there, which I don't think was made very strongly in the testimony by the kind of government, legal representative was the fact that he searched for the video.
• 32:32
  Mike Masnick: Yeah.
• 32:32
  Ben Whitelaw: I think I feel like there's something I.
• 32:34
  Ben Whitelaw: More causal about it.
• 32:35
  Ben Whitelaw: if you've searched for the video, it's not like he just watched it in his feed and then went out and did it.
• 32:41
  Mike Masnick: I mean, to me that almost goes the other way, right?
• 32:44
  Mike Masnick: Where it's like, he was trying to psych himself up to do something so yes, he searched for this video, but like.
• 32:50
  Mike Masnick: If he didn't find it do you think that would've stopped the horrific acts that he did, you know, would he have searched it for it somewhere else?
• 32:57
  Mike Masnick: Would he have searched for a different video if he was just sort of trying to psych himself up?
• 33:01
  Mike Masnick: I mean, I think the argument, if he had just come across it and then that made him go do something, like, that feels a little different, like if that inspired him to do it.
• 33:10
  Mike Masnick: But the fact that he searched for it meant he knew about it.
• 33:13
  Mike Masnick: He was thinking about it already and he was already just sort of.
• 33:16
  Mike Masnick: in that mindset.
• 33:17
  Mike Masnick: So I'm not sure that that actually makes the argument that, you're saying it makes.
• 33:23
  Ben Whitelaw: Yeah.
• 33:23
  Ben Whitelaw: I mean, I think, I mean, it wasn't available anywhere else.
• 33:26
  Ben Whitelaw: Is the point.
• 33:27
  Ben Whitelaw: So we don't, yeah, we,
• 33:28
  Mike Masnick: really, I mean, I don't believe that, like, maybe it may have not been available on any major platform, but I'm sure there were, there were, other places that you could go to find it.
• 33:37
  Mike Masnick: This stuff doesn't disappear.
• 33:39
  Mike Masnick: Right.
• 33:39
  Mike Masnick: you can still find that stuff and, maybe it's a little bit harder and maybe that.
• 33:44
  Mike Masnick: Sort of friction limits the reach of it.
• 33:46
  Mike Masnick: Sure.
• 33:47
  Mike Masnick: I'll buy that and maybe that's a good, but you know, if you have somebody who is determined, and in this case it feels like he was probably determined he was gonna find that video.
• 33:56
  Ben Whitelaw: Yeah.
• 33:57
  Ben Whitelaw: I mean, I, I, I definitely think the friction comes into it and I dunno what the perfect amount of friction is, but a point that kind of, I guess.
• 34:03
  Ben Whitelaw: Backs up.
• 34:03
  Ben Whitelaw: What you're saying is actually something, again that was mentioned very briefly, the conversation with, the ex staff member was, one of the other things that they believe led to the attack or that, that Rudy Kabana, accessed in advance of, committing this atrocity was an academic paper that published the full.
• 34:24
  Ben Whitelaw: extent of the jihadist, kind of creed or, or, or like manual.
• 34:29
  Ben Whitelaw: And I don't imagine that academic or wherever that paper is published, being kind of invited to talk at the testimony about why, why was that,
• 34:38
  Mike Masnick: Yep.
• 34:39
  Ben Whitelaw: why was that handbook including that academic paper?
• 34:41
  Ben Whitelaw: And so there is this, you know.
• 34:43
  Ben Whitelaw: I appreciate, and I acknowledge the, the kind of slight change, the slight difference in approach there where you, you know, we go firmly in on platforms where we state that they have a greater responsibility maybe than others.
• 34:56
  Ben Whitelaw: I still think that she, she was a little bit, un unhelpful and didn't necessarily engage with the idea that this was a violent act in the majority, in the eyes of the majority of people.
• 35:05
  Mike Masnick: yeah, I mean, the fact is like X itself and Elon Musk and the team that works for are disingenuous, so that is part of it.
• 35:11
  Mike Masnick: And I, I would actually bring that into, the next story that we have here, which is that, sky News put out this amazing report where they were sort of curious about.
• 35:19
  Mike Masnick: what sorts of things the algorithm on X feeds you.
• 35:22
  Mike Masnick: And so they set up a bunch of accounts some of which they set up to follow left wing users, some of which they've set up to follow right wing, some of which they set up to follow, you know, non-political users.
• 35:31
  Mike Masnick: And then just tracked for a long time with a lot of data.
• 35:35
  Mike Masnick: And, it's fairly incredible and it's a really nicely done article with really great artwork and, infographic kind of stuff.
• 35:41
  Mike Masnick: But just a really quick summary is that when they did this, if you had a left wing user that only followed left wing users, the algorithm fed them an equal amount of left wing and right wing content, even though they only followed left wing users.
• 35:54
  Mike Masnick: Okay.
• 35:55
  Mike Masnick: So you're like, okay, those showing 50 50, that's cool.
• 35:57
  Mike Masnick: But then when they did the ones who were right wing and only followed right wing users, then they only saw 14% left wing content.
• 36:05
  Mike Masnick: So it was basically.
• 36:06
  Mike Masnick: Almost all right wing content.
• 36:08
  Mike Masnick: And then they had the neutral users who, followed neither, left or right wing political partisan users, and they saw it was like twice as much right wing content.
• 36:19
  Mike Masnick: So like 67% right wing content and only 33% left wing content.
• 36:24
  Mike Masnick: And.
• 36:24
  Mike Masnick: and they said that all of the barely any of the political content shown was nonpartisan at all.
• 36:29
  Mike Masnick: So basically it's really pushing a partisan message.
• 36:33
  Mike Masnick: And right now they're heavily in, Elon in particular is heavily involved in UK politics and trying to push certain messaging.
• 36:40
  Mike Masnick: So, it's pretty incredible and they're pretty disingenuous.
• 36:42
  Mike Masnick: And the whole idea that this is all supporting free speech is kind of nuts.
• 36:46
  Mike Masnick: And you also sent me.
• 36:48
  Mike Masnick: Elon Musk went on the All In Podcast, and, and so I, against my better instincts, watched some of that and watched the sections where he was talking about how he's brought free speech back and how any kind of algorithmic bias is a huge problem you know, and the, idiots on that podcast were cheering him on about how he saved the world from woke and all this stuff.
• 37:09
  Mike Masnick: Without any inkling or any recognition that they have gone in the extreme of the direction, and they're free to do so.
• 37:16
  Mike Masnick: As I've always said, like the editorial discretion, they're free to do so, but the claim that they have somehow fixed things and, gone neutral is just, utter, utter nonsense.
• 37:25
  Mike Masnick: And so I think you have to keep that context in mind when you look at some engagement in what's happening in the uk And this, particular inquiry.
• 37:33
  Ben Whitelaw: Yeah, I think, I think you're right.
• 37:35
  Ben Whitelaw: I think there's, um.
• 37:36
  Ben Whitelaw: there's a nuance to it as always.
• 37:38
  Ben Whitelaw: Uh, what, what would, what would our instrument for nuance be, Mike?
• 37:41
  Mike Masnick: Oh God, the, the, the accordion of nuance.
• 37:45
  Ben Whitelaw: yeah.
• 37:46
  Ben Whitelaw: Probably make quite a kind of sad, sad soft sound.
• 37:49
  Ben Whitelaw: Um, yeah.
• 37:50
  Ben Whitelaw: To go along with a trade off tuba.
• 37:52
  Ben Whitelaw: Um, yeah, I think there's, definitely nuance to this.
• 37:54
  Ben Whitelaw: I, I, I felt that some.
• 37:56
  Ben Whitelaw: Parts of the testimony were, really interesting and, and I again, think it's a, a great topic.
• 38:00
  Ben Whitelaw: We'll probably return to this in the future.
• 38:02
  Ben Whitelaw: as the inquiry wraps up and as we, find out more about what Twitter slash X do now that they're being supervised by the Online Safety Act, we'll move on now, Mike, from that, talk a bit about a couple of other stories in brief terms, as briefest as we can be.
• 38:17
  Ben Whitelaw: let's start with, a story that you picked up, about archive, and about the kind of ai slop that's not only filling our workplaces now, but also, academic journals of note.
• 38:29
  Mike Masnick: Yeah, so Archive, it's RXIV, which is impossible to, but it's pronounced archive.
• 38:36
  Mike Masnick: It's put together by my alma mater, Cornell University, as a place for Preprint Journal, articles to be posted and.
• 38:44
  Mike Masnick: Preprint journal articles are actually really important to scientific research because most of the things, once they've gone through peer review, go behind paywalls and they're very expensive unless you're at an academic institution or even if you're at an academic institution in some cases.
• 38:58
  Mike Masnick: So various preprint servers like archive have been really, really important.
• 39:03
  Mike Masnick: and they have.
• 39:05
  Mike Masnick: they claim, not changed their rules, but started enforcing the rules that they had not been enforcing before because they were getting overwhelmed with AI slop.
• 39:14
  Mike Masnick: and so in particular they limited a specific type of article, a review.
• 39:20
  Mike Masnick: Paper, in the computer science field, which they had said was never the kind of paper that they, they had rules against that originally, and they said, but there were like so few of them that had been submitted that they sort of let it through, but now it's just being flooded and clearly with just absolute nonsense that.
• 39:39
  Mike Masnick: Purely chat GT generated or whatever, and it was becoming too much for their moderation team to deal with.
• 39:44
  Mike Masnick: So they have now said, unless you can show that this paper is being presented at an academic conference or is, being reviewed by an actual journal, you can't put it up there.
• 39:55
  Mike Masnick: So they put, you know, some additional rules.
• 39:57
  Mike Masnick: They said, we're just enforcing the rules that we had before.
• 40:00
  Mike Masnick: But the thing that struck me about it is we're talking about, you know, the rise of ai.
• 40:04
  Mike Masnick: And that's changing and challenging content moderation but everybody always thinks about like social media.
• 40:09
  Mike Masnick: And here we're having it in, an academic journal hosting service, which just shows once again, like how trust and safety and content moderation.
• 40:19
  Mike Masnick: Is everywhere and needs to be.
• 40:21
  Mike Masnick: And also kind of like, I will go back very briefly to the last story in that all in podcast, Elon Musk totally mocks the idea of trust and safety and like the idea that anyone should ever have trust in their title is the dumbest thing ever.
• 40:34
  Mike Masnick: And it's all just censorship and like, no, it's not and this is a case where it's like you have rules and you need somebody to enforce the rules.
• 40:44
  Mike Masnick: at some point, you know, you might let some stuff go through, but archive is not there to be a platform for just AI generated slop, right?
• 40:51
  Mike Masnick: They want to be a place where you can find good, useful academic research that are preprints before they've done peer review and they got overwhelmed and it made a mess and it made it hard to do things.
• 41:00
  Mike Masnick: So they start enforcing the rules and that builds trust.
• 41:03
  Mike Masnick: And so yes, you need trust and safety.
• 41:05
  Mike Masnick: People like that's part of the process.
• 41:07
  Mike Masnick: And yes, it's okay for them to have trust in their title because that's what they're building and.
• 41:11
  Mike Masnick: So this was like, you know, it's a smaller example, but I always love the non-major platform stories because I think they're important to sort of get people to recognize like, these things actually do matter and they matter, not just for the biggest platforms.
• 41:23
  Ben Whitelaw: Yeah, indeed.
• 41:24
  Ben Whitelaw: yeah.
• 41:24
  Ben Whitelaw: And so good news for your, pre-prints about labor relations, Mike, that you will no doubt, I'm not gonna go into that.
• 41:32
  Ben Whitelaw: You have to listen to last week's podcast to know what that reference is about.
• 41:36
  Ben Whitelaw: Um, we kind of round up on, uh, a duo of stories, uh, Mike, that are about France and about how kind of French authorities are, are cracking down on, a couple of different platforms.
• 41:47
  Mike Masnick: everything.
• 41:48
  Ben Whitelaw: Yeah.
• 41:49
  Ben Whitelaw: And, and what I think is a kind of sign about how the country, is thinking about its relationship with big tech.
• 41:55
  Ben Whitelaw: There've been a couple of stories recently.
• 41:57
  Ben Whitelaw: Politico wrote one, about how it's kind of differing, from its bigger European neighbors, including Germany.
• 42:05
  Ben Whitelaw: About how it, relates to these big tech platforms.
• 42:08
  Ben Whitelaw: You know, Germany's thinking more pragmatically about it, the kind of ongoing diplomatic tensions that we have talked about on the podcast.
• 42:16
  Ben Whitelaw: Whereas France has been quite gung-ho in terms of kind of pushing back against, some of how the platforms work and, what they do.
• 42:22
  Ben Whitelaw: And one of the stories that I found you, you got another, but one of the stories I, I found was about an investigation that's being opened into TikTok.
• 42:28
  Ben Whitelaw: following a government committee report that suggested users were at risk of suicide as a result of its algorithm.
• 42:36
  Ben Whitelaw: So, there is now this kind of broader investigation that's being opened about tiktoks algorithm and compliance with national laws, particularly around suicide.
• 42:45
  Ben Whitelaw: probably more fascinating and, and certainly more public.
• 42:48
  Ben Whitelaw: was the story you, you saw about Sheen, uh, the big Chinese platform as well?
• 42:53
  Mike Masnick: Yeah.
• 42:53
  Mike Masnick: And, and she, and you know, it's like the fashion retailer.
• 42:55
  Mike Masnick: Very, very cheap, fast fashion copy stuff.
• 42:58
  Mike Masnick: and so they opened a store in Paris, which I think like a, an actual physical store, which I think got a lot of attention.
• 43:05
  Mike Masnick: And then at the very same time, you know, the France authorities got really mad because they claimed that there was people found on Sheen's Marketplace where, other people can sell stuff.
• 43:15
  Mike Masnick: sex dolls and apparently they were small and therefore potentially implied child, which is bad, like just, you know, o obviously bad.
• 43:24
  Mike Masnick: And so France is threatening to ban sheen entirely.
• 43:27
  Mike Masnick: and she and I think said they were shutting down their marketplace feature in France and response to this, and again, it's.
• 43:33
  Mike Masnick: It's another example of like an alternative platform and you know, people will do bad stuff and break the rules on these platforms and managing that and handling the trust and safety and content moderation aspect of it is really difficult.
• 43:44
  Mike Masnick: I'm sure there's a ton of material on there and the ability to catch something like this is probably difficult.
• 43:51
  Mike Masnick: I don't know exactly what their particular rules are and how this fits.
• 43:55
  Mike Masnick: Obviously when you're selling stuff that's a, marketplace kinds of things is a different sort of challenge than just like social media content.
• 44:02
  Mike Masnick: All of these are different kinds of challenges, but involves, there's always some effort in, in managing the marketplace and dealing with bad sellers or problematic sellers and who violate the rules, And I find it a little bit convenient and a little bit, you know.
• 44:15
  Mike Masnick: Yes, like a bad seller slipped through with a bad product that happens all the time and, immediately jumping to we're gonna ban you.
• 44:22
  Mike Masnick: It felt sort of performative in a way that France can be performative about the internet.
• 44:29
  Mike Masnick: And you know, to me, part of this also just like France, you, you said like, yeah, they're taking a different approach to Germany.
• 44:34
  Mike Masnick: They've always done this.
• 44:36
  Mike Masnick: Like I remember the fights over copyright stuff where France was always the worst on this stuff too.
• 44:41
  Mike Masnick: And just there's some sort of like, I don't know if it because they had the minitel before the internet became big, that they just have this like.
• 44:49
  Mike Masnick: This is a little bit of stereotyping, but there's a bunch of people in France who seem to really hate the internet and, and are really, really quick to attack the internet and, and, you know, within the political class.
• 45:00
  Mike Masnick: It's just, it's amazing to me how often France is just doing something bad,
• 45:04
  Ben Whitelaw: Yeah, interesting.
• 45:06
  Ben Whitelaw: I, I, I hadn't kind of known that.
• 45:07
  Ben Whitelaw: Hi, that backstory, that history.
• 45:09
  Ben Whitelaw: Um, but yeah, I mean, it's definitely a bad time to be a kind of Chinese owned, uh, platform in France.
• 45:15
  Ben Whitelaw: You know, not only are she in and TikTok being investigated, but Temu with Chanel Express are also being investigated under the kind of, marketplace investigation that you talked about.
• 45:24
  Ben Whitelaw: So yeah, we'll probably keep track of that as we, go into next year.
• 45:29
  Ben Whitelaw: which.
• 45:30
  Ben Whitelaw: Will be fascinating.
• 45:31
  Ben Whitelaw: Mike, it's a bad time to be a Chinese platform in France.
• 45:33
  Ben Whitelaw: It's a good time to be a listener of controlled speech'cause we will now go to our bonus chat, with thorns, Payless Halai, talking about how platforms are scaling their CSAM detection.
• 45:43
  Ben Whitelaw: Using safe's new text classifier, which helps trust and safety teams find conversations that actually violate child sexual abuse, policies.
• 45:52
  Ben Whitelaw: I found this a really fascinating chat.
• 45:54
  Ben Whitelaw: I didn't realize that it was possible to actually detect kind of in words, the kinds of behaviors and, interactions that might lead to, a grooming, an exploitation event.
• 46:05
  Ben Whitelaw: So really glad to have pays on the podcast this week.
• 46:19
  Ben Whitelaw: So welcome Pailes to the podcast.
• 46:21
  Ben Whitelaw: It's great to have you here on Control Alt speech.
• 46:23
  Ben Whitelaw: really nice to see you.
• 46:24
  Ben Whitelaw: let's dive straight into, what is a really fascinating topic.
• 46:28
  Ben Whitelaw: many folks working in industry will know about Thorn.
• 46:31
  Ben Whitelaw: In part due to its safer Cs, a detection tool, which more than 90 platforms use day in, day out.
• 46:37
  Ben Whitelaw: Can you share a little bit about the nuts and bolts of how it helps platforms address the challenge of moderating csam at scale and what sets it apart from other tools?
• 46:46
  Pailes Halai: Yeah, yeah, of course.
• 46:47
  Pailes Halai: And, thanks for having me on Ben, big fan of, of your show and, and the newsletter.
• 46:51
  Pailes Halai: So, so really glad to chat to you today.
• 46:54
  Pailes Halai: so as you mentioned, Safer is a scalable solution for, you know, companies to use to identify and remove, CSAM at scale.
• 47:03
  Pailes Halai: we have both large and small companies using it.
• 47:06
  Pailes Halai: So, you know, thinking a two person team running thousands of pieces of content a month, to like a hundred person team running billions of pieces of content a month, it works just as well, at either end of the spectrum.
• 47:19
  Pailes Halai: So.
• 47:20
  Pailes Halai: It's a really, really good tool, as a starting point, but also as you know, a really robust solution for identifying and removing CSA.
• 47:29
  Pailes Halai: I'd say the core of the product is really in its, known CSA detection.
• 47:35
  Pailes Halai: So that's gonna be via the hash matching service and also our classifier models.
• 47:40
  Pailes Halai: So these are machine learning models that are gonna help, companies identify.
• 47:45
  Pailes Halai: Previously unknown or novel CSA.
• 47:48
  Pailes Halai: that's really the core offering, right?
• 47:49
  Pailes Halai: you know, in our opinion, it's not enough to just look for one or the other.
• 47:53
  Pailes Halai: You really need to be looking for both to ensure you're running a, a safe platform, and to keep, the viral spread of CSA, down to a minimum.
• 48:01
  Pailes Halai: beyond that, I think in terms of what sets it apart.
• 48:05
  Pailes Halai: First of all, you know, at Thorn this is all we do.
• 48:08
  Pailes Halai: we are narrowly, narrowly focused on the issue of child sexual exploitation and child sexual abuse.
• 48:15
  Pailes Halai: so that really sets us apart, I think, first and foremost as an organization, as a tool.
• 48:21
  Pailes Halai: I think it's a very unique tool in that so much of what we build is informed by our in-house research team.
• 48:29
  Pailes Halai: You know, how many, how many companies can say that they have a world class research team in-house.
• 48:35
  Pailes Halai: so we kind of take the trends that they're seeing.
• 48:39
  Pailes Halai: And, you know, marry them with some kind of broader industry trends that we're seeing in the space.
• 48:44
  Pailes Halai: And we really try and develop tools that meet the moment of how children are being abused, today, and how they might be abused on in different, surfaces in the future as well.
• 48:55
  Pailes Halai: So, uh, An example of this, in practice is, as part of our online grooming research, we've seen a, a pattern of perpetrators moving kids to private chats since as early as 2022.
• 49:07
  Pailes Halai: And, and we know probably before that, so, we found in that research.
• 49:12
  Pailes Halai: around two and three miners reported experiences of online contacts, inviting them to move from a public chat to a private conversation on a different platform.
• 49:22
  Pailes Halai: And we know for various reasons, you know, this is where, the bulk of grooming happens on these, platforms where it's kind of a black box.
• 49:29
  Pailes Halai: So.
• 49:30
  Pailes Halai: Taking this, these insights from our research team, you know, that really helped inform the build of safe's, latest classifier, which is the text classifier.
• 49:40
  Pailes Halai: and this differs slightly from our image and video in that it's text, and it.
• 49:45
  Pailes Halai: Enables users to identify sexually exploitative conversations, whether it's in strings of texts or in conversations.
• 49:54
  Pailes Halai: and I just got an update this morning.
• 49:56
  Pailes Halai: so this might be breaking news, uh, but we've just added, we've just added a, a grooming label to the text classifier.
• 50:03
  Pailes Halai: So again, this was entirely informed by user research, our in-house research team.
• 50:10
  Pailes Halai: trends that we're seeing.
• 50:11
  Pailes Halai: You know, in terms of growing harm types, grooming is top of mind for a lot of trust and safety teams.
• 50:17
  Pailes Halai: so the idea with this new label is that it helps identify grooming patterns in conversations.
• 50:23
  Pailes Halai: So I'm thinking, planning or suggesting offline meetings, encouraging self-harm or emotional dependency and things of that nature.
• 50:32
  Pailes Halai: so yeah, I think.
• 50:34
  Pailes Halai: Really a combination of us Thorn as an organization being so narrowly focused on this issue space, in combination with our in-house research team that's deeply, deeply embedded within our product roadmap, really makes safer such a unique and powerful product, you know, in, in this space.
• 50:52
  Ben Whitelaw: Yeah, really interesting and, and amazing that there's, you know, such iterative development happening, literally as we speak.
• 50:59
  Ben Whitelaw: Um, always good to have the, the latest breaking news on uncontrollable speech.
• 51:04
  Ben Whitelaw: you mentioned about the kind of scale pals of, child sexual abuse material that can be kind of daunting for.
• 51:10
  Pailes Halai: Mm-hmm.
• 51:11
  Ben Whitelaw: Not only users, but trust and safety teams as well.
• 51:14
  Ben Whitelaw: it doesn't take a lot of looking at media headlines to see cases every week of, grooming and, and, you know, exploitation.
• 51:21
  Ben Whitelaw: Can you kind of share a bit about what maybe gives you hope for the future and, and where you see the most meaningful progress happening with this harm?
• 51:29
  Pailes Halai: Yeah.
• 51:29
  Pailes Halai: I get asked this question quite a lot actually.
• 51:31
  Pailes Halai: Especially, you know, working at an organization like Thorn.
• 51:34
  Pailes Halai: You know, you're kind of exposed to the worst of the worst, and, and you're right, every day there's a new article, a new harm type, and it just seems like you're swimming upstream all the time.
• 51:44
  Pailes Halai: Right.
• 51:44
  Pailes Halai: So for me, I think the, the first thing that comes to mind is really the people.
• 51:50
  Pailes Halai: whether it's people at Thorn who have dedicated their time to work solely on this issue of child sexual abuse and exploitation.
• 51:59
  Pailes Halai: or, you know, the companies that we work with.
• 52:01
  Pailes Halai: I'm fortunate to work with a lot trusts and safety teams in industry and seeing the people that are dedicated to their jobs and, how they approach their day to day, gives you nothing but hope.
• 52:12
  Pailes Halai: but then.
• 52:13
  Pailes Halai: You go to somewhere like Trust Con, you know, you guys are are normally kind of the, the curtain call at Trust Con with, with the live, version of, of this podcast every year this space seems to grow, right?
• 52:24
  Pailes Halai: Like more and more people want to come and join this space, like no matter how hard the issue is.
• 52:30
  Pailes Halai: and that's really helpful.
• 52:31
  Pailes Halai: And thinking beyond the people.
• 52:34
  Pailes Halai: I think just innovative solutions.
• 52:36
  Pailes Halai: You know, I mentioned, the text, classifier, I mentioned the grooming label.
• 52:41
  Pailes Halai: These innovative solutions really make the biggest dent.
• 52:44
  Pailes Halai: You know, you can have all the people working on the issue as you want, but without innovation, without leading edge technology like classifiers and, And machine learning models, you know, we really can't solve this problem.
• 52:57
  Pailes Halai: So I think, you know, a combination of, great people in the space, inspiring people, and innovation really, really makes me feel hopeful.
• 53:06
  Pailes Halai: and even zooming out like a few years and thinking about where Thorn started.
• 53:11
  Pailes Halai: In launching Safer.
• 53:12
  Pailes Halai: you know, since then we've launched, uh, proprietary hashing algorithm, proprietary classifiers.
• 53:19
  Pailes Halai: as I mentioned, the grooming label.
• 53:21
  Pailes Halai: We've done a lot of work just in the last few years and, it's really amazing to see that actually making a difference in the ecosystem.
• 53:28
  Ben Whitelaw: Yeah.
• 53:29
  Ben Whitelaw: definitely.
• 53:29
  Ben Whitelaw: I mean, it's definitely a topic that has got a lot of people's attention and, focus right now, and it's, it's obviously great that Thorn is one of those organizations, as well as developing this kind of detection tools and technology that you've mentioned.
• 53:42
  Ben Whitelaw: thorn also talks a lot about the concept of safety by design.
• 53:45
  Ben Whitelaw: can you talk a bit about what that means to you at Thorn and what are the biggest opportunities you see in embedding safety by design approach into particularly emerging AI systems?
• 53:55
  Pailes Halai: Yeah.
• 53:56
  Pailes Halai: Yeah.
• 53:56
  Pailes Halai: I think it, it's a very complex subject, uh, especially in this, the day and age where, Everyone's adding the words ethical or responsible to their development.
• 54:07
  Pailes Halai: but I think, and we at Thorne really just think that safety by design means baking safety into every stage of AI development or really any product development for that matter.
• 54:17
  Pailes Halai: so in practice that starts with inputs.
• 54:21
  Pailes Halai: So cleaning up your training data, we've heard many stories over the last couple years where there's, kind of, tarnished training data that then enables the model to spit out even worse, generated content.
• 54:33
  Pailes Halai: So it starts with clean training data.
• 54:36
  Pailes Halai: and safer can be a really big help with this as well.
• 54:39
  Pailes Halai: we have companies that have used safer and are today using safer to clean up training data to ensure that they're using the cleanest training data sets.
• 54:48
  Pailes Halai: beyond the inputs, you know, you can think about red teaming.
• 54:51
  Ben Whitelaw: Mm-hmm.
• 54:52
  Pailes Halai: Um, so it's another thing that companies should be looking at and also something that th offers as a service.
• 54:59
  Pailes Halai: and this can be, You know, us testing the model for harms offering solutions in order to mitigate those harms.
• 55:06
  Pailes Halai: So it's really, at every stage, it's not a set and forget it type of, initiative.
• 55:12
  Pailes Halai: you know, you wanna really be aware of model drift, et cetera.
• 55:15
  Pailes Halai: So, every stage, you know, we want to be thinking about safety, and, and thinking of this like from an operational perspective.
• 55:23
  Pailes Halai: It's just a lot easier to be preventative rather than reactive.
• 55:27
  Pailes Halai: we've seen kind of companies trying to, to kind of put the genie back in the bottle, you know, and it's really, really difficult and almost impossible.
• 55:34
  Pailes Halai: So if you focus on ensuring that the model can't produce those harms in the first place, you're gonna have a much easier time preventing the outputs, in being harmful.
• 55:44
  Pailes Halai: So, yeah, I think.
• 55:46
  Pailes Halai: That's kind of how we think about safety by design and, and it's something that we, we really believe in, but we also practice at Thorn as well.
• 55:56
  Pailes Halai: in terms of opportunities, I think.
• 55:59
  Pailes Halai: there's a real chance for companies to differentiate themselves in my opinion.
• 56:03
  Pailes Halai: you know, you, you, you go on to Google and, and type in AI model or, or chat bot.
• 56:08
  Pailes Halai: There are dozens and dozens of options now, and I truly believe, and I, I really hope that users will.
• 56:16
  Pailes Halai: Vote with their, with their money, right?
• 56:18
  Pailes Halai: They'll go and choose the model that is safe for them, for their company, for their kids to use.
• 56:24
  Pailes Halai: So I think there's a real opportunity for companies to.
• 56:28
  Pailes Halai: Really lean into safety by design principles and build a really safe responsible model that users are gonna want to keep using, and users aren't gonna be put off by, by producing adverse material, as outputs.
• 56:42
  Pailes Halai: Mm-hmm.
• 56:42
  Ben Whitelaw: Yeah, I certainly hope that too.
• 56:44
  Ben Whitelaw: I mean, safety, more AI companies focusing on safety is not a bad thing.
• 56:49
  Ben Whitelaw: and, and it's great to see Thorn kind of contributing to that space in the active way that it is.
• 56:54
  Ben Whitelaw: when you kind of fast forward of a few years, payloads, when you think about thorn's impact, um, in the future, in the context of AI and content moderation, what do you think that looks like in kind of real terms.
• 57:05
  Ben Whitelaw: Do you ever envisage a, a world in which AI used to kind of defend and, and not endanger kids in the way that it often is nowadays?
• 57:14
  Pailes Halai: Yeah, it's a, it is a great question.
• 57:16
  Pailes Halai: And, you know, I would say the AI is being used and has been used now for a long time to mitigate these harms.
• 57:23
  Pailes Halai: So, for example, I mentioned Safer was launched around five years ago, coming on six years now.
• 57:29
  Pailes Halai: And we've had our image and video classifier for almost as long.
• 57:32
  Pailes Halai: And that's, that's ai, right?
• 57:35
  Pailes Halai: a AI takes on such a different meaning now with, with LMS and, and chat bots.
• 57:39
  Pailes Halai: we are firm believers in embracing the fact that whenever there is a new technology and a new development, you know, whether it's, being able to stream high quality videos and share high quality videos to, AI generate CSA, these technologies are always gonna be used for bad.
• 57:57
  Pailes Halai: cause the technology is agnostic, but there are always bad actors using, trying to exploit any angle.
• 58:03
  Pailes Halai: So we embrace that at Thorn and we try to lean into that and, and try and build solutions using the same technology.
• 58:10
  Pailes Halai: And as I mentioned, the, image and video classifiers that we have, you know, machine learning models that are able to predict whether it, this is, previously unknown CSA or not.
• 58:21
  Pailes Halai: The latest product from Safer.
• 58:22
  Pailes Halai: The Text Classifier, is a language model that's able to detect, sexually exploitative and abusive behavior, including grooming within text.
• 58:31
  Pailes Halai: so it's really, really about, I think, understanding that tech is gonna be used for bad and it's our job to try and stay ahead of that curve and address it in the best way possible.
• 58:42
  Pailes Halai: so.
• 58:43
  Pailes Halai: I think the moral really is to, to embrace that it's always gonna be used for bad.
• 58:47
  Pailes Halai: that's never gonna cease to be the case.
• 58:49
  Pailes Halai: we are there to ensure that the technology is there to be used for good and to defend kids.
• 58:55
  Pailes Halai: Yeah.
• 58:56
  Ben Whitelaw: Brilliant.
• 58:57
  Ben Whitelaw: a, a good note to end on, I'd say, and, thanks for taking the time to, talk to us today about the work Thorne's doing to give us a bit of context of, you know, your approach and, a bit of a look under the hood as to how you're thinking about CSAM and, preventing it at scale.
• 59:11
  Ben Whitelaw: So appreciate your time today.
• 59:12
  Pailes Halai: Yeah, no worries, and thank you for the time.
• 59:17
  Announcer: Thanks for listening to Ctrl-Alt-Speech.
• 59:19
  Announcer: Subscribe now to get our weekly episodes as soon as they're released.
• 59:23
  Announcer: If your company or organization is interested in sponsoring the podcast, contact us by visiting ctrlaltspeech.com.
• 59:30
  Announcer: That's CT RL alt speech.com.