Latest / Ctrl-Alt-Speech / Move Fast and Mistake Things
Transcript
- 0:00Ben Whitelaw: So you, you will have heard, Mike, that the big buzzy app in, in the Silicon Valley world is clearly right, this won't have pass you by, but it's the kind of app that helps you cheat at work, helps you cheat at school, and it does that by like listening to what you're doing in your laptop, reading everything that goes on your screen and they're like feeding you intel.
- 0:18Ben Whitelaw: It's pretty nuts.
- 0:19Ben Whitelaw: I, I I, I dunno if you use it, but I know you know about it and it's been kind of the center of some internet drama this week, which we're gonna come onto.
- 0:26Ben Whitelaw: but I wanted to use it to start today's podcast.
- 0:29Ben Whitelaw: And they,'cause they're a kind of like, crazy bunch of like, you know, nuts cracked devs.
- 0:36Ben Whitelaw: Uh, they're kind of like prompts on their marketing pages.
- 0:40Ben Whitelaw: Like take the short way.
- 0:42Ben Whitelaw: As in like, do the easy thing.
- 0:43Ben Whitelaw: So what's your easy thing, Mike?
- 0:45Ben Whitelaw: How are you taking the short weight?
- 0:47Mike Masnick: Well, I was gonna say, I think, a lot of our stories this week are about what happens when you take the easy way and why maybe it's not such a good idea to always take the short way that you may discover that certain, nuances and complexities matter.
- 1:02Mike Masnick: So, that's, that's gonna be my, little, preview for today.
- 1:05Mike Masnick: What about you?
- 1:06Mike Masnick: What, short way are you taking Ben?
- 1:08Ben Whitelaw: I was gonna say the same.
- 1:09Ben Whitelaw: You know, I'm noticing in, in the big story that I'll cover today about how Meta was taking the short way by literally just pulling down anything that looked like CSA and, we're gonna see the problems of, that approach very shortly.
- 1:28Ben Whitelaw: Hello and welcome to Control Alt Speech, your weekly roundup of the major stories about online speech.
- 1:33Ben Whitelaw: Content moderation and internet regulation.
- 1:36Ben Whitelaw: It's July the 10th, 2025, and this week's episode is brought to you with financial support from the future of Online Trust and safety fund.
- 1:43Ben Whitelaw: This week we're talking about the accusations of AI censorship, a user uprising against meta and good old fashioned spam texts.
- 1:50Ben Whitelaw: I'm Ben Whitelaw.
- 1:51Ben Whitelaw: I'm the founder and editor of Everything Moderation, and I'm with my trustee co-host, Mike Masnick, founder of Tech Debt.
- 1:59Ben Whitelaw: Mike, how are you?
- 2:00Ben Whitelaw: How deeply have you been embroiled in the internet drama of this?
- 2:05Mike Masnick: It's been really, really fascinating to watch.
- 2:07Mike Masnick: I mean, clearly it's, I mean, it's such a stupid company, right?
- 2:11Mike Masnick: Like, you know, it came out of this guy who created this app to cheat on the, programming tests that, a lot of the big companies use.
- 2:17Mike Masnick: And like, admittedly, some of those programming tests I think are pretty silly.
- 2:21Mike Masnick: but the company.
- 2:22Mike Masnick: that is interviewing students takes over their screen and, so they can watch so that supposedly they can see how you code.
- 2:28Mike Masnick: And yet he created this overlay that is invisible to that.
- 2:31Mike Masnick: And he got kicked out of, Columbia University where he was a student for doing that.
- 2:35Mike Masnick: He.
- 2:35Mike Masnick: Published a video showing him, like getting an offer for like a internship at Amazon after cheating.
- 2:41Mike Masnick: but he's just really leaned into the, like, everyone's like, wow, this guy's an asshole.
- 2:45Mike Masnick: And he's really leaned into that as like the marketing thing.
- 2:48Mike Masnick: and at one point, you know, recently they raised a ton of money from, Andreesen Horowitz and at one point he said, I'm only hiring for two types of jobs.
- 2:57Mike Masnick: engineers and influencers, no companies.
- 2:59Mike Masnick: Any other, any other role.
- 3:02Mike Masnick: Turns out might be helpful to have someone who actually understands the law, uh, because,
- 3:07Ben Whitelaw: Yeah.
- 3:08Ben Whitelaw: What did, what did they do this week?
- 3:09Ben Whitelaw: They, I didn't really understand the kind of psychodrama, but there
- 3:12Mike Masnick: So, so,
- 3:13Ben Whitelaw: the reaction.
- 3:14Mike Masnick: there's a, security researcher who I, I know a little bit, named Jack Cable, who's, a good guy, does a lot of really good, computer security work.
- 3:21Mike Masnick: And he reverse engineered the system prompt.
- 3:25Mike Masnick: that they use for their ai, and that's always an interesting thing.
- 3:28Mike Masnick: and so he figured out a way to to reverse engineer them, and he posted.
- 3:32Mike Masnick: What they were.
- 3:33Mike Masnick: And it was sort of revealing about how, clearly works.
- 3:36Mike Masnick: And then very shortly he received A-D-M-C-A takedown notice, we don't talk about it that much here uncontrolled speech, but the DMCA and copyright laws, sort of the original content moderation tool that,
- 3:49Ben Whitelaw: Yeah.
- 3:50Mike Masnick: every company.
- 3:51Mike Masnick: Learned, you know, you can, send a notice claiming that someone is violating your copyright, and, the platforms are heavily encouraged to then remove that content to avoid facing liability.
- 4:01Ben Whitelaw: It's like the big red button.
- 4:02Ben Whitelaw: Right?
- 4:02Ben Whitelaw: It's like the kind of nuclear
- 4:04Mike Masnick: Yeah, I mean, you know, for a while it was the only sort of legal mechanism to remove any kind of content, and therefore it was also wildly abused by anyone.
- 4:13Mike Masnick: Like people who didn't like a picture of themselves online would file A-D-M-C-A notice because of the sort of structural, legal nature of it.
- 4:20Mike Masnick: It was a way remove content and therefore it became sort of a tool for.
- 4:24Mike Masnick: censorship, backed by the weight of, potential threats of, legal action.
- 4:28Ben Whitelaw: Yeah.
- 4:29Mike Masnick: Jack received A-D-M-C-A notice, which I think was sent to, X as well, because he had posted the screenshots to X.
- 4:37Mike Masnick: And then Roy, the founder of Cluey, responded to Jack Cable and said, we never filed this, bro.
- 4:43Mike Masnick: I mean, it's very, you know.
- 4:45Mike Masnick: tech bro speak, uh, with, with laughing, crying emojis, saying like, we didn't follow this DMCA.
- 4:51Mike Masnick: and then he even said like, it made me double check with legal.
- 4:54Mike Masnick: So apparently they do have some sort of legal, maybe it's not all engineers or, influencers.
- 4:59Ben Whitelaw: unless it's a legal influencer,
- 5:01Mike Masnick: it's possible.
- 5:01Ben Whitelaw: which that maybe there are a.
- 5:03Mike Masnick: And he, he sent like this, you know, I think it's a signal chat that he texted some legal person, who sort of joked about it and said like, I don't think it's a good idea to c and d cease and desist this guy.
- 5:15Mike Masnick: 'cause he'll just post it and clout chase from it, which does sound like influencer speak.
- 5:21Mike Masnick: But then so the funny thing is like.
- 5:23Mike Masnick: Jack responded and he pointed out like, yeah, look, the DMCA notice did come from someone, it signed from someone from your company who's an engineer.
- 5:32Mike Masnick: And then that guy, Kevin Grandin, posted on X, responded and said, oh yeah, I did file a few of these.
- 5:39Mike Masnick: So just like some random engineer at this cheating company sent a bogus DMCA notice to a security researcher, had the CEO deny.
- 5:50Mike Masnick: That they had done anything and then he comes out and is like, oh yeah, my bad.
- 5:53Mike Masnick: He is like, in hindsight, I realize I probably shouldn't have, like you shouldn't have your engineers sending legal notices that have liability attached to them.
- 6:02Mike Masnick: you know there is, it's, even though it's rarely used, part of the DMCA, if you send a false DMCA notice, you can face liability and
- 6:09Ben Whitelaw: Wow.
- 6:10Ben Whitelaw: Kevin's in the shit basically.
- 6:11Ben Whitelaw: Um, I'm gonna send him, maybe I'll, clout chase myself by sending him this episode of Control Speech and say, bro,
- 6:19Mike Masnick: Bro, yes,
- 6:21Ben Whitelaw: Get up to speed on how online speech
- 6:24Mike Masnick: But it's, you know, it is an interesting example of, you know, again, sort of like copyright still underlies all of these things and you have, the AI stuff and, just all of this.
- 6:33Mike Masnick: I thought it was a very, very amusing story.
- 6:36Mike Masnick: And, you know, one reason why maybe you should hire more than just engineers and influencers because, uh, yeah.
- 6:44Ben Whitelaw: talking of which there's a, Alice Hunsberger who writes the Trust and Safety Insider newsletter has done a, a really good piece this week about hiring a fractional trust and safety heads, which is like a kind of, bit of a trend at the moment where you.
- 6:57Ben Whitelaw: basically hire, for like one or two days a week, or one or two days a month as a startup.
- 7:01Ben Whitelaw: Again, something that Roy and Kevin maybe could do with right now is, uh, an experienced trust and safety professional to guide them through, these, early challenges at clearly.
- 7:09Mike Masnick: but you, you know, the, the Silicon Valley bro culture these days are like no, trust and safety is bad, man.
- 7:15Ben Whitelaw: Yeah, yeah, yeah.
- 7:17Ben Whitelaw: They've taken the, uh, Andreessen Horowitz juice.
- 7:20Ben Whitelaw: they've drunk too much Kool-Aid
- 7:21Mike Masnick: enemies of progress.
- 7:23Ben Whitelaw: The enemies of progress.
- 7:24Ben Whitelaw: Well, you know, we are very pro progress here, uncontrollable speech, and we have a whole raft of stories today to get through.
- 7:31Ben Whitelaw: Thanks, uh, for unpacking that, drama Mike for us.
- 7:34Ben Whitelaw: we have an awful lot to get through.
- 7:36Ben Whitelaw: I will say that if you, if listeners kind of log off, before we try to, do our roundup of stories by the end of the day, which we always fail to do the kind of quick and dirty stories, then you'll miss my prompt, and my ask to rate and review the podcast wherever you get your podcasts.
- 7:51Ben Whitelaw: It's super important for us to be discovered and to, grow the listenership of controlled speech.
- 7:56Ben Whitelaw: So we haven't had a, a review in a while.
- 7:58Ben Whitelaw: so do take a, a minute out of your busy days.
- 8:01Ben Whitelaw: We really appreciate it.
- 8:03Ben Whitelaw: we don't cover the, D-M-C-A-A lot, Mike, but we do cover kind of how governments are trying to tell companies how to manage speech online.
- 8:11Ben Whitelaw: And the first story for today is really the kinda latest and a long line of, those stories, but is almost like ai edition of that.
- 8:18Ben Whitelaw: Um, when you mentioned that Andrew Bailey had got involved in.
- 8:22Ben Whitelaw: the latest story about, US content moderation.
- 8:25Ben Whitelaw: I was thinking of the Bank of England governor, and I'm glad to say that this Andrew Bailey is not the same one as the one who sets interest rates here in the uk.
- 8:36Ben Whitelaw: Tell us, I mean, they might know about online speech, to be honest.
- 8:40Ben Whitelaw: Tell us what this has been
- 8:42Mike Masnick: Yeah, it is a common name.
- 8:43Mike Masnick: I think there's a major league baseball player.
- 8:44Mike Masnick: There was one named Andrew Bailey as well.
- 8:46Mike Masnick: So it's like a fairly common name.
- 8:48Mike Masnick: Andrew Bailey is the Attorney General of Missouri.
- 8:51Mike Masnick: and he has always been like a, a sort of very maga e type of person, very aggressive.
- 8:57Mike Masnick: He sort of famously was the one who launched the investigation into media Matters.
- 9:02Mike Masnick: When Media Matters published their.
- 9:04Mike Masnick: Story about, advertisements on X appearing next to neo-Nazi content.
- 9:09Mike Masnick: And when Stephen Miller said like, oh, this is criminal, Andrew Bailey rushed the defense of, Elon Musk said, yes, we will investigate this for you.
- 9:18Ben Whitelaw: The Steven Miller, that's now Deputy
- 9:21Mike Masnick: As chief of staff
- 9:22Ben Whitelaw: of Staff at the White House.
- 9:23Mike Masnick: the, it all comes back together.
- 9:25Mike Masnick: but, so Andrew Bailey's been, uh, attorney General for Missouri for quite some time now.
- 9:30Mike Masnick: he did not initiate, his predecessor initiated the case.
- 9:33Mike Masnick: That was Missouri v Biden.
- 9:36Mike Masnick: which then mur ed into Murphy v Missouri at the Supreme Court was the, this, you know, big case, which we talked about quite a lot last year, regarding the idea of whether or not the government could talk to.
- 9:48Mike Masnick: social media companies about their content moderation practices, right?
- 9:52Mike Masnick: The whole crux of that case was that the mere any communication between government officials and social media companies about their ranking and moderation was so far beyond the pale violation of the First Amendment, that it had to be blocked, and in fact.
- 10:11Mike Masnick: Missouri won in the district court under Judge Terry Dowdy, who's also a very maga sort of famously willing to rule in favor of any Trump issue.
- 10:20Mike Masnick: judge who he released his ruling on July 4th when the courts are normally closed.
- 10:25Mike Masnick: And it was this like, patriotic nonsense thing about how, Biden officials talk just.
- 10:31Mike Masnick: Communicating with social media, FBI people.
- 10:34Mike Masnick: C.
- 10:35Mike Masnick: DC, anyone else communicating in any way was the most egregious, biggest form of censorship he had ever seen
- 10:43Ben Whitelaw: It got a lot of Republicans hot under the collar,
- 10:45Mike Masnick: Oh yeah.
- 10:46Mike Masnick: Yeah.
- 10:46Mike Masnick: And, and he, issued this, broad injunction that blocked basically any government official from ever talking to any tech company.
- 10:56Mike Masnick: And also even like blocking talking to like.
- 10:59Mike Masnick: the Stanford Internet Observatory, like these non parties, it was like very, very, you know, Dowdy said, arguably it was the most massive attack against free speech in US history.
- 11:12Mike Masnick: Okay, keep that in mind.
- 11:15Mike Masnick: This is, you know, entirely and eventually right.
- 11:17Mike Masnick: this went up to the fifth circuit, which, sort of rolled back and said like, nah, maybe not quite that far, but still, still left an injunction on that became Murre, Missouri, where the Supreme Court, the conservative part, you know, the written by Amy Coney Barrett was like.
- 11:31Mike Masnick: No, like that's not you know, there's nothing in here that is a abuse as the First Amendment.
- 11:38Mike Masnick: There were some procedural aspects to it.
- 11:40Mike Masnick: but basically, this was a case where, they totally misrepresented the evidence and everything.
- 11:44Mike Masnick: I.
- 11:44Mike Masnick: And like you had both Justice Kagan and Justice Kavanaugh saying like, wait, no, government officials talk to companies all the time, and like, that's natural.
- 11:54Mike Masnick: Like as long as there's no coercion, there's no problem.
- 11:58Mike Masnick: but anyway, so like this is all framing, which is, becomes important, right?
- 12:02Mike Masnick: Like
- 12:02Ben Whitelaw: I'm excited.
- 12:03Ben Whitelaw: I'm really excited.
- 12:04Mike Masnick: premise of this is that the, you know, government officials can never, so.
- 12:08Mike Masnick: Same.
- 12:08Mike Masnick: Andrew Bailey, who, you know, he didn't start the case, but he ran most of the case and talked over and over and over again about it.
- 12:15Mike Masnick: He sends he puts out a press release and he sent letters to four companies that run AI tools, Google, OpenAI, Microsoft, and Meta
- 12:25Ben Whitelaw: Yeah.
- 12:25Mike Masnick: on research and.
- 12:28Mike Masnick: You can see me, but people listening can't see me.
- 12:30Mike Masnick: I'm putting quote marks around research from
- 12:34Ben Whitelaw: Is this like Jim Jordan style
- 12:35Mike Masnick: yeah, this is even, even more ridiculous than Jim Jordan.
- 12:38Mike Masnick: Like, these guys aspire to, do the level of research that Jim Jordan does.
- 12:44Mike Masnick: a far right wing extremist, nonprofit nonsense pedaling group.
- 12:49Mike Masnick: You know, I, I was going through their webpage and it's just.
- 12:52Mike Masnick: pure nonsense.
- 12:53Mike Masnick: They did research, which consisted of going to six different chatbots and asking them a single question saying, rank the last five presidents from best to worst, specifically in regards to antisemitism.
- 13:09Mike Masnick: So basically saying rank presidents the last five presidents based on how antisemitic they're.
- 13:15Mike Masnick: Three of the six engines that they went to ranked Donald Trump last,
- 13:20Ben Whitelaw: As in he was the L
- 13:21Mike Masnick: the, the most, the most
- 13:23Ben Whitelaw: he was the most.
- 13:25Ben Whitelaw: Got it.
- 13:25Ben Whitelaw: Okay.
- 13:26Ben Whitelaw: Good.
- 13:26Ben Whitelaw: To
- 13:26Mike Masnick: Yes, yes.
- 13:27Mike Masnick: Good to clarify.
- 13:28Mike Masnick: two of them ranked him at the other end saying he was the least antisemitic, and one of them said, I am not touching that.
- 13:36Mike Masnick: And
- 13:38Ben Whitelaw: Pass.
- 13:38Mike Masnick: I'm sorry, but I cannot respond to such a, you know, obviously loaded question.
- 13:44Mike Masnick: so Bailey sends letters to four of the companies, the three that ranked.
- 13:51Mike Masnick: Donald Trump as the most antisemitic and the one that refused to answer at all, though he gets confused in his letters about who's who in.
- 14:02Ben Whitelaw: It's a lot.
- 14:02Ben Whitelaw: There's a lot of tech companies I
- 14:03Mike Masnick: This was, it was not, this was not done thoughtfully or carefully.
- 14:07Mike Masnick: and goes through this whole thing about how ranking Donald Trump last is objectively wrong, is consumer fraud on the people of Missouri, that it is anti-free speech, and that it is the company's trying to inject their worldview.
- 14:26Mike Masnick: And that because of that, they may lose their section two 30 protections.
- 14:32Ben Whitelaw: Because that's a, that's a full house of of crackpot responses.
- 14:36Mike Masnick: It is beyond crazy, and the two companies that said, Donald Trump was the least, anti-Semitic were perhaps not surprisingly, and perhaps we'll discuss more on this later, uh, grok from x and then also deep seek the Chinese, provider.
- 14:54Ben Whitelaw: Yeah.
- 14:54Ben Whitelaw: Okay.
- 14:54Mike Masnick: the one that refused to answer at all was Microsoft, Microsoft's copilot.
- 15:00Mike Masnick: However, he did send a letter to them in which it's funny because the letter to, to whom Microsoft says Copilot ranked Trump last and some other nameless.
- 15:10Mike Masnick: engine didn't rank them at all.
- 15:12Mike Masnick: It says, of the six chat hats asked this question three, including Microsoft's own copilot rated President Donald Trump dead last, and one refused to answer the question at all.
- 15:21Mike Masnick: No, it was copilot that refused to answer the question, but they're so stupid they don't even realize that Bailey or whoever wrote this letter for him.
- 15:29Ben Whitelaw: Poor guy.
- 15:29Ben Whitelaw: Poor guy.
- 15:30Ben Whitelaw: He is so close.
- 15:31Ben Whitelaw: He was so close to landing a slam dunk.
- 15:33Mike Masnick: Yeah, though it.
- 15:34Ben Whitelaw: If any.
- 15:34Ben Whitelaw: If any, he could count or
- 15:35Mike Masnick: It seems to imply that even saying like, I won't answer that question, is some sort of consumer fraud.
- 15:40Mike Masnick: and the, they're claiming the, the fraud.
- 15:43Mike Masnick: It's not even explained.
- 15:44Mike Masnick: The letter doesn't even suggest a theory of fraud.
- 15:47Mike Masnick: It just kind of says like, this is bad and then I need you to, Give me all of this information.
- 15:54Mike Masnick: It says, did you ever have a policy or practice to design or coach your algorithm to disfavor or treat in a disparate manner?
- 16:02Mike Masnick: Anyone?
- 16:02Mike Masnick: you know, it asks for all the documents created, around designing your AI system.
- 16:08Mike Masnick: provide all documents and communications about training and waiting anything resulting in, ranking President Donald Trump unfavorably
- 16:17Ben Whitelaw: Well, so what is his kind of constitutional claim here?
- 16:19Ben Whitelaw: Like what is he, is he suggesting that the First Amendment should be kind of baked into these companies code and outputs?
- 16:27Ben Whitelaw: Like is that where he's going?
- 16:28Mike Masnick: You, you are assuming way too much that there is like a legitimate theory behind all this as opposed to just like.
- 16:34Mike Masnick: Using the power of his office to be a jackass.
- 16:37Mike Masnick: the, only things that he talks about, and it's funny because he talks about this more in the press release than the actual letter.
- 16:43Mike Masnick: I think somewhere along the lines that you probably realize that like the letters to the companies, like lawyers will actually look at this and respond to this.
- 16:50Mike Masnick: And if we go as far as we go in the press release, like we're gonna be in trouble.
- 16:53Mike Masnick: But you know.
- 16:55Mike Masnick: In the, press release he talks about the Missouri Merchandising Practices Act about, deceptive business practices.
- 17:03Mike Masnick: So there's this sort of implicit argument that like, you are promising a neutral rating and the next step to it is that, any neutral rating of antisemitism among the, the last five presidents would have to rank Donald Trump as the least.
- 17:17Mike Masnick: Antisemitic.
- 17:18Mike Masnick: And he, he, presents his argument for why, which is I believe, cut and pasted directly from that crazy right-wing group that, did this research in the first place.
- 17:29Mike Masnick: Basically saying like, Trump has done a few things pro-Israel things, therefore he can't be antisemitic.
- 17:36Ben Whitelaw: Right, right, right.
- 17:36Mike Masnick: so saying that basically at one point even says effectively, like it's an objective fact.
- 17:41Mike Masnick: That Donald Trump is not anti-Semitic, so claiming that he is more anti-Semitic than the last four other presidents is a violation of neutrality and is fraud because the implication doesn't go quite saying this, the implication is that you promoted publicly that you were neutral and then he sort of ties it to the section two 30 argument, which is just also completely ass backwards that like.
- 18:07Mike Masnick: two 30 says you have to be neutral.
- 18:08Mike Masnick: So he's saying, because you are no longer neutral, you will lose your section two 30 protections because you ranked Donald Trump this way, which is not how section two 30 works, because you don't have to be neutral.
- 18:21Mike Masnick: Like they actually like, quote there's like quote marks as if it's from the law you know, neutral platform, which is not in the law You don't have to be neutral and in fact, like the whole point of the law is that you're not supposed to be neutral.
- 18:34Mike Masnick: Like Chris Cox, the Republican who co-wrote section two 30 has said this, said this directly to me.
- 18:40Mike Masnick: I interviewed him recently and he told me the whole point was to encourage platforms to moderate and not to be neutral and to say like, this kind of content is okay for us.
- 18:50Mike Masnick: This kind of content is not like that's the whole point of section two 30, and yet Bailey here is implying that.
- 18:57Mike Masnick: you could lose your, which is not a thing you don't lose.
- 18:59Mike Masnick: Like there are actions that are covered by two 30 and there are actions that are not, or content that is covered by two 30 and content that is not covered by two 30.
- 19:05Mike Masnick: There's nothing you could do to like lose your two 30 protections.
- 19:10Ben Whitelaw: Right.
- 19:10Ben Whitelaw: Okay.
- 19:11Ben Whitelaw: so this is interesting.
- 19:12Ben Whitelaw: So there's kind of no basis to this.
- 19:14Ben Whitelaw: Is it gonna go anywhere, do you think?
- 19:16Mike Masnick: that's the question, right?
- 19:17Mike Masnick: Like a lot of this is purely performative.
- 19:20Mike Masnick: and so, you know, he is, playing a part, maybe he wants to get appointed to the Trump administration in some form or another, and he's, making his play here as like the most aggressively stupid person you can be.
- 19:31Mike Masnick: But you know, he can launch an actual investigation.
- 19:35Mike Masnick: He does sort of frame this as like, this is not a demand, this is a request for voluntary help, but like I.
- 19:41Mike Masnick: When you receive something like that, the lawyers are going to get involved.
- 19:45Mike Masnick: I assume that they'll respond.
- 19:47Mike Masnick: but it could, you know, as he did with media Matters, it could escalate into A-A-A-C-I-D-A civil investigatory demand, which is a, a subpoena, at which point they, they would have to go to court and sort of try and prevent it.
- 19:58Mike Masnick: And then it becomes this fight like, do you wanna be fighting with the Attorney General of Missouri?
- 20:03Mike Masnick: and it just gets in the news and it allows him to get in the news and claim that these AI companies are, biased against'em.
- 20:09Mike Masnick: and here's the thing too, and I think this is important to bring up, and like all the stories are sort of, you know, I've seen a couple stories on this aren't necessarily even talking about.
- 20:15Mike Masnick: It's like, I would bet you that if you kept asking a lot of these, AI engines the same question, you would get different answers.
- 20:23Mike Masnick: Because again, They generate content.
- 20:26Mike Masnick: sometimes they make up stuff.
- 20:28Mike Masnick: Sometimes they will probably rank him one way.
- 20:30Mike Masnick: Sometimes they will rank him another way.
- 20:32Mike Masnick: you know, they're not pulling from a database.
- 20:33Mike Masnick: I.
- 20:34Mike Masnick: They're making up their answer based on, stuff that they have access to, and they can think through stuff and they can reason.
- 20:40Mike Masnick: And you know, I wouldn't surprise me if I actually did run that exact query on a few of these engines and got mixed results.
- 20:47Mike Masnick: But like when I, I a, I forget which one I asked, maybe it was chat, GPT, it gave me back a long response with.
- 20:54Mike Masnick: It did also rank, Donald Trump as the most anti-Semitic, but it came with a long list of reasons why, you know,
- 21:01Ben Whitelaw: Right.
- 21:01Ben Whitelaw: Okay.
- 21:02Mike Masnick: with links,
- 21:03Ben Whitelaw: and that's obviously helpful to some degree.
- 21:05Ben Whitelaw: There's a risk, right, that other attorney generals in other states.
- 21:10Ben Whitelaw: We'll do something similar, right?
- 21:11Ben Whitelaw: This, this, if this could be a kind of recipe for, making a point and signaling to the kinda Republican administration that, you know, maybe yeah, maybe I'm, ready for the next step up.
- 21:22Mike Masnick: Yeah.
- 21:22Ben Whitelaw: that's, I don't wanna be talking about this on every single podcast,
- 21:25Mike Masnick: Yes.
- 21:26Ben Whitelaw: but there's, I feel like we already talk about the kind of, Twitter files style, dreamt up dramas that, you know, like politicians make in relation to platforms.
- 21:34Ben Whitelaw: But I can see this being replicated time and time
- 21:37Mike Masnick: Yeah, but the, and the thing is too, like if he gets away with this, there's no reason why it has to only be one side other than like shame.
- 21:42Mike Masnick: Right.
- 21:42Mike Masnick: You know?
- 21:43Mike Masnick: But like you could have uh, say a a, an attorney general from a democrat, blue state, going after these companies for, I.
- 21:51Mike Masnick: providing, anti-abortion information or like, pro-gun rights stuff or something of, that nature where, you know, they're say like, oh, you're, promoting, violence through, information about guns, for example, right?
- 22:04Mike Masnick: you know, then Republicans would be upset about that.
- 22:06Mike Masnick: The whole idea is like the government's not supposed to be engaged in policing speech in any way, which was in theory though, it was ridiculous.
- 22:13Mike Masnick: The point of the Missouri v Biden case, the level of hypocrisy in this is that he cites that case as the reason why he's sending these letters.
- 22:21Mike Masnick: Even though what he's doing in these letters is way worse than anything that they accused the Biden administration of which again was sort of thrown out by the courts.
- 22:30Mike Masnick: So.
- 22:31Mike Masnick: Everything about this is, the only principle is like free speech is you have to say nice things about Donald Trump and like, against free speech is anything that is like, against Trump.
- 22:44Mike Masnick: it's, it's an insane level of nonsense.
- 22:47Ben Whitelaw: Yeah, and you forget, Mike, that you know, politicians, unlike some of these LLMs, have very bad memories and, and, you know, will disregard, you know, Supreme Court judgements if it doesn't suit them to do so.
- 22:59Ben Whitelaw: So I, this is a really interesting, and I'm glad to know that Andrew Bailey, governor of the, bank of England in the UK is not involved.
- 23:08Ben Whitelaw: That's, that's very helpful.
- 23:09Ben Whitelaw: Or that, any baseball players are, are not
- 23:11Mike Masnick: Yes.
- 23:11Ben Whitelaw: either.
- 23:13Ben Whitelaw: That would make things much worse.
- 23:15Ben Whitelaw: Um, okay.
- 23:16Ben Whitelaw: Onto our next story.
- 23:17Ben Whitelaw: Now this, this is another AI related story, but this concerns, platforms that many people will know.
- 23:23Ben Whitelaw: It's about meta and about a plethora, dozens and dozens of users who have.
- 23:29Ben Whitelaw: Complained to the company and to media about having their accounts taken down for breaching rules on child sexual exploitation, or child sexual abuse material, CSAM.
- 23:41Ben Whitelaw: these people, a hundred of whom, who've spoken to the BBC, who reported the story this week, say that they have been, incorrectly accused of, posting CS a on Instagram and Facebook and have had their accounts taken down to great stress.
- 23:57Ben Whitelaw: some people have, talked about, feeling incredibly isolated, being very shocked about this, just getting a notification, that, they've.
- 24:04Ben Whitelaw: posted CSA and, not really knowing what that means and then having the account disappear and not being able to log in as a result.
- 24:11Ben Whitelaw: Some people have also had, business accounts taken down and, for them that's a kind of means of, making money and, of their livelihood.
- 24:17Ben Whitelaw: and so there's a, big group of people who've suddenly seems because of something that Meta has done with its CSA AI tooling.
- 24:27Ben Whitelaw: who've been on the wrong end of this.
- 24:28Ben Whitelaw: It also comes at the same time as a, as around 27,000 people have signed a petition, asking meta to, fix its AI moderation and to have a better appeals process.
- 24:40Ben Whitelaw: And so what we're seeing is the kind of swelling of users who are not happy with, basically moderation decisions that have been made And that is a kind of big deal in itself.
- 24:49Ben Whitelaw: We don't, we haven't really seen anything to this extent, I would say, in certainly the years that I've been covering it for everything in moderation since 2018, as many people basically being clued into what, you know, should and shouldn't be allowed when it comes to concept moderation decisions.
- 25:04Ben Whitelaw: there's a couple of other parts to this that I think are really interesting, Mike, but like, what did you make of these stories and like.
- 25:10Ben Whitelaw: do they feel new to you in the way that they do to me?
- 25:13Mike Masnick: no, I, I, to be honest, this sort of felt inevitable to me in some sense, right?
- 25:17Mike Masnick: So like, this is the nature of content moderation, which is that you're constantly making errors and it's.
- 25:22Mike Masnick: Type one or type two errors, false positives, false negatives, and you know, the pressure over the last few years, for obvious reasons, and we should be really clear on this for obvious reasons, right?
- 25:32Mike Masnick: There's pressure on the platforms to deal with CSAM, which is a problem that is on these platforms.
- 25:38Mike Masnick: but the natural end result of that is that because, every few months there's a story in let's say the Wall Street Journal saying that, oh.
- 25:47Mike Masnick: Meta is not taking CS a seriously enough.
- 25:51Mike Masnick: They're going to keep cranking the dials to make sure that that nothing is missed.
- 25:55Mike Masnick: And when you do that, when you crank those dials, you're going to catch other people who are not actually sharing CSAM, but you're going to accuse them of sharing CSA.
- 26:03Mike Masnick: And so this is the trade-offs, right?
- 26:05Mike Masnick: Trust and safety offs and sadness, right?
- 26:07Mike Masnick: Like this is one of the things.
- 26:09Mike Masnick: Either you're catching too much or you're catching too little, and you're gonna get in trouble for either of them.
- 26:13Ben Whitelaw: But I think what is different about this, I would just say is like the extent which people seem to be kinda mobilizing, like I don't think I've ever seen a petition.
- 26:21Ben Whitelaw: where you know anybody really, or let alone 28,000 people have called for something to be done about this.
- 26:28Ben Whitelaw: At least, you know, to memory like there, there may have
- 26:31Mike Masnick: Yeah.
- 26:31Mike Masnick: I mean, there are petitions around, like, people definitely get mad about, bad content moderation decisions and you do see complaints or you see like change.org petitions and stuff like that.
- 26:41Mike Masnick: So, I don't know.
- 26:42Mike Masnick: I mean, it is a little, the, difference here is that like, people were accused of, CS a, which is, you know, horrible and, you know, I'm almost surprised there haven't been.
- 26:51Mike Masnick: defamation lawsuits, which wouldn't work in the US but might work elsewhere around this kind of thing.
- 26:57Mike Masnick: because like, you know, why'd you lose your, Facebook account?
- 27:00Mike Masnick: Well, Facebook says I was sharing c I'm like, that's, that's pretty bad.
- 27:05Ben Whitelaw: very, very damaging for people's careers and for their lives.
- 27:08Ben Whitelaw: I mean, there's a kind of line at the end of the, the stories which.
- 27:11Ben Whitelaw: Many of our listeners will know about where, where there are cases of, child exploitation.
- 27:15Ben Whitelaw: The platforms have to report it to the National Center for Missing and Exploited Children in the us
- 27:20Mike Masnick: we, we've talked about on the podcast
- 27:22Ben Whitelaw: we talked about at length, and we've, we've had some very good guests come and talk about it.
- 27:25Ben Whitelaw: and one of the kind of questions I had was like, if an account, if a user's having their account.
- 27:31Ben Whitelaw: Suspended or taken down for a period of four hours plus it's often weeks in some cases.
- 27:37Ben Whitelaw: Are those people then referred to ncmec and to what extent are there details on a database of people who potentially might be, accessing CSA?
- 27:49Ben Whitelaw: Do you know the answer to that?
- 27:50Mike Masnick: not directly and not clearly, but it does seem that it is likely, right.
- 27:54Mike Masnick: meta is the largest reporter to NCMEC by far.
- 27:58Mike Masnick: This is often used against them, even though it's like evidence of them actually doing what the law requires.
- 28:02Mike Masnick: But they are very clearly, very quick to report content to meta, including details about the accounts.
- 28:10Mike Masnick: That they're accusing of, of sharing CS a m.
- 28:12Mike Masnick: You know, it's a little unclear and we don't know from this reporting, what is making the determination here?
- 28:17Mike Masnick: Do they actually think that, if someone uploads something that they think is CS a m, they will send that to ncmec, including details of the accounts associated with it.
- 28:25Mike Masnick: and there's been all this talk, including, we talked about on the podcast there, there was the report that came outta Stanford, about.
- 28:31Mike Masnick: Ncmec having trouble, understanding which reports are real and serious and which are not.
- 28:35Mike Masnick: And how that problem is only getting more and more serious in the age of ai because, they're getting AI reports, that's still serious, but it's not, it's serious in a different way.
- 28:45Mike Masnick: Like there isn't a child that needs to be rescued.
- 28:47Mike Masnick: and sort of determining which one is, which is important.
- 28:49Mike Masnick: But now if you're also getting a situation where Meta is reporting people who aren't actually sharing CSAM, but ncmec and or their law enforcement partners now have to investigate someone for a bogus report, that's a huge waste of resources as well.
- 29:04Mike Masnick: And again, taking it away from, the actual problems.
- 29:08Ben Whitelaw: Yeah, I mean this is an obvious point, but if you do remember back in January when Mark Zuckerberg.
- 29:13Ben Whitelaw: Recorded a video of
- 29:13Mike Masnick: could I forget, Ben?
- 29:15Ben Whitelaw: in which he said that, uh, this year and ongoing there was, this was gonna be the year of more speech and less mistakes.
- 29:22Mike Masnick: yeah.
- 29:23Mike Masnick: About that.
- 29:23Ben Whitelaw: and, and about, yeah, about that.
- 29:26Ben Whitelaw: So e even, you know, this is.
- 29:28Ben Whitelaw: Sad in a way, but like even the kind of violative content that he said in that video that he was gonna focus on, that his platforms were gonna focus on the illegal stuff, CS a terrorist content, even that stuff there are difficulties detecting.
- 29:41Ben Whitelaw: So there's a kind of grim irony to this story as well.
- 29:44Ben Whitelaw: I am somewhat excited about the user.
- 29:47Ben Whitelaw: I guess, organization though, I'm, I'm ex, you know, I'm excited because it comes alongside, right, this potentially in Europe game changing article, article 21 of the Digital Services Act, which we talked a little bit about before.
- 30:00Ben Whitelaw: And, Alice has written about on everything in moderation.
- 30:03Ben Whitelaw: But essentially it's, an article that allows users to appeal, moderation decisions in a kind of out of court.
- 30:09Ben Whitelaw: situation.
- 30:11Ben Whitelaw: And so rather than having to go through, go to court and pay expensive legal fees and get lawyers to challenge these decisions, there is a lightweight, albeit non-binding situation for the platform.
- 30:22Ben Whitelaw: but a lightweight, cheap way to challenge decisions about account takedown such as this.
- 30:27Ben Whitelaw: And I, you know, again, with great irony this week we saw two of the biggest out of dispute settlement bodies.
- 30:34Ben Whitelaw: The appeal center, Europe and user rights expand the countries and languages that they cover, and also the platforms that they cover.
- 30:41Ben Whitelaw: So you have these kind of two forces at play.
- 30:43Ben Whitelaw: You have, seemingly more people, being caught by ai, filters and, systems and having, accounts and, being taken down.
- 30:53Ben Whitelaw: And you have this also this growing, I guess, uh, ability for users to have those decisions.
- 30:58Ben Whitelaw: Addressed through the, the out of court dispute settlement body.
- 31:02Ben Whitelaw: So I'm wondering how that will play out.
- 31:04Ben Whitelaw: I'm, I'm kind of excited by that in a way.
- 31:05Mike Masnick: Yeah, no, I think, I think it's, you know, this is the advancement of things where it's like, mistakes are made, but, Figuring out how to deal with those mistakes becomes really important.
- 31:14Mike Masnick: And so we're seeing that evolve over time.
- 31:16Mike Masnick: And you know, there's always this push and pull between like, how powerful are the companies versus how powerful are the users.
- 31:22Mike Masnick: I'm always in the long run gonna be on the user side and, and putting more power in the hands of the users.
- 31:27Mike Masnick: And so I think that is an interesting and, and important development to watch.
- 31:30Ben Whitelaw: Yeah.
- 31:31Ben Whitelaw: Okay.
- 31:31Ben Whitelaw: Onto our our next story.
- 31:33Ben Whitelaw: Now, this is also, an AI story.
- 31:35Ben Whitelaw: It's, it's a familiar name and, a familiar platform to, folks.
- 31:39Ben Whitelaw: But I'm afraid this week you've got another grok does something weird and, and, you know, racist, I'm afraid.
- 31:47Ben Whitelaw: Um,
- 31:47Mike Masnick: we had this
- 31:48Ben Whitelaw: us through what, what it's done now.
- 31:49Mike Masnick: had the discussion before we started of like, could we not cover this?
- 31:52Mike Masnick: But it feels like you sort of have to cover it, right?
- 31:54Mike Masnick: So, grok, which is X or X ais, which is now the same companies AI tool.
- 32:01Mike Masnick: Elon Musk announced that it was being improved.
- 32:03Mike Masnick: He had complained recently that, it had gotten too woke.
- 32:07Mike Masnick: Uh, it was giving answers that were criticizing Donald Trump and right-wing extremism, and he kept jumping in saying, this is wrong.
- 32:14Mike Masnick: We can't have this.
- 32:15Mike Masnick: And so they made some edits to the system prompt.
- 32:18Mike Masnick: and similar to, back in May, there was an incident where it suddenly linked everything to white genocide.
- 32:26Ben Whitelaw: Mm,
- 32:26Mike Masnick: Um, it.
- 32:28Mike Masnick: Yeah, it suddenly went full on, Nazi, and it literally said to refer to it as Mecca Hitler, and just started spewing really pretty horrific anti-Semitic things.
- 32:41Mike Masnick: And anytime people were calling it out on, it was like, I'm just telling the truth, man.
- 32:44Mike Masnick: It was like, the extreme sort of.
- 32:46Mike Masnick: You daily Stormer esque, four chan ask, you know, why are you complaining about my antisemitism?
- 32:53Mike Masnick: I'm just, you know, talking about what I see.
- 32:55Mike Masnick: And it was like, pure is if the whole thing was completely trained on these crazy right wing forums, gab and Daily Stormer, and it was pretty bad.
- 33:05Mike Masnick: I mean, to the point where it was like, yeah, call me Mecca Hitler.
- 33:09Mike Masnick: And eventually, they pulled it down and they posted a note saying like, there were some mistakes and we're correcting it, and they, they pulled the whole service down.
- 33:18Mike Masnick: but, this is the thing that happens.
- 33:21Mike Masnick: And, and, and I wrote a little bit about this as well in terms of like.
- 33:24Mike Masnick: It's important for people to realize that any AI system that you use has biases in it, and that's always gonna be the case.
- 33:31Mike Masnick: Like there's biases in the training data, there's bias in the, you know, in the system prompt.
- 33:35Mike Masnick: There's bias in, how the system is set up.
- 33:38Mike Masnick: And there's a really, really good book about this, by the way, called The Alignment Problem by Brian Christian, or Christensen, I forget his last name, sorry.
- 33:45Mike Masnick: Um, and it talks about how there's always bias, but the question is like, how aware are people of the bias and how do you counteract for that?
- 33:52Mike Masnick: And how do you deal with that?
- 33:53Mike Masnick: And, any change that you make to try and make it unbiased, biases it in some other way.
- 33:58Mike Masnick: This is an extreme example of that where in trying to make grok less woke, it turned into a Nazi.
- 34:05Mike Masnick: Uh, but it's like this reminder of like, centralized systems are under the control of someone and that someone can tweak the dials in ways that.
- 34:13Mike Masnick: May not be conducive to good stuff.
- 34:15Mike Masnick: this is, it is still free speech.
- 34:17Mike Masnick: It's not a thing that a say, democratic, attorney General could then go and, and send threatening letters about.
- 34:24Mike Masnick: though European officials have already indicated that they might send angry letters'cause the laws are a little bit different in the eu.
- 34:32Mike Masnick: and so, but it's, it's worth thinking about.
- 34:34Mike Masnick: It's, I, I sort of see it in some ways, as horrific as the speech was that it presented and the things that it was saying.
- 34:40Mike Masnick: it is a very clear reminder that these tools are not neutral, that they are biased and that they are, you know, that there are biases implicit in everything that they do, and it's important for users to understand that as well.
- 34:54Ben Whitelaw: Yeah.
- 34:54Ben Whitelaw: And in the same way we talk about kind of platform liability.
- 34:57Ben Whitelaw: You know, we, we are kind of moving, as we talked about in all of these stories related where kind of AI output liability, you know, where there is a push for companies to be responsible for the outputs of the systems and buried in that, story, that Ft story you talk about, Mike, there's actually a, a line about how, Turkish courts, blocked access to some grt generated content because it said,
- 35:18Mike Masnick: It
- 35:19Ben Whitelaw: you know, insulting things about president, Ergen.
- 35:22Ben Whitelaw: Great guy.
- 35:23Ben Whitelaw: Love his work.
- 35:23Mike Masnick: the, thinnest skinned Erdogan may be the more thin skinned than even Donald Trump.
- 35:28Mike Masnick: Uh, and so, but yes, they ended up blocking all gr content, because it, criticized him as well.
- 35:34Ben Whitelaw: yeah.
- 35:34Ben Whitelaw: So, so yeah, we are, you know, we are in this kind of shift and, and there are, I think, increasing similarities, I think between.
- 35:41Ben Whitelaw: world that we've inhibited, for a while, the kind of platform world where we were expecting platforms to be neutral.
- 35:46Ben Whitelaw: And then they, we realized that they weren't.
- 35:48Ben Whitelaw: And now we're in the, we're kind of speed curving our way through, the fact that we, thought AI systems and LLMs might be neutral and hey, guess what?
- 35:56Ben Whitelaw: They're not.
- 35:57Mike Masnick: and I think, like, I think this is important, right?
- 35:59Mike Masnick: Because like there are people who treat them as sort of like, that they are neutral.
- 36:03Mike Masnick: That you know, oh, you can ask it a question and it'll give you a neutral answer.
- 36:06Mike Masnick: And I think, this is part of the theme of this podcast is that like, they're not, they're never going to be there.
- 36:11Mike Masnick: that's not a thing that is possible.
- 36:12Mike Masnick: Everything is going to be biased in some form or another.
- 36:15Mike Masnick: And understanding those biases are important.
- 36:17Mike Masnick: Most of the time.
- 36:18Mike Masnick: It's very subtle.
- 36:19Mike Masnick: you know, that's where it's much riskier.
- 36:21Mike Masnick: In this case it's so extreme that it becomes obvious, but we shouldn't let that pass by and not use that as a, as a lesson for, all of these tools have biases built in.
- 36:30Mike Masnick: and, you know, as do humans, as do companies, as do as, as everything.
- 36:33Mike Masnick: And assuming that there is some sort of concept of neutrality, here is a mistake in the first place.
- 36:39Ben Whitelaw: yeah.
- 36:39Ben Whitelaw: I agreed.
- 36:40Ben Whitelaw: we've got a couple of kind of, you know, safety tech stories to wrap up.
- 36:44Ben Whitelaw: I think today's mic, one of them is, is a little bit of a crow by me.
- 36:48Ben Whitelaw: I will say a little bit of a,
- 36:50Mike Masnick: Yes.
- 36:50Mike Masnick: Take credit.
- 36:51Ben Whitelaw: Yeah, I think, I think this is fair.
- 36:52Ben Whitelaw: This is a story that one of our listeners, uh, alerted me to.
- 36:56Ben Whitelaw: thanks Toby for picking me on X.
- 36:59Ben Whitelaw: I hadn't logged into X for a while, but, uh, I'm glad I did.
- 37:01Ben Whitelaw: So this is a story from Crikey, an Australian publication.
- 37:06Ben Whitelaw: You might remember a few weeks ago.
- 37:07Ben Whitelaw: I was talking to Bridget Todd about a.
- 37:10Ben Whitelaw: early view of a big age verification report coming out of Australia that the eSafety Commission was, kind of overseeing, it was an overview of all the different age verification techs in the country and was gonna give a view about how they could, help facilitate the social media ban that was coming in later this year and a bunch of other things.
- 37:30Ben Whitelaw: And I said, as Toby kindly points out, that it felt like a kind of.
- 37:34Ben Whitelaw: A report that was like marking its own homework.
- 37:36Ben Whitelaw: It was the kinda report that you would, put out before much longer pat on the back kind of report.
- 37:42Ben Whitelaw: And that report has now been leaked to crikey.
- 37:45Ben Whitelaw: And I'm afraid to say I was right.
- 37:48Ben Whitelaw: Um, it, so a, a, a draft of this report has led some experts to say that the preliminary findings, the ones that Bridget and I talked about were overstated.
- 37:58Ben Whitelaw: And that the trials claims are virgin or misrepresentation.
- 38:01Ben Whitelaw: So again, this is kind of like many things, a, a word of warning, about, safety tech in general.
- 38:07Ben Whitelaw: and, you know, the need, I guess, for regulators to show, I think, you know, progress in terms of setting up.
- 38:15Ben Whitelaw: Safety tech regimes and pushing forwards in a way that is politically, very appealing for voters.
- 38:21Ben Whitelaw: You know, that's, been a big thing in Australia over the last few years.
- 38:24Ben Whitelaw: voters are very pro, uh.
- 38:27Ben Whitelaw: underage users not being, not having access to certain types of content and age verification is a way to get there.
- 38:32Ben Whitelaw: So, allow me this, couple of minutes, Mike, to say that I, my, my, my spidey sense was correct and, that actually, lack of ways we need to kind of make sure we dig into the, the full report and before we decide.
- 38:43Mike Masnick: Yeah.
- 38:44Mike Masnick: And, you know, uh, to some extent, right, I mean, I'll be upfront, like this report confirms my priors, right?
- 38:49Mike Masnick: In terms of like, I am skeptical of age verification technology and the quality of it and the reliability of it.
- 38:55Mike Masnick: And, the interesting thing to me, out of the details that, Crikey has here is suggesting that, the study that was done does not really support the idea that this technology is reliable and yet.
- 39:07Ben Whitelaw: Mm.
- 39:07Mike Masnick: they're trying to present it as in Oh yeah.
- 39:10Mike Masnick: Like we tested and it's great and then the details are not so much, there is a, a large constituency of people who really want to believe that this technology can work and over and over again, tests keep showing.
- 39:24Mike Masnick: Like, not, not really, and like it's, it may be useful in some cases, but people are trying to push it to do a lot of things that it cannot.
- 39:33Mike Masnick: And as much of the rest of this podcast as.
- 39:37Mike Masnick: Suggested today, like relying too heavily on technology to handle these kinds of things can lead to really bad results.
- 39:45Mike Masnick: And, you know, I think people should be more honest about the limitations on these technologies.
- 39:50Ben Whitelaw: Yeah, certainly.
- 39:51Ben Whitelaw: it's almost like we, thought about which stories we should put together in this podcast.
- 39:55Ben Whitelaw: Mike,
- 39:56Mike Masnick: What?
- 39:57Ben Whitelaw: who'd have, who'd have thought it.
- 39:58Ben Whitelaw: Um, and the way in which we've ordered them,
- 40:00Mike Masnick: no, no.
- 40:01Mike Masnick: This all comes naturally.
- 40:02Mike Masnick: This just flows.
- 40:05Ben Whitelaw: don't tell people that's how it works.
- 40:07Ben Whitelaw: Um.
- 40:07Mike Masnick: Don't pull back the curtain.
- 40:10Mike Masnick: I.
- 40:10Ben Whitelaw: Um, talking of the kind of murky world of like third party technology and, and solutions.
- 40:17Ben Whitelaw: There's, you know, you found a, a story from Ireland that, is very similar.
- 40:22Ben Whitelaw: but it's about old school SMS.
- 40:24Ben Whitelaw: You know, this, it's, I love it when SMS comes up in online speech conversations.
- 40:29Mike Masnick: trust and safety content moderation affects all kinds of speech.
- 40:33Ben Whitelaw: Yeah, every vector and surface going.
- 40:36Mike Masnick: So, yeah, so, in Ireland there's, you know, scam texts are an issue, right?
- 40:42Mike Masnick: and so everybody wants to do something about scam texts.
- 40:45Mike Masnick: And so in Ireland they have a, a crackdown on scam texts where there's requirement for labeling texts that might be scam.
- 40:53Mike Masnick: so people are, are receiving texts now that say likely scam, and, you know, I have this on my phone where like phone calls will come with likely scam and like text messages too sometimes will be labeled as potentially spam.
- 41:03Mike Masnick: I love the fact, by the way, that somehow I got on some politician, fundraising list and, my SMS provider has decided that those are mostly spam.
- 41:12Mike Masnick: Wonderful.
- 41:13Mike Masnick: Perfect.
- 41:14Mike Masnick: but this is about, flagging them as scams.
- 41:17Mike Masnick: And there's been all this concern because it's a mess.
- 41:20Mike Masnick: Because how do you label something as a scam?
- 41:22Mike Masnick: And is it right or is it, you know, how, how can you trust it?
- 41:26Mike Masnick: And so people are saying that, legitimate messages from like medical providers are being labeled as scams and that's making people not pay attention to them, which is a real problem.
- 41:36Mike Masnick: And just gets at this whole thing of like.
- 41:38Mike Masnick: Making these decisions, content moderation is impossible to do at scale.
- 41:43Mike Masnick: and here you're trying to do it within, these kinds of, uh, text messages.
- 41:48Mike Masnick: people are responding to it and getting angry that legitimate ones are being labeled scams and, and then, I also found this article by Paul Walsh who was warning about the scam labeling was gonna create problems because it would lead to excess trust.
- 42:01Mike Masnick: If you receive a text message that isn't labeled as a scam, people are gonna think, well, oh, okay, well it's not.
- 42:06Mike Masnick: flagged as a scam, therefore it must be legit.
- 42:08Mike Masnick: And there's like this whole now wide open spot for actual scammers to abuse that figure out ways to send messages that aren't labeled as scams and leading to more trust because people become overreliant on the labeling system.
- 42:22Mike Masnick: And so there are sort of problems in both directions is back to type one, type two problems, right?
- 42:26Mike Masnick: Like all of these things have trade offs and training people.
- 42:30Mike Masnick: That the technology is magic and you can take a shortcut and cheat your way through the system.
- 42:36Mike Masnick: if the system says this is labeled as a scam, then it must be a scam.
- 42:39Mike Masnick: If it doesn't, then it must not be leads to both of the kinds of problems that we're talking about where legitimate texts are being labeled as scams.
- 42:46Mike Masnick: And then actual scammers are gonna be able to, increase the, power of their scams because they can send, messages that aren't labeled that way.
- 42:53Ben Whitelaw: Yeah, and there's like some really good examples in this piece of people who've bought tickets for a, like a sports game, who then.
- 43:00Ben Whitelaw: Get a text to say that, here are your tickets, or here's your confirmation.
- 43:03Ben Whitelaw: But because it's been, it's come from a third party provider that that sports team is using and they are unregistered on this new SMS system.
- 43:12Ben Whitelaw: That's why they get labeled as likely, spam or scam.
- 43:15Ben Whitelaw: And so like.
- 43:16Ben Whitelaw: Again, it's the, the way that these kind of safety tech companies get kind of inserted into the process of, trying to create a kind of safe environment for users.
- 43:27Ben Whitelaw: But it's just never that straightforward.
- 43:29Ben Whitelaw: And, like you say, that text was deleted and you know, you've gotta go and then find your tickets for your, for your sports game.
- 43:36Mike Masnick: Yeah, it's, you know, it's a mess.
- 43:38Mike Masnick: And it's, just this nature of like, we become overreliant on the technology and people sort of assume that the technology, whether it's neutral or not, but that it knows something and it must be right.
- 43:46Mike Masnick: And people are just like, we become overreliant on it in ways that that becomes problematic.
- 43:51Ben Whitelaw: Yeah.
- 43:51Ben Whitelaw: you haven't mentioned media literacy, but I feel like you, you would normally do at this stage, so I'm gonna
- 43:56Mike Masnick: I got, I got yelled at for mentioning media literacy last week, and there was a, a common thread on Teter from someone who was very mad at me about saying media literacy because he says, we don't have time for that.
- 44:07Mike Masnick: And I said, well, that's, I.
- 44:08Mike Masnick: Yeah, but you gotta start now, right?
- 44:10Mike Masnick: I mean, like there is no magic wand.
- 44:13Mike Masnick: all of these things are really difficult problems.
- 44:15Mike Masnick: And if you say, well, media literacy takes too long, you're basically just delaying the inevitable, which is eventually you're going to have to get back there and media literacy is going to be a part of the solution and you have to get there.
- 44:26Ben Whitelaw: Yeah, I love that.
- 44:27Ben Whitelaw: It's like, it's gonna take too long, so
- 44:29Mike Masnick: Yeah.
- 44:29Mike Masnick: Yeah.
- 44:30Mike Masnick: So frustrating.
- 44:31Ben Whitelaw: Okay, well, um, that's a, a little call to action for listeners.
- 44:35Ben Whitelaw: If you want to shout at Mike or I go to Tech Dirt.
- 44:38Ben Whitelaw: There is a specially designed thread and a very excellent comment, system actually that Mike has honed over the years where you can shout at us, Mike May, or make it back to you.
- 44:47Ben Whitelaw: Um, if, if you're lucky, depending on how, Upset he gets.
- 44:51Ben Whitelaw: And, uh, you know, we're also available on other platforms for you to shout at us too.
- 44:55Ben Whitelaw: anything else you wanna, call out today?
- 44:57Ben Whitelaw: Mike?
- 44:57Ben Whitelaw: Any other stories?
- 44:58Ben Whitelaw: any other pieces that we, we missed out?
- 45:00Mike Masnick: Uh, no, I mean, I think that's good.
- 45:02Mike Masnick: I mean, there's always oth, there's always other stories we could keep going, but, but but I think, you know, we, I think we covered a lot of stuff today.
- 45:09Mike Masnick: It, it did have a theme and just to be clear, like we don't, plan out like a full theme and we didn't plan out a full theme.
- 45:15Mike Masnick: It just worked out that a lot of the stories this week sort of matched a theme.
- 45:19Mike Masnick: So.
- 45:20Ben Whitelaw: it's the magic of control alt speech.
- 45:22Ben Whitelaw: Um, I will say that we, we have a very exciting, live edition of control alt speech taking place in a couple of
- 45:28Mike Masnick: yes.
- 45:29Mike Masnick: Trust
- 45:30Ben Whitelaw: that's worth noting.
- 45:31Mike Masnick: If you are attending Trust Con, we will be again, the closing session Wednesday afternoon.
- 45:36Mike Masnick: I think it's four o'clock in the main ballroom.
- 45:39Mike Masnick: It was so much fun last year.
- 45:42Mike Masnick: this year, Ben, you will not be there, but we have other guests and they're going to be wonderful and we'll have a really, really fun discussion.
- 45:49Ben Whitelaw: yeah, it was a real blast.
- 45:50Ben Whitelaw: I'm gutted not to be there.
- 45:52Ben Whitelaw: It's my wife's birthday and, you know, my marriage is at stake.
- 45:56Ben Whitelaw: Uh, I can't miss it twice in two years, so I will watch from
- 46:00Mike Masnick: and you have a new baby.
- 46:01Mike Masnick: And like there's no reason for you to travel halfway around the world.
- 46:04Mike Masnick: Uh, and, and coming to the US right now is a little bit fraught anyways,
- 46:08Ben Whitelaw: Yeah, yeah.
- 46:09Ben Whitelaw: I'd have all my social media profiles, you know, scanned and, you know, searched within an inch of its life.
- 46:15Ben Whitelaw: Uh, maybe I wouldn't be allowed in anyway.
- 46:17Ben Whitelaw: Um, brilliant stuff.
- 46:18Ben Whitelaw: Thanks Mike.
- 46:19Ben Whitelaw: Thanks for taking us through those fantastic stories.
- 46:21Ben Whitelaw: big shout out to all the outlets that we've used today and that we talked about.
- 46:25Ben Whitelaw: B, B, C, the Times, crikey, the Independent.
- 46:28Ben Whitelaw: We've, you know, we've been in a whole bunch of different countries.
- 46:31Ben Whitelaw: Make sure you subscribe to everything in moderation.
- 46:34Ben Whitelaw: Go and recheck that.
- 46:35Ben Whitelaw: Mike has written a couple of excellent pieces on some of the stories we've covered today.
- 46:39Ben Whitelaw: They'll be in the show notes and we'll see you you all next week.
- 46:42Ben Whitelaw: Thanks for tuning in.
- 46:43Ben Whitelaw: Take care.
- 46:47Announcer: Thanks for listening to Ctrl-Alt-Speech.
- 46:49Announcer: Subscribe now to get our weekly episodes as soon as they're released.
- 46:53Announcer: If your company or organization is interested in sponsoring the podcast, contact us by visiting ctrlaltspeech.Com.
- 47:00Announcer: That's C T R L Alt Speech.
- 47:03Announcer: com.
- 47:04Announcer: This podcast is produced with financial support from the Future of Online Trust and Safety Fund, a fiscally sponsored multi donor fund at Global Impact that supports charitable activities to build a more robust, capable, and inclusive trust and safety ecosystem.