Latest / Ctrl-Alt-Speech / Writing Some Wrongs
Transcript
- 0:00Ben Whitelaw: So this week's prompt to start us on control speech mic alludes to a story that we're gonna discuss in our, podcast today.
- 0:07Ben Whitelaw: And that is that of Grammarly Grammarly, the AI editing and, spelling tool.
- 0:13Ben Whitelaw: I use it myself from time to time.
- 0:15Ben Whitelaw: and I know that you have your own little system up, up your sleeve, but the, prompt on the app store that kind of publicizes Grammarly is a kind of perfect start for us on the podcast.
- 0:25Ben Whitelaw: It is, choose the right words, strike the right tone.
- 0:29Ben Whitelaw: So it's maybe less of a prompt, more than an instruction for today's podcast.
- 0:35Ben Whitelaw: Um, what, what is the tone you're gonna be striking today?
- 0:39Mike Masnick: How, how do you answer that one?
- 0:40Mike Masnick: So, I mean, I will say, as I mentioned to you before we started, and as you may have noticed, my voice is not entirely here this week.
- 0:49Mike Masnick: I, I seemed, I woke up this morning, I'm fine, otherwise I don't feel sick in any other way, but my voice slightly disappeared.
- 0:57Mike Masnick: So I am going to try and choose words that will actually come out of my throat and strike the right tone in that it is this, uh, slightly, slightly off, tone.
- 1:09Ben Whitelaw: Anything that is audible today is, is
- 1:11Mike Masnick: Yes, yes.
- 1:12Mike Masnick: It would be a bonus.
- 1:13Mike Masnick: Uh, what about you?
- 1:14Mike Masnick: What, words are you choosing properly here?
- 1:18Ben Whitelaw: Well, I mean, I'd like to think on controlled speech, we, take a fairly pragmatic and, and sometimes positive, tone.
- 1:25Ben Whitelaw: You know, we try to keep a measured response to all of the, chaos ensuing in relation to the stories we discussed.
- 1:31Ben Whitelaw: But, you know, I'm feeling a bit despondent today, Mike.
- 1:34Ben Whitelaw: my tone is one of, bleakness to be honest.
- 1:36Ben Whitelaw: And, but the stories that we cover are, are not for the faint hearted.
- 1:41Ben Whitelaw: And, you know, they did leave me feeling a bit, a bit like, what have we got in store in the future?
- 1:46Ben Whitelaw: Where are we going?
- 1:47Ben Whitelaw: So maybe talking through it today will help.
- 1:50Mike Masnick: it's your therapy session.
- 1:51Ben Whitelaw: same thing.
- 1:52Ben Whitelaw: Yeah.
- 1:53Ben Whitelaw: Let's see how this pans out.
- 2:05Ben Whitelaw: And welcome to Control Alt Speech, your weekly roundup of the major stories about online speech, content moderation, and internet regulation.
- 2:12Ben Whitelaw: It's March the 12th, 2026, and this week we're talking about an AI tool that's riled up writers, a new documentary about platform safety and WhatsApp finally coming to the parental controls party.
- 2:23Ben Whitelaw: My name is Ben Whitelaw.
- 2:24Ben Whitelaw: I'm the founder and editor of Everything in Moderation, and I'm joined by a real life.
- 2:29Ben Whitelaw: Mike Masnick.
- 2:31Ben Whitelaw: He's back, everyone.
- 2:33Ben Whitelaw: How are you doing,
- 2:34Mike Masnick: I am, I'm doing okay.
- 2:35Mike Masnick: There was a podcast with both of us last week.
- 2:38Mike Masnick: It's just, we had recorded it way before, but this is the first time in, in a while that, uh, you and I have chatted.
- 2:45Mike Masnick: it's been a little while.
- 2:46Mike Masnick: I have been traveling.
- 2:48Mike Masnick: We've had a bunch of wonderful guest hosts.
- 2:51Mike Masnick: We had the banked episode that we did.
- 2:53Mike Masnick: Uh, this is the first sort of, we're not quite live, but live ish episode that we've done in a month, I think between the two of
- 3:01Ben Whitelaw: yeah, yeah, for sure.
- 3:03Ben Whitelaw: I mean, we haven't done a kind of news roundup for, for a good few weeks.
- 3:07Ben Whitelaw: and I, I do like the kind of you know, the very mysterious nature of, of your introduction, there's like, I've been traveling, I've been, I've, I've been
- 3:15Mike Masnick: I've been places.
- 3:16Mike Masnick: Yeah.
- 3:16Mike Masnick: Yeah.
- 3:17Mike Masnick: I've seen things, Ben, I've seen things,
- 3:20Ben Whitelaw: Don't ask me any more about it.
- 3:23Mike Masnick: uh,
- 3:24Ben Whitelaw: but it's, it's very good to have you back.
- 3:26Ben Whitelaw: yeah.
- 3:26Ben Whitelaw: I've missed chatting to you about each week's stories and we've got a lot to get into.
- 3:31Ben Whitelaw: Let's crack on with today's episode because we've, we've got a lot to chat through.
- 3:35Ben Whitelaw: And before we do your usual reminder to like the podcast rate and review us wherever you, get your podcast.
- 3:42Ben Whitelaw: we haven't had a review in a few weeks now.
- 3:45Ben Whitelaw: Um, probably a few, a bit longer than that actually.
- 3:48Ben Whitelaw: Um,
- 3:49Mike Masnick: but.
- 3:49Ben Whitelaw: yeah, it's been a barren period for controlled speech, but we are getting a few comments on Spotify.
- 3:55Ben Whitelaw: so that's been nice to have some, some engagement there.
- 3:58Ben Whitelaw: we will definitely get back in touch on, Spotify if they leave a comment and we're getting a few emails as well, which is great podcast@controlaltspeech.com.
- 4:05Ben Whitelaw: really enjoy listening to our listeners.
- 4:07Ben Whitelaw: we actually had a, a really interesting email that I'll bring to you, Mike, which.
- 4:11Ben Whitelaw: I've had a good discussion with, with the listener about, and that was a, some criticism about the way that I talked about team councils a few weeks ago.
- 4:19Ben Whitelaw: and what's been really nice is to have a kind of really frank and open conversation with, with our listener about why we, talked about the team council announcement from Discord and the way we did, whether it was a fair assessment of the story and, you know, that kind of interaction is, is really important for us on the podcast and I think important for our listeners as well.
- 4:38Ben Whitelaw: So, you know, we do read and reply to every email we get and, really grateful for people who've taken the time to listen and also get in touch as well.
- 4:47Ben Whitelaw: So, yeah, don't be shy.
- 4:49Mike Masnick: I'll also jump in and mention, as a reminder, we are always looking for sponsors for the podcast.
- 4:56Mike Masnick: come on the podcast, talk to us.
- 4:58Mike Masnick: Part of the sponsorship is that we will have a very fun and interesting interview with you or someone that you designate, and we are always looking for new sponsors.
- 5:07Ben Whitelaw: Yeah, for sure.
- 5:07Ben Whitelaw: I mean, this podcast, doesn't pay the bills without you guys.
- 5:12Ben Whitelaw: I think that that's fair to say if you, if you enjoy the podcast, if you listen to it, if you find it valuable, yeah, do get about becoming a sponsor.
- 5:20Ben Whitelaw: Um, we are thinking about other ways to, allow regular listeners to support the podcast in New Ways.
- 5:26Ben Whitelaw: Will be coming back to you with more information on that soon.
- 5:29Ben Whitelaw: but yeah, big shout out for our sponsors.
- 5:31Ben Whitelaw: Everyone who's, been a previous sponsor, we salute you.
- 5:34Ben Whitelaw: we've also got our control speech Bing Go card for 2026, which we lovingly crafted at the start of this year.
- 5:42Ben Whitelaw: We got some help from our listeners to come up with some bingo card squares.
- 5:46Ben Whitelaw: we haven't had anybody.
- 5:47Ben Whitelaw: Tell us that they've won yet, Mike.
- 5:49Ben Whitelaw: but it's, it's a matter of time.
- 5:51Ben Whitelaw: And, you know, there's a few stories today that I think hit a couple of the squares.
- 5:55Ben Whitelaw: particularly about, AI missteps not least, and, and also some platform CEOs that crop up from time to time.
- 6:03Ben Whitelaw: So play that wherever you are listening, control alt speech.com/bingo.
- 6:08Ben Whitelaw: and let us know how you get on.
- 6:10Ben Whitelaw: So, let's crack on with today's stories, Mike.
- 6:12Ben Whitelaw: we've got, a few really interesting of, of real varied mix of stories actually this week.
- 6:17Ben Whitelaw: and we're gonna start off with, that AI tool that has riled up writers.
- 6:22Ben Whitelaw: you are not one of those writers that have been riled up, are you?
- 6:27Mike Masnick: I mean, I'm, I'm riled up in some ways, but perhaps differently than, than most people who have been really riled up by this.
- 6:33Mike Masnick: yeah, so this is from Grammarly, though.
- 6:36Mike Masnick: I should note though, nobody is saying this Grammarly changed their name.
- 6:41Mike Masnick: They're, they're no longer called Grammarly.
- 6:42Mike Masnick: They're now superhuman, which was, they bought another company that was called Superhuman and in the process took on their name, but everybody still calls them.
- 6:51Mike Masnick: Grammarly and Grammarly, you know, was this sort of simple plugin that, gave you grammar advice as you wrote?
- 6:58Mike Masnick: I had used it many, many years ago, kind of when it first launched, and then I found it wasn't that helpful and I, I stopped and now I have a million other tools that I use.
- 7:07Mike Masnick: So I've never gotten back on the, the Grammarly train, but I know it is very widely used.
- 7:12Mike Masnick: It's probably the most widely used grammar tool, but obviously in the last few years they've been launching a bunch of different AI related tools.
- 7:20Mike Masnick: I know that they have AI writing tools that have sort of mixed reviews.
- 7:25Mike Masnick: I know that they have an AI detector that also has very mixed reviews, but apparently back in August they launched a new feature which didn't get much notice at the time, which was what they called like expert reviews.
- 7:39Mike Masnick: So they could, you could review your piece of writing and it would sort of.
- 7:44Mike Masnick: Suggest that famous people or experts in various topics, you would get advice as if they were reviewing your piece.
- 7:53Mike Masnick: And so, there was Stephen King could review your horror novel that you were working on.
- 8:00Mike Masnick: or, you know, a, a bunch of other, famous and, and in some cases not so famous people.
- 8:06Mike Masnick: And, and it was sort of a strange feature in that it wasn't like you couldn't.
- 8:10Mike Masnick: Ask Stephen King, the fake Stephen King, Stephen King bought to review your piece.
- 8:16Mike Masnick: But it would sort of say like, we'll give you suggestions like what, a Stephen King would suggest.
- 8:22Mike Masnick: And it was sort of, you know, it, it was sort of mixed in this weird way and would make sort of vague suggestions, not very interesting suggestions from what I've seen.
- 8:33Mike Masnick: and so somebody noticed it last week sometime and posted about it on social media, and was sort of saying like, Hey, this is weird.
- 8:42Mike Masnick: Like, I don't think, I was never asked permission for this, whatever.
- 8:45Mike Masnick: Then Casey Newton, our recent.
- 8:48Mike Masnick: Control Alt speech guest host, Casey Newton, wrote a thing about it, noting that he himself was one of the people, and he spoke to other people, including Kara Swisher, who seemed, you know, as Kara Swisher does, particularly pissed off about the, the use of her name without permission.
- 9:07Mike Masnick: and a bunch of other authors as well.
- 9:08Mike Masnick: And then more and more people started looking and everybody got very angry about it.
- 9:12Mike Masnick: because Casey had reached out to Grammarly, they had told him, oh, you know, if someone is upset, they can email us at this, like, expert opt out address, which was weird, right?
- 9:25Mike Masnick: So the whole, you know, part of the reason why everybody's so angry is that.
- 9:28Mike Masnick: most of the people involved were never asked, as far as I can tell.
- 9:31Mike Masnick: All of the people whose names were used were never asked.
- 9:35Mike Masnick: they were never certainly offered any compensation, but they weren't even asked if, if it was okay to use your name.
- 9:40Ben Whitelaw: Mm-hmm.
- 9:41Mike Masnick: And, to then have it be opt out.
- 9:44Mike Masnick: Like, I have no idea if I'm on that list.
- 9:48Mike Masnick: might be, I might not be.
- 9:49Mike Masnick: I, it wouldn't surprise me either way.
- 9:52Mike Masnick: but like, if I didn't wanna do it, do I just have to guess and then send them an opt out and say, Hey, take my name off of this if you've used it.
- 10:00Mike Masnick: That seems not great either.
- 10:03Mike Masnick: and then so as sort of the storm sort of kept growing about this, they finally announced yesterday Wednesday that they were shutting down the feature and, you know, there was a, a weak apology posted to LinkedIn.
- 10:17Mike Masnick: the, the sort of usual corporate apology, not quite what we meant.
- 10:21Mike Masnick: You know, we, we should have taken more care, blah, blah, blah.
- 10:25Mike Masnick: not very interesting at about the exact same time that the CEO posted this apology and saying we're taking it down.
- 10:33Mike Masnick: There was also a potentially class action lawsuit filed by Julia Anguin, famous, journalist, who was one of the names.
- 10:42Mike Masnick: She only found out about that.
- 10:44Mike Masnick: She was in it from Casey Newton writing about it, seeing her name mentioning it, and she had posted on Blue Sky.
- 10:50Mike Masnick: She was like, wait, what?
- 10:51Mike Masnick: I'm included in this.
- 10:53Mike Masnick: And then a day later there was a lawsuit filed and the lawsuit is potentially actually interesting.
- 10:59Mike Masnick: Because it's arguing over publicity rights.
- 11:01Mike Masnick: A lot of people saw this and, and thought like there was like a defamation thing.
- 11:05Mike Masnick: It's not defamation.
- 11:06Mike Masnick: Defamation is something very different than this, but there are publicity rights laws, and they're a little bit of a mess because in the, in the US there's no federal publicity rights law.
- 11:17Mike Masnick: It's state by state.
- 11:18Mike Masnick: Some states have them, most states have something, but a lot of them don't.
- 11:23Mike Masnick: But the, publicity rights laws are generally meant to be about like false endorsement.
- 11:30Mike Masnick: You can't put an advertisement up saying, Ben Whitelaw loves.
- 11:35Mike Masnick: This book or whatever if you haven't actually endorsed it.
- 11:39Mike Masnick: and that was the point of it.
- 11:40Mike Masnick: Those laws have now been really kind of misused, I think in many ways over anything related to the use of someone's name mentioning someone.
- 11:51Mike Masnick: There are a whole bunch of cases that I think have been really abusive and, attempt to sort of censor speech in some form or another by abusing these laws.
- 12:00Mike Masnick: But this feels like exactly what these laws were supposed to be.
- 12:03Mike Masnick: If, if a user of Grammarly sees like, get advice from Stephen King, they're going to think that Stephen King said okay to that.
- 12:11Mike Masnick: don't think that there's any way that, you know, it feels like the lawsuit makes a, a fair bit of sense.
- 12:18Mike Masnick: and I'm one who feels that, you know, most of these publicity rights, laws are, are kind of a mess and, and not well used.
- 12:25Mike Masnick: But in this case it kind of feels like what it, what it's for.
- 12:28Ben Whitelaw: Yeah, it's a bit of a mess, isn't it?
- 12:30Ben Whitelaw: It's, it's, if you kind of put aside the fact that this is a feature that has been in the public domain for six months and there's never got traction enough for people to notice.
- 12:41Ben Whitelaw: Putting that aside for one second, um, you know, I think the kind of row back on this is symptomatic, I think of a bunch of things.
- 12:47Ben Whitelaw: It's, it's symptomatic of how.
- 12:50Ben Whitelaw: AI companies are, doing product releases and, and, updating their, products or their platforms with AI features that are shitty in a lot of cases and don't have any thought in them, whether that's from a safety perspective or otherwise.
- 13:05Ben Whitelaw: And also, kind of this broader point, I guess, which is that everyone is being affected by AI systems in ways that they're kind of, would never have, never thought to have been, you know, it's obviously a big story in some senses for the writers involved, but that kind of broader point here is that, everyone's content is in these LLMs everyone's, information is being used to train them.
- 13:29Ben Whitelaw: the fact that Casey Newton, Julia Anguin, their names are being used.
- 13:34Ben Whitelaw: In this kind of expert review, guys, is really just the tip of the iceberg.
- 13:38Ben Whitelaw: and it's, only stories like this that I think will make people realize the kind of broader public, realize you know, what we're contending with here.
- 13:45Ben Whitelaw: in terms of the, the kind of mass use of people's information, content data to, to create these systems.
- 13:51Mike Masnick: Yeah.
- 13:52Mike Masnick: And it's like, I mean, there are different elements to that.
- 13:55Mike Masnick: You know, there's a part of me that.
- 13:57Mike Masnick: You know, I, I don't think it's wrong or bad to train AI systems on content, and I know that there are lots of people who disagree with me on that, and I, I understand where they're coming from.
- 14:10Mike Masnick: I just think that.
- 14:12Mike Masnick: if you think through the nature of how people learn and how people express themselves, it's often by, reading works from other people and learning from that and building on it.
- 14:24Mike Masnick: And creativity is always people starting from, you know, trying to copy someone else's work and then adding their own voice into it and learning their own voice.
- 14:32Mike Masnick: And to have a computer system do that as well.
- 14:35Mike Masnick: Seems to me, to be totally fair.
- 14:38Mike Masnick: This is why I've argued that the training of LLMs should be considered fair use.
- 14:43Mike Masnick: Again, I understand people have conceptual differences with that and feel differently.
- 14:48Mike Masnick: There are lawsuits about it.
- 14:50Mike Masnick: We'll see where they come out in the end.
- 14:53Mike Masnick: So like, the idea of learning from others I think is a natural instinct, even if it's a computer system.
- 15:01Mike Masnick: But that is different than.
- 15:02Mike Masnick: Then going out and presenting it as here, get help from Stephen King.
- 15:08Mike Masnick: Right.
- 15:09Mike Masnick: and, you know, I was thinking about it again, like, I have no idea if I'm included in this.
- 15:14Mike Masnick: if I was, it doesn't upset me as much as it upsets other people, but that is also like, I'm not particularly proprietary about anything that I do.
- 15:24Mike Masnick: Um,
- 15:25Ben Whitelaw: Would you be more upset to be included or to be not
- 15:27Mike Masnick: yeah, that's, that's a good question.
- 15:28Mike Masnick: That's a good question.
- 15:29Mike Masnick: It, it might be the latter.
- 15:33Ben Whitelaw: I appreciate your honesty.
- 15:34Mike Masnick: Yeah, it might be the latter.
- 15:36Mike Masnick: Uh, but the thing that would upset me more, I think is if I was included and it was giving really bad advice, and that seems to be the case.
- 15:45Mike Masnick: Like I've seen the advice that it is giving, that these expert reviews are giving and it seems really generic and
- 15:52Ben Whitelaw: Yeah.
- 15:53Mike Masnick: Like not, particularly helpful at all.
- 15:56Mike Masnick: and I don't understand.
- 15:58Mike Masnick: There's a, there's a bunch of things about this that I don't understand.
- 16:01Mike Masnick: I don't understand how they release this product without reviewing it and thinking through, you know, we've discussed in the past on like, on safety features, right?
- 16:10Mike Masnick: having trust and safety teams in the process from an early stage, not going to them a week before you're going to release and saying, Hey, are there any trust and safety concerns about this?
- 16:21Mike Masnick: But like, the process of releasing a new feature or a new product should involve, multiple stakeholders within the company who can look at the possible risks and challenges and opportunities associated with the product.
- 16:34Ben Whitelaw: Yeah.
- 16:34Mike Masnick: wondering if this was kind of, you know, we're in the age of AI vibe coding stuff.
- 16:40Mike Masnick: I'm a fan of that, but like.
- 16:43Mike Masnick: It feels like maybe this was just like a vibe coded feature.
- 16:46Mike Masnick: Some engineer was like, Hey, I know what we can do, and then they just ran with it and never thought about the consequences of, of this.
- 16:53Mike Masnick: Or never had a lawyer review it or never had, other people within the company who think about, the trust side of trust and safety.
- 17:01Mike Masnick: Like this is a, the type of feature that, diminishes trust rather than increases it.
- 17:06Mike Masnick: and I don't understand how they got there and, you know, it seems like the kind of thing where a company that size could easily have just asked people and said Hey, are you interested?
- 17:18Mike Masnick: Maybe throw them a little bit of money.
- 17:20Mike Masnick: Like, I don't even think it would be that much.
- 17:22Mike Masnick: And just say like, Hey, we'd like to, you know, we've trained something on you.
- 17:26Mike Masnick: And like I, I mentioned this to you without going into too much details, like I've played around with, you know, I have these tools that I use to edit my stuff.
- 17:35Mike Masnick: I've played around with a feature kind of like this that I built myself just more to see if it worked, like feed, the tool, a really famous author's work and just say like, if this person were editing this piece, how would they edit it?
- 17:50Mike Masnick: And it's just sort of like, it's like a parlor trick kind of thing where it's like, oh, that's kind of funny.
- 17:55Mike Masnick: Like, I can see why it would do this thing.
- 17:58Mike Masnick: It looks like the Grammarly thing isn't even doing.
- 18:02Mike Masnick: It's just sort of like pasting fairly generic advice under the name of someone famous or like, you know, famous within a certain area for the exact reasons why we have publicity rights laws.
- 18:14Mike Masnick: Like just to, trade off of their, famous name.
- 18:17Ben Whitelaw: Yeah, and it does feel like a kind of missed opportunity from a product
- 18:21Mike Masnick: Yeah.
- 18:22Mike Masnick: Oh,
- 18:22Ben Whitelaw: You know, it's, it, Grammarly could have taken this as an opportunity to pay editors and writers for the way that they edit to get a breakdown of how they think about editing, or think about writing, which Casey Newton, you know, provided in his newsletter this week.
- 18:40Ben Whitelaw: As he spoke about this story, and then he could have trained, you know, mini models on, Casey's particular way of editing, and then that would've been a super helpful feature.
- 18:48Ben Whitelaw: It would've, paid some money back to Casey for crafting or for honing his craft after over years and years and years.
- 18:55Ben Whitelaw: And you could have done that at scale and, and had a, fairly positive, benefit to users, to the platform and to the editors upon which that was trained.
- 19:04Ben Whitelaw: as it's turned out, they'd missed that opportunity.
- 19:07Ben Whitelaw: and I, that kind of made me think about, I guess, how product safety and product design is being increasingly talked about, in a lot of the work we do, Mike, you know, if you go back to the kind of EU investigations that have been opened recently, against TikTok, the focus is on product design.
- 19:22Ben Whitelaw: It's on addictive design.
- 19:23Ben Whitelaw: It's on the lack of thinking that goes into releasing features.
- 19:28Ben Whitelaw: That positively Im impact users generally speaking.
- 19:31Ben Whitelaw: And I, and I, I wonder if kind of product folks are left out of these kinds of conversations.
- 19:36Ben Whitelaw: I wonder how many listeners that we have are, are focused on product or product managers or engineers or people who, are building some of these products.
- 19:44Ben Whitelaw: 'cause we know that we, speak to and are listened by lots of policy folks and regulators and academics and, and journalists.
- 19:52Ben Whitelaw: But almost like products folks don't tend to have the kind of sensibilities that we're, hoping that they would have in order to roll out a feature like this.
- 20:01Ben Whitelaw: again, I would love to talk to kind of product people as to how they think about these things.
- 20:06Ben Whitelaw: But yeah, that's where the, the gap is for me.
- 20:09Ben Whitelaw: Is that Product people.
- 20:10Ben Whitelaw: Having the, trust and safety sensibilities.
- 20:13Ben Whitelaw: Thinking ahead, thinking about how this might have secondary impacts on segments of users like editors, because that's really where this, this has fallen down.
- 20:22Mike Masnick: Yeah, I mean, I think you know, I think there are different stages to this and I think, you know, I always look at the cybersecurity side, where, for a long time it felt like security was kind of an afterthought for a lot of products that were released.
- 20:36Mike Masnick: And then it got, there were so many huge breaches and problems that it became central to most companies.
- 20:44Mike Masnick: Like, oh, we have to build from the beginning, security by design.
- 20:48Mike Masnick: think about the security aspects from the very start.
- 20:51Mike Masnick: And you know, most companies now are pretty thoughtful about that.
- 20:54Mike Masnick: But I'm wondering if, we need more of that in.
- 20:58Mike Masnick: not, you know, when we think about trust and safety, we sort of lean heavily on the safety side, I think
- 21:03Ben Whitelaw: Mm
- 21:03Mike Masnick: understandable reasons.
- 21:04Mike Masnick: But the trust part of it is actually really important too.
- 21:07Mike Masnick: and I really wonder how much more, we need to make it core to everything that people build from the start.
- 21:13Mike Masnick: Think about the trust side of it.
- 21:16Mike Masnick: Like you wanna build a product that people like to use, that you have a trusting relationship between the company and the user.
- 21:23Mike Masnick: and something like this burns trust in all sorts of ways.
- 21:27Mike Masnick: Like in a really big and powerful way.
- 21:29Mike Masnick: Like, I don't trust that company anymore.
- 21:32Ben Whitelaw: No, and it, and it's obviously hard to get that trust back.
- 21:35Ben Whitelaw: that's something we've seen across both platforms, but also media in the past, other institutions who've, once you lose trust, it's very hard to kind of regain it.
- 21:44Ben Whitelaw: I think this feels like a continuation of, the assault on, Verification as a product feature when we talked about this in relation to primarily Twitter slash x in the past, but verification, is the, proving that somebody is who they say they are.
- 22:00Ben Whitelaw: And, it's not exactly the same in the Grammarly's case as it is to, Twitter or to other platforms that previously gave users a blue check as a way of authenticating who they are.
- 22:11Ben Whitelaw: But it, it's, it's a similar thing.
- 22:13Ben Whitelaw: I would say it's, it's kind of on that continuum where people now are, are not necessarily who they say they are on these platforms.
- 22:22Ben Whitelaw: And that is a problem, that is a problem whether you are reading their posts, it's a problem whether you are getting editing advice from them.
- 22:29Ben Whitelaw: and I would love, again, it's a shame that Grammarly didn't take this as an opportunity to.
- 22:34Ben Whitelaw: add back into that part of, you know, we're trying to authenticate people and, use their credibility in ways that benefits us as a platform, but also the users who use our
- 22:45Mike Masnick: again, like, you know, they could have found enough people, enough well-known people that they could have thrown a little bit of money at, and the product would've been wonderful and like, like a really exciting product I think that everybody was happy with and that they, opted into and to go this other way, I, I'm, I'm just like, my mind is blown, like the, they thought this was a good idea, that anyone thought this was a good idea.
- 23:10Ben Whitelaw: I think somebody's probably gonna go and build.
- 23:13Mike Masnick: Sure.
- 23:13Ben Whitelaw: that we're talking about.
- 23:14Ben Whitelaw: That might be you, it might be you, it might be that your vibe coded, vibe coded editor gets a few upgrades and you know, it sounds a bit like Casey Newton soon.
- 23:22Ben Whitelaw: But, um, I think one last thing I'd say on it before we move on is like, isn't it ironic that, there's this long standing debate, I think as to whether kind of AI generated text is better than a human generated text.
- 23:33Ben Whitelaw: And here we have a situation where a tool is using the reputation of humans in order to validate AI generated suggestions.
- 23:45Ben Whitelaw: Right?
- 23:45Ben Whitelaw: There's something kind of very perverse about that and very ironic.
- 23:48Ben Whitelaw: It's like, okay, well you might think there's a New York Times quiz this week that our producer Lee shared, and you can choose between an AI generated text and a human generated text.
- 23:58Ben Whitelaw: In some ways it doesn't matter.
- 24:01Ben Whitelaw: Because if, you know, if grammarly's viewpoint is to be believed, people are always going to want suggestions and recommendations from people that they trust.
- 24:09Ben Whitelaw: And so there is gonna be a role for, people who have honed their craft in whatever field it is, it's just that Grammarly have, have failed to see that, or recognize that was quite the case
- 24:19Mike Masnick: Yeah.
- 24:20Ben Whitelaw: anyway.
- 24:21Ben Whitelaw: interesting.
- 24:21Ben Whitelaw: First, first story of the week.
- 24:23Ben Whitelaw: It's definitely been doing the rounds.
- 24:25Ben Whitelaw: A story that people may be less, aware of.
- 24:28Ben Whitelaw: Um, something I've been following is the release of a new documentary called Molly versus the Machines.
- 24:35Ben Whitelaw: Now this came out in the UK last week.
- 24:38Ben Whitelaw: I believe it's in the US on Apple tv.
- 24:41Ben Whitelaw: You haven't seen it,
- 24:42Mike Masnick: I have not seen It No.
- 24:44Ben Whitelaw: No.
- 24:44Ben Whitelaw: Okay.
- 24:45Ben Whitelaw: but I think it's worth talking about, for a number of reasons.
- 24:48Ben Whitelaw: The Molly Russell Case that the documentary looks into, and recaps took place in 2017.
- 24:55Ben Whitelaw: Molly Russell was a, a teenager who took her own life after consuming, content on social media platforms.
- 25:01Ben Whitelaw: That was the verdict of the coroner's court, after her death.
- 25:05Ben Whitelaw: And it was an important moment in the UK because it raised the issues of online safety to a much broader audience, of parents who didn't realize that social platforms could be dangerous.
- 25:17Ben Whitelaw: And Molly's Daddy and Russell has become a campaigner since then.
- 25:22Ben Whitelaw: Advocating for kind of thoughtful regulation that keeps children safe online.
- 25:27Ben Whitelaw: and we'll talk a bit about him in a second.
- 25:29Ben Whitelaw: That moment, Molly's death.
- 25:31Ben Whitelaw: And the, the work done by her dad and the Molly Rose Foundation that's been set up in her name subsequently, has also led, I think, to the kind of online safety act in the uk.
- 25:42Ben Whitelaw: And, and that has obviously spawned a number of other kind of regulatory, impetus in other countries.
- 25:47Ben Whitelaw: And so it's important I think, for us to kind of reflect on the documentary from that sense.
- 25:52Ben Whitelaw: I won't give too many spoilers'cause I think people might go and watch it, but I think what I would just kind say is that, the documentary kind of very skillfully weaves, Molly's, stages of her early life.
- 26:04Ben Whitelaw: Together, kind of her friends and her dad and bringing together kind of family members who knew her in those early stages and then lays out really what happens, in the, time before she, she took her life.
- 26:17Ben Whitelaw: it kind of very clever visually because it uses a couple of devices that I think are really interesting as a way of showing the, her journey towards taking her own life.
- 26:28Ben Whitelaw: And one of those is the fact that there's a lot of, there's an AI chatbot coincidentally that the director essentially types into, to show particular elements of the story.
- 26:41Ben Whitelaw: And I was reading more about how the documentary is produced.
- 26:44Ben Whitelaw: And there were some elements that were actually AI generated.
- 26:46Ben Whitelaw: And so that device that typing, going into a chat bot and the responses that come out, which are in an American accent, that kind of really sets up the, the tension of the story, which is this kind of teenager who is, growing up in a world where she's spending a lot of time on Pinterest and Instagram, and these kind of large Silicon Valley companies who almost you kind of can't stand up to is, is the narrative.
- 27:12Ben Whitelaw: there's a strong element here about surveillance capitalism and, the way that big tech companies have, sucked up data from users and, used that to predict what will engage consumers online.
- 27:24Ben Whitelaw: You know, Molly Was consuming over 2000 suicide posts in the months before she, took her own life, and that was a big part of the coroner's trial kind of took place afterwards.
- 27:37Ben Whitelaw: And so that's a really interesting thread that runs through the whole documentary.
- 27:41Ben Whitelaw: It's slightly kind of, it runs slightly counter to the very personal stories from her dad and also the very robust interviews with experts who have worked in trust and safety previously.
- 27:53Ben Whitelaw: I'm not sure if the, that theme of surveillance capitalism quite worked, but, the documentary was actually co-written by Shasana Zubov, who is a, a name that many people will know who, has worked and written about surveillance capitalism for a long time.
- 28:07Mike Masnick: She She coined the phrase.
- 28:08Mike Masnick: yeah.
- 28:09Ben Whitelaw: yeah.
- 28:09Ben Whitelaw: so that's where that comes from.
- 28:11Ben Whitelaw: Broadly speaking, really interesting documentary.
- 28:14Ben Whitelaw: it's going to, I think, shift the perceptions, at least in the UK of a lot of people's views on online safety and platforms, and will add to this fuel, I think, to, ban social media for under sixteens and potentially, regulate social media platforms in other ways.
- 28:29Ben Whitelaw: So, just wanted to bring that to our listeners, Mike, and to, to share a little bit more of, yeah, what that documentary entails without giving the game away too much.
- 28:36Mike Masnick: Yeah.
- 28:37Mike Masnick: I mean, I'm, I'm interested.
- 28:39Mike Masnick: I'll, I'll watch it at some point.
- 28:40Mike Masnick: I'm sure I'm a little.
- 28:42Mike Masnick: skeptical of that sort of framing.
- 28:45Mike Masnick: you know, I sort of think back to the social dilemma documentary, which was a big deal on Netflix and definitely drove a lot of the conversation I thought was incredibly misleading.
- 28:56Mike Masnick: you know, I, I can't comment directly on this one because I haven't seen it, but, you know, some of the framing, at least as you've described it, also sounds to me potentially misleading.
- 29:06Mike Masnick: And I think that doing a documentary, looking back at someone who ended up taking their own life is, emotionally colored by the ending that everybody knows.
- 29:19Mike Masnick: And you can look at things and say, oh, well they did this, and then they, they ended up taking their life.
- 29:27Mike Masnick: but making that true causal connection, nobody can know what.
- 29:33Mike Masnick: Was the final straw, what made her make that, unfortunate decision?
- 29:38Mike Masnick: and I worry about stories that try to automatically associate it with, oh, they, spent a lot of time on Instagram and therefore Instagram must have been at fault.
- 29:48Mike Masnick: Or, any of these things you can color it by because we don't know.
- 29:54Mike Masnick: And there are also lots of stories of young people in trouble who found communities on social media that help them.
- 30:04Mike Masnick: And so to jump from one to the other, that one is inherently bad or causal or that a particular setup or structure is bad.
- 30:15Mike Masnick: Strikes me as emotionally manipulative in ways that are not necessarily accurate.
- 30:20Mike Masnick: I sort of feel that way about the, surveillance capitalism as a term.
- 30:24Mike Masnick: I think it's terrible.
- 30:25Mike Masnick: I thought Shoshana's book is not particularly good.
- 30:27Mike Masnick: I don't necessarily need to go down that road.
- 30:30Mike Masnick: I think it's misleading and confusing and, and not an accurate portrayal of how companies actually make these decisions.
- 30:39Mike Masnick: there is obviously no doubt like capitalism exists and companies are built to try and make money and to extract profits.
- 30:47Mike Masnick: That's the nature of capitalism itself.
- 30:50Mike Masnick: but I think that Shoshana's book in particular was.
- 30:55Mike Masnick: Very, very inaccurate in terms of what the decision making is like and why those decisions are made and the nature of the nuances behind all of these decisions.
- 31:06Mike Masnick: And I fear that you end up in a similar spot with again, I haven't seen the documentary.
- 31:11Mike Masnick: I'm sure it's a very good documentary, but I worry about the sort of emotional tug of this, that it's very easy to, you know, the number of people who still talk to me about the social dilemma as if that proved how, Facebook was manipulating people into extremism when that wasn't what it showed.
- 31:31Mike Masnick: it really, really bothers me.
- 31:33Mike Masnick: So I, I worry about pieces of, cultural artifacts like this, that tell a specific story from a specific position that will often miss the trade-offs and nuances.
- 31:46Mike Masnick: You know, the trade off here being, you know, there are lots of people for whom social media is really useful, and that includes young people, especially in cases of marginalized youth, where they're looking for a community, they're looking for meaning, they're looking to know that they're not the only one in the world.
- 32:02Mike Masnick: And social media has given that to many people.
- 32:04Mike Masnick: And that's not to say that it's an inherently good or bad, but it's, it appears to be good for some people, bad for some people, and neutral for some people.
- 32:13Mike Masnick: and the proper approach to dealing with that is figuring out how do we identify the people who it's bad for and how do we deal with those situations?
- 32:20Mike Masnick: And that requires an astounding level of nuance that I fear gets really lost when you have a documentary that just presents the one angle of it.
- 32:30Ben Whitelaw: I mean, I, I'll stand up the documentary in the sense that, it makes very clear that Molly had depressive episodes, was a teenager who, like many was struggling with, her mental health.
- 32:42Ben Whitelaw: And, I suppose that the kind of her use of those platforms exacerbated that in ways that we talked about on the podcast.
- 32:48Ben Whitelaw: You know, the, the most extreme cases of, kind of mental health, however old you are, will not necessarily be helped by using platforms or using any kinds of internet services at great length.
- 33:00Ben Whitelaw: Um.
- 33:00Ben Whitelaw: Ian Russell, her dad is a very, very good narrator of the story.
- 33:05Ben Whitelaw: And, and this is not just in the documentaries.
- 33:07Ben Whitelaw: He has been a very consistent and coherent, I think, explainer of the challenges and the nuances.
- 33:15Mike Masnick: Yeah.
- 33:15Mike Masnick: I, I, I think he's always been, very interesting.
- 33:17Mike Masnick: I always find him interesting to listen to.
- 33:19Mike Masnick: I don't always agree with him, but I do think there are other campaigners who I think are, less willing to dive into the nuance and he, he, which is, you know, I, I wouldn't blame him if he had gone the other way, but I think he's willing to dive into the nuances and I appreciate that.
- 33:35Ben Whitelaw: And, and, and the Molly Rose Foundation, as we've mentioned on previous episode of the podcast, have actually been anti a social media ban for under sixteens because they recognize that it's, it's a blunt instrument and won't cause the outcomes that that many parents want.
- 33:51Ben Whitelaw: So in that sense, I think the documentary trades a fairly good line.
- 33:54Ben Whitelaw: I think probably what we're talking about here, Mike, is, the fact that documentaries like all forms of media mostly, they are viewed like all journalism, like lots of books because they have an, an underlying negative story to him.
- 34:09Ben Whitelaw: You know, this idea that certain stories will be kind of seized upon by audiences more, I think lends directors to, to frame these topics in certain lights.
- 34:19Ben Whitelaw: And if you did a story about the benefits of social media, I don't think you'd have people watch it.
- 34:23Mike Masnick: Well, I don't think anyone would pay for that right now.
- 34:25Mike Masnick: Right.
- 34:25Mike Masnick: I mean, I don't think anyone would pay to make that because it doesn't, it doesn't sell.
- 34:29Mike Masnick: Right.
- 34:29Mike Masnick: Which is the argument that, that, that you're making.
- 34:31Mike Masnick: But I also think that like it's, there's an element to this that is amusing, not amusing, but sort of am, uh, maybe amusing in, in concept that, All of these things are complaining about, oh, like the manipulative power of social media.
- 34:44Mike Masnick: And yet these documentaries themselves are emotionally manipulative in some form or another.
- 34:49Mike Masnick: And, emotionally manipulative culture happens and sometimes is good, right?
- 34:54Mike Masnick: Like drives people to realize that there are important stakes, at issue.
- 34:59Mike Masnick: And that people need to understand things.
- 35:00Mike Masnick: And I think that is the power of, culture.
- 35:03Mike Masnick: But it's, it is a little bit weird slash ironic, I guess, that there's this idea that, that power, that emotional power of culture when it's on social media somehow needs to be treated differently than when it's a documentary.
- 35:20Mike Masnick: So, you know, the joke that I had made about the social dilemma years ago was that it did everything, that movie.
- 35:27Mike Masnick: Did everything that it accused social media of doing.
- 35:30Mike Masnick: It was emotionally manipulative.
- 35:31Mike Masnick: It told you a story that wasn't quite true.
- 35:33Mike Masnick: It tried to, manipulate you into believing something that wasn't accurate.
- 35:37Mike Masnick: And these are the exact same things that it, in the movie is accusing social media of doing, and nobody points that out.
- 35:44Mike Masnick: You know, the fact that culture influences people is something that we've always accepted, but for some reason people can't handle that when it's social media.
- 35:55Ben Whitelaw: Well, the difference I suppose, is the personalized
- 35:58Mike Masnick: Sure.
- 35:58Mike Masnick: It
- 35:58Ben Whitelaw: of, of social media platforms, right?
- 36:00Ben Whitelaw: There's if, a director makes a decision to pull at somebody's heartstrings in order to kind of.
- 36:06Ben Whitelaw: Make a point that's not necessarily going to affect people in the way that if an engineer changes the weights on an algorithm that will have the kind of scale and impact
- 36:19Mike Masnick: the the underlying argument still effectively goes back to the same thing, which is like, the reason that you make an emotionally manipulative documentary is because it will sell more and it will make the studio that produces it more money.
- 36:33Mike Masnick: The reason that you tweak an algorithm is that you will get more people to view more ads and it will make the company more money to some extent.
- 36:39Mike Masnick: It all comes back to that.
- 36:41Mike Masnick: And like, you can critique capitalism if you want, you know, if you wanna bring it all back to that, the root cause of all of this.
- 36:49Mike Masnick: and that's there, but that's a different debate than do we ban social media.
- 36:54Ben Whitelaw: Yeah.
- 36:54Ben Whitelaw: I see what you're saying.
- 36:55Ben Whitelaw: I think the.
- 36:57Ben Whitelaw: The scaled nature of social media platforms is, you know, the scaled nature of that manipulation, let's call it, is what people,
- 37:04Mike Masnick: it's different.
- 37:04Mike Masnick: It's a different kind of challenge.
- 37:06Mike Masnick: I'm not saying it's the identical thing, but I'm saying like, if you separate out the actual claims, the claims feel like the same sorts of claims, you know?
- 37:14Mike Masnick: and they're the claims that have shown up forever.
- 37:16Mike Masnick: I mean, we had this discussion about all sorts of, you know, every new kind of media content.
- 37:21Mike Masnick: There were complaints about, how much the radio manipulated people.
- 37:25Mike Masnick: There were complaints about comic books, about Dungeons and Dragons, about, video games.
- 37:31Mike Masnick: These things come up and the reality is historically, everybody say, well, this time is different.
- 37:37Mike Masnick: This time is different.
- 37:38Mike Masnick: That's true.
- 37:38Mike Masnick: Every single time and every single time, for the most part, society.
- 37:43Mike Masnick: Figures out how to adapt and like when there are problematic aspects to it, it is society that adapts, not through banning stuff, but through figuring out how do you educate people to use these things in a better way.
- 37:56Ben Whitelaw: Yeah.
- 37:56Ben Whitelaw: And, and that's really the, I would say the, the thrust of the documentary is that people need to figure this out for themselves.
- 38:05Ben Whitelaw: I think, again, I would love to hear listeners' thoughts on the documentary if they've watched it.
- 38:10Ben Whitelaw: we probably kind of go, got into enough detail today.
- 38:12Ben Whitelaw: I would love to have seen it focus a bit more on the safety policies of the platforms and the, and the lack of kind of, I guess, rigor or enforcement of certain rules.
- 38:22Ben Whitelaw: You know, the leap to surveillance capitalism and the bringing in of lots of, Silicon Valley talking heads somewhat diluted.
- 38:30Ben Whitelaw: Both the words of the family and of Molly's friends and also the experts that were brought in to talk about it.
- 38:35Ben Whitelaw: But hey, it all adds to.
- 38:38Ben Whitelaw: I guess to the pile of, stories that we're talking about each week, Mike, and, and what eventually will be a, a great understanding of how platform safety works, which is I think what controlled speech is, all about.
- 38:49Ben Whitelaw: Let me know what you think when you finally get around to watching it.
- 38:51Mike Masnick: absolutely.
- 38:52Ben Whitelaw: cool.
- 38:52Ben Whitelaw: let's go on now to our other stories this week that we wanted to, to bring to you listeners.
- 38:57Ben Whitelaw: talking of child safety.
- 39:00Ben Whitelaw: Our first story in our quick roundup is something that I thought was happening anyway.
- 39:04Ben Whitelaw: Mike, um, a platform in 2026 releasing parental control features.
- 39:11Ben Whitelaw: Who would've thought it.
- 39:12Mike Masnick: Yeah.
- 39:13Mike Masnick: Uh, in this case it's WhatsApp, you know, which is part of the Meta Empire.
- 39:18Mike Masnick: WhatsApp is always sort of set off in its own.
- 39:20Mike Masnick: Silo, I guess.
- 39:22Mike Masnick: but they, they launched these sort of fairly advanced parental features.
- 39:25Mike Masnick: I guess I had never really thought about it before, whether or not WhatsApp had parental features.
- 39:30Mike Masnick: but apparently now they do.
- 39:32Mike Masnick: and you know, what struck me about them beyond the fact that like, oh, you know, seems a bit late to be launching parental features, is these seem pretty well thought out to me, to be honest.
- 39:43Mike Masnick: Like, I, I looked at it, it's, it's not age verification, which I have my problems with and concerns with.
- 39:49Mike Masnick: This is literally, you know, as a parent sets up an account for a child, it allows them to set it up together so the, the accounts are linked and there are all sorts of features that are blocked and the parent has some level of control without it being surveillance based.
- 40:05Mike Masnick: I thought it seemed like a nice way of doing parental controls, even if it's, you know, maybe a decade late to the game.
- 40:13Ben Whitelaw: Yeah.
- 40:13Ben Whitelaw: You would hope that the platform, that was the, the latest.
- 40:17Ben Whitelaw: To the party the last to, join the ranks of platforms that have parental controls would do it best, frankly.
- 40:23Ben Whitelaw: Right.
- 40:23Ben Whitelaw: You know, they've seen everyone else go before them.
- 40:25Ben Whitelaw: They've seen the critiques.
- 40:27Ben Whitelaw: but yeah, it does seem like there's a fair bit of, granularity to, you can get reports as a parent if somebody contacts your child, if they're not part of your address book, that kind of stuff.
- 40:39Ben Whitelaw: If your child decides to block, another user, you get notified of that.
- 40:43Ben Whitelaw: So there is this, you get a lot more kind of detail I think about your, your child's usage.
- 40:48Ben Whitelaw: I'm sure that that isn't necessarily gonna be that welcome for, for children particularly, you know, those who are approaching the, age of 16.
- 40:57Ben Whitelaw: but hey, there's, benefits to that I think so.
- 41:00Ben Whitelaw: I would love to see a comparison, actually, Mike and I dunno if you've seen this already, of the way that different platforms do put into controls and have you ever seen a kind of ranking or, or a leaderboard or anything
- 41:10Mike Masnick: yeah, I, I, I haven't.
- 41:12Mike Masnick: and I do feel like.
- 41:14Mike Masnick: There is a concern that, that a lot of the parental controls that are out there on other apps are just not used.
- 41:19Mike Masnick: That a lot of times parents don't even know that they're there.
- 41:22Mike Masnick: Or if they do, it's sort of difficult to set up.
- 41:24Mike Masnick: And oftentimes, you know, the reason that younger people especially get set up on a particular app is because, their friends are using it.
- 41:33Mike Masnick: and often it's like, oh, you know, we gotta sign up for WhatsApp because the soccer club is all, sorry, UK Football Club is, uh, uh, you know, everybody's using it so I gotta sign up right now.
- 41:47Mike Masnick: and in that case, you just sign up really quickly'cause parents don't have time to figure out what are the parental controls.
- 41:52Mike Masnick: So it would be nice if there was like.
- 41:54Mike Masnick: A better way to, indicate to parents or like after the fact to have them opt in.
- 41:59Mike Masnick: I know I've had this with like my kids who signed up for certain platforms that later implemented parental controls and like we went and looked at it and was like, oh, well, you know, when we signed you up, we kind of lied about your age because otherwise you wouldn't have been able to sign up.
- 42:15Mike Masnick: And now if I try and put in place parental controls, it won't let me put in parental controls.
- 42:19Mike Masnick: 'cause it says you're 28 years old.
- 42:22Mike Masnick: Uh, and we've sort of dealt with that in, in different ways over time.
- 42:26Mike Masnick: I wish there were better ways to sort of surface that in the first place and, and make people aware of it.
- 42:32Mike Masnick: But, we'll see how that goes.
- 42:34Ben Whitelaw: yeah.
- 42:34Ben Whitelaw: It reminds me of, um, the kind of appeals that users can submit in Europe under the DSA, there's this, this idea that, you know, people don't know it exists.
- 42:45Ben Whitelaw: And even though.
- 42:46Ben Whitelaw: These are helpful mechanisms for redress and for safety.
- 42:50Ben Whitelaw: Actually the platforms don't do enough to kind of promote them and your average reader or user doesn't actually read the press release like we do.
- 43:00Ben Whitelaw: Um, they're not as sad as we are.
- 43:02Mike Masnick: the the real, the real, story here, Ben, is that we need more people listening to this podcast.
- 43:07Mike Masnick: If everybody listened to this podcast, they would know about these things.
- 43:10Ben Whitelaw: Yeah, exactly.
- 43:12Ben Whitelaw: and maybe we'll make that lead table, lead table of parental controls.
- 43:15Ben Whitelaw: 'cause that would be very interesting.
- 43:17Ben Whitelaw: Not least because my small baby son will eventually have to be on these platforms too.
- 43:23Ben Whitelaw: another story that is an interesting one that caught both of our eye this week.
- 43:26Ben Whitelaw: Mike, was a new judgment from the oversight board, the independent Supreme Court style, although they don't really like us calling it that, body for content moderation decisions.
- 43:37Ben Whitelaw: this is one that, this is the thing that made me saddest this week, Mike.
- 43:40Ben Whitelaw: This is I mean, I've read a lot of the oversight board decisions.
- 43:45Ben Whitelaw: none of them have made me as kind of blue as, as this one.
- 43:47Ben Whitelaw: And it's because I feel like there's, it, it really kind of sums up where we are heading as a information ecosystem.
- 43:54Ben Whitelaw: I'll, I'll briefly describe what, the decision is about, what the case was and when we'll talk about why it's bleak.
- 44:00Ben Whitelaw: the case in question was a video that was posted in June last year during the 12 day war between Israel and Iran.
- 44:09Ben Whitelaw: And the video showed a burning building that was badged as, a live video was.
- 44:15Ben Whitelaw: And that was meant to be offa, and it was meant to be showing buildings in Haifa on fire and.
- 44:22Ben Whitelaw: Your average person would think it was generated by ai, but that didn't stop it from getting 700,000 views and traveling fairly far on the web.
- 44:32Ben Whitelaw: it was copied in a bunch of different places.
- 44:35Ben Whitelaw: They think it might've come from TikTok and was posted elsewhere.
- 44:38Ben Whitelaw: So you had this, AI generated video doing the rounds purporting to be, something that it wasn't clear case of, misinformation, potentially disinformation.
- 44:46Ben Whitelaw: And what the case outlines is, I guess a series of failures by the platform, but also by, I think, the cross platform efforts to stop videos like this from, going viral.
- 44:58Ben Whitelaw: The first thing is that actually you know, it was reported a bunch of times by users for being AI generated, but as the case explains, wasn't reviewed by a moderator and it wasn't given an AI label, by the content policy team, subsequently Facebook have said, meta said that it wouldn't be classified under its misinformation policy because there wasn't a imminent threat of harm, which again, you could argue, and the oversight board did was not the case.
- 45:26Ben Whitelaw: it also, didn't have any kind of AI labels applied automatically.
- 45:32Ben Whitelaw: The nature of Meta's systems is that you have to either submit as a user that this is AI generated content, which users are unlikely to do, or it has to be escalated to a particular team within Meta, and then kind of applied, after the fact, and none of those things happened.
- 45:48Ben Whitelaw: And, we obviously are in the middle of a very similar war now where there's been a lot of incidents of AI generated video and content.
- 45:57Ben Whitelaw: it just feels like the future of, of the social platforms is to have content like this that is not only kind of not believable, but also isn't suitable for the systems that the platforms have in place to categorize it as, as misinformation or otherwise.
- 46:12Ben Whitelaw: And the recommendations from the oversight board, they're a kind of laundry list of things that they would like to do and none of them, to me, Mike, seem like they're going to be implemented anytime soon.
- 46:23Ben Whitelaw: The idea of having kind of specific AI generated policies, I dunno why meta would, want to do that necessarily.
- 46:29Ben Whitelaw: I dunno how they'd be incentivized to do so.
- 46:31Ben Whitelaw: The board recommends kind of having content credentials, what's known as kind of C two PA, so, so provenance for ai content integrated more deeply into the platform.
- 46:42Ben Whitelaw: I don't see that happening anytime soon.
- 46:44Ben Whitelaw: And so what what I see is this kind of stretch ahead where we just have more and more of this type of content filling platforms, creating doubt among users, and then potentially, causing real life risk.
- 46:56Ben Whitelaw: So, yeah, not to bring, you know, the podcast down from, from our super jolly, episode so far, but yeah, it was a tough read.
- 47:04Mike Masnick: it, it, it, it's, yeah, potentially bleak.
- 47:07Mike Masnick: I am, I, I feel a little differently about this, perhaps not surprisingly.
- 47:12Mike Masnick: Um, like I get that, I get that this kind of content is problematic.
- 47:16Mike Masnick: I get that.
- 47:17Mike Masnick: It feels like meta doesn't care that much.
- 47:19Mike Masnick: You know, I'm not so sure that they won't implement the CTPA stuff.
- 47:24Mike Masnick: I, I don't know that that will make that big a difference, because I think bad actors will figure out ways around that no matter what.
- 47:30Mike Masnick: but to me, again, this kind of goes back to we lean so hard on the tech companies to solve these issues when I'm not sure it should be their job.
- 47:41Ben Whitelaw: Hmm.
- 47:42Mike Masnick: Or that they would ever do a particularly good job of it.
- 47:44Mike Masnick: And I feel like, you know, when we have stories like this and like, yeah, like sure, some of the suggestions from the oversight board are, interesting.
- 47:52Mike Masnick: Like it'd be nice if Meta actually did pay attention to this stuff and did some of this stuff.
- 47:56Mike Masnick: But again, at what cost, at what trade off, focusing on this particular video, it got a lot of views.
- 48:02Mike Masnick: You say, okay, well they should have seen that, they should have done something about it.
- 48:05Mike Masnick: They should have escalated it to a team.
- 48:07Mike Masnick: But that also means that that team is not reviewing some other video or some other content that is equally problematic.
- 48:13Mike Masnick: And again, we sort of lose the aspect, it scale.
- 48:15Mike Masnick: It's easy to look at one or you know, a dozen or a hundred situations and not recognize that they're dealing with a million situations at and, and if you focus on one particular one at a time, you're going to be missing something else.
- 48:29Mike Masnick: to me, again, this kind of goes back to are societal level issues that I feel like we.
- 48:37Mike Masnick: Lose sight of how do we solve them at a societal level, which is often education and teaching people.
- 48:44Mike Masnick: How do you determine what is real and what is not real?
- 48:46Mike Masnick: How do you, view content skeptically and try and figure out what makes the most sense?
- 48:52Mike Masnick: rather than just saying, this has to be meta's responsibility to solve and get it right because I don't trust Mark Zuckerberg to get this right.
- 49:01Mike Masnick: Even if the law told him he had to get it right.
- 49:04Mike Masnick: Even if the oversight board says he has to get it right.
- 49:07Mike Masnick: I, I feel like there's this sort of knee-jerk reaction to say, well, these companies in the middle have to solve all these problems for us, and that's not gonna happen.
- 49:19Mike Masnick: And if they do try and solve them, they're not gonna do a good job of it.
- 49:23Ben Whitelaw: Yeah, I get that.
- 49:24Ben Whitelaw: I suppose in this particular case, the incentives for users, and this goes for more broadly than this one incidence.
- 49:33Ben Whitelaw: there are certain incentives that platforms set up where it is beneficial and actually financially lucrative to pump out information like this.
- 49:42Ben Whitelaw: So, so this page and this video were monetizable, right.
- 49:47Mike Masnick: I'm not saying that Facebook has no responsibility
- 49:49Ben Whitelaw: right, right, right.
- 49:50Ben Whitelaw: I'm just saying I'm not, if we're talking about, if we're trying to turn the, my despondency into something practical, which I think is a good.
- 49:57Ben Whitelaw: Attempt, a good thing to try and do.
- 50:00Ben Whitelaw: You know, one thing is like, platforms should not incentivize people to create slop AI generated slop or engage anything that's engagement baiting because they will do so because they, people are,
- 50:14Mike Masnick: people
- 50:14Ben Whitelaw: people are human
- 50:16Mike Masnick: Yes.
- 50:17Ben Whitelaw: and, you know, they will attempt to earn money in any ways that they can.
- 50:20Ben Whitelaw: This user was not in Iran or in Israel.
- 50:25Ben Whitelaw: They were in the Philippines.
- 50:27Ben Whitelaw: They didn't have like reason to be, this wasn't even politically motivated.
- 50:31Ben Whitelaw: This was financially motivated.
- 50:33Ben Whitelaw: And, the way that platforms have created a marketplace for missing and disinformation is something that is on the platforms and, and that plays into their business models because.
- 50:43Ben Whitelaw: know, they know they want people to producing more content so they can select which posts and videos and, get seen by individuals in the way that we've highlighted in the Molly Russell Case.
- 50:55Ben Whitelaw: that is something they can practically do.
- 50:57Mike Masnick: Yeah.
- 50:57Mike Masnick: But again, like to some extent, this goes back to the same point I was making before, which is that this is capitalism, right?
- 51:03Mike Masnick: And
- 51:05Ben Whitelaw: Don't make me advocate for the downfall of capitalism, Mike.
- 51:07Mike Masnick: I, I I know, I, I won't either.
- 51:09Mike Masnick: But like, I think you have to recognize that, that is an element of this.
- 51:14Mike Masnick: And it's like, it's great to say, gee, wouldn't, wouldn't the world be wonderful if that didn't exist and if there weren't monetary incentives for stuff, but there are, right?
- 51:23Mike Masnick: And that's not Meta's fault necessarily.
- 51:26Ben Whitelaw: No, it's not.
- 51:27Ben Whitelaw: but that does feel like a great place to end tonight's podcast.
- 51:30Mike Masnick: Next week, tune in as we solve capitalism.
- 51:34Ben Whitelaw: yeah, the alternatives, the list is not long, but the list of stories that we've talked about this week has been, we appreciate all the outlets who've been, whose stories we've drawn upon.
- 51:45Ben Whitelaw: do go and read and subscribe.
- 51:47Ben Whitelaw: Go to the show notes, and go and see that.
- 51:49Ben Whitelaw: Mike, it's great to have you back.
- 51:50Ben Whitelaw: Really appreciate chatting to you and, uh, we'll be back next week.
- 51:53Ben Whitelaw: As usual.
- 51:54Ben Whitelaw: Take care, everyone.
- 51:55Ben Whitelaw: I.
- 51:58Announcer: Thanks for listening to Ctrl-Alt-Speech.
- 52:00Announcer: Subscribe now to get our weekly episodes as soon as they're released.
- 52:04Announcer: If your company or organization is interested in sponsoring the podcast, contact us by visiting ctrlaltspeech.com.
- 52:11Announcer: That's CT RL alt speech.com.