Latest / Ctrl-Alt-Speech / An Appeal a Day Keeps the Censor Away

Transcript

An Appeal a Day Keeps the Censor Away · Ctrl-Alt-Speech

• 0:00
  Ben Whitelaw: So you and I, Mike, we're a long way from university and college, right?
• 0:03
  Ben Whitelaw: It's been a few years, but if we were back studying, we might be using the secret crash app, Fizz Social.
• 0:11
  Ben Whitelaw: It's a new one.
• 0:11
  Ben Whitelaw: You might not have heard about it.
• 0:13
  Ben Whitelaw: And if we were using Fizz Social, we might be asked when prompted.
• 0:17
  Ben Whitelaw: What's fizzing?
• 0:17
  Ben Whitelaw: I don't think, I don't think either of us would have any credibility if, we responded to that in any other situation, but control or speech is fine.
• 0:28
  Mike Masnick: All right, all right, within this context, well, since that's a made up word, and it means absolutely nothing, I have no idea, even within the context of this social app, which apparently is hot on some college campuses, what's fizzin I can make up what it means.
• 0:44
  Ben Whitelaw: Yeah.
• 0:45
  Ben Whitelaw: Please do.
• 0:46
  Mike Masnick: And so, I'm going to say I had to travel this week and, went to a conference and I'm still a bit jet lagged.
• 0:51
  Mike Masnick: So right now my brain is fizzing.
• 0:57
  Mike Masnick: What about you, Ben?
• 0:58
  Mike Masnick: What's, what's fizzing with you?
• 1:00
  Ben Whitelaw: What's fizzing is probably the discord server of, uh, AI.
• 1:11
  Ben Whitelaw: I'm guessing that's, I'm guessing that's fizzing, um, and a lot of concerned users, which we're going to talk about in today's episode.
• 1:25
  Ben Whitelaw: Hello and welcome to Ctrl-Alt-Speech, your weekly roundup of the major stories about online speech, content moderation, and internet regulation.
• 1:34
  Ben Whitelaw: This week's episode is brought to you with financial support from the future of online trust and safety fund.
• 1:38
  Ben Whitelaw: My name's Ben Whitelaw.
• 1:40
  Ben Whitelaw: I'm the founder and editor of Everything in Moderation.
• 1:42
  Ben Whitelaw: And I'm back with Mike Masnick, freshly returned from a, a weekend in Bologna.
• 1:48
  Ben Whitelaw: how are you doing Mike?
• 1:49
  Mike Masnick: I'm, I'm doing well, I, I enjoyed, I got to go to the In Hope Summit this week, and gave a, keynote talk there, which was really, really interesting, a lot of discussion on child safety issues and, uh, really enjoyed talking to folks there and, hearing the latest on that and, you know, keeping up on all these things that are obviously very important subjects.
• 2:11
  Ben Whitelaw: Great.
• 2:11
  Ben Whitelaw: Awesome.
• 2:12
  Ben Whitelaw: I mean, I was just stuffing my face with pizza and pasta.
• 2:14
  Ben Whitelaw: Um, and, and then listening to you and Kate debate away last week.
• 2:19
  Ben Whitelaw: It was a great episode.
• 2:20
  Ben Whitelaw: Um, she didn't hold back.
• 2:22
  Mike Masnick: Yeah.
• 2:22
  Mike Masnick: And, and, uh, I enjoyed that.
• 2:25
  Mike Masnick: And then the week before was you and Kat, which I thought was really interesting.
• 2:28
  Mike Masnick: So this is the first time we've been back together, you and I podcasting.
• 2:31
  Mike Masnick: So it's, uh, it's nice to have the, official crew back together for this week.
• 2:37
  Ben Whitelaw: Yeah, exactly.
• 2:37
  Ben Whitelaw: In, uh, the Britain U S in its original form.
• 2:41
  Ben Whitelaw: since we last got together, Mike, we've had some reviews, people have heeded our call for, some feedback, most of it's been nice.
• 2:47
  Ben Whitelaw: Um, I've got to say, did you have a favorite from coming through the reviews we've had?
• 2:51
  Mike Masnick: Yeah, they're a bunch of really nice ones.
• 2:53
  Mike Masnick: It's always good to hear good reviews.
• 2:55
  Mike Masnick: and so I liked this one that came in a few weeks ago from someone who gave us five stars.
• 3:01
  Mike Masnick: Always nice.
• 3:02
  Mike Masnick: We appreciate that.
• 3:03
  Mike Masnick: But you know, honest feedback is important.
• 3:06
  Mike Masnick: It said, I'm not in the trust and safety industry and I think that's nice to hear because this is not just a podcast for people in the trust and safety industry.
• 3:13
  Mike Masnick: It's supposed to be for anyone who's interested in issues around online speech and says, so not in trust and safety industry, but the discussion is easy to follow and interesting for anyone with an interest in the topic.
• 3:23
  Mike Masnick: Exactly what we're looking for.
• 3:25
  Mike Masnick: And.
• 3:26
  Mike Masnick: Noted.
• 3:26
  Mike Masnick: I particularly appreciate that Ben and Mike are bringing in several women experts for a non tech bro perspective.
• 3:34
  Mike Masnick: does that mean we're the tech bros here?
• 3:37
  Ben Whitelaw: I think, no, I, I think it means we're also not tech bros, but neither women nor tech bros,
• 3:43
  Mike Masnick: yes, yes.
• 3:44
  Mike Masnick: But, um, no, I mean, I think that is actually one of the things that we do think is important is, is bringing in all different perspectives, certainly not, Just tech pro perspective, not just us perspective, and really having, broad, thoughtful discussions on these topics.
• 3:59
  Mike Masnick: And, I, I hope we're succeeding.
• 4:01
  Mike Masnick: And so it's nice to have, uh, reviews that suggest where hitting that target that we're aiming for.
• 4:06
  Ben Whitelaw: yeah, definitely.
• 4:07
  Ben Whitelaw: We also, spotted a post from a listener and, I want to know what listeners do while they're listening to the podcast.
• 4:14
  Ben Whitelaw: Mike that's, this is, this is my new thing.
• 4:16
  Ben Whitelaw: Okay.
• 4:16
  Ben Whitelaw: So we've got a, uh, a skeet, a post on blue sky, that said doing laundry and catching up with control or speech.
• 4:23
  Ben Whitelaw: Okay.
• 4:23
  Ben Whitelaw: So I was like, Oh, that's kind of nice.
• 4:24
  Ben Whitelaw: You know, I can see how that would work.
• 4:25
  Ben Whitelaw: Then I also got a text from a listener.
• 4:28
  Ben Whitelaw: Who I happen to know personally.
• 4:29
  Ben Whitelaw: And, and she said that she listened to the podcast while doing laundry.
• 4:33
  Ben Whitelaw: And now I'm just wondering how many people listen to control of speech doing laundry and what that means.
• 4:39
  Mike Masnick: That is a good question.
• 4:41
  Mike Masnick: Is there some sort of nexus between laundry and listening to us ramble on about online speech?
• 4:48
  Ben Whitelaw: Yeah.
• 4:48
  Ben Whitelaw: Maybe there's this like enough laundry that you, in the hour that we talk, you can get most of the laundry done, washing, folding, ironing, washing.
• 4:57
  Ben Whitelaw: You know, maybe that's it.
• 4:58
  Ben Whitelaw: Maybe that's it.
• 4:59
  Ben Whitelaw: And you know, now I want to know what everyone else does.
• 5:02
  Ben Whitelaw: Okay.
• 5:02
  Ben Whitelaw: So if you're listening to this, you want to tell us what you do while you're listening to control or speech, drop us an email podcast that control or speech.
• 5:10
  Ben Whitelaw: com.
• 5:11
  Ben Whitelaw: Send us a message on one of the various platforms.
• 5:13
  Ben Whitelaw: maybe we'll make this a new feature.
• 5:15
  Ben Whitelaw: might be fun.
• 5:18
  Mike Masnick: See, now I'm trying to think of what I do, because I do listen to every episode.
• 5:21
  Mike Masnick: Uh, it's, it's, you know, it's painful to listen to yourself as many people know, but I, I, find that it's probably important.
• 5:28
  Mike Masnick: to making me a better podcaster.
• 5:30
  Mike Masnick: But, yeah, I mean, I, I try and sneak in podcast listening whenever I can, doing dishes, going for a walk, driving places, probably doing laundry too.
• 5:40
  Mike Masnick: I'm sure that's happened.
• 5:41
  Ben Whitelaw: Yeah.
• 5:42
  Ben Whitelaw: Okay.
• 5:42
  Ben Whitelaw: Well, maybe, maybe that's the thing.
• 5:43
  Ben Whitelaw: Boring tasks plus control or speech equals slightly less boring.
• 5:48
  Mike Masnick: There we go.
• 5:48
  Mike Masnick: There we go.
• 5:49
  Ben Whitelaw: great.
• 5:50
  Ben Whitelaw: Let's crack on with the stories today.
• 5:51
  Ben Whitelaw: We've got, some really interesting stories.
• 5:53
  Ben Whitelaw: They kind of knit neatly together in a, in a way that is, quite an enjoyable, when we look at each week's stories, we're just trying to figure out what the connections are, what the dots are we can join.
• 6:04
  Ben Whitelaw: I think there's some nice.
• 6:05
  Ben Whitelaw: Nice linkages today.
• 6:06
  Ben Whitelaw: So let's start Mike with, it's been a while since, we've talked and it's been a while since I've heard about the mad, lawsuits that have been filed in us States.
• 6:16
  Ben Whitelaw: So it's appropriate that we're back together and there's been a story this week.
• 6:22
  Mike Masnick: 13 States and the district of Columbia all filed lawsuits, against TikTok they all worked on together, but it was.
• 6:31
  Mike Masnick: a little bit different than normal in that each of them filed the lawsuits individually within the, states and, District of Columbia.
• 6:39
  Mike Masnick: Uh, and so they, they filed them in local courts rather than federal court.
• 6:42
  Mike Masnick: Most of the lawsuits of this nature have been filed in federal court.
• 6:45
  Mike Masnick: and each of them filed their individual lawsuits, but they all obviously work together because it's all based on the same basic thing.
• 6:50
  Mike Masnick: So there are little differences between each one because they're all relying on state laws that say slightly different things.
• 6:55
  Mike Masnick: It's better.
• 6:55
  Mike Masnick: basically says TikTok bad for kids mental health, very, very light on the details within the lawsuits, within the complaints, they sort of mentioned, the scrolling and the challenges that happened on TikTok and claims that TikTok, was trying to get kids to use the app more and therefore this is some sort of consumer harm.
• 7:22
  Mike Masnick: did look at all 14 of the filings.
• 7:26
  Mike Masnick: There was also Texas filed one that was slightly different.
• 7:28
  Mike Masnick: So you could say there were 15 lawsuits filed in the last week against TikTok and within state courts.
• 7:34
  Mike Masnick: And just like, just, It feels to me, they're all based on this idea, this narrative that TikTok is bad for kids mental health, and therefore we can sue about it.
• 7:45
  Mike Masnick: And that's it.
• 7:46
  Mike Masnick: Like, they don't really have details that support that.
• 7:49
  Mike Masnick: They have vibes.
• 7:52
  Mike Masnick: TikTok, bad for kids, therefore we can sue.
• 7:56
  Mike Masnick: It feels very, very weak to me.
• 7:59
  Ben Whitelaw: And so the, this is based upon kind of teens and children suffering mental health issues as a result of using it, right?
• 8:07
  Ben Whitelaw: Like it's kind of as a result of excessive use.
• 8:10
  Ben Whitelaw: Is that, is that right?
• 8:12
  Mike Masnick: I mean, that's the claims that they make, but not clearly and not directly, they can't directly tie it to TikTok, they sort of generalize around it.
• 8:20
  Mike Masnick: And they basically just say that these various features that TikTok has, is why.
• 8:27
  Mike Masnick: You know why we have these problems, but they make a whole bunch of jumps and assumptions that are not clearly supported.
• 8:34
  Mike Masnick: You know, and we've talked about this before, but not clearly supported by the data.
• 8:37
  Mike Masnick: So they just say, you know, the for you feed autoplay, endless scroll, ephemeral content.
• 8:43
  Mike Masnick: They talk about, you know, The stories and Tik TOK live, which is, you know, relatively new features that we don't even know push notifications.
• 8:50
  Mike Masnick: Like every app today has push notifications.
• 8:53
  Mike Masnick: And then also they say likes and comments.
• 8:56
  Mike Masnick: So here we are.
• 8:57
  Mike Masnick: We just started out this podcast asking people to comment.
• 9:01
  Mike Masnick: Are we negatively impacting the mental health of our listeners when we do that?
• 9:06
  Ben Whitelaw: I mean, it's bad enough.
• 9:07
  Ben Whitelaw: We asked him to listen, Mike, let alone.
• 9:11
  Ben Whitelaw: Yeah.
• 9:12
  Mike Masnick: it's, it, it just, it feels really, really weak.
• 9:15
  Mike Masnick: So, and you know, and there's just all these other things where it's like, yes, you can see some areas where maybe some things, can lead for some kids to certain problems.
• 9:24
  Mike Masnick: I talked about beauty filters but also they just cite things that are clear and not really proven.
• 9:31
  Mike Masnick: So they mention the search in general, idea for a health warnings, which we've talked about, which is not based on any science.
• 9:38
  Mike Masnick: They talk about, teen mental health, being in a crisis, which we've also talked about where the evidence does not show that it's directly caused by these apps.
• 9:46
  Mike Masnick: And the lawsuits just sort of assume that they are.
• 9:49
  Mike Masnick: They also compare it to substance addiction.
• 9:51
  Mike Masnick: They say that, it's just like being addicted to drugs.
• 9:55
  Mike Masnick: And we know that's not true.
• 9:57
  Mike Masnick: We know that there are different issues there.
• 9:59
  Mike Masnick: And yet the lawsuit really reads the lawsuits, plural, read as though they sort of took the media narrative and assume that all of it is true and they just.
• 10:09
  Mike Masnick: don't seem to feel that they need to go any further in terms of actually proving the details.
• 10:13
  Mike Masnick: It's just this, assumption out there that because some kids and nobody denies this, that some kids have struggled with mental health and therefore have used social media.
• 10:24
  Mike Masnick: And again, most of the evidence suggests that for most kids, it is situations where they're not getting mental health support that they need.
• 10:32
  Mike Masnick: And therefore they turn to social media and use that more, which is not.
• 10:36
  Mike Masnick: Not a great situation by any means, but not that the apps themselves are causing it, but the assumption is then flipped and there's this larger assumption that the apps are inherently harmful.
• 10:48
  Mike Masnick: and therefore the people who made the app should be held liable for this inherent.
• 10:54
  Mike Masnick: that goes across it.
• 10:55
  Ben Whitelaw: I mean, I feel like I remember there was a Guardian article from about 18 months ago that had the headline something along the lines of, we just know so little about what TikTok does, to our mental health.
• 11:06
  Ben Whitelaw: and I don't think we've actually got any further than that.
• 11:09
  Ben Whitelaw: And I think these lawsuits kind of demonstrate that in a way, don't they?
• 11:12
  Ben Whitelaw: Like, there's so little kind of robust evidence as to its effects on populations in general, let alone children.
• 11:20
  Mike Masnick: Yeah.
• 11:20
  Mike Masnick: But I don't think that's true, right?
• 11:22
  Mike Masnick: I mean, I do think that people have been studying this now and, the studies are coming back, not showing any inherent problems with it that some kids definitely struggle, but there are a number of other factors and that's, where the evidence is.
• 11:35
  Mike Masnick: and I think actually.
• 11:36
  Mike Masnick: That, takes us to a point where I, I want to transition to this other piece that I think is really important and that want people to read if they haven't yet, which is.
• 11:47
  Mike Masnick: From Dana Boyd on her sub stack.
• 11:50
  Mike Masnick: and hopefully most of the people listening to this know about Dana.
• 11:54
  Mike Masnick: if you don't, she has been the leading researcher in this field going back many, many years.
• 12:02
  Mike Masnick: You know, she wrote a book a decade ago about kids and social media, and really, has spent tons of time talking to kids, talking to social media companies, talking to parents, doing all this research and actually understanding this stuff and has a much, deeper, more thoughtful conception about all of this.
• 12:21
  Mike Masnick: And she wrote a piece that I think is really important for people to read and thinking about this.
• 12:24
  Mike Masnick: And I wish that the people who filed these state lawsuits had read called risks versus harms.
• 12:30
  Mike Masnick: And, the point that she's making is that, says in it.
• 12:35
  Mike Masnick: There's a difference in the question between does social media harm teenagers and can social media be risky for teenagers?
• 12:44
  Ben Whitelaw: Mm
• 12:45
  Mike Masnick: And, it's undeniable that there are certain situations in which it can be risky for teenagers, but that doesn't mean that it is inherently harmful for teenagers.
• 12:55
  Mike Masnick: And she goes on to talk about thinking about risk and harms as two different things, and that often people conflate these things.
• 13:03
  Mike Masnick: And as she notes, like there are all sorts of things that we do that have some level of risk involved.
• 13:09
  Mike Masnick: And we do things to try and judge that risk and determine how safe we feel and then to minimize the risk.
• 13:15
  Mike Masnick: So going outside and walking down the street and crossing a street, Is potentially risky.
• 13:22
  Mike Masnick: You could get hit by a car.
• 13:23
  Mike Masnick: You could get, you know, I don't know, exposure to the sun and get skin cancer.
• 13:28
  Mike Masnick: Like there's all sorts of risks and we do things to try and minimize that.
• 13:33
  Mike Masnick: If you're a child, we hold your hand as we cross the street.
• 13:36
  Mike Masnick: you know, eventually as you grow older, we teach you how to look both ways and, do things to minimize the risk, but there is still some level of risk, but we don't then say like, we need to sue the streets or sue the cars for existing because every once in a while, a car does hit someone, she also compares in this piece, which I think is really interesting to.
• 13:59
  Mike Masnick: Skiing, a favorite activity of mine, which I also know, has some inherent risks involved and, is not the safest of activities, like you can definitely get, really hurt and lots of people do.
• 14:13
  Mike Masnick: And yet we're not talking about passing laws to shut down ski resorts.
• 14:18
  Mike Masnick: What we do is we teach people, we teach people how to do this.
• 14:21
  Mike Masnick: We teach them how to minimize the risk, and we still, Expect that for some percentage of people, there is going to be some harm.
• 14:28
  Mike Masnick: They will fall on the wrong side of that risk.
• 14:30
  Mike Masnick: And
• 14:31
  Ben Whitelaw: I mean, it is really interesting piece and I included it in everything moderation this week as well.
• 14:35
  Ben Whitelaw: I think it's a great read, like definitely go and read this everyone.
• 14:38
  Ben Whitelaw: and, and she makes kind of the point that, risk reduction is about socializing the risks and people understanding what they are and educating people around them and people having agency to decide for themselves, which obviously in the real world.
• 14:52
  Ben Whitelaw: We've done pretty well.
• 14:53
  Ben Whitelaw: we haven't done that as well online.
• 14:55
  Ben Whitelaw: And I wondered like Donna kind of says that we will get to the point where people will understand how to manage their risks.
• 15:01
  Ben Whitelaw: When do you think that will be, because, you know, the internet has been around a bunch of time.
• 15:07
  Ben Whitelaw: A lot of people have spent a lot of time on, on the internet in various guises, to kind of jump through the kind of intricacies of the speech, but like, when do you think that will, that will happen?
• 15:17
  Ben Whitelaw: Um, and, and what's going to make us get to that point?
• 15:20
  Mike Masnick: think that it's, I mean, it is happening.
• 15:23
  Mike Masnick: It's just that, with something new, it always takes little bit of time.
• 15:27
  Mike Masnick: And this is the argument I've been making for a long time, which is that, historically societies figure these things out.
• 15:32
  Mike Masnick: and a lot of that is that socialization of the risks and the, and, how to understand it and how to minimize it.
• 15:38
  Mike Masnick: And we're seeing more and more evidence of that, you know, and, so people get mad when I talk about things like media literacy, but that's really what, we're talking about here is if you have a better understanding of these things, you learn how to handle it.
• 15:53
  Mike Masnick: You learn how to minimize the risk for yourself.
• 15:56
  Mike Masnick: You learn how to take precautions.
• 15:58
  Mike Masnick: That doesn't mean and Dana makes this really clear in her piece.
• 16:02
  Mike Masnick: There are still ways to talk about these things on the design side.
• 16:05
  Mike Masnick: She, she goes deep into the questions of design because so many of the like regulatory approaches here are focused on design effectively.
• 16:12
  Mike Masnick: Like we have to, force the companies to design.
• 16:15
  Mike Masnick: their apps and services in ways that are inherently safer.
• 16:19
  Mike Masnick: And there are reasons to think about that and how to do better design stuff.
• 16:23
  Mike Masnick: But some of it is, you know, some of the harms are not really from the design.
• 16:28
  Mike Masnick: A lot of the, the, risk is from the speech itself.
• 16:32
  Mike Masnick: And that's where the problems come in.
• 16:34
  Mike Masnick: And we see this with like, you know, in California, they had the age appropriate design code, which was, a design code, but again, it was like, It wasn't really, and that's why the courts rejected it as unconstitutional, because they saw that it was really about regulating speech under the guise of calling it a right.
• 16:48
  Mike Masnick: regulating design.
• 16:49
  Mike Masnick: And so, you don't design your way out of these things.
• 16:52
  Mike Masnick: You can do some things to help minimize stuff.
• 16:55
  Mike Masnick: You know, you design crosswalk, you know, we're getting back to the street analogy, you design crosswalks and you design traffic lights and signals that help, and, you know, there are other things that people do, you know, there some places that now have like flags.
• 17:08
  Mike Masnick: If you're crossing the street, you grab a flag so you can, you know, so there are some design things and it.
• 17:13
  Ben Whitelaw: where, do they have flags?
• 17:14
  Mike Masnick: Oh, you haven't seen this.
• 17:15
  Mike Masnick: This is fantastic.
• 17:16
  Mike Masnick: I've seen it in a few places where they, they have like on polls on either side of a crosswalk, you have a little bucket with little orange flags.
• 17:24
  Mike Masnick: And so you pick up the flag as you cross the street and you sort of wave it so that cars will see and know.
• 17:30
  Mike Masnick: I've seen it in a few places.
• 17:32
  Mike Masnick: I, yeah, it's not like I'm trying to think because it's not, near me, but I've definitely seen it in a few places.
• 17:37
  Mike Masnick: I think I S I saw it in, Wyoming recently when I was was on my trip of this summer.
• 17:42
  Mike Masnick: We saw it in Wyoming, but I've seen it in a few other places as well.
• 17:45
  Ben Whitelaw: Sorry to stop you in your flow, but I, I just, where
• 17:48
  Mike Masnick: Yeah, yeah,
• 17:49
  Ben Whitelaw: is this?
• 17:50
  Mike Masnick: it's it.
• 17:51
  Mike Masnick: I've seen it in a few places.
• 17:52
  Mike Masnick: I think I also had seen a video that they had in like Tennessee also somewhere, but I didn't see that one person, but I've seen it in a few places.
• 17:59
  Ben Whitelaw: But the point is,
• 18:00
  Mike Masnick: The point is it's like a design way of like trying to, make things more safe, but a lot of this is just sort of educational.
• 18:07
  Mike Masnick: And this is, this is a story we hadn't planned on talking about, but I'll just throw it in as well was that, of all the bills, I criticized a whole bunch of these bills in California, but they recently passed a media literacy bill.
• 18:18
  Mike Masnick: Specifically about AI and technology.
• 18:20
  Mike Masnick: And I think that kind of stuff is really important if we're teaching kids how to use these things properly.
• 18:25
  Mike Masnick: And that doesn't mean banning them entirely.
• 18:27
  Mike Masnick: It's saying like, learn how to use it appropriately so that you are minimizing those risks and you're taking precautions and you're making smarter decisions yourself rather than expecting the company to magically protect you from all potential harms.
• 18:42
  Ben Whitelaw: Yeah.
• 18:42
  Ben Whitelaw: I mean, Those two stories for me indicate once again, that we were still in the problem definition phase.
• 18:49
  Ben Whitelaw: You know, we still really don't have consensus as to what the problem is, broadly speaking.
• 18:55
  Ben Whitelaw: So we don't really, you know, Donna's been writing about it for years.
• 18:59
  Ben Whitelaw: And so this idea of like risk versus harm is still something that is, being talked about and refined and kind of
• 19:04
  Mike Masnick: Well,
• 19:05
  Ben Whitelaw: thought through, and that's, that for me is an issue and I'm, do we get to the consensus that we need to then start to figure out what happens
• 19:12
  Mike Masnick: Well, I think.
• 19:13
  Mike Masnick: You know, I think part of the issue is that when something does go wrong, it's horrible and, often traumatic.
• 19:19
  Mike Masnick: And we have all of these examples of, traumatic things of, kids dying, right?
• 19:25
  Mike Masnick: I mean, the worst possible thing.
• 19:27
  Mike Masnick: And so that leads people to want to take action and that is understandable.
• 19:32
  Mike Masnick: And it's often, they want to find something to blame and social media, because it's new, becomes a really easy target and because everybody uses it.
• 19:41
  Mike Masnick: But I, I think that, the really useful thing about Dana's piece, while it may not be new, but it's just a really, you know, Good way to reframe the thinking about this.
• 19:53
  Mike Masnick: When we're talking about these things, are we talking about an inherent harm?
• 19:58
  Mike Masnick: Is it something where we have, designed a system where almost everybody who goes through it is likely, or that the risk level is so high that everybody should realize there is a problem?
• 20:10
  Mike Masnick: Or is it one where there is just this inherent risk and we have not thought done enough to train people how to, use their own agency to reduce the risk.
• 20:21
  Mike Masnick: if we start to think through this lens of, are we talking about an inherent harm, or are we talking about levels of risk that can be managed by individuals?
• 20:30
  Mike Masnick: It just paints all this through you know, it's a different kind of picture and a different prism to look at these things through and a much more useful one.
• 20:38
  Mike Masnick: So what I think is useful here is at least in using this as a framing device in how we talk about these issues of risks and harms and how to move forward from that.
• 20:49
  Ben Whitelaw: Yeah.
• 20:49
  Ben Whitelaw: And how to identify as a kind of responsible risk taker on the internet as well, because risk, as you say, isn't always a bad thing.
• 20:56
  Ben Whitelaw: Okay.
• 20:56
  Ben Whitelaw: We've, um, we've, covered a few stories there.
• 20:59
  Ben Whitelaw: Let's shift now to, I guess, a platform story now is a succession of platform stories that demonstrate that.
• 21:06
  Ben Whitelaw: Really, the risks are there and they're, being, felt by users try to be dealt with by platforms, not always to the best, outcomes.
• 21:14
  Ben Whitelaw: And this, this is a Verge story that we both noted this week, which is basically noted the kind of oddities of, moderation on Instagram and thread recently.
• 21:24
  Ben Whitelaw: It's kind of pulled together a few examples across the two.
• 21:27
  Ben Whitelaw: Two meta platforms and, kind of ask the question, like what the hell's going on with moderation, um, on these two platforms.
• 21:35
  Ben Whitelaw: So just to give you a sense of what's going on, there's, you might've seen some posts on various platforms about this yourself as a listener.
• 21:42
  Ben Whitelaw: People saying that I'm having my account taken down because Instagram thinks I'm under 13.
• 21:48
  Ben Whitelaw: or, my threads posts has been taken down because I've said a word and the AI moderation has kind of decided that that's not acceptable.
• 21:57
  Ben Whitelaw: And some really odd examples and actually a couple of the verge reporters have been caught up in this themselves.
• 22:02
  Ben Whitelaw: So I think that's kind of where the story came about.
• 22:05
  Ben Whitelaw: the most kind of egregious one I thought was interesting was, uh, kind of social media consultant, figure called Matt Navarro, who posted a BBC news article about Tom Brady, the NFL player falling for an AI hoax, that post, was flagged.
• 22:20
  Ben Whitelaw: He got downranked and obviously then talked about it and posted about it.
• 22:24
  Ben Whitelaw: So basically lots of weird things going on.
• 22:27
  Ben Whitelaw: and, you know, an indication, I think that increasingly platforms are using AI and automated moderation to do the work that's kind of all well and good.
• 22:34
  Ben Whitelaw: And in some sense, we also noted that TikTok this week are, they've announced that they're going to be moving much more of their moderation to be automated.
• 22:44
  Ben Whitelaw: And so you have this kind of situation where.
• 22:46
  Ben Whitelaw: AI moderation is not working particularly well right now on the bigger platforms where the resources are available and they've got much more experience of doing that and more platforms are going to go down that route.
• 22:57
  Ben Whitelaw: and basically users not being able to, contest the decisions that this moderation is, is having.
• 23:03
  Ben Whitelaw: And it made me think about an issue that I had in my head.
• 23:05
  Ben Whitelaw: And we talked about this briefly, but when everything in moderation got blacklisted on LinkedIn, I told you about this, didn't I?
• 23:12
  Ben Whitelaw: Um, very weird situation where essentially the kind of everything moderation page, one day I rocked up, tried to paste the link to the newsletter and I was told that, the URL, the LinkedIn thought it was malware and that it was dangerous to other users.
• 23:25
  Ben Whitelaw: And I, and I was,
• 23:26
  Mike Masnick: from an informational standpoint.
• 23:30
  Ben Whitelaw: Yeah, I mean, you know, it's a subjective thing, I guess, but, and so I ended up submitting, I ended up having a long process of trying to gain access to be able to post on LinkedIn again, and like, just to kind of explain to users what that looked like, because this is happening many, many times over, and I hadn't quite grasped how difficult it was to, when I was on the receiving end, I ended up having to speak to LinkedIn.
• 23:52
  Ben Whitelaw: I filed a report.
• 23:54
  Ben Whitelaw: I had, a six or seven email back and forth with a LinkedIn representative who said, it's all fine.
• 24:00
  Ben Whitelaw: The preview's appearing, on LinkedIn as it would normally do if you post a URL, you can go ahead and do this, to which I applied, actually, it's not working.
• 24:07
  Ben Whitelaw: they said, have you checked, uh, the SSL certificate of your website?
• 24:11
  Ben Whitelaw: you know, have you done X, Y, and Z?
• 24:12
  Ben Whitelaw: And I said.
• 24:13
  Ben Whitelaw: I've checked all of the above, you know, it's all above board.
• 24:16
  Ben Whitelaw: It's still not clear to me why, why my website, which is ironically about content moderation and online speech, let's not forget is being, prevented from being posted.
• 24:26
  Ben Whitelaw: And I was sent on this complete round the houses trip.
• 24:29
  Ben Whitelaw: They sent me to a website, VirusTotal.
• 24:32
  Ben Whitelaw: Don't know if you've heard of VirusTotal, has it come across your radar?
• 24:36
  Mike Masnick: Never.
• 24:37
  Ben Whitelaw: it's a kind of Spanish, of cyber security firm that was founded years ago, bought by Google.
• 24:43
  Ben Whitelaw: And it kind of aggregates lots of different signals, antivirus kind of cyber signals, and then packages them up and that allows people like LinkedIn to buy them, and be able to kind of bake that into their moderation processes.
• 24:56
  Ben Whitelaw: they said, actually, it's not us.
• 24:58
  Ben Whitelaw: We haven't decided that your website is, an issue.
• 25:02
  Ben Whitelaw: Go and speak to this company called Syradar who are one of the signals, one of the inputs for the service.
• 25:07
  Ben Whitelaw: And so I then go to this company, Syradar, which is a similar kind of cybersecurity company based in Hanoi.
• 25:14
  Ben Whitelaw: And they confirmed that it was.
• 25:16
  Ben Whitelaw: a false positive, but we're very slow to reply.
• 25:20
  Ben Whitelaw: And I ended up having to go on Facebook messenger, Mike, to find a, a pretty much defunct Facebook account of this company.
• 25:28
  Ben Whitelaw: So radar to ask them to unblacklist me and to allow me to kind of then post the net literally about three hours later, I was able to post the everything moderation URL again.
• 25:40
  Ben Whitelaw: And that it was all kind of.
• 25:43
  Ben Whitelaw: automated moderation, like it was all AI moderation was the models that were doing the work in the background.
• 25:48
  Ben Whitelaw: And it made me realize just how how helpless users can be when they don't have the ability to contest these issues.
• 25:55
  Ben Whitelaw: and the fact that we're seeing a bit of a trend of this in this past week or so is, definitely worth
• 26:03
  Mike Masnick: Yeah.
• 26:03
  Mike Masnick: And it's interesting to me on few different levels.
• 26:05
  Mike Masnick: You know, last year we released two different.
• 26:08
  Mike Masnick: trust and safety related video games.
• 26:10
  Mike Masnick: And one of them moderator mayhem is one where you're a frontline moderator.
• 26:15
  Mike Masnick: and we added a level and we almost did this a little bit as a joke.
• 26:20
  Mike Masnick: We added a level where the company that you are working for turns on its AI moderation system and promises you that the.
• 26:30
  Mike Masnick: appeals that reach you should be a higher level now because the AI will pre vet them.
• 26:35
  Mike Masnick: And when that happens, you start getting the dumbest possible AI decisions.
• 26:42
  Mike Masnick: just, you know, a whole bunch of things that misunderstand words.
• 26:45
  Mike Masnick: And I found it funny because, you know, one of the things that came up in the Instagram threads moderation thing was that using the word cracker, it was originally used in, in the context of cracker jacks, a very popular snack.
• 27:00
  Mike Masnick: I don't know if it's popular in the UK, but very
• 27:02
  Ben Whitelaw: going to ask you, is crack, are crack jacks nice?
• 27:04
  Ben Whitelaw: They look delicious.
• 27:05
  Mike Masnick: Oh yeah, they're, they're wonderful.
• 27:07
  Mike Masnick: It's, it's a little bit of an old timey kind of, uh, snack, but you know, it was like, it had an association with baseball and the song take me out to the ball game actually mentions Cracker Jacks in the, in the, in the thing, it's, it's, you know, it's caramel and popcorn and peanuts and stuff.
• 27:23
  Mike Masnick: It's, it's
• 27:23
  Ben Whitelaw: not to like?
• 27:24
  Mike Masnick: Yeah, it's, you know, it's very tasty, but anyway, so somebody had mentioned that got banned and it was because of the use of the word cracker, which in certain contexts can be a slur.
• 27:34
  Mike Masnick: And then anyone who was saying cracker in any context was getting suspended or banned.
• 27:40
  Mike Masnick: And that's the kind of thing that we put into moderator mayhem as a joke, like exactly that kind of, word that has two meanings and in one context might be problematic, but in many contexts is not.
• 27:51
  Mike Masnick: And we kind of thought that was a joke.
• 27:53
  Mike Masnick: and especially like, I almost felt bad because when that game came out, that was, you know, the AI stuff was getting more and more popular and.
• 28:00
  Mike Masnick: we were sort of joking about like, AI is going to be terrible at content moderation.
• 28:03
  Mike Masnick: And then like, since then we've seen examples of AI moderation actually being, you know, pretty, pretty compelling and pretty good.
• 28:09
  Mike Masnick: And so I was like, Oh, maybe we went too far with that and moderator mayhem.
• 28:13
  Mike Masnick: And now like, no, it looks like, but, but then, you know, of all things, like, You would think that Meta would have a better sense.
• 28:20
  Mike Masnick: Like I could see this happening for like some smaller company that, you know, doesn't fully realize, but you would think that Meta with all the trust and safety expertise that they have and the AI expertise that they have, that it would never get to that level, but it does, and that is, it's a really sort of interesting thing to think about, as we move to a no matter what the AI is going to become more and more important within the trust and safety world and within the content moderation world, the fact that meta at this stage of the game is making such, ridiculous looking mistakes, and we can say like, we know.
• 28:57
  Mike Masnick: I talk about it, the impossibility of content moderation, doing content moderation.
• 29:01
  Mike Masnick: Well, you are always going to make some kinds of mistakes, but these kinds of mistakes are so embarrassing and so ridiculous because the other one, which we didn't even talk about as much, which was crazy.
• 29:11
  Mike Masnick: And the, you sort of mentioned a little bit was like this verge reporter was told that their account was being taken down their account that they've had for.
• 29:20
  Mike Masnick: A long time since they said before, Facebook bought Instagram, which would suggest how old they are.
• 29:27
  Mike Masnick: They were told that they were under 13 and their account was being suspended.
• 29:30
  Mike Masnick: And they actually uploaded their ID as part of the appeal to show I'm over and they rejected the appeal.
• 29:38
  Mike Masnick: And you're just like, the systems are out of control at this point.
• 29:41
  Ben Whitelaw: yeah, yeah.
• 29:41
  Mike Masnick: it's, you know, this is not just like, these are hard calls.
• 29:45
  Mike Masnick: These are the AI just making blatantly wrong calls.
• 29:48
  Ben Whitelaw: Yeah.
• 29:48
  Ben Whitelaw: And I can, we've talked about the kind of response that platforms usually come out with once a technical issue happens like this, and it's usually like, this was a technical glitch, we've now fixed it.
• 29:59
  Ben Whitelaw: Like somebody at some point will probably recognize that one of the many systems, much like in my example with everything in moderation, wasn't working as should.
• 30:07
  Ben Whitelaw: And has been adjusted as a result.
• 30:09
  Ben Whitelaw: they kind of went back to normal.
• 30:11
  Ben Whitelaw: Does it give users any more confidence?
• 30:12
  Ben Whitelaw: This is not going to happen again.
• 30:14
  Ben Whitelaw: I don't think so.
• 30:15
  Ben Whitelaw: you know, the worst part about it for me is that in the examples I mentioned, and in my example, the fact that it relies on the user having experience and understanding and personal connections to fix it, that's the real worry, right?
• 30:28
  Ben Whitelaw: You know, I was able to reach out to somebody at LinkedIn who I knew worked on the trust and safety team, Matt Navarro.
• 30:35
  Ben Whitelaw: The kind of social media consultant guy, he added Adam Massary, the head of Instagram and threads who replied to him within a few hours, if not less, and said, we're working on it.
• 30:45
  Ben Whitelaw: And then, you know, a bunch of time later, it was fixed.
• 30:48
  Ben Whitelaw: Like if you're not somebody who, who knows what to do and in the comment thread underneath Matt's post, there's a whole bunch of people who've had.
• 30:56
  Ben Whitelaw: been had their accounts taken down for very innocuous things.
• 30:59
  Ben Whitelaw: If you don't know what to do or where to go, you are just stuck.
• 31:02
  Ben Whitelaw: and
• 31:03
  Mike Masnick: but it's, yeah, I mean, it's, it's yes.
• 31:05
  Mike Masnick: And I think that is a concern, but it also, it is more complicated than that in some ways too, because these are the cases where there are legitimate concerns that there was a mistake made.
• 31:15
  Mike Masnick: The problem is that even when decisions are made that are legitimate or have a legitimate reason behind them, people still get upset.
• 31:22
  Mike Masnick: This is part of the impossibility of content moderation at scale.
• 31:26
  Mike Masnick: I am now experiencing.
• 31:28
  Mike Masnick: Some of that myself, you know, as we have mentioned, I'm now a board member at blue sky, which I think some people think gives me way more power than I actually have.
• 31:38
  Mike Masnick: there are some people who have been moderated on blue sky and had labels applied to their account and I get.
• 31:46
  Mike Masnick: skeets in my direction constantly, like, Mike, fix this.
• 31:50
  Mike Masnick: Like, how come I am getting labeled as being intolerant?
• 31:53
  Mike Masnick: And it's like, it's not my decision to make, so, I can understand why, like, it becomes really difficult.
• 32:00
  Mike Masnick: Like, yes, you're right.
• 32:01
  Mike Masnick: in your case, you're able to reach out to someone or if things happen, or, with the verge article, they can write an article and that will tend to get attention.
• 32:08
  Mike Masnick: And that feels problematic, but also, are people who are going to complain with less than legitimate complaints.
• 32:16
  Mike Masnick: And so it's, it's tough to work out a system where it's like, yes, only the good complaints get through and, and not the, uh, less legitimate complaints.
• 32:26
  Ben Whitelaw: sure.
• 32:26
  Ben Whitelaw: It sounds like you're making, making out that I deserved it.
• 32:29
  Ben Whitelaw: Are you saying
• 32:30
  Mike Masnick: Well, you know, you, you might, I mean,
• 32:32
  Ben Whitelaw: I wrote,
• 32:33
  Mike Masnick: go,
• 32:33
  Ben Whitelaw: I think I wrote about on hub.
• 32:35
  Ben Whitelaw: I think that was what my problem was.
• 32:36
  Mike Masnick: that, that, that could be it.
• 32:37
  Mike Masnick: That could be it.
• 32:38
  Ben Whitelaw: legitimately.
• 32:39
  Ben Whitelaw: Uh, so yeah, I mean, this leads us really neatly onto our next story, which, um, was a big story this week and is a kind of perfect, other side of the coin to, to the story we've just talked through, about the Appeals Center to Europe.
• 32:52
  Ben Whitelaw: Mike, tell us what it is and, and what's happened.
• 32:54
  Ben Whitelaw: Mm
• 32:55
  Mike Masnick: So this is, big news.
• 32:56
  Mike Masnick: this is sort of an offshoot of the oversight board who we've talked about before, which was.
• 33:03
  Mike Masnick: Originally put together by Metta to handle, appeals on, you know, higher level, decisions.
• 33:10
  Mike Masnick: And obviously we've talked a lot about the oversight board over the years.
• 33:12
  Mike Masnick: If you are listening to this, you probably know who the oversight board is, but they have launched this new thing, which is being funded through a 15 million grant from the oversight board trust, but is then.
• 33:25
  Mike Masnick: In theory, independent called the Appeal Center Europe, which can be shortened to ACE, A C E.
• 33:32
  Mike Masnick: and it is one of these appeals boards that is being set up under the DSA.
• 33:38
  Mike Masnick: And we've talked about the DSA a bunch, but one of the interesting components of the DSA is that it does require tech companies to allow for there to be third party appeals boards, these sort of, alternative dispute resolution kinds of systems out there.
• 33:55
  Mike Masnick: And in the last few months, we've seen a few of these different services launch.
• 34:01
  Mike Masnick: And the idea is that if you are in one of the situations that we just talked about, around a moderation system that you feel has gone wrong and done you wrong, that you can appeal not to the company, but to a third party board that will review it and then, make a decision.
• 34:17
  Mike Masnick: And so ACE Appeal Center Europe is the newest and probably the one that is getting the most attention.
• 34:24
  Mike Masnick: because it has that connection to the oversight board, though, interestingly, it is not just going to be for meta properties.
• 34:32
  Mike Masnick: It will also cover YouTube and Tik TOK.
• 34:36
  Mike Masnick: And they have a system where if you, feel that you were wronged by one of those, you can appeal, you have to pay 5.
• 34:44
  Mike Masnick: to appeal, but if you win your appeal, you will get your 5 back.
• 34:48
  Mike Masnick: And, the companies I think are paying like 90 per, issue as well.
• 34:54
  Mike Masnick: Um, so some of the interesting things here are that, it is the separate appeals board.
• 34:59
  Mike Masnick: It is a way to, challenge some of these decisions and have an outside party look at it.
• 35:03
  Mike Masnick: It is, and this is important.
• 35:05
  Mike Masnick: It is not binding on any of the platforms.
• 35:07
  Mike Masnick: So, You know, LinkedIn is not one of these, so I know some of the other, providers out there are handling LinkedIn complaints.
• 35:13
  Mike Masnick: So in theory, you could have gone to one of them and complained about your, everything in moderation being blocked.
• 35:19
  Mike Masnick: They could look it over, say, this is ridiculous, send their decision to the company, and then the company looks it over and they are obligated to, look at it in good faith and, then decide, but they are not bound by it.
• 35:32
  Mike Masnick: So they can choose not to follow these decisions,
• 35:36
  Ben Whitelaw: Yep.
• 35:36
  Mike Masnick: I was going to say it's,
• 35:37
  Ben Whitelaw: Right?
• 35:38
  Ben Whitelaw: Like this is, this is like a kind of big, big, new marketplace for user appeals and like a massive shift.
• 35:44
  Mike Masnick: it is a big change and it is a change that is developed under the law.
• 35:47
  Mike Masnick: And so, there's been a lot of talk about the oversight board over the last few years, and this idea of having different kind of dispute resolution mechanism for social media, and it's been an interesting experiment, but this makes it much broader, right?
• 36:01
  Mike Masnick: The complaint with the oversight board was that.
• 36:03
  Mike Masnick: it has that sort of connotation and I know people hate this, but as like the Supreme Court that it's taking up the big issues, the big sort of policy kinds of things.
• 36:12
  Mike Masnick: thinking.
• 36:13
  Mike Masnick: Whereas these under the DSA, these are supposed to be about smaller issues.
• 36:18
  Mike Masnick: You know, the kinds of things like, Hey, I can't share everything in moderation anymore.
• 36:22
  Mike Masnick: Hey, Instagram says I'm 13, even though I've been on their platform for 14 years.
• 36:27
  Ben Whitelaw: Yeah.
• 36:27
  Mike Masnick: These kinds of decisions where you can have an outside party, look at it and make a decision send something that will, that the company will actually pay attention to.
• 36:36
  Mike Masnick: So you don't have to do what we do, which is like, find somebody that you know, to complain, who will pass you on to somebody else.
• 36:43
  Mike Masnick: And so it's creating this process.
• 36:45
  Mike Masnick: I have no idea how it's going to work.
• 36:46
  Mike Masnick: And the interesting thing here is that there are now a number of these different bodies and there will probably be more coming.
• 36:52
  Mike Masnick: I think we were saying before, there's already four of them announced.
• 36:55
  Ben Whitelaw: This is the fourth year.
• 36:56
  Mike Masnick: and there's like a competition element there too, because apparently the way it works is that you as a user.
• 37:01
  Mike Masnick: Can choose which of these boards that you go with, and then you can't, you can't then switch, you know, once you've chosen, that's, who you've chosen for this particular thing.
• 37:11
  Mike Masnick: So, but there's this sort of competition element that, it's this multi sided market in an interesting way where, you know, you can complain to different boards, the companies will, maybe we'll take some boards more seriously than others and, and may appreciate things.
• 37:25
  Mike Masnick: I think it's, it's just a really fascinating experiment.
• 37:28
  Mike Masnick: We don't know, there's all sorts of reasons why it might not work.
• 37:31
  Mike Masnick: And I think there'll probably be some hiccups along the way, and we'll definitely see some, some of the challenges, but I think it's a really interesting approach and one really worth observing and seeing what it leads to.
• 37:43
  Mike Masnick: And, I hope being able to iterate and take lessons from it and maybe something.
• 37:48
  Mike Masnick: Much better can come out of this.
• 37:50
  Mike Masnick: You know, one of the complaints that I've had for years in talking about the big tech companies, Google and Facebook and, and all of them is that they don't do customer service well.
• 38:01
  Mike Masnick: They're not designed to take customer complaints.
• 38:04
  Mike Masnick: There there's, you know, it's very difficult.
• 38:05
  Mike Masnick: Like, who do you call?
• 38:06
  Mike Masnick: You don't, you can sort of send a message off into the ether and never get a response.
• 38:11
  Mike Masnick: Whereas this is a way of sort of forcing that.
• 38:14
  Mike Masnick: On people and creating an interesting sort of marketplace for that.
• 38:18
  Mike Masnick: And so, I'm really fascinated to see how this plays out.
• 38:21
  Ben Whitelaw: Yeah.
• 38:21
  Ben Whitelaw: I mean, this kind of mechanism is used in the EU in other, in other areas, right.
• 38:26
  Ben Whitelaw: In the kind of consumer world, if you're not being provided, the service of your product is, unsatisfactory.
• 38:32
  Ben Whitelaw: There's like processes in place for that.
• 38:33
  Ben Whitelaw: So it's kind of been taken from that world.
• 38:36
  Ben Whitelaw: and applied to the DSA in what is known as article 21, Alice Sonsberger, who writes trust and safety insider, the kind of Monday newsletter that comes out under the everything moderation brand.
• 38:47
  Ben Whitelaw: You know, she, she's like really excited by this because it's the biggest shift in user appeal is really since the report button.
• 38:54
  Ben Whitelaw: it's been a decade since the report button happened.
• 38:56
  Ben Whitelaw: We've seen some.
• 38:57
  Ben Whitelaw: Innovation in terms of reporting flows and the data being gathered through the reporting process, being more robust and more actionable for trust and safety teams, but this is like a whole new level.
• 39:09
  Ben Whitelaw: and Alice was imagining, and I'll show the piece in the show notes.
• 39:13
  Ben Whitelaw: A world in which, you know, ODS bodies specialized in different harms and in, different types of complaint.
• 39:19
  Ben Whitelaw: Right.
• 39:20
  Ben Whitelaw: So she, thought about an example of, hate speech in the LGBTQ community, you might go a to a particular ODS.
• 39:27
  Ben Whitelaw: In the EU, that's particularly good at that.
• 39:30
  Ben Whitelaw: and, you know, the four that have launched so far, one is in Ireland.
• 39:33
  Ben Whitelaw: That's, the ACE, body that you mentioned, Mike, there's also one in Hungary.
• 39:36
  Ben Whitelaw: There's one in Malta.
• 39:37
  Ben Whitelaw: There's one in Germany as well.
• 39:39
  Ben Whitelaw: essentially, you can find the ODS body that's going to be able to deliver you the outcome that you most want, right.
• 39:44
  Ben Whitelaw: And it's not binding, but.
• 39:46
  Ben Whitelaw: We expect people to gravitate towards the bodies that have the best kind of a response rate can say that they've managed to enforce some sort of change or impact for the platforms.
• 39:57
  Ben Whitelaw: This is a really interesting kind of new mechanism that the platforms are going to have to deal with.
• 40:01
  Mike Masnick: Yeah, we're going to have to see, right.
• 40:03
  Mike Masnick: and, you know, one of the things, and I mentioned this to you before we started recording, I have this, degree that I got when I went to college and industrial and labor relations.
• 40:13
  Mike Masnick: And one of the things that we studied there was.
• 40:17
  Mike Masnick: Arbitration, because that's a, you know, alternative dispute resolution mechanism that is very popular and, and, a lot of different contexts.
• 40:24
  Mike Masnick: And in theory, when you explain the arbitration system is like a way of avoiding.
• 40:30
  Mike Masnick: Uh, very expensive legal challenge.
• 40:33
  Mike Masnick: There are some things that are really appealing about it.
• 40:36
  Mike Masnick: And, it allows for a setup where there's a human being who will listen to both sides and try and make a balanced decision.
• 40:43
  Mike Masnick: In practice, it proved to be a lot more complicated because of some very twisted incentives that were structured.
• 40:49
  Mike Masnick: And what happened, especially in the early two thousands, was that companies started abusing the arbitration process.
• 40:57
  Mike Masnick: Because they were often the ones who, you know, companies would bring thousands of arbitration cases and individuals would bring one.
• 41:05
  Mike Masnick: and the arbitrators tended to be historically biased towards the companies and arbitration actually became a way for companies to get away with really bad behavior and have an arbitrator sort of rubber stamp it.
• 41:18
  Mike Masnick: And so, there are some things set up with the way these disputes systems are set up
• 41:22
  Ben Whitelaw: Yeah.
• 41:23
  Mike Masnick: to try and avoid that, I think.
• 41:26
  Mike Masnick: But it's really tough to predict how these actually play out and what the incentive structures are and the different gamesmanship that is going to happen.
• 41:34
  Mike Masnick: And there's a whole bunch of sort of like different variables and game theory that has to go on here.
• 41:40
  Mike Masnick: And I don't think we'll know exactly how well these work for some time.
• 41:44
  Mike Masnick: But.
• 41:44
  Mike Masnick: still fascinating and still like the opportunity for us to learn something really interesting and potentially lead to.
• 41:52
  Mike Masnick: Useful systems for dealing with, just outright mistakes.
• 41:57
  Mike Masnick: it's worthwhile to have that experiment happen.
• 42:00
  Ben Whitelaw: Yeah.
• 42:00
  Ben Whitelaw: And to your point, the likelihood of.
• 42:02
  Ben Whitelaw: Bad faith appeals, much like the folks who are getting in touch with you, uh, on blue sky and asking for a pre, for whatever reason that's likely to be high and, how we kind of, these bodies sift through those and how platforms deal with those is an ongoing question, but yeah, super fascinating.
• 42:18
  Ben Whitelaw: So, two sides of, of that kind of appeals question in two stories there.
• 42:23
  Ben Whitelaw: Cool.
• 42:23
  Ben Whitelaw: So there, there are kind of bigger stories this week, Mike.
• 42:26
  Ben Whitelaw: Let's do one smaller story each before we wrap up.
• 42:29
  Ben Whitelaw: you had a couple that you were tying together, a particularly egregious, example of, a user who definitely deserves a ban.
• 42:37
  Mike Masnick: Yeah.
• 42:38
  Ben Whitelaw: No question about it.
• 42:39
  Mike Masnick: yeah, so these are, there's actually two stories here and I'll, I'll do them both really quickly.
• 42:44
  Mike Masnick: There is something about and I've sort of joked about the content moderation learning curve that every new social media platform has to learn and that is like you have all these new social media platforms pop up and say we are the free speech platform.
• 42:55
  Mike Masnick: We're not going to do any moderation at all.
• 42:57
  Mike Masnick: Of course, very quickly they learn like that doesn't work.
• 43:01
  Ben Whitelaw: Hmm.
• 43:02
  Mike Masnick: And so here were two examples of that with two different platforms.
• 43:05
  Mike Masnick: The one that you were sort of alluding to was this platform kick, which sort of set itself up as a kind of video streaming platform that was not going to be aggressive and, banning people and, you know, they want to, go do, you know, whatever crazy thing you want it to do and this.
• 43:20
  Mike Masnick: Guy who seems like a real jerk, you know, the kind of person who would hear that and say, yeah, that's the platform for me.
• 43:26
  Mike Masnick: Uh, Jack Darty, was driving his McLaren, you know, super expensive, uh, supercar, at, crazy speeds and live streaming and doing crazy stuff and checking his phone and like responding to people while he was doing that, and then crashed it on the live stream and kick.
• 43:45
  Mike Masnick: Finally decided that that was enough to ban him.
• 43:48
  Mike Masnick: so there's all sorts of stuff between like, are you encouraging people to do stupid stuff?
• 43:51
  Mike Masnick: And there've been concerns about that with like Snapchat other stuff as well.
• 43:55
  Mike Masnick: But, that I thought it was interesting that kick actually banned him after saying like, basically we we're not going to do, you know, we barely ban anyone.
• 44:04
  Mike Masnick: And it's like, well, you do have a limit, right?
• 44:05
  Mike Masnick: It's like when somebody crashes a supercar on your stream, sort of shows you the idea that, yeah, you need trust and safety, you need content moderation.
• 44:13
  Mike Masnick: And especially if you claim that you're not going to do that, you're going to attract people like this, who are going to just create problems for you.
• 44:21
  Mike Masnick: the second sort of related story to that was truth social, which obviously is Donald Trump's, social media platform, which, these days is not so much a social media platform as like the place where he just, post whatever nonsense is coming to his mind.
• 44:35
  Mike Masnick: Um, but, um, there are a lot of users on it.
• 44:38
  Mike Masnick: And there was this investigative piece at Gizmodo where they had, filed freedom of information act requests with the government to find out if people had complained about things related to truth social and found a whole bunch of people are getting scammed.
• 44:51
  Mike Masnick: So scammers are going on truth social perhaps recognizing that.
• 44:55
  Mike Masnick: the rabid followers of Donald Trump may not be the most discerning and careful people that they are easy marks, and that they are being scammed out of tons of money and it's romance scams, it's, crypto investment scams.
• 45:11
  Mike Masnick: It's all sorts of stuff.
• 45:13
  Mike Masnick: and apparently they're really easy marks and true social has very little in the way of trust and safety.
• 45:19
  Mike Masnick: they do have some, but very little and.
• 45:22
  Mike Masnick: They apparently have not done a very good job of finding and stopping these scams.
• 45:27
  Mike Masnick: And Trump's, you know, most rabid followers on the platform are getting taken for tons of money.
• 45:34
  Ben Whitelaw: Yeah.
• 45:34
  Ben Whitelaw: And in Donna, in Donna Boyd's words, they've not been socialized or educated quite sufficiently to understand the risks at play.
• 45:44
  Mike Masnick: yes, I would say that.
• 45:45
  Mike Masnick: But you know, it's, these are both examples of, young social media platforms that assume that they don't have to do much moderation and don't have to do much trust and safety work.
• 45:54
  Mike Masnick: And you quickly see that when you do that, you get, scams and jerks and, terrible people on your platform.
• 46:02
  Mike Masnick: And that's, that's what happens.
• 46:03
  Ben Whitelaw: Yeah, no, exactly.
• 46:04
  Ben Whitelaw: Um, final story of today's episode might follow as a similar theme.
• 46:08
  Ben Whitelaw: You'll be unsurprised to know.
• 46:09
  Ben Whitelaw: some people might've seen this on 404 media.
• 46:12
  Ben Whitelaw: it's a story about a virtual, companion site.
• 46:16
  Ben Whitelaw: That uses AI to, make mostly young men feel kind of less lonely that was hacked.
• 46:22
  Ben Whitelaw: Okay.
• 46:23
  Ben Whitelaw: And it raises a lot of questions about yeah, the moderation of small sites and apps.
• 46:28
  Ben Whitelaw: And actually places in sharp focus, I'd say the, dangers around open sourcing kind of large language models, which.
• 46:34
  Ben Whitelaw: used by platforms like this one to, create products.
• 46:38
  Ben Whitelaw: So what's happened is that the data of all of these users has been leaked and includes the prompts that they put into the virtual companion app.
• 46:47
  Ben Whitelaw: And a lot of that included kind of sexual fantasies, very personal information, and some of that included.
• 46:54
  Ben Whitelaw: references to underage, children and prompts to create child sexual abuse material.
• 46:59
  Ben Whitelaw: So for a full media report, there's some 30, 000 occurrences of the term 13 year old, which is really shocking.
• 47:07
  Ben Whitelaw: And, you know, you might say, okay, this is a hack you never learned to kind of see that data we weren't meant to know, but actually if you.
• 47:16
  Ben Whitelaw: The founder of this site, this product moi, M U A H dot AI, has been very kind of forthcoming with the fact that his app is very well moderated, so he's given interviews.
• 47:28
  Ben Whitelaw: He's talked about the fact that, prompts are moderated.
• 47:31
  Ben Whitelaw: They've implemented content moderation to prevent.
• 47:33
  Ben Whitelaw: Inappropriate, questionable content on the platform and the language models are trained to avoid sensitive topics.
• 47:40
  Ben Whitelaw: That's clearly not the case at all, based upon the information from this hack.
• 47:44
  Ben Whitelaw: Right?
• 47:45
  Ben Whitelaw: Like it's, it's very clear and.
• 47:48
  Ben Whitelaw: this is a tool built with a kind of assortment of open source tools and made me think like, we're thinking about open AI.
• 47:57
  Ben Whitelaw: We're thinking about kind of anthropic that the kind of big large language models that are going to have kind of commercial models, laid on top of them and users will be able to use for their own benefit.
• 48:05
  Ben Whitelaw: There's all this open source stuff that we're kind of seeing being used for, for reasons that don't make me feel very good about it.
• 48:13
  Ben Whitelaw: and actually the, the kind of follow up to this that I noticed as we were researching today's podcast, some of that data is now being used.
• 48:20
  Ben Whitelaw: and people are being sextorted off the back of it.
• 48:24
  Ben Whitelaw: So we have people who've, used that app, who put in prompts, whose email addresses are linked to that data, and they're now being, sextorted by people forced to provide money and access to, Company data and company services for the employees that they work for.
• 48:39
  Ben Whitelaw: So, you know, harm, perpetuating harm all over the place, really.
• 48:43
  Ben Whitelaw: And, again, Definitely, the founder of that app needs to really go up your content moderation speaker of mine.
• 48:49
  Ben Whitelaw: Cause very far behind.
• 48:52
  Mike Masnick: Yeah.
• 48:53
  Mike Masnick: I mean, there's a few different things here.
• 48:54
  Mike Masnick: Like the question around open source models and stuff is a much bigger discussion.
• 48:59
  Mike Masnick: Not one I think we can have in sort of the, the quick story version.
• 49:02
  Mike Masnick: Cause there are a lot of big questions around that.
• 49:04
  Mike Masnick: The thing here that I think what this shows is that there are a lot of people who just, claim that they're doing content moderation and trust and safety work.
• 49:13
  Mike Masnick: And that, you know, safety is important to them.
• 49:15
  Mike Masnick: And a lot of them are not.
• 49:17
  Mike Masnick: Being entirely honest about that.
• 49:18
  Mike Masnick: And I think that's what clearly happened here is you make those claims publicly.
• 49:22
  Mike Masnick: This is, since we started this episode off with the, talking about the tech bros, this is a common thing that happens with tech bros, where they will tell you what you want to hear and they will say, of course, we're doing this safely.
• 49:35
  Mike Masnick: And of course, we've put these safeguards in place.
• 49:37
  Mike Masnick: And of course, we've thought about this stuff.
• 49:38
  Mike Masnick: And the reality is that they don't care and they haven't thought about it.
• 49:42
  Mike Masnick: And this is what happens is that, then, They get hacked and all their data is leaked.
• 49:47
  Mike Masnick: And, hopefully that means this app is dead in the water and this guy's got to go find a more responsible job.
• 49:53
  Mike Masnick: Um, but this is also where media literacy comes into, do you believe this guy when he says that?
• 49:59
  Mike Masnick: And, uh, there are lots of, probably lots of other red flags associated with.
• 50:03
  Mike Masnick: Kind of the way this app was designed and the way it was pitched and the way it was marketed that should have raised red flags about whether or not you would trust him to have actually built the app safely.
• 50:12
  Ben Whitelaw: Yeah, indeed.
• 50:13
  Ben Whitelaw: All of those stories kind of remind me that we have a long way to go in, in the quest for, some consensus around what the problem is with.
• 50:20
  Ben Whitelaw: online safety and speech in general, but I feel like we've done a good, job today of trying to flesh those issues out and, uh, nicely back in the chair with you.
• 50:28
  Ben Whitelaw: And,
• 50:28
  Mike Masnick: Yeah.
• 50:29
  Mike Masnick: Always good.
• 50:29
  Mike Masnick: Always good.
• 50:30
  Mike Masnick: I'm glad it's always, we really enjoyed our guest hosts are, who have been, Excellent.
• 50:34
  Mike Masnick: I think.
• 50:35
  Mike Masnick: Um, but it is always good to, be sitting across from you again and to have a discussion.
• 50:39
  Mike Masnick: I think, you know, the interesting thing about today's episode was that there was this, through line between all of the different stories and that they all were sort of connected in, how this space remains a really challenging space with lots of interesting things happening.
• 50:52
  Ben Whitelaw: yeah.
• 50:53
  Ben Whitelaw: And at this point, I only hope our listeners have finished their laundry.
• 50:57
  Ben Whitelaw: Um, but they,
• 50:58
  Mike Masnick: I hope you folded, folded your clothes carefully.
• 51:02
  Mike Masnick: Do not leave them all crumpled up.
• 51:03
  Mike Masnick: Okay.
• 51:04
  Ben Whitelaw: Indeed.
• 51:04
  Ben Whitelaw: Indeed.
• 51:05
  Ben Whitelaw: We're a pro, ironing non crease podcast.
• 51:11
  Ben Whitelaw: Says the man who never does any ironing.
• 51:13
  Ben Whitelaw: Um, that's a great note to wrap up today, Mike.
• 51:15
  Ben Whitelaw: if you enjoyed the podcast today's episode, drop us a review on the platforms where you most listen.
• 51:21
  Ben Whitelaw: And thanks again for joining us.
• 51:23
  Ben Whitelaw: We'll speak to you next week.
• 51:27
  Announcer: Thanks for listening to Ctrl-Alt-Speech.
• 51:29
  Announcer: Subscribe now to get our weekly episodes as soon as they're released.
• 51:33
  Announcer: If your company or organization is interested in sponsoring the podcast, contact us by visiting ctrlaltspeech.Com.
• 51:40
  Announcer: That's C T R L Alt Speech.
• 51:43
  Announcer: com.
• 51:44
  Announcer: This podcast is produced with financial support from the Future of Online Trust and Safety Fund, a fiscally sponsored multi donor fund at Global Impact that supports charitable activities to build a more robust, capable, and inclusive trust and safety ecosystem.