Latest / Ctrl-Alt-Speech / Look What The Chat Dragged In

Transcript

Look What The Chat Dragged In · Ctrl-Alt-Speech

• 0:00
  Ben Whitelaw: So Mike, this week I was shamed by a friend of mine, who commented on my lack of language skills.
• 0:06
  Ben Whitelaw: Uh, yeah, I was, uh, my holiday Spanish didn't quite cut it in a conversation we had.
• 0:11
  Ben Whitelaw: So, I've gone back to duo lingo, the kind of famous gamified language learning app, and I thought we could use that to start today's podcast.
• 0:19
  Ben Whitelaw: When you go on to Juliano, you are prompted to kind of put in your details and start to use the app, and it asks to, learn for free forever.
• 0:28
  Mike Masnick: Oh.
• 0:29
  Ben Whitelaw: So I'm gonna ask you, what would you like to learn for free forever?
• 0:33
  Mike Masnick: Well, this is, I was debating how to respond to this particular prompt.
• 0:37
  Mike Masnick: 'cause there are a few different directions I could go and I'm sort of, I'm gonna turn it around a little bit and, and hope for something that, the rest of the world might learn for free forever.
• 0:46
  Mike Masnick: Which, you know, on the subject that we often talk about.
• 0:50
  Mike Masnick: I think it would be nice for people to recognize that humanity is complicated and that there aren't simple answers for, bad things that happen.
• 0:58
  Mike Masnick: Just because of the nature of humanity.
• 1:00
  Mike Masnick: It would make life so much easier if we didn't have to explain that every week.
• 1:03
  Mike Masnick: But since we do have to explain every week, we get to talk about it on this podcast, which is lots of fun.
• 1:09
  Mike Masnick: But what would you like to learn for free forever?
• 1:12
  Ben Whitelaw: Well, I dunno if I'm, it's something I'd necessarily like to learn, but I'm, I feel like I'm going to learn very quickly and for free how to change nappies.
• 1:20
  Ben Whitelaw: Uh, so, uh, that is something I will be forced to deal with.
• 1:24
  Ben Whitelaw: It's one of the reasons I'm taking a bit of a break from controlled speech.
• 1:27
  Ben Whitelaw: so yeah, when I come back in a few weeks time, I'll be a pro.
• 1:30
  Mike Masnick: yes, you, you'll pick it up very, very quickly.
• 1:42
  Ben Whitelaw: Hello and welcome to Control Alt Speech, your weekly roundup of the major stories about online speech, content moderation, and internet regulation.
• 1:50
  Ben Whitelaw: It's May the first, 2025, and this week's episode is brought to you with financial support from the future of online Trust and Safety Fund, and sponsored by Modulate the Prosocial Voice Intelligence Company.
• 2:00
  Ben Whitelaw: This week we're talking about giant group chats, the African moderator fight back, and the big debate around AI companion bots.
• 2:08
  Ben Whitelaw: I'm Ben Whitelaw.
• 2:08
  Ben Whitelaw: I'm the founder and editor of Everything and Moderation, and I'm with Mike Masnick, founder of Tech and Board member of Blue Sky.
• 2:20
  Mike Masnick: We have a bell.
• 2:21
  Ben Whitelaw: We have a bell.
• 2:22
  Ben Whitelaw: It arrived.
• 2:23
  Ben Whitelaw: It arrived just after we finished recording last week,
• 2:26
  Mike Masnick: Actually, I, I will say it, it arrived just like, literally just after, because like seconds after we got off recording last week, you sent me a picture of the bell,
• 2:35
  Ben Whitelaw: Yeah.
• 2:36
  Mike Masnick: which we didn't have.
• 2:37
  Mike Masnick: We, I had to, I had to verbally bell last week,
• 2:41
  Ben Whitelaw: Save yourself.
• 2:42
  Ben Whitelaw: Save your dings.
• 2:43
  Mike Masnick: and, and this week of course, we have no blue sky stories, so
• 2:47
  Ben Whitelaw: Exactly SOS law.
• 2:49
  Ben Whitelaw: but yeah, no, this, the production values of this podcast have just gone up significantly.
• 2:53
  Ben Whitelaw: Thanks to my new bell.
• 2:55
  Ben Whitelaw: Um, yeah, it looks like something that I've stolen off a reception of a bad hotel.
• 3:00
  Ben Whitelaw: Um, but it, but it's there.
• 3:02
  Ben Whitelaw: yeah.
• 3:02
  Ben Whitelaw: Nice to see you, Mike.
• 3:03
  Ben Whitelaw: Uh, good to have you, have you back.
• 3:04
  Ben Whitelaw: And,, we've got a couple of literary reviews, which is exciting, although we're not gonna go into them this week because we've got a lot to get through.
• 3:12
  Ben Whitelaw: I'm gonna leave you to go through those when I'm off over the next couple of weeks.
• 3:16
  Ben Whitelaw: As I mentioned up top, I'm, taking a few weeks off the podcast, and Mike, you've got a great selection of co-hosts.
• 3:23
  Mike Masnick: have some great co-hosts coming though.
• 3:24
  Mike Masnick: I will say next week we are off entirely.
• 3:26
  Mike Masnick: I'm away at a conference.
• 3:28
  Mike Masnick: you have your stuff going on.
• 3:30
  Mike Masnick: Uh, so there won't be a podcast next week, but after that, for the next few weeks after that, we have a bunch of really interesting and fascinating guests lined up, and you'll discover them as we release them.
• 3:40
  Mike Masnick: So it should be fun.
• 3:41
  Ben Whitelaw: yeah.
• 3:41
  Ben Whitelaw: Reason to, to come back and have a listen.
• 3:44
  Ben Whitelaw: that's also a reason to rate and review the podcast wherever you get it.
• 3:47
  Ben Whitelaw: you may have your review shared, on the podcast, particularly if it has a literary review, which is something that goes back to an episode maybe five or six weeks ago now.
• 3:56
  Ben Whitelaw: where we, talked about, a tech dirt user writing a novel in the comments of the site.
• 4:01
  Ben Whitelaw: So, yeah.
• 4:02
  Ben Whitelaw: bring your best literary references and reflections, extra points for obscure kind of novels that we haven't heard of.
• 4:10
  Mike Masnick: But then how will we even notice?
• 4:13
  Ben Whitelaw: yeah.
• 4:13
  Ben Whitelaw: Well, you can also email us to tell us that we're, small-minded and, and, you know,
• 4:18
  Mike Masnick: Illiterate.
• 4:20
  Ben Whitelaw: And you win, you win double points.
• 4:22
  Ben Whitelaw: we're gonna whiz through today's stories, Mike.
• 4:24
  Ben Whitelaw: We've got a lot to, talk through and some kind of really interesting meaty stories that have been published by a great range of, publishers this week.
• 4:31
  Ben Whitelaw: And we do have a, an excellent chat with Mike Pappas, the CEO of control speech.
• 4:36
  Ben Whitelaw: Launch sponsor Modulate, who is a man who talks very eloquently at the best of times, and even when he has a cold.
• 4:43
  Ben Whitelaw: Um, I had a chat with him, about the way he thinks about fraud and what Modulate had been doing to, evolve their voice detection software away from gaming or, or kind of in addition to gaming into spaces where fraud typically occurs, like social.
• 5:00
  Ben Whitelaw: Platforms and marketplaces, so stick around for that.
• 5:03
  Ben Whitelaw: he's a great, great guest as usual.
• 5:06
  Mike Masnick: Yeah, he's always, always got really deep and, thoughtful insights and, a really clear way of explaining it.
• 5:11
  Mike Masnick: That's really kind of usually very, you know, eye-opening and thought provoking, so he's
• 5:15
  Ben Whitelaw: Yeah.
• 5:16
  Ben Whitelaw: and he is a reminder that if, listeners like the podcast and they have the financial means to sponsor it, to ensure that we keep appearing in your feeds, please do get in touch.
• 5:24
  Ben Whitelaw: go to the website, drop us a line control alt speech.com.
• 5:28
  Ben Whitelaw: We are a very brand safe podcast.
• 5:30
  Ben Whitelaw: I would say, you know.
• 5:33
  Mike Masnick: Perhaps the safest, the brand safest of podcast.
• 5:36
  Ben Whitelaw: I think so.
• 5:37
  Ben Whitelaw: I think so.
• 5:38
  Ben Whitelaw: Not like some of the other platforms we might talk about today.
• 5:41
  Ben Whitelaw: Um, but you are guaranteed to have, your brand within a very, brand safe context.
• 5:46
  Ben Whitelaw: So, yeah, that's my plug.
• 5:48
  Ben Whitelaw: let's jump in, Mike.
• 5:49
  Ben Whitelaw: we've got a lot to get through and, you know, I've got my Duolingo lessons to, to get to at the end of this.
• 5:55
  Ben Whitelaw: So, We're gonna start today with, some group chats.
• 5:58
  Ben Whitelaw: We've talked a lot about group chats over the past, four or five weeks, of controllable speech.
• 6:02
  Ben Whitelaw: There's been some stuff happening in US politics related to group chats.
• 6:07
  Mike Masnick: I have no idea what you're talking
• 6:09
  Ben Whitelaw: Yeah, I I know you're not super into it or.
• 6:14
  Mike Masnick: Have you been planning your, your war attacks and bombings, uh, through a group chat, maybe with, you know, relatives or,
• 6:23
  Ben Whitelaw: Not, not recently, but I mean our control speech signal chat is one of my only signal chats
• 6:30
  Mike Masnick: oh, you are missing out my friend.
• 6:32
  Ben Whitelaw: yeah.
• 6:33
  Ben Whitelaw: Yeah.
• 6:33
  Ben Whitelaw: But the story you, you've brought to us from SEMA four is like signal chats on a new level.
• 6:39
  Mike Masnick: Yeah.
• 6:39
  Mike Masnick: Yeah.
• 6:39
  Mike Masnick: It, it's quite, fascinating story came out last weekend, from Ben Smith who is the founder of Semaphore.
• 6:46
  Mike Masnick: And it's this deep look into, a few different group chats in particular of the sort of Silicon Valley, right.
• 6:53
  Mike Masnick: That they, really somewhere during the Covid pandemic started to build up a series of group chats where they kind of, incubate their brains in further and further extreme content.
• 7:05
  Mike Masnick: it's in some ways not entirely surprising.
• 7:08
  Mike Masnick: I think a lot of people suspected that, you know, where you have this sort of, tech VC world that went extremely like pro-Trump and, a little bit nutty, at times over the last few years that they seemed really aligned.
• 7:22
  Mike Masnick: And as if.
• 7:23
  Mike Masnick: As if they had been talking about things in some, you know, some place that we didn't get to see and then sort of brought it all out together and, and this sort of confirms it and talks a little bit about it.
• 7:32
  Mike Masnick: and so there's some, Partially eyeopening, but partially like, yeah, I kind of expected that was happening, aspects to it.
• 7:40
  Mike Masnick: but you know, the thing that really struck me about it was sort of this recognition of like how much online speech has moved to sort of private spaces and, away from the sort of public spaces.
• 7:51
  Mike Masnick: And, and it got me thinking a little bit about sort of the evolution of online speech.
• 7:56
  Mike Masnick: In this nature and you know, I was thinking back to like, early bulletin boards or Usenet time period where.
• 8:04
  Mike Masnick: they were sort of quasi-public spaces, you know, they were public, but they were sort of hard to find and not everybody was in there.
• 8:11
  Mike Masnick: You had small groups of people, and so you sort of had the obscurity through the fact that, you know, not as many people were in there.
• 8:18
  Mike Masnick: and so it felt more intimate and, and close.
• 8:21
  Mike Masnick: And then as we sort of got into the web two o era.
• 8:26
  Mike Masnick: People started to think that like, oh, there should be this one giant group chat.
• 8:30
  Mike Masnick: Right?
• 8:31
  Mike Masnick: And sort of leading up to that, or around the same time, maybe a little bit preceding that you sort of began to have the rise of instant messaging, which was usually sort of one-to-one instant messaging.
• 8:41
  Mike Masnick: You had a OL, instant messenger, Yahoo Messenger, whatever, all these other things.
• 8:45
  Mike Masnick: So you know, which was a really powerful.
• 8:47
  Mike Masnick: Tool.
• 8:48
  Mike Masnick: And I think, lots of us grew up on, you know, one of those tools and the ability to communicate with people was great, but they didn't really have the group features, or not quite as, widely used.
• 8:57
  Mike Masnick: And then we went to this world where it was like everybody in one central group chat, you know, it's like the Twitter or Facebooks of the world, which were like, it's a one giant public group chat, which, has some, Powerful features, but then also some, some negative consequences that we all sort of began to to deal with.
• 9:16
  Mike Masnick: And then I've certainly noticed in the last, you know, really since the beginning of the pandemic, more and more of the sort of interesting conversations that maybe I used to have a decade ago on, say a platform like Twitter.
• 9:28
  Mike Masnick: Started to move into private spaces, and that included discord groups of which I'm in way too many.
• 9:35
  Mike Masnick: It included slack groups of which I'm in way too many.
• 9:38
  Mike Masnick: And then more recently, it's all been sort of signal based, a little bit of WhatsApp.
• 9:42
  Mike Masnick: So you begin to have these like.
• 9:44
  Mike Masnick: Group conversations.
• 9:46
  Mike Masnick: And the thing that struck me as kind of interesting is like, you know, all of the talk about regulating online speech and, all of the things, you know, all the conversations we have about trust and safety and everything sort of seems stuck in the world where all of these conversations are happening entirely in public, in the sort of grand arena of Facebook or Twitter.
• 10:07
  Mike Masnick: and all of the thinking is sort of built on this mental model of.
• 10:11
  Ben Whitelaw: of
• 10:11
  Mike Masnick: The internet and online speech are public, and yet now what we're discovering is that more and more of it, you know, obviously that's still going on and people are still using those things, but more and more of the consequential conversations are actually happening in private spaces and in some cases those are.
• 10:28
  Mike Masnick: Accessible private spaces There may be quasi-public private spaces that people can join.
• 10:32
  Mike Masnick: In some cases they're entirely private.
• 10:34
  Mike Masnick: In some cases they're entirely encrypted when you're talking about WhatsApp or Signal.
• 10:39
  Mike Masnick: So it's, dark.
• 10:40
  Mike Masnick: And in some cases, you know, especially with Signal, they involve disappearing messages.
• 10:45
  Mike Masnick: And so that was a part of the SE four story as well, that more and more.
• 10:50
  Mike Masnick: what actually makes some of the people feel comfortable talking in these spaces is the fact that they're designed to disappear.
• 10:56
  Mike Masnick: And in fact, there was, there's one part in here where they talk about, you know, people would have messages that were set to disappear in like 30 seconds or a minute, which is basically like when you want to, say something you know is not good.
• 11:08
  Ben Whitelaw: yeah, start a war.
• 11:11
  Ben Whitelaw: Maybe
• 11:11
  Mike Masnick: Yeah.
• 11:12
  Mike Masnick: Yeah.
• 11:13
  Mike Masnick: So there's a bunch of different things, but just the idea that, this is happening and, and I think there are good reasons for that.
• 11:19
  Mike Masnick: I am, I guess unlike you, I'm in a fair number of, group chats, though none of mine are nearly as horrific and, scary, as what is described in the seven four piece.
• 11:29
  Mike Masnick: but At the same time that we hear these, the stories from, the media and certainly from policy makers and politicians about this idea that, oh, you know, social media is this, horrible echo chamber and we have to deal with that.
• 11:42
  Mike Masnick: And, I think the real sort of echo chambery thing, like the stories from this sounds very echo chambery and certainly of a lot of very powerful people in this case, in this particular group chat, sort of egging each other on to be worse, right?
• 11:57
  Ben Whitelaw: I wanna talk a bit about the, the kind of characters in this particular group chat.
• 12:00
  Ben Whitelaw: 'cause it's, it's particularly relevant and we haven't quite kind of unpacked that.
• 12:03
  Mike Masnick: Yes.
• 12:04
  Ben Whitelaw: I think we should, we'll talk about the kind of broader, quasi, private, semi-private nature of some of these.
• 12:10
  Ben Whitelaw: Messaging apps that have increasingly large limits on who can join groups.
• 12:15
  Ben Whitelaw: But let's start with the, like the people in this particular group, because it, they say and have particularly strong views about censorship and what they are and allow and aren't allowed to say, which I think is relevant here too.
• 12:26
  Mike Masnick: Yeah, I mean, so the, the particular group chat, there's the main one they talk about is called Chatham House.
• 12:32
  Mike Masnick: which is, you know, sort of a, wink in a nod to the, think tank and the, the sort of famous Chatham House rules, which is, you know, I know that more than I know the think tank, which is basically, you can talk about the conversation that we had here, but you can't name anyone.
• 12:47
  Ben Whitelaw: like, Chatham House is gonna be pissed off about their name being used for this group.
• 12:52
  Ben Whitelaw: Right.
• 12:52
  Ben Whitelaw: This group of like, kind of increasingly volatile, tech bros.
• 12:56
  Ben Whitelaw: That's gonna be, that's gonna be annoying.
• 12:58
  Mike Masnick: Yeah, and it's basically like the people in here.
• 13:01
  Mike Masnick: are basically all the people that you've heard of recently being deeply involved.
• 13:05
  Mike Masnick: You know, coming from the tech world and being deeply involved in sort of political discussions except for Elon Musk.
• 13:10
  Mike Masnick: I don't seem to mention Elon being in the chat as far as I can, uh, uh, if I remember correctly.
• 13:15
  Mike Masnick: but there are a bunch of, obviously Mark Andreesen, Krishnan, who was in Musk Circle and was like one of the early guys who went to.
• 13:25
  Mike Masnick: he had worked at Twitter before, but sort of came back with Elon and was sort of deeply involved in stuff.
• 13:31
  Mike Masnick: They talk about, mark Cuban, who has been, sort of the billionaire who pushes back on them.
• 13:38
  Mike Masnick: And apparently he's kind of like the central character in this because he's like the only guy willing to sort of fight with all the, extremist viewpoints.
• 13:47
  Mike Masnick: But it does talk about how they.
• 13:49
  Mike Masnick: Build up certain ideas and beliefs within the chat.
• 13:53
  Mike Masnick: And so like the example I talk is like the mainstreaming of Curtis Jarvin, who is, a horrific human being who believes that, democracy is a terrible idea and we need to move back to a monarchy.
• 14:05
  Mike Masnick: and you know, we need a dictatorship.
• 14:07
  Mike Masnick: And he is, certainly gotten.
• 14:10
  Mike Masnick: A lot of press recently because of, j.
• 14:13
  Mike Masnick: D Vance is a big follower of Curtis Jarvin and Peter Thiel has been a big supporter of Curtis Jarvin.
• 14:18
  Mike Masnick: And, there's this idea that a lot of what the US government is doing is based on vin's beliefs, which is a little bit of a exaggeration, but, he's become important in this.
• 14:29
  Ben Whitelaw: partly because of this group.
• 14:30
  Ben Whitelaw: I think, and we, we won't go too much deeper on the vin, but there's a very good interview that the New York Times did, which is also quite controversial, which will include in the show notes, and these guys in this group, but it's mostly men in the piece,
• 14:41
  Mike Masnick: yes.
• 14:42
  Mike Masnick: Almost entirely.
• 14:42
  Mike Masnick: They did say there's like a, a token, woman here or there, but it's almost all men.
• 14:47
  Ben Whitelaw: Yeah.
• 14:47
  Ben Whitelaw: and they, they end up kind of Yeah.
• 14:48
  Ben Whitelaw: Like juicing themselves up as you say, and basically making out that they are saying things in that group that they used to say publicly on social media, but because of the kind of industrial censorship complex are less able to do.
• 15:01
  Ben Whitelaw: Right.
• 15:01
  Ben Whitelaw: Is
• 15:03
  Mike Masnick: Yes.
• 15:03
  Mike Masnick: Which is nonsense, right?
• 15:04
  Ben Whitelaw: it's just nonsense.
• 15:05
  Mike Masnick: Yeah, I mean, that's the claim and like Andreesen made that claim like, oh, these conversations should be happening in public, but because of cancel culture and the woke mind virus, they can't, which is nonsense.
• 15:14
  Mike Masnick: Which is, you know, and everyone knows that because Andreesen is still there on, X making these same comments.
• 15:20
  Mike Masnick: Elon Musk obviously has been making those comments.
• 15:22
  Mike Masnick: I.
• 15:22
  Mike Masnick: Zuckerberg has walked back all of the, and Andreessen is on the board of Meta.
• 15:26
  Mike Masnick: Like all of this stuff gets left out of these discussions.
• 15:29
  Mike Masnick: It's like, he's always been able to say this stuff.
• 15:31
  Mike Masnick: What really happened was that he started to get criticized for some stuff.
• 15:34
  Mike Masnick: I mean, years ago where I think a lot of this started was he got a ton of criticism on Twitter many years ago when he was defending, Facebook before there were Meta had the, very controversial program called Free Basics, where they would offer free internet access, but it was a limited internet access that was basically free access to the Facebook part of the internet.
• 15:56
  Mike Masnick: And a lot of people, including myself, had real problems with that, which is, their sort of denying the world, the wider access to the internet.
• 16:03
  Mike Masnick: And Andreessen had gone on a rant on Twitter that was basically saying like, the poor people should, should what we give them and shut up.
• 16:12
  Mike Masnick: and he was criticized by that.
• 16:14
  Mike Masnick: That's not, you know, that's a, a paraphrase, right?
• 16:16
  Mike Masnick: That's not exactly what he said, but that was the implication of what he said.
• 16:19
  Mike Masnick: And he got criticized and he ended up deleting his entire Twitter account and sort of pouting about it for a few months before sort of slowly making his way back.
• 16:27
  Mike Masnick: Then ever since then I've noticed like he just seems unwilling to take any kind of criticism.
• 16:33
  Mike Masnick: So similar sort of thing happened in the early pandemic when Clubhouse suddenly became like a big thing and it was this, audio chat, sort of public chat where he, was one of the big users of it and he, said some, dumb stuff and he got called out on it and it's like, that is.
• 16:50
  Mike Masnick: if you're going to speak publicly, getting criticized for it is part of the bargain.
• 16:54
  Mike Masnick: It's not fun.
• 16:55
  Mike Masnick: I mean, I get criticized all the time.
• 16:56
  Mike Masnick: I don't like it.
• 16:57
  Mike Masnick: But like, do you decide that the world is you know, you have to destroy a part of the world as he's now decided he has to destroy universities where he thinks they're like building up, their.
• 17:08
  Mike Masnick: Turning people into the kinds of, woke people who will criticize him.
• 17:12
  Mike Masnick: And that is, unfair and must be stopped.
• 17:14
  Mike Masnick: he could have always spoken.
• 17:16
  Mike Masnick: He, his only problem was that he was getting criticized and so the fact that he feels that he has to go into a, group chat with a sort of protective, group of, people who would cheer him on and build up his ego, kind of an interesting development.
• 17:28
  Ben Whitelaw: Yeah, I mean this, these guys are a bit of a joke.
• 17:32
  Mike Masnick: Yeah.
• 17:32
  Ben Whitelaw: You know, you can't, you can't not read this article and think that they are like, absolutely pathetic.
• 17:37
  Ben Whitelaw: Apparently there's, there's a line in it where they say, Ben Smith reports that they think of the group chat as like what they call the republic of letters, which is like a kind of 16th century, long distance, correspondence that like Europeans used to send across countries and, and so they, they're kind of equating themselves in a group chat talking about the kind of mad.
• 17:57
  Ben Whitelaw: Shit that they are with the historical tradition of sending eloquent, intelligent letters.
• 18:03
  Ben Whitelaw: And that, that for me is hilarious.
• 18:04
  Ben Whitelaw: Like this is intellectualization of literally spouting off 15 hours a day, sometimes as many hours you, you can't think that they're anything but a bunch of losers.
• 18:14
  Ben Whitelaw: Basically, the, the, the, the, there's the kind of wider point that I think you make, which I think is relevant to us and to listeners is this, to what extent is this private, you know, when you have a group of 300 people and some messaging apps have, limits as high as a thousand now, or telegram?
• 18:31
  Ben Whitelaw: I think it's like 200,000 for some groups, like to what extent.
• 18:35
  Ben Whitelaw: Do you think these are still messaging apps in the traditional way that they emerge in, in the kind of old sense of the word?
• 18:42
  Mike Masnick: Yeah, I
• 18:42
  Ben Whitelaw: what extent do they need to be kind of moderated in the way that public social media was?
• 18:47
  Ben Whitelaw: There's that tension we have.
• 18:49
  Mike Masnick: Yeah, I mean, it's always a spectrum, right?
• 18:50
  Mike Masnick: It's not like there's these buckets where you're obviously classified as one thing or another.
• 18:55
  Mike Masnick: It's always the sort of spectrum.
• 18:56
  Mike Masnick: And as people change and innovate and change features and affordances, it's always going to adjust and change and, but it creates different challenges and you know, it is funny where there is this feeling that.
• 19:08
  Mike Masnick: one there's a sort of meta story to this, which is not metas in the company, but, but you know about the fact that.
• 19:15
  Mike Masnick: Chatham House leaked and some of the chats leaked to Ben Smith says something about like, when a group gets to a certain size, there will always be some sort of challenges.
• 19:24
  Mike Masnick: And it's, it's funny, there is one group chat I'm in, a small group chat, but it's a very active one and a fun one.
• 19:31
  Mike Masnick: But we had a debate not that long ago about adding people to the group.
• 19:36
  Mike Masnick: The conclusion, like some people are like, you know, we all know people who would be good to add into this group.
• 19:41
  Mike Masnick: But the general conclusion was like, no, we, we have this group and if we add anyone to it, it just changes the dynamic.
• 19:48
  Mike Masnick: And we're sort of used to this and there's like this whole debate about like, would you add any more people to the group, so, any sort of group, you have group dynamics, and when you have group dynamics, you have to have some sort of governance to some extent or another.
• 20:00
  Mike Masnick: And the smaller they are, the more you can do, the more sort of norms take hold.
• 20:05
  Mike Masnick: But as it gets larger, it switches from norms to some sort of form of governance or not.
• 20:10
  Mike Masnick: Which, is what everything that we're talking about is always about, which is like, the competition between.
• 20:16
  Mike Masnick: Rules, norms, governance, regulations, and where do you apply those things?
• 20:21
  Mike Masnick: And they apply at different levels, at different stages for different things.
• 20:24
  Mike Masnick: And it's a constantly changing situation, constantly evolving.
• 20:28
  Mike Masnick: And you sort of have to figure out how that, works.
• 20:30
  Mike Masnick: And.
• 20:31
  Mike Masnick: you can't treat a, group chat of five people the same as a group chat of 300 people versus a group chat of 200,000 people versus a totally public social media system of a billion people, right?
• 20:43
  Mike Masnick: They're all different and they have different things and different affordances.
• 20:47
  Mike Masnick: It's sort of interesting to see the way speech is sort of divvying up across these different, kinds of platforms and different tools.
• 20:54
  Ben Whitelaw: Yeah, and the kind of arbitrary cutoffs, I guess, in the way that those different sized communities or spaces get treated.
• 21:01
  Ben Whitelaw: in terms of the safety protocols, in, in terms of the policies, you know, there's always gonna be areas that are not covered as maybe as well as you'd like, because.
• 21:10
  Ben Whitelaw: there's a point where it moves from small group to a, you know, a larger group, and it's hard to be able to detect that as a platform and to kind of manage that as well as maybe everyone would like.
• 21:20
  Ben Whitelaw: fascinating piece, Mike, probably the first time we've heard about this group in such detail.
• 21:24
  Ben Whitelaw: Definitely worth going away and reading this weekend.
• 21:27
  Ben Whitelaw: Listeners, you said that that wasn't a meta story.
• 21:30
  Ben Whitelaw: The next story is very much a meta story.
• 21:32
  Ben Whitelaw: about meta the company and the platform and, um, When you were sunning yourself, on your holiday a few weeks back, Mike, which I know you never do, but Pratik Var Gray, and I talked a bit about, a story that's linked to this next one.
• 21:45
  Ben Whitelaw: we mentioned the fact that in Kenya, the high court had given the go ahead for two cases to be heard, about meta and the cases being brought by moderators who have suffered mental health trauma and PTSD as a result of work they've done for a company called Sam.
• 22:01
  Ben Whitelaw: I mentioned at the time that I, I thought it would open the door to other cases in other countries.
• 22:07
  Ben Whitelaw: I mentioned Brazil, I mentioned South Africa.
• 22:09
  Ben Whitelaw: I didn't mention Ghana.
• 22:10
  Ben Whitelaw: And lo and behold, this week we've had stories about the potential of, Ghanaian moderators taking meta to court and these are linked, Mike, it's almost frightening.
• 22:21
  Ben Whitelaw: I'll just kind of recap what this is.
• 22:22
  Ben Whitelaw: This is a story that the Guardian have done with the Bureau of Investigative Journalism, which has done some fantastic work about the role and the kind of plight of moderators in lots of different countries over the last four or five years.
• 22:33
  Ben Whitelaw: And the case is directly related to the Kenyan one in the sense that after.
• 22:39
  Ben Whitelaw: Meta got out of Kenya because of these two cases.
• 22:42
  Ben Whitelaw: It set up shop in Ghana, in Acra, and it hired a bunch of moderators through a company called Majorelle, which is another BPOA business process outsourcing company.
• 22:53
  Ben Whitelaw: these big companies used to do kind of customer service stuff, call center work, and they've increasingly done moderation work.
• 22:59
  Ben Whitelaw: And that was in 2023 already we're seeing moderators.
• 23:04
  Ben Whitelaw: Come to, the press and to legal firms and talking about the horrific conditions they've been facing.
• 23:10
  Ben Whitelaw: This latest group have said much the same that the Kenyan moderators did, which they've been, forced to moderate content without breaks for hours upon end.
• 23:18
  Ben Whitelaw: They have had, significant mental health issues.
• 23:21
  Ben Whitelaw: There's a, a piece that.
• 23:22
  Ben Whitelaw: The Guardian published about one particular moderator who, tried to commit suicide after, undergoing, trauma as a result of the content that he, he moderated.
• 23:31
  Ben Whitelaw: this is all the same stuff that we saw before, and it's like meta haven't learned their lesson at all.
• 23:37
  Ben Whitelaw: They've literally kind of set up shop in a different African country with a different BPO and have learned nothing from before.
• 23:44
  Ben Whitelaw: they have, in comments that the Guardian said that they have wellness and mental health support available.
• 23:51
  Ben Whitelaw: But judging by, the comments from the moderators themselves and from Fox Glove, which is, a legal firm that has been doing some really good work here and which has been, supporting the moderators, that doesn't seem to be as good as they've made out.
• 24:02
  Ben Whitelaw: So again, you know, just as this kind of Kenyan moderator story was gonna come to a head, Mike, you've actually got another one happening right at the same time.
• 24:10
  Mike Masnick: Yeah, I mean, this is the nature of content moderation.
• 24:13
  Mike Masnick: It was funny, I was reading through these stories and it reminded me, I'm sure I've mentioned it on the podcast before, the documentary film, the cleaners.
• 24:21
  Ben Whitelaw: Yeah, yeah, yeah.
• 24:22
  Mike Masnick: you know, from like a decade ago, and that was, meta or, you know, then Facebook moderators in the Philippines, you know, working for A BPO.
• 24:32
  Mike Masnick: And the same exact pattern where, they're working for some sort of BPO, they're not allowed to mention that they work for Facebook, but it's obvious that they work for Facebook and all the details are that they're working for Facebook.
• 24:43
  Mike Masnick: And they all sort of go through this, these stages of like, We're seeing 15 seconds of absolutely horrific content over and over and over and over again, and it changes the way they think you know, some of it in the expected ways where you sort of become desensitized to, to horrific things or then you begin to have problems in your life, but sometimes in, in other ways where it's just like distorting your view on reality and sort of impacting your, interpersonal relationships and all of these kinds of things.
• 25:09
  Mike Masnick: That was, you know, a decade ago that they made that film.
• 25:11
  Mike Masnick: And this is the same story, and it just feels like they just sort of move around at the same time.
• 25:17
  Mike Masnick: You have the flip side to this equation, which is that, if companies are not doing this, then they get screamed at for not taking content, moderation, trust and safety seriously.
• 25:27
  Mike Masnick: And so, do you deal with those two things?
• 25:30
  Mike Masnick: And, and one element of it is like, certainly the technology's gotten much better.
• 25:34
  Mike Masnick: Over the last few years and, and the artificial intelligence aspect of content moderation has become better and better, but it's still limited and you still need, humans in the loop.
• 25:42
  Mike Masnick: But, when you put humans in the loop, the issue is that there are humans out there who have done terrible things and then want to post about it online, or that you have humans who want to find terrible things.
• 25:51
  Mike Masnick: and there's like, as I started out this, podcast saying like, there's no easy solution to it.
• 25:58
  Mike Masnick: Because, everything is horrible and you're, you're always, you know, as I said last week, you're looking for the least bad solution to different problems that are out there.
• 26:07
  Mike Masnick: So I, I read this and it's like, yes, this is horrible.
• 26:10
  Mike Masnick: It's horrible the way the company seems to treat some of these moderators.
• 26:13
  Mike Masnick: They definitely, is mentioned, they sort of.
• 26:15
  Mike Masnick: Appear to, treat employees as sort of throw away people, you know, sort of wear them out, expose'em to horrible things, destroy them, and then dump them on the side of the road when they're no longer useful.
• 26:26
  Mike Masnick: I mean, some of the stories in here are horrific, where, people are really affected by this, and then the company's like, okay, well you can't moderate content anymore.
• 26:33
  Mike Masnick: Here's this even less paying job that we'll give you.
• 26:35
  Mike Masnick: And people are like, well, I, I don't wanna take that.
• 26:37
  Mike Masnick: And they're like, well, then you can't work for us at all anymore.
• 26:40
  Mike Masnick: And it's like, well.
• 26:41
  Mike Masnick: I understand where that comes from because as a company, they're sort of trying to figure that out.
• 26:45
  Mike Masnick: And if the person can't do the moderation, then what are they gonna do?
• 26:48
  Mike Masnick: But this seems like a problem, but it also feels like one of these problems that we get when we recognize that there are people, there are people doing horrible things out there, and the people who are trying to find horrible content and expose'em to horrible content or share horrible content.
• 27:05
  Mike Masnick: how do you stop that without then exposing other people to the horrible content?
• 27:09
  Mike Masnick: And there's no good answer here.
• 27:11
  Ben Whitelaw: Yeah, naturally it comes down to, you know, one of our famous phrases of, content moderation is very difficult to do at scale.
• 27:18
  Ben Whitelaw: the reason why Meta and any platform ha has to, or feels like it has to bring a BPO on board is because it needs extra capacity to look at all the content, all the reports, all the, you know, egregious posts that come through.
• 27:33
  Ben Whitelaw: And that, that makes sense.
• 27:34
  Ben Whitelaw: And we, we've talked a bit about, through the antitrust case that's happening at the moment.
• 27:38
  Ben Whitelaw: how large platforms, are much more difficult to, moderate in that sense.
• 27:43
  Ben Whitelaw: the thing I wanna talk about is that this is essentially a labor story.
• 27:45
  Ben Whitelaw: I.
• 27:46
  Ben Whitelaw: You know, this is a kind of like, working conditions that are suitable for people to ensure that they're paid a fair wage and, meta have said that the employees get paid, I think double the average salary in Ghana.
• 27:58
  Ben Whitelaw: but that doesn't seem to me to reflect the kinds of work that they do and seems to miss out all of the context, which is that the average in Ghana is probably, very low.
• 28:06
  Ben Whitelaw: and I also note that, you know, meta has the, money and the capacity to be able to pay people more.
• 28:11
  Ben Whitelaw: It has the capacity to pay more to the BPO.
• 28:15
  Ben Whitelaw: The BPO is relatively small, but was bought recently.
• 28:18
  Ben Whitelaw: I noted before we started by a big French company called Tele Performance, who had an absolutely gangbuster year last year.
• 28:25
  Ben Whitelaw: revenue went up 23%, year on year.
• 28:28
  Ben Whitelaw: They also can pay their employees more.
• 28:31
  Ben Whitelaw: so it feels, you know, relatively, some of this feels relatively easy to address, even if it's hard to deal with.
• 28:37
  Ben Whitelaw: That intractable issue that we have of like content moderation at scale is tough.
• 28:40
  Mike Masnick: Yeah, but you're running it up against the other intractable problem that we have, which is the nature of capitalism.
• 28:46
  Mike Masnick: I mean,
• 28:47
  Ben Whitelaw: Ah,
• 28:48
  Mike Masnick: so like, you know, these businesses are told that they need to make money and they need to make increasing money and they need to have increasing margins and all this kind of stuff.
• 28:56
  Mike Masnick: And you have big companies like Meta and Tele performance that have shareholders that they have to account to, and those shareholders wanna see number go up and line go up and.
• 29:06
  Mike Masnick: can make a very strong argument that that leads to, bad situations in the world.
• 29:09
  Mike Masnick: But unless you're dealing with that underlying issue, you can say like, sure, they can pay more and they should pay more.
• 29:15
  Mike Masnick: And I would agree with you just, on a conceptual basis.
• 29:19
  Mike Masnick: But you have to put that into the context of the system and the world that we live in, which is that these companies are owned by shareholders who.
• 29:26
  Mike Masnick: Are less interested in that.
• 29:28
  Mike Masnick: Right.
• 29:28
  Mike Masnick: And, and are just interested in seeing the profits go up.
• 29:31
  Mike Masnick: And so the natural state of things, and this is true of any sort of outsourcing kind of thing that has happened in all different industries over the years, not just in this one, is that you look for cheaper labor that will do the work that is effective enough on a global scale.
• 29:46
  Mike Masnick: And so I, again, like, I'm not saying this is the right thing to do, but it's, easy to say they should pay them more and they should, but like.
• 29:52
  Mike Masnick: You have to put that into the context of the system that these companies operate in, and you begin to realize like these are systematic, global society level problems that, that aren't so simple to solve.
• 30:03
  Ben Whitelaw: do you think shareholders of Teleperformance or or meta would mind taking a slightly smaller dividend if they knew that?
• 30:10
  Ben Whitelaw: I don't know.
• 30:10
  Ben Whitelaw: Moderators in Ghana weren't like,
• 30:13
  Mike Masnick: possible, right?
• 30:14
  Mike Masnick: I mean, this is the nature.
• 30:15
  Mike Masnick: This is why we now have activist investors who are like pro-social activist investors who look to invest in companies and say like, no, we want you to change your policies and we're willing to take a slightly smaller profit.
• 30:25
  Mike Masnick: or you could make the argument that like, in the long term it is better because you don't have these, front page stories in the Guardian that slam your company for being.
• 30:33
  Mike Masnick: Evil, horrible people that, causes disruptions to your business.
• 30:37
  Mike Masnick: If you want to have a good reputation in the world, you can still make money if you continue to treat employees well, there are certainly companies in the world that have embraced that.
• 30:45
  Mike Masnick: here in the US certainly there's been a lot of conversation about Costco in particular, though.
• 30:50
  Mike Masnick: there's some issues there right now with like trying to unionize workers in Costco, but historically, they've always tried to pay their workers more and they've had a much, a stretch of where their employees were not only paid well, but they tended to stay at Costco for a much longer time.
• 31:05
  Mike Masnick: And yet Costco has been incredibly profitable over that time.
• 31:08
  Mike Masnick: There are ways to do business right, and still be profitable and sort of make that a part of your brand and your business.
• 31:14
  Mike Masnick: Because that helps in terms of, the media aspect of it.
• 31:17
  Mike Masnick: But again, we're talking about fitting that into the overall system and I, you know, you hope that articles like this and media attention leads companies to realize like, wait, it's more costly than it appears to go for the sort of cheap.
• 31:29
  Mike Masnick: Solution.
• 31:30
  Mike Masnick: maybe it does make sense to pay people more, to treat them better, because then, it may feel like it cuts into our bottom line in the short term, but in the long term, we could get good press out of it instead of this horrific press.
• 31:41
  Mike Masnick: but, that's a sort of strategic decision that these companies need to make and it's a little bit more challenging.
• 31:46
  Ben Whitelaw: yeah.
• 31:47
  Ben Whitelaw: If Costco did moderation,
• 31:48
  Mike Masnick: Yeah.
• 31:49
  Ben Whitelaw: I'd like, I'd read that piece.
• 31:50
  Ben Whitelaw: Uh, other, other, other wholesale companies are available, although if Costco, you are listening and wanna sponsor the next episode of Good Product Speech, please do reach out.
• 31:58
  Ben Whitelaw: Um,
• 31:59
  Mike Masnick: I do think they're having a labor dispute currently, so I don't know where that is now, but
• 32:04
  Ben Whitelaw: okay.
• 32:04
  Ben Whitelaw: We'll figure that out and then we'll, we'll, we'll reach out.
• 32:06
  Ben Whitelaw: Um.
• 32:07
  Ben Whitelaw: Okay, cool.
• 32:08
  Ben Whitelaw: So you know, that's a big story that continues to kind of rumble on and we'll, we'll come back to in future episodes of Controlled Speech.
• 32:14
  Ben Whitelaw: we've got time, Mike, before we dive into our chat with Mike for a couple more, quick fire stories, which we never managed to make very quick fire, uh, particularly when there's like a kind of gaggle of them, as the next story is.
• 32:25
  Ben Whitelaw: So
• 32:26
  Mike Masnick: I'm gonna, I'm gonna do my best and admit that this story is one that probably deserves, longer, more thoughtful conversation, but I wanna try and go through it quickly.
• 32:34
  Mike Masnick: it started with, a big piece in the Wall Street Journal by Jeff Horowitz, who has done, you really astounding work over the years, sort of exposing where Meta falls down.
• 32:43
  Mike Masnick: I think Meta hates him with the passion of a thousand sons.
• 32:47
  Mike Masnick: But, he's really exposed, like, where there are breaks and problems in, man trust and safety work.
• 32:52
  Mike Masnick: And in this case, he was looking at their push for AI bot companions.
• 32:57
  Mike Masnick: And apparently, you know, there are a lot of companies doing this.
• 33:00
  Mike Masnick: We talked about character ai.
• 33:02
  Mike Masnick: there's a legal controversy about them.
• 33:04
  Mike Masnick: but what, the article by Jeff found was that.
• 33:08
  Mike Masnick: there had been like some event where a bunch of these bots were sort of shown and metas performed poorly, in part because they had locked it down and sort of tried to make sure that nothing bad would happen and the bots would, not stray into more dangerous territories.
• 33:22
  Mike Masnick: Often sort of, you know, sexual adult content kind of territories.
• 33:26
  Mike Masnick: And because they performed badly, mark Zuckerberg got upset and basically told the team take off the restrictions.
• 33:32
  Mike Masnick: just let's accept some risk because of that.
• 33:36
  Mike Masnick: The Wall Street Journal.
• 33:37
  Mike Masnick: We're able to sort of get these bots to have conversations that are very problematic.
• 33:42
  Mike Masnick: And you can look at the article and, one meta had licensed famous people, John Cena, Kristen Bell, some other folks to be, so, you know, the identities of these chats.
• 33:53
  Mike Masnick: And then we're able to have those chats engage in sexual conversations with people who identified as being underage.
• 34:01
  Mike Masnick: And there.
• 34:03
  Mike Masnick: It's bad.
• 34:03
  Mike Masnick: Like there's no way to look at this and say that it's good, Meta's response, Very self-serving response is effectively like, this almost never happens.
• 34:13
  Mike Masnick: You really sort of have to push the model to have it happen.
• 34:16
  Mike Masnick: and there is some accuracy to that.
• 34:17
  Mike Masnick: Like there are lots of stories of AI doing bad things where when you look at the details, it's always like, because the AI was pushed to do the bad thing and if you keep pushing and you keep sort of twisting it and trying to trick it, in some cases you had to sort of do this semi-famous, Red teaming trick of like, the AI tells you I can't do that.
• 34:36
  Mike Masnick: And then you, you have a way to get around it.
• 34:38
  Mike Masnick: I'm, I'm not gonna explain what that is here it is in the article, but there are a number of little tricks to sort of get around when the AI tells you it's not gonna do that.
• 34:46
  Mike Masnick: You know, clearly there were some protections put in place, but, you know, I think the, bigger story here was, they have examples of Zuckerberg basically saying like.
• 34:53
  Mike Masnick: Remove the guardrails and at one point, even saying like, according to someone who apparently told Jeff or told the Wall Street Journal that Zuckerberg said like, I missed out on Snapchat and I missed out on TikTok and I'm not gonna miss out on this.
• 35:06
  Mike Masnick: And so it's like, you know, we need to be the leader in these AI chat bot things.
• 35:10
  Mike Masnick: and so the way he's trying to do that is to throw away the safety concerns about it.
• 35:15
  Mike Masnick: That's really problematic and really dangerous.
• 35:18
  Ben Whitelaw: yeah, really great, really great piece and really shows Zuckerberg's character in all of its glory.
• 35:24
  Ben Whitelaw: And there's a couple other pieces that will include in the show notes, Mike, that, do you wanna just allude to those briefly?
• 35:28
  Mike Masnick: Yeah, there, there was also a study that came out this week from Common Sense Media basically saying that kids should never use AI chat Botts.
• 35:35
  Mike Masnick: I think that's wrong.
• 35:37
  Mike Masnick: I'm not gonna get into it.
• 35:38
  Mike Masnick: We could go into a whole discussion on it.
• 35:39
  Mike Masnick: I think that there are obviously cases where they should not, kids should not be using AI chat bots, but I think a wholesale condemnation saying.
• 35:46
  Mike Masnick: You know, it's the same story.
• 35:47
  Mike Masnick: Prohibition, banning whatever.
• 35:49
  Mike Masnick: I think there are ways to teach people to use things, right?
• 35:51
  Mike Masnick: There are ways to use tools properly and educating everybody, having the tool makers be better, having people who are using it be better.
• 35:58
  Mike Masnick: Having parents teach kids, having, teachers teach kids better.
• 36:01
  Mike Masnick: How to use these things is a better approach.
• 36:03
  Mike Masnick: But there was a study this week from Common Sense Media in association with Stanford that argues that kids should never use these things.
• 36:09
  Mike Masnick: We'll have a link to that story.
• 36:10
  Mike Masnick: It's worth reading, as well.
• 36:11
  Mike Masnick: And, I think that's basically it.
• 36:13
  Mike Masnick: We also, there was a, a business insider story of a mother who works in tech who talks about how to raise a kid, to understand the limitations and problems and risks of these technologies and saying that's a better approach, which I also think fits into this, story of like, Kids and using these technologies, especially AI chat bots, it's something new.
• 36:31
  Mike Masnick: It is something of a challenge, but I think there are ways to approach it intelligently and carefully and thoughtfully rather than just saying, this is bad.
• 36:37
  Mike Masnick: This is horrible.
• 36:37
  Mike Masnick: We have to wipe out the whole space.
• 36:39
  Ben Whitelaw: Yeah, it would be really interesting to see what other research comes out about the rise of AI companions.
• 36:44
  Ben Whitelaw: 'cause I've seen, initial research that it's a, a kind of use of.
• 36:47
  Ben Whitelaw: AI that is really re increasing very rapidly.
• 36:50
  Ben Whitelaw: Um, we just don't not know enough enough about the kind of effects of it.
• 36:53
  Ben Whitelaw: I'll just wrap up, Mike by, sharing a couple of stories about frauds, um, again, related to a meta.
• 37:00
  Ben Whitelaw: So we've actually had a kind of three in a row of negative press for meta.
• 37:04
  Ben Whitelaw: That's not, not usually how we do it, it's not been on purpose, but, colleague of mine at the ft, a writer called Martin Wolf, wrote an op-ed this weekend about how he had been alerted to deep fakes on Instagram and on Facebook, advertising a completely bogus kind of investment scam with his face on it.
• 37:27
  Ben Whitelaw: Essentially, somebody's created a very close up, video of him saying.
• 37:32
  Ben Whitelaw: Join my, my WhatsApp group.
• 37:34
  Ben Whitelaw: I'll tell you all the stocks that are about to go up.
• 37:37
  Ben Whitelaw: I've got, decades of experience in this stuff.
• 37:39
  Ben Whitelaw: And he's, he's a massively respected columnist, in the uk.
• 37:42
  Ben Whitelaw: his piece is kinda interesting in and of itself.
• 37:44
  Ben Whitelaw: You know, he's a, 79-year-old man.
• 37:46
  Ben Whitelaw: I don't imagine he, he uses many of these platforms in as much depth as, many of our listeners.
• 37:51
  Ben Whitelaw: And, you know, his kind of surprise at the fact that this is able to happen is kind of interesting in and of itself.
• 37:57
  Ben Whitelaw: Ofcom and meta were alerted the ads have come down.
• 38:01
  Ben Whitelaw: But like all of these things, really the, like we talked about today, Mike, you know, whack-a-mole approach to these things, things will crop up and he will I'm sure be back in fake ads on the platform soon.
• 38:11
  Ben Whitelaw: it's also linked to a new report.
• 38:14
  Ben Whitelaw: That came out yesterday, in the UK from the Financial Conduct Authority, which is, basically kind of financial watchdog in the UK who do a lot of the relationship management with the social media platforms related to financial scams and, you know, the kind of influencer trend that's taking shape.
• 38:32
  Ben Whitelaw: And interestingly, they have come out and said that meta is one of the slowest to react to.
• 38:37
  Ben Whitelaw: It's alerts about these scams when they're on the platform.
• 38:41
  Ben Whitelaw: So, you know, often taking six weeks at a time to take down content that, the FCA, find, and which deemed to be, improper.
• 38:50
  Ben Whitelaw: So, we're seeing there, I guess despite the kind of size of the company, despite the kind of firepower that it has in terms of its trust and safety approach, being very slow to deal with.
• 38:59
  Ben Whitelaw: Financial scams at large, and for Martin Wolf having a kind of very personal, effect on him.
• 39:05
  Ben Whitelaw: So again, we don't have much more time to go into scams.
• 39:09
  Ben Whitelaw: It's something that we, I would like to go into a bit more, Mike.
• 39:11
  Ben Whitelaw: 'cause I think there's been big shift across the industry.
• 39:14
  Ben Whitelaw: People are.
• 39:14
  Ben Whitelaw: Working much more together.
• 39:15
  Ben Whitelaw: And there's a couple of really interesting, industry groups that have emerged to, deal with scams.
• 39:20
  Ben Whitelaw: but today I think we'll use that neat link to shift from our stories, which we've covered from the ft, from the Guardian, from the Wall Street Journal, from the Bureau of Investigative Journalism.
• 39:31
  Ben Whitelaw: And to jump into our bonus chat with Mike Pappas from Mod eight about his experience of detecting abuse in gaming, is translating to tracking financial malfeasance.
• 39:40
  Ben Whitelaw: take it away, Mike.
• 39:51
  Speaker: [music]
• 39:52
  Ben Whitelaw: It's great to have you back on the podcast.
• 39:54
  Ben Whitelaw: Mike.
• 39:54
  Ben Whitelaw: Thanks for taking the time to talk to us, uh, control alt speech.
• 39:57
  Ben Whitelaw: you are here to talk a bit about online fraud, which is a topic that continues to be something we, speak to and about every week.
• 40:04
  Ben Whitelaw: And, you've been busy in the last year since you helped launch the podcast.
• 40:08
  Ben Whitelaw: Modulate was a launch sponsor.
• 40:10
  Ben Whitelaw: Talk us through how your kind of thinking and the company's thinking has evolved and, and what you mean when you talk about online fraud.
• 40:17
  Mike Pappas: Yeah, thanks again for having me back, Ben.
• 40:19
  Mike Pappas: Excited to be here.
• 40:20
  Mike Pappas: so as you may remember, modulate is a pro-social voice intelligence company.
• 40:26
  Mike Pappas: So what that means is we have this.
• 40:28
  Mike Pappas: Technology we've built that's able to analyze voice conversations in very, very rich ways, understand the emotions, the conversational dynamics and back and forth.
• 40:38
  Mike Pappas: And what we've been trying to do is leverage that in different environments where we can recognize sort of the, Deeper details of a conversation than you would get from a superficial text analysis or something like that, and say, where can we deploy that level of intelligence and insight to help protect users or give them a richer experience?
• 40:58
  Mike Pappas: So.
• 40:59
  Mike Pappas: As you know, we got started in the game space looking at toxicity detection as well as positivity detection.
• 41:05
  Mike Pappas: But in the last few years we've been working with a number of folks outside of the gaming space in more classic enterprise use cases around things like call centers or in the gig economy.
• 41:16
  Mike Pappas: We're frequently asked, Hey, can you help us navigate some of these challenges around financial malfeasance?
• 41:24
  Mike Pappas: That sort of fits nicely into this bucket of things that we're trying to do, but is a new challenge because as I'm sure you know, there's a lot of different, types of fraud or scams or abuse, which I can talk more about.
• 41:39
  Mike Pappas: Figuring out the right way to partition those things required us to bring in a new level of expertise and really sort of think through how those kinds of categories and detections should look different from a typical sort of harassment or hate speech detection.
• 41:54
  Mike Pappas: So that's a lot of the work we've been doing over the, the last several months in the lead up to our recent voice vault announcement, which is that fraud product.
• 42:03
  Mike Pappas: but let me, let me pause there and let you ask some additional questions.
• 42:06
  Ben Whitelaw: Yeah, it's fascinating.
• 42:07
  Ben Whitelaw: I mean, we, we touched on this before we started recording, but you have this idea of this kind of breakdown, this, of almost like taxonomy between fraud scams and abuse that, that you use to kinda shape this work.
• 42:18
  Ben Whitelaw: Talk us through how you see those, differently.
• 42:20
  Ben Whitelaw: I.
• 42:21
  Mike Pappas: Yeah, so when people talk about fraud, the picture that comes into their head is usually you are trying to defraud me, and that is absolutely one of the kinds of things that we need to watch for when we're listening to these conversations.
• 42:36
  Mike Pappas: In an enterprise setting, I.
• 42:37
  Mike Pappas: We are listening for is Ben calling this call center to claim he never received an order that he did and that he needs his money back?
• 42:46
  Mike Pappas: Or is Ben calling an elderly person and trying to claim that he's actually their nephew and needs them to wire him money?
• 42:53
  Mike Pappas: There's all these kinds of scams that I should say Evil Ben, um, would maybe be trying to, to deploy.
• 42:59
  Mike Pappas: that is sort of what we mean in our classification of fraud as direct fraud.
• 43:04
  Mike Pappas: We differentiate that from something that's equally important to us, which is recognizing victims.
• 43:11
  Mike Pappas: When they perhaps are calling their financial provider.
• 43:15
  Mike Pappas: So if I'm calling my bank and I have been scammed in a different setting, and now I am coming in saying, Hey, I got this call and I need to wire this money today.
• 43:27
  Mike Pappas: It's super urgent, the Nigerian prince needs me, then the bank has a both financial and moral incentive to recognize, Hey Mike.
• 43:36
  Mike Pappas: Let's talk a little bit before we wire this money out.
• 43:39
  Mike Pappas: and, you know, they're, they're actually in many regions of the world on the hook.
• 43:43
  Mike Pappas: If they do allow me to complete that transaction, they need to make me whole because they facilitated the sort of process of me being scammed so that that's scamming and then abuse.
• 43:54
  Mike Pappas: Is someone more directly sort of physically coercing me to do the wrong thing.
• 43:59
  Mike Pappas: So you often see this in abusive relationships, more commonly, unfortunately, from men to a woman, but can be in any case where one member of the relationship.
• 44:09
  Mike Pappas: Doesn't literally have control over the others' finances, but is deploying a lot of abusive tactics and maybe is literally even sitting there behind you while you're on the phone with your banker telling you what to say, and we can notice that.
• 44:25
  Mike Pappas: Or maybe it's simply that there's a lot of uncertainty from your position when you're trying to make this transaction or you're being asked to do something that would not normally be financially responsible.
• 44:36
  Mike Pappas: So where with toxicity we can really just look and say, Hey, we can kind of hear the malevolence in your voice.
• 44:42
  Mike Pappas: A lot of the time when we're trying to understand fraud, it requires us to look much deeper at the content of what's being said, at the fact that someone behind the scenes might have manipulated the conversation we're having now.
• 44:56
  Mike Pappas: So our system needs to understand.
• 44:59
  Mike Pappas: Why might you be calling and sort of think about that and it ends up being a much more nuanced risk mitigation process.
• 45:05
  Mike Pappas: So we're a lot less likely to flag, say to a bank or a call center, this is definitely a problem.
• 45:12
  Mike Pappas: Shut it down.
• 45:13
  Mike Pappas: Right now we're a lot more likely to flag.
• 45:16
  Mike Pappas: There are a lot of risk factors that we're identifying.
• 45:20
  Mike Pappas: You might want to run an extra identity check or you might wanna put a two day pause on this transaction.
• 45:25
  Mike Pappas: There's.
• 45:26
  Mike Pappas: A lot of tools that you might have to soften that risk and make sure that you can really dig in and validate things before you do something that you can't sort of turn back.
• 45:37
  Ben Whitelaw: Yeah.
• 45:37
  Ben Whitelaw: when you kind of frame it like that, Mike, it's very.
• 45:39
  Ben Whitelaw: Clear how, pervasive, fraud is in this, in those broad senses are, and how, how often we can kind of, I guess, come up against those harms in different guises.
• 45:49
  Ben Whitelaw: You know, you mentioned about modulate starting its life as a, gaming focused, technology.
• 45:55
  Ben Whitelaw: You've started to think more about marketplaces and the gig economy and, and social platforms to an extent as well.
• 46:01
  Ben Whitelaw: How much are the kind of.
• 46:03
  Ben Whitelaw: Foundations that you built for gaming, translatable into those worlds.
• 46:07
  Mike Pappas: Believe it or not, we were able to deliver our first sort of fraud detection tools within about two or three weeks of getting that request and that that's the result of many years of dedicated work in building this more holistic voice intelligence platform that both talks mod and voice vault are built on top of.
• 46:28
  Mike Pappas: By the time we were getting this request, we had already taught that ecosystem, things like how to detect child grooming, which in many ways is reminiscent of fraud or sort of a longer term scam, right?
• 46:40
  Mike Pappas: So we had a lot of the core ingredients already in our voice intelligence model, and it was at that point much more about us just telling it, Hey, please now look for this kind of bad thing.
• 46:53
  Mike Pappas: As opposed to that one, rather than having to teach it about that new kind of bad thing from scratch.
• 46:59
  Ben Whitelaw: Right.
• 47:00
  Ben Whitelaw: And, and can you give us something like some of the most egregious examples that you're, that you've kind of come across in these new, verticals that you're working?
• 47:07
  Ben Whitelaw: Because I think a lot of listeners will be.
• 47:09
  Ben Whitelaw: fascinated by some of the examples you've shared with me previously, like
• 47:12
  Mike Pappas: Yeah, I mean, it, it varies so much, and this is, this is something that we're thinking a lot about is there's so many different kinds of customers for this product.
• 47:21
  Mike Pappas: Again, a a financial institution needs to worry much more about protecting you from yourself in a lot of ways.
• 47:28
  Mike Pappas: a retail call center needs to worry about sort of you trying to scam the business.
• 47:33
  Mike Pappas: In a gig platform setting, you're worried about people trying to manipulate your drivers directly Potentially.
• 47:39
  Mike Pappas: So in the food delivery space, we see a lot of folks that will, you know, get on the phone with a driver and say, you only delivered half my order.
• 47:48
  Mike Pappas: I was charged for this.
• 47:49
  Mike Pappas: You personally need to Venmo me this money.
• 47:54
  Mike Pappas: and we'll make, you know, personal, direct threats to that gig worker who is of course not an employee.
• 48:01
  Mike Pappas: So it doesn't have all the protection of the platform.
• 48:03
  Mike Pappas: These platforms do want to try and do what they can to support these workers, but it's a setting where I think, not that I'm gonna say any of these, you know, scammers and fraudsters have a moral like to stand on, but I think many of them might believe that they're scamming some many million dollar corporation when in fact they're taking money out of some of these gig workers' pockets who are really just trying to get by.
• 48:28
  Mike Pappas: and of course you see similar things with, telecom providers who are worried about someone scamming the elderly or other vulnerable people very directly.
• 48:36
  Mike Pappas: so it really ranges in terms of who is being targeted.
• 48:41
  Mike Pappas: you know, we, we've talked to a number of folks in the online dating space about.
• 48:44
  Mike Pappas: The type of scam that was called pig butchering.
• 48:48
  Mike Pappas: I know that there's been a movement away from using that language to make it, um, less frankly demeaning to the victims, but it's still a pervasive type of scam.
• 48:57
  Mike Pappas: And so, sorry that was more of a ramble than a direct answer, but I, I think that the truth is it's just such a big space.
• 49:04
  Mike Pappas: and this is why we think it's really important to be.
• 49:07
  Mike Pappas: Using a sort of more, AI type system that can really navigate these different conversational dynamics.
• 49:14
  Mike Pappas: Because if you just try and pre-program, oh, look for the words Nigerian prince, you're never gonna catch even a 10th of the stuff that's happening here.
• 49:24
  Ben Whitelaw: Right.
• 49:24
  Ben Whitelaw: And then, and the nature of, I guess, voice is that there is a real life element to it, you know, and it's these, particularly the gig economy examples there, you know, they blur into kinda real life potential harm and, almost physical violence, which I think is so fascinating about the work you do.
• 49:38
  Ben Whitelaw: you talked there about, um, your kind of new products.
• 49:41
  Ben Whitelaw: Just give us a sense of kind of what it does and, and maybe, you know, if listeners are looking for support in this area, like what it could do for them.
• 49:48
  Mike Pappas: Yeah, so voice vault akin to talks MOD is a system that can be plugged into any voice conversation environment, and can watch hundreds of millions of conversations in parallel, yes, in a privacy respecting way.
• 50:01
  Mike Pappas: I won't go off on that whole tangent right now, but that is something that's very important to us and we've done a lot of work to build out those privacy settings appropriately.
• 50:11
  Mike Pappas: But what it's able to do, again, whether it's deployed into a traditional call center in an app used by your gig workers directly onto sort of telecom services for the average consumer, it's able to sit on top of those conversations and recognize the telltale early signs of this kind of fraud scammer abuse, once it notices that.
• 50:32
  Mike Pappas: Each partner of ours will customize.
• 50:34
  Mike Pappas: What do we do about that?
• 50:36
  Mike Pappas: Again, a financial institution might say, let's bring in a supervisor.
• 50:39
  Mike Pappas: Let's put a hold on the transaction.
• 50:41
  Mike Pappas: A telco might say, maybe we give you a configuration option so that if it's trying to scam grandma, it can call one of grandma's kids or send them a notification so that they can intervene.
• 50:53
  Mike Pappas: The right intervention is gonna be different in each of these settings, but that's fully tuneable.
• 50:59
  Mike Pappas: The other piece of this that I'll call out is, this is fully voice native.
• 51:02
  Mike Pappas: You, you mentioned voice being really important here.
• 51:05
  Mike Pappas: Some financial transactions don't happen on voice.
• 51:08
  Mike Pappas: Many still do, and especially those most vulnerable populations are also often the ones who are most inclined to be using voice chat.
• 51:17
  Mike Pappas: and it's also, again, a place where you can see emotions.
• 51:20
  Mike Pappas: So if you're looking for signs of things like financial or broader abuse, being able to actually hear the tenor of the voice and understand sort of the emotional wellbeing of that color.
• 51:32
  Mike Pappas: Can be incredibly powerful tool in recognizing people who need help, but might not be in a position to say it
• 51:38
  Ben Whitelaw: Yeah, so voice, voice in some ways, like almost some of the most, at risk groups, at some of the most at risk moments, you could argue, you know, um.
• 51:48
  Mike Pappas: Yeah.
• 51:49
  Ben Whitelaw: that's all really, really interesting.
• 51:50
  Ben Whitelaw: Where, where can we find out more, Mike, about the products and the work you're doing?
• 51:54
  Ben Whitelaw: Where should listeners go
• 51:55
  Mike Pappas: the easiest answer is our website, just modulate.ai.
• 51:58
  Mike Pappas: We've got detailed information about voice fault, and we'll be sharing a lot more in the coming weeks and months as we get, some of our earliest customers together on things like case studies.
• 52:08
  Mike Pappas: So, definitely go there for the deepest information on how this product works.
• 52:13
  Mike Pappas: we've also got a number of other resources, so you can find us on LinkedIn.
• 52:17
  Mike Pappas: We've got our newsletter Trust and Safety lately.
• 52:19
  Mike Pappas: This time I'm not accidentally naming your newsletter, Ben.
• 52:23
  Mike Pappas: Um, though, everything in moderation is also an excellent resource.
• 52:26
  Mike Pappas: Um, but yeah, you can find us pretty much anywhere online and we're, always excited to talk about this.
• 52:33
  Mike Pappas: even if, we're not the right vendor partner for you.
• 52:36
  Mike Pappas: We think it's incredibly important for people to understand the nuances of how to build a voice safety system, and we're always happy even just to offer advice to folks that are looking to build something separately.
• 52:47
  Ben Whitelaw: Brilliant.
• 52:48
  Ben Whitelaw: Well, that's really great.
• 52:49
  Ben Whitelaw: Love to hear you, talk so thoughtfully about this, really tricky, tricky harm to spot Mike.
• 52:54
  Ben Whitelaw: And, uh, thanks for taking the time to speak to.
• 52:56
  Mike Pappas: Thanks again for having me.
• 53:00
  Announcer: Thanks for listening to Ctrl-Alt-Speech.
• 53:03
  Announcer: Subscribe now to get our weekly episodes as soon as they're released.
• 53:07
  Announcer: If your company or organization is interested in sponsoring the podcast, contact us by visiting ctrlaltspeech.Com.
• 53:13
  Announcer: That's C T R L Alt Speech.
• 53:16
  Announcer: com.
• 53:17
  Announcer: This podcast is produced with financial support from the Future of Online Trust and Safety Fund, a fiscally sponsored multi donor fund at Global Impact that supports charitable activities to build a more robust, capable, and inclusive trust and safety ecosystem.