Latest / Ctrl-Alt-Speech / Honey, I Shrunk the Kids’ Internet
Transcript
- 0:00Ben Whitelaw: So faci, we were talking just before we started recording, about how the prompt some control al speech, which we use every single week to start the podcast, have got weirder and weird, uh, and weird.
- 0:10Ben Whitelaw: Uh, so I'm, I'm sorry to put you in this situation'cause this is maybe one of the strangest, Janor AI is an actually an app we're gonna talk a bit about in today's episode.
- 0:19Ben Whitelaw: It's a kind of immersive character, world building type app, used a lot by teenagers, and when you go onto the site it says, you know, big kind of bold letters, be anyone build anything.
- 0:32Ben Whitelaw: So, as your introduction to, control speech, what would you be and what would you build?
- 0:37Fadzai Madzingira: I love that you pick something that is clearly we are the target audience of, um, I, I think if I could build anything, it would be something that can.
- 0:48Fadzai Madzingira: Track these safety stories as well as you and Mike seem to do, because preparation for this, I was like, how do, um,
- 0:59Ben Whitelaw: Yeah.
- 0:59Ben Whitelaw: Okay.
- 1:00Ben Whitelaw: Okay.
- 1:00Ben Whitelaw: I mean, I, I would like that too actually, because it, if you build it, let me know.
- 1:06Ben Whitelaw: it would save us a lot of time, as you say.
- 1:08Ben Whitelaw: Um, I, I think if I was to build anything, apart from your magic tool to help you prepare for podcasts, I think I would be a janitor actually.
- 1:15Ben Whitelaw: I spent,
- 1:16Fadzai Madzingira: that's nice.
- 1:17Ben Whitelaw: I spent a summer as a university kind of janitor.
- 1:20Ben Whitelaw: I was painting rooms and dorms and you know, generally sprucing up the place in between cohorts of delinquent students.
- 1:27Ben Whitelaw: And I had a great summer.
- 1:29Ben Whitelaw: So maybe, you know, taking, taking the janitorial, route would be actually quite nice.
- 1:34Ben Whitelaw: Not that I'm not enjoying this.
- 1:35Fadzai Madzingira: Yeah, I know.
- 1:36Fadzai Madzingira: I love how your, your home renovations have not deterred you from the desire of like, let's make things nicer.
- 1:42Fadzai Madzingira: Um, so that is excellent.
- 1:45Ben Whitelaw: My therapist would've A field day.
- 1:56Ben Whitelaw: Hello and welcome to Control Alt Speech, your weekly roundup of the major stories about online speech, content moderation, and internet regulation.
- 2:04Ben Whitelaw: It's April the ninth, 2020 sixth, and this week we're discussing the future of Meta's Giant content moderation experiment, grease, jumping on the social media band bandwagon, and how the kids might be.
- 2:14Ben Whitelaw: All right, depending on who you talk to.
- 2:16Ben Whitelaw: My name's Ben Whitelaw.
- 2:17Ben Whitelaw: I'm the founder and editor of Everything in Moderation, and as you would've heard already, Mike is taking a well earned break this week from hosting duties, and I'm very lucky to be here with Fai Mad Gira, a policy expert with a decade of experience at Meta Salesforce, Ofcom and Twitch.
- 2:32Ben Whitelaw: Fai, welcome to the podcast.
- 2:34Fadzai Madzingira: Thank you.
- 2:35Fadzai Madzingira: I am atic to be here.
- 2:37Fadzai Madzingira: Anyone who knows me knows I am nerding out like crazy right now.
- 2:40Fadzai Madzingira: So thank you so.
- 2:43Ben Whitelaw: It is an absolutely pleasure to have you.
- 2:44Ben Whitelaw: I mean, we, we should the full disclaimers that Fad Z and I met several years ago at a conference to do with content moderation and internet regulation.
- 2:52Ben Whitelaw: And we are both based in London and we, we are, I'd say we're mates now.
- 2:56Ben Whitelaw: I don't wanna, I don't wanna
- 2:57Fadzai Madzingira: think so.
- 2:58Fadzai Madzingira: I think so.
- 2:59Fadzai Madzingira: I try.
- 3:00Fadzai Madzingira: I don't
- 3:05Ben Whitelaw: well, I was worried because I was putting myself out there and, you know, sometimes that can be unrequited, but I'm glad, I'm glad you think the same.
- 3:13Ben Whitelaw: we're very lucky to have you on the podcast.
- 3:15Ben Whitelaw: As I say, part of your role at Twitch is where it's very multifaceted.
- 3:18Ben Whitelaw: First of all, you're leading the policy outreach and education teams, at Twitch, which, many of our listeners will know about.
- 3:25Ben Whitelaw: can you tell us a bit about how that role plays out and what kind of structure, uh, the team looks like at Twitch?
- 3:32Fadzai Madzingira: Yeah.
- 3:32Fadzai Madzingira: so, uh, like you said, I, I lead, it's a global team, and it's policy outreach education, which is the three large pillars.
- 3:40Fadzai Madzingira: And what that means is my team is responsible for, safety policy development.
- 3:45Fadzai Madzingira: we provide input into product roadmaps, and then we engage with community insights, which helps shape our safety communications, and we also lead our safety education program.
- 3:55Fadzai Madzingira: it's a very strong part of our core value around being community first.
- 3:58Fadzai Madzingira: And I'll speak on that a little bit.
- 4:00Fadzai Madzingira: but before I do that, I don't wanna make any assumptions.
- 4:03Fadzai Madzingira: so I might wanna start with just like, what is Twitch?
- 4:06Fadzai Madzingira: for those who may not be familiar, Twitch is a live streaming platform.
- 4:09Fadzai Madzingira: we're, in.
- 4:10Fadzai Madzingira: any given month, about 5 million streamers create content for over a hundred million users.
- 4:16Fadzai Madzingira: I think what might surprise you is that while Twitch is often known as being gaming adjacent, and as such is often viewed as having a very young viewership, actually over 70% of our communities, sit between the ages of 18 and 35.
- 4:30Fadzai Madzingira: we actually have a really diverse community.
- 4:32Fadzai Madzingira: we have, not just gaming, which is what we're historically known for.
- 4:36Fadzai Madzingira: We have people, who are, DJs, musicians, political commentators.
- 4:40Fadzai Madzingira: It is a wonderfully long list of, individuals who are on the platform.
- 4:45Fadzai Madzingira: what I love most about Twitch and how it impacts our safety is, the centering of Twitch is around community building.
- 4:52Fadzai Madzingira: so I'm a lurker, on several like black women gaming streamers and a lot of, DJs.
- 4:58Fadzai Madzingira: and they do a lot of long form content.
- 5:01Fadzai Madzingira: And long form content is a little bit different because it requires, it requires someone to really engage with those who are in chat and the, people who engage with their content.
- 5:10Fadzai Madzingira: And so what happens is you start to build, community across very specific, niche and diverse types of, issues or areas or, interests.
- 5:19Fadzai Madzingira: and, uh, how that impacts what it means is that the focus for us is how do we make sure we're building safety.
- 5:25Fadzai Madzingira: Products and policies that inspire that community expression.
- 5:29Fadzai Madzingira: and so my team is a reflection on that, in that I don't just lead the team that owns the community guidelines.
- 5:35Fadzai Madzingira: it's also a team that's focused on, well, how do we talk about our safety policies and practices?
- 5:40Fadzai Madzingira: How do we explain that?
- 5:42Fadzai Madzingira: what does our education look like if the center of what we do is about building community and explaining why we are doing what we're doing and then iterating and trying to learn how do we educate better?
- 5:53Fadzai Madzingira: So rehabilitation is also a strong part of how we do that, and that's reflected across all of our safety teams.
- 5:58Fadzai Madzingira: So that's engineering, tooling, operations.
- 6:01Fadzai Madzingira: and I engage quite regularly with our executive teams as well because of that safe community's focus.
- 6:06Fadzai Madzingira: and it inadvertently aligns very closely with.
- 6:08Fadzai Madzingira: My, research work, which you're aware of.
- 6:11Fadzai Madzingira: Like I focus a lot on what does it mean to build user empowerment within communities.
- 6:15Fadzai Madzingira: and so it is a very different way of how I've historically done trust and safety.
- 6:19Fadzai Madzingira: The focus historically has often been how do we take down harm?
- 6:23Fadzai Madzingira: And this is very much about how do we build safe communities, which is really cool.
- 6:28Ben Whitelaw: really interesting.
- 6:28Ben Whitelaw: And I think that has been the trend over the kind of two years or so that Mike and I have been doing the podcast is that shift has been happening, every week, right?
- 6:36Ben Whitelaw: There are stories about how users are being given tools to be able to manage their little corner of the internet, more closely to the values that they have.
- 6:43Ben Whitelaw: you know, as you say, like creating policies with users that allow'em to express themselves in the way that they wish.
- 6:48Ben Whitelaw: So that, that's really interesting to hear your career follow the same route.
- 6:52Ben Whitelaw: I wanna talk a bit about the kind of education piece, um, particular, because I think that's a pretty unique part of what you do in, in terms of the, the roles and the hats that you wear.
- 7:01Ben Whitelaw: what are the best ways that you've found to kind of educate users about policies?
- 7:05Fadzai Madzingira: that is a great question and it's an ongoing question.
- 7:08Fadzai Madzingira: I am so grateful that I have such an excellent, education lead on my team.
- 7:14Fadzai Madzingira: and her entire focus is not just the presentation of education, but what does safety literacy mean?
- 7:21Fadzai Madzingira: and I think the way.
- 7:22Fadzai Madzingira: We like to think about it is that it depends, on the audience, where the creator is in their journey, and making sure that any information is accessible, easy to get to, an easy, understandable, and then it also means iterating.
- 7:36Fadzai Madzingira: I realize I'm not answering, I'm answering your question like a lawyer, but what that means is that it depends on the thing we're educating on, right?
- 7:43Fadzai Madzingira: If we're launching brand new products that no one's Ever been able to engage with?
- 7:48Fadzai Madzingira: so when we first, launched Auto Mod, which is a tool that helps, our creators and their moderators moderates their, chat and their channel.
- 7:55Fadzai Madzingira: when you launch something like that, it's not enough to just do a singular blog or a singular tweet.
- 8:00Fadzai Madzingira: You'd provide a lot more detail guides, as well where people can go and find information on how to use the tool, how to engage the tool, and then we would continuously update and monitor based on, feedback we're getting from the community.
- 8:13Fadzai Madzingira: whereas some things, a small enough changes that we are sort of like, Hey, we've just updated this one thing around, how moderation, prompts work, or how our chat prompts work.
- 8:21Fadzai Madzingira: And so heads up and then that might just go out on socials.
- 8:24Fadzai Madzingira: it's also been, I think To your question, it also means then we've had to be quite creative about how do we know if something is working And it's required for the first time in my career, which is what's so cool about Twitch, of really sitting down and being like, well, what does working mean?
- 8:39Fadzai Madzingira: and how do you think, how do we think about actor behavior and what does it mean to build a toxic, free space?
- 8:45Fadzai Madzingira: And when we say we want to rehabilitate, does rehabilitate mean they never do anything wrong again?
- 8:50Fadzai Madzingira: Or the way they don't do this specific thing wrong again?
- 8:53Fadzai Madzingira: and that's been really cool and that continues to be an area.
- 8:56Fadzai Madzingira: We, we work on a lot.
- 8:58Fadzai Madzingira: There's a lot of smart people that I kind of just sit in a room and get to ask questions and engage with, who work in the space.
- 9:05Ben Whitelaw: Amazing.
- 9:06Ben Whitelaw: that suspension piece you mentioned there, one of the metrics I guess that most platforms will think about and many people in your types of role will think about is, is the kind of suspension rate.
- 9:15Ben Whitelaw: Um, and that suspension system, who you ban, what you ban them for, you know, when they're allowed to kind of return is obviously a very, interesting part of, the trust and safety armory essentially, you know, if you're Donald Trump, you get to come back, if it president changes, but that's not always the case for your average user.
- 9:31Ben Whitelaw: so I just wanted to kind of, you, you've done some work on this over the last 12 months or so.
- 9:35Ben Whitelaw: What made you re-look at this?
- 9:37Ben Whitelaw: Within the twitch trust and safety, structure and, and what's new about it.
- 9:42Fadzai Madzingira: Yeah.
- 9:42Fadzai Madzingira: so how we've been thinking about enforcement has actually been an evolving process over the last three years.
- 9:49Fadzai Madzingira: and it's really a focus on our side of, I think historically we had a very, I mean, and you know, this industry wide, it was very all for nothing.
- 9:56Fadzai Madzingira: It's like you lose your account, you're gone forever.
- 9:58Fadzai Madzingira: That's it.
- 9:59Fadzai Madzingira: Goodbye.
- 9:59Fadzai Madzingira: but as policies become more nuanced, the societal norms change, but also our recognition of acknowledging that, our platform is somewhere where people are making strong communities and friendships and, they're finding, people who are like them and interested in things like them.
- 10:16Fadzai Madzingira: Cutting them off in that way is an incredibly punitive measure.
- 10:20Fadzai Madzingira: And so it starts to really mean that we need to think about the severity of.
- 10:24Fadzai Madzingira: The harm, but also in what instances is someone who just didn't know or understand our rules.
- 10:30Fadzai Madzingira: Someone who, once we get, they get a warning or they get a singular suspension, in what ways do they start to realize like, oh, okay, I think I understand now.
- 10:37Fadzai Madzingira: I'm not gonna do that again.
- 10:39Fadzai Madzingira: Um, so it's very dependent on severity and context.
- 10:41Fadzai Madzingira: And so we made that initial change, a little over a year and a half ago where we introduced, escalated consequences and we introduced a more nuanced warning system.
- 10:51Fadzai Madzingira: And then in February, this year, what we really, tried to do as part of just like modernizing our efforts, is to focus our enforcement restrictions specifically where the offense occurred.
- 11:01Fadzai Madzingira: So rather than, someone losing access to the entire platform, we are really, putting the suspension where the offense, happens.
- 11:08Fadzai Madzingira: So if a user violates our community guidelines in streaming, then they will receive a streaming suspension.
- 11:13Fadzai Madzingira: but it still means they can chat and they can engage with some of their favorite, creators and streamers as well.
- 11:18Fadzai Madzingira: again, it will depend on the severity of the harm and so on.
- 11:21Fadzai Madzingira: And so we still take our most severe.
- 11:24Fadzai Madzingira: Violations quite seriously.
- 11:25Fadzai Madzingira: And in those cases you'll lose complete access.
- 11:28Fadzai Madzingira: But we are really honing in on what does it mean to educate and re rehabilitate.
- 11:33Fadzai Madzingira: And the statistics tell us quite firmly that actually the majority of our community have never had a suspension.
- 11:39Fadzai Madzingira: And those who've had a suspension or have had a warning, are actually less likely to repeat the same thing.
- 11:45Fadzai Madzingira: And we've seen the similar evidence as well with our chat prompts.
- 11:48Fadzai Madzingira: which is something that, it's a bit like a nudge.
- 11:51Fadzai Madzingira: and I know there's a tons of research, I think roadblocks and meta have done over the years to indicate that if you tell someone like, Hey, it looks like what you're about to post might violate, people are more likely to update or change what they were about to say.
- 12:03Fadzai Madzingira: and so it's pretty clear that the majority of our users are good faith.
- 12:06Fadzai Madzingira: So what does it look like for us to build an enforcement system that acknowledges that, instead of like overly, I, I like to use the example of, what does it look like to have a system that focuses on, really helping in community building versus like, how do we get the bad guys?
- 12:21Fadzai Madzingira: because we've gotten really good at getting the bad guys, but we haven't done enough on the other side, and now we've really focused over the last three to five years on let's make sure we are actually building for the majority of our users.
- 12:33Ben Whitelaw: Yeah.
- 12:34Ben Whitelaw: Uh, it's a, it's a really nice approach actually.
- 12:36Ben Whitelaw: And something that I talked a lot about when I used to work had a very different situation and a very different scale working with newsrooms and their commenting systems.
- 12:45Ben Whitelaw: And actually, you know, if you're just about removing people, you incentivize the kind of wrong behaviors, whereas, like you say, you want to create a system where people leave you know, their best contributions and, adds to the environment that you're already making, which is really interesting.
- 12:58Ben Whitelaw: So, so what you're saying is kind of, previously people would've been banned completely, but now they're getting banned from either the, the streaming or the chatting maybe for 24 hours or a week, and then they're allowed back in.
- 13:08Fadzai Madzingira: Yeah.
- 13:09Fadzai Madzingira: And again, it depends on the severity or the nature of the violation.
- 13:13Fadzai Madzingira: cause the point on the severity is really important, mostly because our most severe and egregious harms are, you lose access.
- 13:20Fadzai Madzingira: But for something where it might be, um, and this happens a lot.
- 13:23Fadzai Madzingira: Someone's come from a different platform.
- 13:25Fadzai Madzingira: and so they're not as familiar with our rules as compared to a platform that has very different rules.
- 13:30Fadzai Madzingira: And so they might accidentally, break a rule because they didn't realize it.
- 13:34Fadzai Madzingira: They receive a warning from us, and it's a chat suspension, so then they can't chat, but they can still stream.
- 13:40Fadzai Madzingira: But now they've also learned, oh, okay, got it.
- 13:42Fadzai Madzingira: I'm not supposed to say that in chat.
- 13:44Fadzai Madzingira: and we found that that actually helps keep people on the platform and connected to their communities.
- 13:49Fadzai Madzingira: so it was a really cool, very recent, very cool, change.
- 13:52Fadzai Madzingira: But I, I think it's focused on the right thing.
- 13:55Ben Whitelaw: Yeah, definitely.
- 13:55Ben Whitelaw: I mean, it's, it's sounds like kind of very, smart of set of improvements there.
- 13:59Ben Whitelaw: And, you know, great to hear from people like yourself working at the cutting edge of trust and safety as well, making changes under the hood.
- 14:04Ben Whitelaw: I think that's kind of really what we wanna do more, uh, here on controlled speech.
- 14:08Ben Whitelaw: we're gonna jump into today's stories fad.
- 14:10Ben Whitelaw: I, we've, Got a range of, reads to get through before we do so, reminder to our listeners to rate review, like, and subscribe wherever you get your podcasts.
- 14:19Ben Whitelaw: if you enjoy a controlled speech on Spotify, you know what to do.
- 14:22Ben Whitelaw: If you're a YouTuber, you know what to do.
- 14:25Ben Whitelaw: If you're on Apple and any other podcast, apps, don't be the person who doesn't rate and review us or, or leave a comment.
- 14:31Ben Whitelaw: we need you.
- 14:32Ben Whitelaw: This is your call to arms.
- 14:33Ben Whitelaw: so yeah, thanks.
- 14:34Ben Whitelaw: for that great intro.
- 14:35Ben Whitelaw: Lovely to hear about your backstory.
- 14:37Ben Whitelaw: it was kind of inevitable really, FAI that we were going to.
- 14:39Ben Whitelaw: Start with a company that you previously worked at, um,
- 14:43Fadzai Madzingira: Yeah.
- 14:43Ben Whitelaw: just depended which one.
- 14:45Ben Whitelaw: And we are gonna start with meta.
- 14:48Ben Whitelaw: Um, we're gonna start with the oversight board in particular.
- 14:50Ben Whitelaw: a story that came out right after we recorded last week, and which you were kind of keen to talk about is the news coming out from, Casey Newton's platformer.
- 14:58Ben Whitelaw: He who previously co-hosted the podcast a few weeks ago that the oversight board might have their funding reduced, when the next renewal comes round.
- 15:05Ben Whitelaw: Talk to us about this story and, and why you found it interesting.
- 15:08Fadzai Madzingira: Yeah.
- 15:09Fadzai Madzingira: So, I, uh, I mean then Facebook now meta, but when I was there it was Facebook and, the reason I found the story so interesting is I was part of the teams right at the beginning when we were ideating around the oversight board, what its role, what's what are we aiming to do.
- 15:24Fadzai Madzingira: and I just, I view it as such this great experiment of like, well, what does oversight mean within the realm of just trust and safety?
- 15:32Fadzai Madzingira: and so I did a lot of the workshops, going with the oversight board team to different parts of the world to talk about these are our guidelines.
- 15:39Fadzai Madzingira: How would you do this?
- 15:40Fadzai Madzingira: and it was probably the most I'd engage with people who weren't in tech or in the industry while talking through like very transparently, like, this is how we do this.
- 15:49Fadzai Madzingira: and then engaging with the first set of members just before I, I left the company and just thinking, wow, these are really smart people who are committing their time to do this.
- 15:58Fadzai Madzingira: And so I've watched the journey for like years, over the last couple of years and just watching how they, they've shifted.
- 16:04Fadzai Madzingira: and so I just thought when I saw this story about, what an interesting.
- 16:09Fadzai Madzingira: Point to be in, because I think, I think the oversight board has done such a one great job actually of being able to talk about themselves as independent, despite all the concerns at the beginning around funding.
- 16:19Fadzai Madzingira: and wondering like, well, what does this mean if their, their funding is ending, what does it mean for the oversight board?
- 16:24Fadzai Madzingira: or their funding is being adjusted rather is I think how, the story talks about it.
- 16:29Fadzai Madzingira: and that they're debating different options and like what is available to them and what does it mean for them to work with other, platforms or, um, yeah.
- 16:38Fadzai Madzingira: So I, I, I thought it was just interesting because I wondered what does it mean for us to think about oversight
- 16:43Ben Whitelaw: Mm-hmm.
- 16:43Fadzai Madzingira: the industry, and was really interested in your thoughts.
- 16:46Fadzai Madzingira: 'cause I know you and Mike talk about the all.
- 16:53Ben Whitelaw: Yeah, I mean, I, I think it's, um, definitely a story we followed over time.
- 16:56Ben Whitelaw: We've actually had one of the oversight board members, Kenji Yoshino co-host the podcast.
- 17:01Ben Whitelaw: we'll share the link to that in, in the show notes.
- 17:03Ben Whitelaw: Fascinating conversation.
- 17:05Ben Whitelaw: He was very open about the board's challenges and, the work that it's done.
- 17:08Ben Whitelaw: And then we also had a spotlight episode with, two other, Members of the oversight board, Paolo, Kara.
- 17:14Fadzai Madzingira: great episode.
- 17:15Ben Whitelaw: Yeah.
- 17:16Ben Whitelaw: And Ju and, Julie as well.
- 17:17Ben Whitelaw: Um, and so that is a really interesting arc, I think, as you say, over time.
- 17:23Ben Whitelaw: I'm, I'm not that surprised by the news, I'll be honest.
- 17:26Ben Whitelaw: I think there's, there's something kind of inevitable about the time we're in, uh, the political moment that we find ourselves in, and the work that we know behind the scenes of large tech companies to kind of ingratiate themselves to particular presidential, regimes.
- 17:43Ben Whitelaw: so I wasn't particularly surprised, I'll be honest about this story.
- 17:46Ben Whitelaw: I've kind of joked in the past about, you know, when is it going to happen?
- 17:51Ben Whitelaw: there'll be less funding almost certainly, but like, will they have the funding removed completely.
- 17:55Ben Whitelaw: surprising thing for me, I guess Vai is like how early this story has been put out into Ether.
- 18:02Ben Whitelaw: the funding actually runs for another couple of years, right?
- 18:06Ben Whitelaw: So it's, it's, going to be, I think 2028 is when the next, round happens.
- 18:11Ben Whitelaw: And so we're miles in advance of that.
- 18:14Ben Whitelaw: Um, and that's normally a bad thing.
- 18:16Ben Whitelaw: when we're talking about kind of media, stories is that somebody is kinda preparing for something that would be, would be my guess and I dunno any more than that.
- 18:24Ben Whitelaw: so what, what is it that you about the shift?
- 18:27Ben Whitelaw: If the board disappears, what would you see happening as a result?
- 18:30Fadzai Madzingira: maybe not worries in as much as I think it.
- 18:33Fadzai Madzingira: it might be an indicator, like you've said, like it's a shift.
- 18:37Fadzai Madzingira: Looking at the, time we're in right now, I think there has historically always been this desire for like, we should have oversight from third parties.
- 18:45Fadzai Madzingira: I suppose then what does it look like to have oversight in different ways?
- 18:49Fadzai Madzingira: or what does consulting or engagement look like?
- 18:51Fadzai Madzingira: for Twitch, for example, we have a safety advisory collective, which is made up entirely of our creators.
- 18:57Fadzai Madzingira: And so those are individuals who consult on our policies and products because we wanna make sure we're hitting the right theme with our communities.
- 19:05Fadzai Madzingira: so that's not to say there isn't still room for expertise, but I wonder if maybe the shift is more onto like, proactive consulting versus oversight.
- 19:14Fadzai Madzingira: I don't know.
- 19:14Fadzai Madzingira: but I think it's a, a significant shift, for the industry.
- 19:18Ben Whitelaw: Yeah.
- 19:18Ben Whitelaw: And, and we've talked on the podcast a bit, as well about the role of these advisory councils.
- 19:23Ben Whitelaw: You have expert councils.
- 19:26Ben Whitelaw: OpenAI has one for health experts.
- 19:28Ben Whitelaw: There are parent councils.
- 19:30Ben Whitelaw: We've mentioned the ROBLOX one, relatively new and, and kind of working behind the scenes at the moment.
- 19:35Ben Whitelaw: And then there are team councils again, the most kind of notable is, tiktoks.
- 19:39Ben Whitelaw: And those teams are kind of vising on the way that they use the platform, what they would like to see, the way the policies are framed and, and communicated.
- 19:48Ben Whitelaw: And some of the members are actually put in front of other key stakeholders and regulators as far as, the way that they use the platform.
- 19:54Ben Whitelaw: So there are multiple types of council and multiple ways that they're used.
- 19:58Ben Whitelaw: my concern with that is that.
- 20:00Ben Whitelaw: They're not necessarily as transparent or independent as perhaps the oversight, oversight board is, or, or has purported to be.
- 20:09Ben Whitelaw: You know, that's one of the big things that they, the members talk about is that we are kind of independently, appointed to the board.
- 20:16Ben Whitelaw: We, publish all of our judgments.
- 20:18Ben Whitelaw: Everyone can go and read them.
- 20:19Ben Whitelaw: Doesn't matter what kind of platform you work for, you can take that information.
- 20:23Ben Whitelaw: You can kind of use it and apply it in your own work, even though you're not working at meta, that isn't the case for these other councils, right?
- 20:29Fadzai Madzingira: And I, I, think that's absolutely right.
- 20:31Fadzai Madzingira: I wonder if then this is the point where we start talking about transparency in those consultation, uh.
- 20:38Fadzai Madzingira: Realms rather than, because I do think there's something about oversight that really implies, or requires that says, this is the only time you really require this transparency, which is why regulators have to be transparent and oversight, why these have to be transparent.
- 20:52Fadzai Madzingira: it's always.
- 20:53Fadzai Madzingira: Always been, and I think you and I have talked about this in in other conferences, it's always been weird to me that we are not as interested in, well, what was the process?
- 21:01Fadzai Madzingira: And from a consulting perspective or from an input perspective, or what did the experts tell you?
- 21:06Fadzai Madzingira: and like all of, uh, my team included, but all of us internally, we are engaging with experts all the time.
- 21:13Fadzai Madzingira: and I wonder like, well, what does it look like for us to be more transparent in those engagements and whether those learnings would actually be more helpful for smaller companies to figure out like, well, I could take this learning.
- 21:24Fadzai Madzingira: whereas sometimes I think with really like companies like meta, smaller companies, like how do you start to even replicate, some of the decisions or discussions that have come out of the oversight board?
- 21:34Fadzai Madzingira: So, yeah, that's a really good push.
- 21:36Fadzai Madzingira: I do, I would love more transparency around like, who are you talking to and what do they tell you?
- 21:41Ben Whitelaw: tell you?
- 21:41Ben Whitelaw: Yeah, exactly.
- 21:42Ben Whitelaw: And what, what is the relationship that these experts have or these parents have with the platform?
- 21:46Ben Whitelaw: there's a really fascinating interview in the documentary, Molly versus the Machines, which talked a bit about recently.
- 21:53Ben Whitelaw: This is the documentary about Molly Russell, the teen who, committed suicide in the uk, seven or eight years ago now.
- 21:59Ben Whitelaw: And, and one of the.
- 22:00Ben Whitelaw: Interviews is with an expert on mental health who was in meta's of advisory council.
- 22:06Ben Whitelaw: And she, you know, mentions about the way that the company kind of used them as a sounding board but gave them very little notice about when changes would be made.
- 22:13Ben Whitelaw: didn't really take their advice or recommendations on board.
- 22:16Ben Whitelaw: It was fairly kind of, very high level, as a kind of engagement.
- 22:20Ben Whitelaw: And yeah, good to know that now, um, that's in the public domain, but actually knowing that in real time would actually be more helpful.
- 22:27Ben Whitelaw: if you were to kind of, again, you were involved in the early stages of the oversight board, so I'm gonna put you on the spot.
- 22:31Ben Whitelaw: What, what would, uh, kind of, do you think there's scope for an oversight board for the, for the whole industry?
- 22:36Ben Whitelaw: Is there a, a structure that is done for meta, which could be applied to all major platforms?
- 22:42Ben Whitelaw: Can you see.
- 22:43Ben Whitelaw: Other platforms submitting decisions or appeals in, in the way that you do For the oversight board?
- 22:49Fadzai Madzingira: this is gonna sound super facetious, but isn't that what regulation is?
- 22:53Fadzai Madzingira: Um,
- 22:55Ben Whitelaw: Yeah.
- 22:55Fadzai Madzingira: and may like again, I'm not trying to be, but I, I think in the, at some point the oversight board had really talked about, well, what does it look like for us to do this, like for the internet?
- 23:05Fadzai Madzingira: And I'm like, wow, that is a broad scope.
- 23:08Fadzai Madzingira: I think maybe the focus and the question we wanna ask is like, what is the problem we believe an oversight board would solve for?
- 23:15Fadzai Madzingira: and then what would that look like, at scale?
- 23:18Fadzai Madzingira: Um, I think on our side we were very much like, well, what we wanna know is like, do our communities feel safe, Safety is a very personal thing, so we need to be able to empower them.
- 23:29Fadzai Madzingira: So we need to be able to design with them.
- 23:31Fadzai Madzingira: So now we have to have a safety advisory collective.
- 23:33Fadzai Madzingira: So that, that was the very backward, working backwards way that we kind of were thinking about it.
- 23:38Fadzai Madzingira: think that's the question is like, if we feel like oversight is needed, I suppose the question is like, what is it solving for and what's the problem we're trying to deal with?
- 23:46Fadzai Madzingira: and then we can ask then is an oversight board the right way to do it?
- 23:51Ben Whitelaw: Yeah.
- 23:51Ben Whitelaw: And I, I think the oversight framing is maybe something that platforms in this political moment wouldn't necessarily want.
- 23:58Ben Whitelaw: Um, but I think that the kind of product focused council and, and consulting and advisory, if you take into account the recent, cases in the US that have focused on product design and, and product safety, you can definitely see, I think how that, trend may continue.
- 24:15Ben Whitelaw: but yeah.
- 24:15Ben Whitelaw: Okay.
- 24:15Ben Whitelaw: So, so no giant, oversight board of oversight boards,
- 24:21Fadzai Madzingira: It sounds like a giant overlord, doesn't it?
- 24:23Fadzai Madzingira: Um, yeah.
- 24:24Fadzai Madzingira: I, I mean, I would love to see what that, what I'm like, how do you pick cases?
- 24:29Fadzai Madzingira: and like, does it matter if it's like middleware or, B2C or oh my gosh, I'm like, my head is turning with a bureaucracy already.
- 24:38Fadzai Madzingira: Um, it.
- 24:39Ben Whitelaw: I mean that.
- 24:40Ben Whitelaw: It would be, it would be.
- 24:41Ben Whitelaw: I mean, the, one of the criticisms of the board is that they haven't taken as many cases on as many people have thought, particularly for the kind of cost of the board.
- 24:49Ben Whitelaw: You know, all these experts are expensive.
- 24:52Ben Whitelaw: You know, they are some of the best legal scholars and human rights experts and journalists and editors in their field, in their respective countries.
- 25:00Ben Whitelaw: And, you know, then you have a, a case and a kind of case system behind that, a bunch of people who help sift through the, the cases that come through.
- 25:07Ben Whitelaw: So that's been one of the criticisms of the bang for Buck.
- 25:10Ben Whitelaw: It hasn't been, particularly, effective, but again, I think as you say, you have to really work out what you're judging the board on.
- 25:17Ben Whitelaw: and, their report that they put out a few months ago suggests that, you know, from their perspective, they've, they've done as, as much as they possibly could in terms of making meta change their processes.
- 25:25Fadzai Madzingira: Right.
- 25:25Fadzai Madzingira: And arguably, which it's not untrue is, when they've been able to change how meta has engaged with something or done something, it impacts how smaller companies might see that issue or how the industry might see that issue.
- 25:38Fadzai Madzingira: and so from that perspective, arguably it's, it's incredibly impactful.
- 25:41Fadzai Madzingira: I was really happy to hear that they're starting to think about actor level and behavioral level, policies.
- 25:46Fadzai Madzingira: 'cause I think as an industry we've just been like, this is where we need to focus.
- 25:50Fadzai Madzingira: and I think you, you said something really important about, they're telling us this now and it's until 2028.
- 25:55Fadzai Madzingira: So I'm like, okay.
- 25:56Fadzai Madzingira: Well that's a good point.
- 25:57Fadzai Madzingira: That means there's still a lot of, engagement and work and product.
- 26:00Fadzai Madzingira: I assume that will continue to come out of, the board.
- 26:03Fadzai Madzingira: All that to say is I think even what they might do despite this news, is still gonna be something that the industry is going to look at, which I think is really interesting.
- 26:11Fadzai Madzingira: But I wonder if we will start to look at it in the backdrop of, well then what else do we want?
- 26:16Fadzai Madzingira: do we wanna have more consultation kind of bodies rather?
- 26:19Ben Whitelaw: yeah.
- 26:20Ben Whitelaw: Maybe this, maybe this story will force, that kind of thinking amongst people working in platforms and in the wide industry.
- 26:26Ben Whitelaw: It's like if the oversight board doesn't exist, what do we want the next version of that to be, if at all?
- 26:31Ben Whitelaw: Yeah.
- 26:32Ben Whitelaw: Super interesting.
- 26:33Ben Whitelaw: let's go on now to, another story.
- 26:35Ben Whitelaw: Another story we both found very interesting this week.
- 26:38Ben Whitelaw: and this is, on the outside of things, just a kind of another child safety story.
- 26:43Ben Whitelaw: It's another piece by the New York Times, about the online life of a teenager.
- 26:47Ben Whitelaw: And we've talked about many of those over the last few months.
- 26:50Ben Whitelaw: this one is a little bit different.
- 26:52Ben Whitelaw: The piece is called What Teens Are Doing with their Role Playing Chatbots.
- 26:55Ben Whitelaw: And it looks a bit like, one of those kind of sad stories of a teenager who has been affected, uh, through their mental health or worse by the use of a platform on and, and, over engagement with it.
- 27:08Ben Whitelaw: And just to kinda give you a sense of why that looks like the, the headline is pretty vague.
- 27:12Ben Whitelaw: There are these black and white pictures of, of a teenager and, you know, you start reading the piece and I dunno if you found this faci, but the sense is that something is going to go wrong,
- 27:22Fadzai Madzingira: Right, exactly.
- 27:23Ben Whitelaw: It's kind of a bit disconcerting.
- 27:26Ben Whitelaw: Why I think it's worth talking about is actually kind of what the piece is actually doing and how it was written and how it was researched.
- 27:31Ben Whitelaw: So just wanna talk a bit about that.
- 27:33Ben Whitelaw: the piece focuses on a guy called Quentin, who is 15 now, but was 13, a couple of years ago when, when the reporter met them.
- 27:41Ben Whitelaw: And he talks about how he uses these character chatbots, these social companions that we've talked about a lot.
- 27:48Ben Whitelaw: Some of the big companies that do them include character ai, who face lawsuits, for their, the way that they've kind of not kept teens safe online, but also kind of smaller, certainly less regulated, apps like talky.
- 28:01Ben Whitelaw: Uh, there's one called Poly Buzz and, and janitor AI as well, which we talked about at the top of the episode.
- 28:05Ben Whitelaw: And all of these very immersive chatbots are now apparently what teens are using to, keep themselves busy, feel the time, but in parts of their day.
- 28:14Ben Whitelaw: And this guy, Quentin, is using it kind of an hour after school, uses it for four or five hours, on weekends.
- 28:21Ben Whitelaw: And, he's able to get through the kind of age verification of character ai, all the usual kind of japes that a teenager, gets on, in using an online platform.
- 28:29Ben Whitelaw: his friends use it and all of this is kind of, laid out in the first half of the piece.
- 28:34Ben Whitelaw: Then there is this kind of surprise, paragraph like halfway through about where the reporter says, you know, I've spent the last, year and a bit speaking to Quentin and his friends via Discord as a way of trying to find out how and why they use these social chatbots That's, really the most fascinating part about this piece for me, faci.
- 28:54Ben Whitelaw: It's like we have a reporter who has actually spent time talking to end users and figuring out what role this technology plays in their lives.
- 29:04Ben Whitelaw: And that's, yes.
- 29:05Ben Whitelaw: It's the New York Times.
- 29:06Ben Whitelaw: Yes.
- 29:06Ben Whitelaw: They're very well funded.
- 29:07Ben Whitelaw: They have more time than the average outlook would be able to, to invest in that.
- 29:11Ben Whitelaw: But that's an, as a starting point.
- 29:12Ben Whitelaw: I think that's an amazing thing.
- 29:14Ben Whitelaw: before we get into kind of like, what was interesting about Quincy's experience?
- 29:17Ben Whitelaw: Like, was that surprising to you, the fact that that happened?
- 29:19Fadzai Madzingira: do, you know what?
- 29:20Fadzai Madzingira: It isn't until you sit it just now that I was like, oh yes, he did say that.
- 29:23Fadzai Madzingira: but I, I, so I think you're right because I think we spend a lot of time, in the space really focused on, what did the platform do and what are the issues around the platform and what are the harms and so on.
- 29:35Fadzai Madzingira: And I don't think we spend as much time thinking about, well, What did end users say?
- 29:39Fadzai Madzingira: And, I mentioned, at the beginning that when you think about communities, the more di diverse communities, safety is gonna look different, right?
- 29:46Fadzai Madzingira: And so like, really asking them like, well, what, tooling will help you here?
- 29:50Fadzai Madzingira: What products will help you here?
- 29:51Fadzai Madzingira: Like, how do we design with you?
- 29:53Fadzai Madzingira: and so like, actually you're right, it's actually quite novel to think like, okay, someone actually sat down with someone, not just once, but over an incredibly long amount of time to really understand like, well, how are you engaging?
- 30:04Fadzai Madzingira: And so on.
- 30:04Fadzai Madzingira: and I love your point about the gray photos.
- 30:07Fadzai Madzingira: It was very cinematic, but also very like, what's happening?
- 30:11Fadzai Madzingira: and so we'll get into Quinton's experience, but I'm so glad that wasn't the only one who noticed the photos, but yeah, it's really cool to hear that community engagement.
- 30:18Fadzai Madzingira: 'cause that's a lot of what my team does.
- 30:20Fadzai Madzingira: It's good to think, oh, so reporters are doing this now too, which is really great.
- 30:24Ben Whitelaw: Definitely, and, and I've thought a lot about, and talked about, with Mike, the way that media portray online safety issues and the fact that, the general public's understanding of, safety on platforms is driven by media coverage.
- 30:37Ben Whitelaw: could argue there's a direct line between the way that media has covered platforms and the, almost never ending number of social media bands that are cropping up every single week.
- 30:46Ben Whitelaw: we know that also platforms care a lot about what media says about them.
- 30:50Ben Whitelaw: You know, they, um, they respond, they, they respond very quickly when a reporter comes to them, with an issue or having found a certain post.
- 30:58Ben Whitelaw: You know, you might have been on the end of a receiving end of one of those things yourself.
- 31:02Ben Whitelaw: Um, no comment.
- 31:04Ben Whitelaw: but you know, the way that these stories are told are, IM, are important.
- 31:07Ben Whitelaw: I think that's what we try and kind of communicate on the podcast.
- 31:10Ben Whitelaw: in terms of Quentin's experience, and again, he is just one, teenager, so, we shouldn't kind of overestimate, this, but it feels like this piece is a kind of average experience of a teenager on these social chatbots, which I think is very rarely presented.
- 31:25Ben Whitelaw: Would you say the same?
- 31:26Ben Whitelaw: Yeah.
- 31:27Ben Whitelaw: and just to give you a sense of why I think that, you know, he, uses the chatbots extensively, but over the course of a couple of years as he, kind of comes out of his shell as he gets a girlfriend, as he finds of other hobbies, as he actually, does some therapy, coincidentally his circumstances change and he kind of removes himself from talking to this chatbot as much as, as he would normally do, and.
- 31:49Ben Whitelaw: His life essentially gets better and he stops, using these chatbots in the same way.
- 31:53Ben Whitelaw: And I found that kind of very, very interesting.
- 31:55Ben Whitelaw: Like, yes, there are, they are addictive products.
- 31:58Ben Whitelaw: we know that there are, there are teens who have committed suicide as a result of developing very, very intense social bonds with them.
- 32:04Ben Whitelaw: and some of the people in the piece, admit that, that they do the same, but it's not as bleak a picture as I think many other pieces or coverage makes out.
- 32:14Fadzai Madzingira: I would agree.
- 32:14Fadzai Madzingira: I think, and so there's a couple of things I think we're all aligned on the importance of how do we prioritize mental health in, safety and in platform engagement?
- 32:25Fadzai Madzingira: And like, what does that look like for young people especially?
- 32:27Fadzai Madzingira: I think what I found really interesting about Quentin's experience is the reasons in the beginning that he was, using the chat bot was very much like, hey, it's always available, and I'm bored and I'm by myself, so this is easy to engage with.
- 32:41Fadzai Madzingira: But, it seemed him and his friends also had.
- 32:43Fadzai Madzingira: They seem to have quite a clearer distinction on the role of the chat bot in their lives as compared to, and they called out like, yeah, some more vulnerable teens.
- 32:51Fadzai Madzingira: That might be really hard for them, but I know like, this is just like for games.
- 32:56Fadzai Madzingira: and then the cutest, um, and not to spoil the ending for, for listeners, but then the cutest part is then he gets into, he gets his first girlfriend and then he starts using it less.
- 33:04Fadzai Madzingira: and so like that movement into like real life, relationship and engagement and there's something to be argued.
- 33:11Fadzai Madzingira: oh gosh.
- 33:11Fadzai Madzingira: My, my friends are gonna laugh at me'cause I always bring up Esther Perel, but Esef Perel, has argued about what is the role of chatbots in supplementing, our understanding of how to engage with others, rather than considering them as.
- 33:24Fadzai Madzingira: replacements or avoiding them completely.
- 33:26Fadzai Madzingira: Right.
- 33:27Fadzai Madzingira: and I think there's something really interesting about what does it mean to build a platform that prioritizes mental health, that prioritizes community engagement and encourages someone to be like, this is a good place for you to test what you are gonna go do in the real world.
- 33:40Fadzai Madzingira: And I think that's essentially what Quintin did is that he used it as a, as a soundboard.
- 33:44Fadzai Madzingira: And it was fun for a little while.
- 33:46Fadzai Madzingira: He got his first girlfriend and suddenly realized like, actually I'm on this for less than three hours in a week.
- 33:50Fadzai Madzingira: and oh, I barely log on anymore.
- 33:52Fadzai Madzingira: and I, I think that it says something about if we were to co-design this with that in mind, what would that look like?
- 34:00Fadzai Madzingira: And I think that's really cool actually.
- 34:02Ben Whitelaw: Yeah.
- 34:03Ben Whitelaw: And I, I think, I think it's a really good point.
- 34:04Ben Whitelaw: I think the reporter, KMIR Hill, does a good job of that in the piece.
- 34:08Ben Whitelaw: But she also is in the comments underneath the article.
- 34:11Ben Whitelaw: And because I'm a, I'm a former kind of comments editor.
- 34:15Fadzai Madzingira: you are
- 34:16Ben Whitelaw: I obviously read the comments and she's in the comments talking to readers, and there's a really interesting exchange about how social chatbots, might be the, fast food of intimacy in the future, which I think kind of speaks to what you're saying, right?
- 34:29Ben Whitelaw: Like eat fast food from time to time, but you know, it's not always good for you.
- 34:34Ben Whitelaw: it's cheap, it's quick, it's on demand.
- 34:37Ben Whitelaw: it is regulated to some degree differing in different countries.
- 34:41Ben Whitelaw: But actually, you're not banning fast food completely.
- 34:43Ben Whitelaw: You can still go and get fried chicken or, or mackey's or other fast foods are available whenever you can.
- 34:49Ben Whitelaw: so that was a kind of helpful framing for me actually, is like, this is fast food that does a very specific job.
- 34:55Ben Whitelaw: it's not gonna be the thing that, you want people to eat every day, but you know, there's, there's a time and a place for it.
- 35:00Fadzai Madzingira: yeah.
- 35:01Fadzai Madzingira: Um, I mean, uh, fast food, that's quite a comparison and I think I need to sit with that.
- 35:05Fadzai Madzingira: Um, but I, I, I do think there's something, that we don't talk about a lot.
- 35:10Fadzai Madzingira: And I think some of the other stories, talk about this is, to your point about platforms and, these places being a space for, fast tracking, learning about intimacy and so on is like, well, if I'm learning about how to build and foster community and connection, this is actually helpful in how I engage out in the real world.
- 35:27Fadzai Madzingira: we have a lot of Twitch creators who meet each other on the platform and then organize real life meetups, um, and will.
- 35:34Fadzai Madzingira: We'll come back to the company and tell us about like a creator meetup.
- 35:37Fadzai Madzingira: I had a colleague who met her boyfriend on Twitch, which I remembered asking like how, and it was like I finally, they saw, they started following each other's, channels and they started talking and then they met in real life.
- 35:49Fadzai Madzingira: And then that's what happened.
- 35:50Fadzai Madzingira: And so like there is something about, acknowledging like, hey, if platforms are prioritizing mental health and are prioritizing, building connection and building community and they're empowering people to build that community, it could actually be quite helpful.
- 36:04Fadzai Madzingira: And it could be especially helpful if, you are young person who has the right resources and framing around them, and it could be really helpful if, I know you and Mike have talked about this, like certain vulnerable young people who are either differently abled or of color or queer, um, where they find their communities online and are able to foster a sense of identity and expression because they've found these places.
- 36:30Fadzai Madzingira: I think there's something to be said that this story seems to indicate like, okay, I, I had a safe space.
- 36:35Fadzai Madzingira: I also understood what this thing was in my life.
- 36:38Fadzai Madzingira: I had access to other resources.
- 36:40Fadzai Madzingira: I was in therapy separately.
- 36:42Fadzai Madzingira: And so by the time I was connecting with people and building my relationships, this thing wasn't a thing that stopped me.
- 36:49Fadzai Madzingira: It was a thing where I, I practiced beforehand and now could do this for real.
- 36:53Fadzai Madzingira: and so like, yeah, when I got to the end, I was like, oh, it's a love story.
- 36:56Fadzai Madzingira: Um, and it just took a long time to get there, but it was quite beautiful.
- 37:00Ben Whitelaw: Yeah.
- 37:00Ben Whitelaw: And you don't, you don't get many of those in control or speech, I'll say that.
- 37:06Ben Whitelaw: but yeah, it does feel like a kind of, it feels like an average experience for probably more than most teens.
- 37:12Ben Whitelaw: and again, that's just my sense ha having read a lot of these stories poured over a lot of the coverage.
- 37:17Ben Whitelaw: move on to kind of talking, talking of average experience of teens.
- 37:20Ben Whitelaw: We're gonna, talk through a number of stories that I think kind of, again, speak to this, this idea that.
- 37:26Ben Whitelaw: You know, maybe teenagers aren't doing so badly.
- 37:28Ben Whitelaw: and we're gonna start with the, piece from Tech Policy Press that you flagged about something that Mike and I talked about last week.
- 37:34Ben Whitelaw: The Australia social Media ban.
- 37:36Ben Whitelaw: Some smart analysis from people who are kind of in the weeds on, on tech regulation.
- 37:40Fadzai Madzingira: Yeah.
- 37:41Fadzai Madzingira: so I thought it was really interesting because, I mean, it's nothing, I don't think it's anything new.
- 37:45Fadzai Madzingira: I think it's very much like, oh, this is a lot harder than might have been thought of at the beginning.
- 37:50Fadzai Madzingira: There's no.
- 37:51Fadzai Madzingira: Real early lessons right now.
- 37:54Fadzai Madzingira: But what was interesting for me at least is the story was really like, is it really something for us to be like, okay, the rest of the world is watching really carefully what's happening.
- 38:03Fadzai Madzingira: I mean, the UK is doing a consultation right now on a range of options.
- 38:07Fadzai Madzingira: Indonesia is also thinking, through an, an approach similar to Australia.
- 38:12Fadzai Madzingira: and then I think for me it was just how clearly the article was like, there's no such thing as a one size fits all.
- 38:17Fadzai Madzingira: and we really need to have a more nuanced approach.
- 38:20Fadzai Madzingira: I think when you had, Avi on the podcast a couple of months ago, he talks about it as Swiss cheese, which has never left me as like an approach.
- 38:28Fadzai Madzingira: Like there's no silver bullet.
- 38:30Fadzai Madzingira: It's a little bit like Swiss cheese.
- 38:31Fadzai Madzingira: and I think that's, what we're bumping into is like, actually this is, this is really like doing this at scale is difficult.
- 38:38Fadzai Madzingira: so we all need to think about What we're trying to achieve.
- 38:41Ben Whitelaw: Yeah, definitely.
- 38:42Ben Whitelaw: uh, and vie is, is a really, very smart switched on child safety expert.
- 38:46Ben Whitelaw: I had a chat with her about kind of all things, child safety, youth safety, and age appropriate design a couple of months ago now, would include that link in the show notes.
- 38:54Ben Whitelaw: I think you're right, Faso.
- 38:55Ben Whitelaw: It's a very timely reminder about that episode exists.
- 38:59Ben Whitelaw: yeah, I think this, kind of analysis is, is a great read.
- 39:02Ben Whitelaw: If you've kind of been catching up on, the Australia social media ban, progress.
- 39:06Ben Whitelaw: And I think it's, you know, a reminder, like you say, that we, we need to be clear as to what it is we're wanting as the outcome.
- 39:13Ben Whitelaw: you know, it's, it's not gonna be, as we've mentioned in the New York Times piece, there's gonna be Detrimental effects to social media bans.
- 39:19Ben Whitelaw: and they're not always gonna work as we, as we hope for, you know, age verification is a tricky thing to be able to do.
- 39:25Ben Whitelaw: It's not consistent.
- 39:26Ben Whitelaw: It's, technically very difficult.
- 39:27Ben Whitelaw: So, you know, where does that leave?
- 39:29Ben Whitelaw: children that we're look, you know, trying to keep safe.
- 39:32Fadzai Madzingira: Yeah.
- 39:32Fadzai Madzingira: Because some of the stories, and again, I, I think I liked how this one was written.
- 39:36Fadzai Madzingira: 'cause often when it comes to, when we talk about age assurance at scale, it turns into very much a regulator versus platform.
- 39:43Fadzai Madzingira: And I, I like to remind people, I'm like, I think we're all committed to wanting young people to be safe.
- 39:48Fadzai Madzingira: and we're all committed to trying to do whatever it is we're aiming to do.
- 39:52Fadzai Madzingira: Like, if that's our aim, we're all on the same, we're all working towards the same goal.
- 39:56Fadzai Madzingira: I do think it's really interesting, Just some of the conversations and the framing.
- 40:01Fadzai Madzingira: I think the, the story you flagged, like literally right before, um, around Greece, when you flagged that, I was like, oh, wow, Greece is now jumping on the bandwagon.
- 40:09Fadzai Madzingira: but actually it was interesting, even hearing some of the, the government spokesperson was quite nuanced in the fact that.
- 40:15Fadzai Madzingira: yes, they're looking at a social media plan for under fifteens, but actually their concerns, around like addiction and mental health, their concerns are more just like, uh, how do you do this across Europe?
- 40:27Fadzai Madzingira: Like, it's not helpful for us to do this on our own here in Netherlands to do this on its own here.
- 40:32Fadzai Madzingira: Like, what does it mean for, uh, for the EU to have like a coordinated effort?
- 40:36Fadzai Madzingira: and I was quite appreciative to see that because I, I do think there's something about how we are talking about these concerns that really require, just a reminder, like, we are all on the same, same page.
- 40:47Fadzai Madzingira: so like, what are we doing to fix our concerns,
- 40:50Ben Whitelaw: Yeah, I agree.
- 40:51Ben Whitelaw: I mean, this, story, this Greece social media ban story, which came out this week is, is the latest and a long line of countries who are, who are looking to ban social media.
- 40:58Ben Whitelaw: slightly different in that they, gone for an under fifteens age limit, which, is slightly different.
- 41:03Ben Whitelaw: Most countries are going for an under sixteens.
- 41:06Ben Whitelaw: and they're going to, as of next January, January, the first going to force age verification on, the major platforms there is, from the coverage I've read, it's not exactly clear what those major platforms are.
- 41:19Ben Whitelaw: one Greek outlet, I read so that, that was Facebook, Instagram, TikTok, and Snap.
- 41:23Ben Whitelaw: The New York Times reached out to, yeah, the, the New York Times reached out to YouTube.
- 41:28Ben Whitelaw: but that wasn't mentioned in the Greek report.
- 41:29Ben Whitelaw: So there's gonna four platforms.
- 41:31Ben Whitelaw: I think that a, a majority of.
- 41:34Ben Whitelaw: Greek teens use, they're going to have to implement age verification in Greece.
- 41:39Ben Whitelaw: which is a new thing.
- 41:40Ben Whitelaw: But yeah, there's a, there's a much wider push in some countries across the EU to consolidate that ban, which is a massive, massive kind of shift, I think is, having a cross territory ban approach.
- 41:53Ben Whitelaw: Very difficult to do, I think, in the EU because of the, the differences in politics and, and social values.
- 41:59Ben Whitelaw: But maybe it's, one for next year.
- 42:02Fadzai Madzingira: I wonder if, and I think, just to go back about a coordinated approach, only because I don't think it should just be a coordinated approach on should they be a social media ban.
- 42:12Fadzai Madzingira: I think there has to be a coordinated approach on what, does our multi-pronged approach look like to keeping young people safe online.
- 42:19Fadzai Madzingira: and I, I think part of what we are seeing with the tech policy press piece and all of these other pieces, cause I really wanna make sure that it doesn't sound like it's like, aha, it didn't work.
- 42:29Fadzai Madzingira: And I'm like, no, that, that's not it.
- 42:31Fadzai Madzingira: I think it's, what are we trying to solve for?
- 42:33Fadzai Madzingira: So that way we have that multi-pronged approach.
- 42:35Fadzai Madzingira: And so like, what does education look like and what does safety literacy look like?
- 42:39Fadzai Madzingira: And, I mentioned the family tech cycle, uh, report.
- 42:42Fadzai Madzingira: But I, I, I just think that we've, We've sometimes missed the fact that it really isn't a silver bullet.
- 42:48Fadzai Madzingira: and I, want us to be, have more of those conversations about we need a coordinated, multi-pronged approach.
- 42:54Ben Whitelaw: we will come onto the report in a second.
- 42:56Ben Whitelaw: 'cause I think that it starts to offer some of the, ways forward.
- 42:59Ben Whitelaw: The Greek thing is really interesting to me.
- 43:00Ben Whitelaw: I I hadn't really been following their attempts over the last year to really crack down on screen time.
- 43:06Ben Whitelaw: You know, they're very, very, forward thinking, I guess is one way of, of talking about it in terms of, children using screens.
- 43:12Ben Whitelaw: So twenty, twenty four, they banned phones in schools.
- 43:14Ben Whitelaw: So there was a kind of very, a much stricter enforcement of phones in classrooms.
- 43:19Ben Whitelaw: If you took your phones out, and you were believed, you know, you were seen by a teacher, you were suspended for one day.
- 43:24Ben Whitelaw: so very, very strict.
- 43:26Ben Whitelaw: And then last year they expanded that to, allow parents to really restrict screen time via an app called the Kids' Wallet, which is a kind of.
- 43:34Ben Whitelaw: Greek wide, app that is linked to, the kind of government tax id, which means that you can essentially get your kid to download it.
- 43:43Ben Whitelaw: You can link it to your government app that you pay your taxes and do your kind of admin through.
- 43:48Ben Whitelaw: And at that point, you can then allow and, and manage your child's screen usage and app usage in a way that, I guess, takes the responsibility away from some of the platforms.
- 43:58Ben Whitelaw: So, the new band that's coming in next year is the kind of third stage of, that policy.
- 44:03Ben Whitelaw: That strategy, which again, is surprising for a relatively small country, within the much wider eu.
- 44:09Fadzai Madzingira: Yeah.
- 44:09Fadzai Madzingira: I, I think, and maybe those are the experiments to watch.
- 44:13Fadzai Madzingira: 'cause you, you shared that one about the Irish, um, was it an Irish village that was working on being phone free?
- 44:19Fadzai Madzingira: and I wonder, so I have such a bias towards communitarian, programs and goals, but I, I think there's something so beautiful about what the village was doing, because their focus was instead of just focusing on removing phones, we actually need to build a, shared, a shared reality of what we're solving for.
- 44:37Fadzai Madzingira: And then we need to educate parents, guardians.
- 44:40Fadzai Madzingira: And children as to why we're doing what we're doing.
- 44:43Fadzai Madzingira: And so they ran workshops, they had podcasts that they shared with parents.
- 44:47Fadzai Madzingira: They talked through how to keep kids safe.
- 44:49Fadzai Madzingira: and then, then they started instituting like time free, zones and times and so on and so forth.
- 44:55Fadzai Madzingira: And then they found that to actually be far more successful from a wellbeing perspective.
- 45:00Fadzai Madzingira: And it was because it was a community effort and that they were like, it takes a village, so we have to do it as a village.
- 45:05Fadzai Madzingira: and so maybe it, it would be interesting to think about these experiments in smaller countries and, smaller communities.
- 45:12Fadzai Madzingira: and what does that look like?
- 45:13Fadzai Madzingira: and I think, I think it also pushes the, this is why it's a multi-pronged approach.
- 45:17Fadzai Madzingira: Like if the, even these smaller communities with shared values are like, actually it still needs to be more multi-pronged how we do this.
- 45:25Fadzai Madzingira: and so a ban isn't always just the way to go.
- 45:29Ben Whitelaw: yeah, let, let's talk about the kind of report that you, you discovered this week and that you found very interesting.
- 45:33Ben Whitelaw: 'cause I think that speaks to, to that ethos, right?
- 45:36Fadzai Madzingira: Yeah.
- 45:36Fadzai Madzingira: So it's, um, family tech cycle and it's really focused on, and what I really liked about it is it gives really practical advice around what does it mean to design with children and parents in mind.
- 45:49Fadzai Madzingira: and so they think about, where do parents feel, overwhelmed and exhausted.
- 45:53Fadzai Madzingira: and then how do you design in a way that brings children along the way?
- 45:58Fadzai Madzingira: think what I really liked about it was, They, they have really practical callouts, like actually parents want more specificity when it comes to what our kid friendly settings, but also.
- 46:08Fadzai Madzingira: Something I thought was really fun is that they talked about, well, can we create materials that are fun for digital literacy and can be delivered in a multimodal way?
- 46:16Fadzai Madzingira: So not just articles, but can we have videos, can we have things that we can share with our kids and do together?
- 46:22Fadzai Madzingira: and I thought that that was really cool because it talks about what does it mean to foster safety literacy in a family and not just with parents.
- 46:30Fadzai Madzingira: and then some of the other great suggestions that I, I just, quickly wrote down was, for platform designers specifically is they talk about what does it mean to have dedicated onboarding for parents and for people who are under 18, what does it mean to teach children how to self-regulate themselves?
- 46:44Fadzai Madzingira: So.
- 46:45Fadzai Madzingira: They make a point about different developmental stages.
- 46:48Fadzai Madzingira: So if someone opens an account when they're 14, what does it mean that when they turn 16 and you decide actually they should have access to these features that they might not have had before.
- 46:57Fadzai Madzingira: and then how do you show them like, this is a good thing you've changed, like you've developed at a certain point, so now you can use this thing.
- 47:04Fadzai Madzingira: And like, what does it mean to teach them how to regulate in that way?
- 47:07Fadzai Madzingira: And that empowers a child and how they engage on the platform.
- 47:10Fadzai Madzingira: last thing was that they just were like, safety literacy is ongoing.
- 47:13Fadzai Madzingira: It doesn't stop even when someone turns 18.
- 47:16Fadzai Madzingira: and that we have to acknowledge the Societal challenges around, mental wellbeing and loneliness and anxiety, and how do you talk about that out loud with your child?
- 47:24Fadzai Madzingira: And I just thought it's so well placed.
- 47:26Fadzai Madzingira: and I've had a couple of conversations with other colleagues who think about, that wellbeing by design or safety by design framing for children who have said the same thing.
- 47:35Fadzai Madzingira: And I just, I loved the article.
- 47:37Ben Whitelaw: Yeah.
- 47:37Ben Whitelaw: So there, are there things that you, you might see Twitch taking from this report and, building off the back of it?
- 47:42Ben Whitelaw: Like I.
- 47:42Fadzai Madzingira: Yeah, I, I definitely, I mean, there's things similar that we do.
- 47:46Fadzai Madzingira: So we have creator camps where we think a lot about safety education.
- 47:49Fadzai Madzingira: So when someone's becoming a creator on the platform, what safety education do we need to give them?
- 47:54Fadzai Madzingira: we also have, hubs for parents and guardians as well that allows them to engage with, like, especially recognizing that a parent might not be as familiar with Twitch.
- 48:03Fadzai Madzingira: So it also even goes into terminology or like, this is what this means.
- 48:06Fadzai Madzingira: And so when you see this, you should make sure to do, to switch this on or engage or have this conversation with your child.
- 48:12Fadzai Madzingira: Um, and I think what I love most about our hub for parents is we have a section where it says like, regardless of everything above here are conversations you should have about your child, about privacy, about scams, about what, like, you know, and it just gives.
- 48:26Fadzai Madzingira: Wording and framing and vocabulary to a parent who might just not have known or thought to have that conversation with their child, prior to being on the platform.
- 48:35Fadzai Madzingira: I think that it has to be something that continues.
- 48:37Fadzai Madzingira: I'm always concerned when safety literacy is like, well, as long as we've taken care of everyone who's under 18, we're done.
- 48:42Fadzai Madzingira: where I'm like, actually, it's for everyone who's on the internet.
- 48:45Fadzai Madzingira: Um, so, my education lead thinks a lot about where's a creator in their journey, and how do you write education depending on that journey.
- 48:53Fadzai Madzingira: And so that's something we think about as well when it, depending on the community, the creator and why user empowerment tools that matters so much.
- 49:00Ben Whitelaw: Yeah.
- 49:01Ben Whitelaw: Great.
- 49:01Ben Whitelaw: That's really helpful.
- 49:03Ben Whitelaw: Um, and, and also the kind of the line that stood out for me really was the.
- 49:06Ben Whitelaw: line that said that families are absorbing cognitive and emotional labor that product design could meaningfully reduce.
- 49:11Ben Whitelaw: And that after all that's kind of gone on over the last few weeks.
- 49:14Ben Whitelaw: The, the big meta trials in New Mexico and California, you know, the big focus in the EU on product design and addictive design.
- 49:22Ben Whitelaw: there is a lot to be done within the product teams in particular, I think, to help parents help their children, which this report is a very helpful reminder of, and again, a nice kind of upbeat end to controlled speech.
- 49:34Ben Whitelaw: That's how you've kind of introduced, a, a hopeful tone to controlled speech, which I'm not saying that Mike, I'm not saying that Mike doesn't do, but the, the has been noted.
- 49:45Ben Whitelaw: It has been noted, and I wonder if our listeners will, will, will think the same.
- 49:48Fadzai Madzingira: Oh, wonderful.
- 49:49Fadzai Madzingira: I am always here to bring hope.
- 49:51Fadzai Madzingira: I think that might do an episode where it's Mike and I.
- 49:54Ben Whitelaw: Yeah.
- 49:56Ben Whitelaw: Then we'll see who, see, see who the real, kind of like, who the real, uh, you know, stickler is.
- 50:02Fadzai Madzingira: Mike.
- 50:03Ben Whitelaw: Yeah.
- 50:03Ben Whitelaw: He's, he's a good guy.
- 50:04Ben Whitelaw: He's, he's actually back in the hot seat next week, so he will be, joining me again.
- 50:09Ben Whitelaw: And yeah, Faso, just to say thank you so much for your time this week.
- 50:11Ben Whitelaw: I really appreciate you joining us here in Control speech joining.
- 50:14Ben Whitelaw: It's been wonderful to have you.
- 50:15Fadzai Madzingira: Thank you so much for asking me to do this, this.
- 50:18Ben Whitelaw: Good, glad, glad.
- 50:19Ben Whitelaw: It was fun.
- 50:20Ben Whitelaw: Um, and listeners, yeah, enjoy this week's episode.
- 50:23Ben Whitelaw: go and read and subscribe to all the outlets we've spoken about this week, the New York Times Tech Policy Press, platformer Reuters and others.
- 50:29Ben Whitelaw: we can't do the episode without them.
- 50:31Ben Whitelaw: and yeah, share the episode.
- 50:33Ben Whitelaw: Go and like review and subscribe to Control speech wherever you get your podcasts, and we'll see you next week.
- 50:41Speaker: Thanks for listening to Control Alt Speech.
- 50:44Speaker: Subscribe now to get our weekly episodes as soon as they're released.
- 50:48Speaker: If your company or organization is interested in sponsoring the podcast, contact us by visiting control alt speech.com.
- 50:55Speaker: That's CT RL alt speech.com.