Latest / Views and News with Clarence Ford / How a narrow court ruling became a week of anti-foreigner rage online
Transcript
- 0:00Speaker 1: But Kyle Findlay, it's great to have you with us
- 0:01Speaker 1: from Murmur Intelligence talking about that article, of course, in
- 0:05Speaker 1: the Mail and Guardian. This is such an important conversation.
- 0:07Speaker 1: Thank you, Kyle.
- 0:09Speaker 2: Thanks for having me, Clarence.
- 0:10Speaker 1: Kyle, so your investigation essentially tracked how a procedural ruling
- 0:15Speaker 1: on asylum applications exploded into tens of thousands of angry
- 0:18Speaker 1: posts within days. Were these artificial posts or were they
- 0:22Speaker 1: real people making these posts?
- 0:26Speaker 2: Real people. The way that influence operations work in South
- 0:30Speaker 2: Africa and across the African continent, we've done a lot
- 0:33Speaker 2: of research. We've gone undercover and spoken to the people.
- 0:38Speaker 2: What happens is that the platforms are pretty good at
- 0:40Speaker 2: identifying bots. They can figure out when the behavior looks
- 0:43Speaker 2: automated and they squash them quickly. So what's happened as
- 0:47Speaker 2: a result is whole black market industries across the world
- 0:51Speaker 2: have sprung up in every country you go to. of
- 0:54Speaker 2: real people coordinated via WhatsApp groups that get paid a
- 0:58Speaker 2: pittance in mobile money, mobile data, to do something small
- 1:02Speaker 2: like comment on something or reshare something. And swarms of
- 1:08Speaker 2: these people get to it. They're coordinated by what we
- 1:11Speaker 2: call mega-influencers. And collectively, they make a lot of noise
- 1:17Speaker 2: and they give the illusion of an issue being bigger,
- 1:23Speaker 2: more polarized than it really is when you log off
- 1:30Speaker 2: and you speak to people in real life.
- 1:32Speaker 1: Okay, so you're saying coordinated amplification rather than spontaneous public reaction.
- 1:39Speaker 1: You're saying this is not organic virality. This is engineered swarming.
- 1:46Speaker 1: That's what you're saying. And coordination means that it is
- 1:50Speaker 1: a plan, it is orchestrated, and there's a budget. Kyle?
- 1:57Speaker 2: Sorry, I lost you there.
- 1:58Speaker 1: I said you're proposing that it's coordinated, it's orchestrated, maybe
- 2:02Speaker 1: even a budget for that purpose.
- 2:06Speaker 2: Yeah, so South Africa is the brunt of many different
- 2:13Speaker 2: interests that use these mechanisms. You could be a DJ
- 2:17Speaker 2: who wants to make some noise. You could be a
- 2:20Speaker 2: brand of choose that wants to make some noise. You
- 2:23Speaker 2: could be a ward councillor. You could be an MP.
- 2:27Speaker 2: You could be a nation state outside of South Africa.
- 2:30Speaker 2: They all use the same mechanism. And in our interviews
- 2:34Speaker 2: with the people, if you're what we call a nano-influencer
- 2:39Speaker 2: or buzzer, someone doing the on-the-ground work, you could be
- 2:42Speaker 2: being paid 100, 150, 250 rand per action. If you're
- 2:47Speaker 2: an intermediate level controlling a swarm, you could be paid...
- 2:50Speaker 2: 5,000 rand, 10,000 rand. If it's a big campaign around
- 2:54Speaker 2: election time and you're a mega influencer, you could be
- 2:57Speaker 2: paying 250,000 rand, 500,000 rand.
- 3:01Speaker 1: I get you. The data you say identified clusters of
- 3:06Speaker 1: 800 to 1,300 accounts acting in near identical ways. How
- 3:13Speaker 1: are they so coordinated? How is it possible for them
- 3:15Speaker 1: to act in near identical ways? Is that a brief
- 3:19Speaker 1: or is that a computer program?
- 3:21Speaker 2: So there are two parts to it. There's building up
- 3:25Speaker 2: the ecosystem, which takes time. So when it comes to
- 3:28Speaker 2: South Africa's anti-foreigner movement, that movement has been built up
- 3:31Speaker 2: over the last six years. It was launched on April 20, 2020,
- 3:36Speaker 2: with the hashtag Put South Africans First. And at that time,
- 3:40Speaker 2: it was Herman Mashaba and Fuyo Zungula from ATM Party
- 3:44Speaker 2: who were the main proponents of that hashtag. So there's
- 3:48Speaker 2: been six years of building a community here. that has
- 3:52Speaker 2: had paid amplification active in the community the whole time.
- 3:56Speaker 2: So what that does is it creates a consensus around
- 4:01Speaker 2: how that community thinks and speaks, the counter arguments it has,
- 4:06Speaker 2: the issues it reacts to. So you've already got a
- 4:10Speaker 2: community primed to jump on any issue. In those communities,
- 4:16Speaker 2: you then have certain influencers who are coordinate their nano-influencers,
- 4:23Speaker 2: they cascade the instructions down via WhatsApp. And so when
- 4:28Speaker 2: something kicks off, you have a mixture of real people
- 4:31Speaker 2: that have found themselves in a very tight echo chamber,
- 4:35Speaker 2: and you have a mixture of paid provocateurs, for lack
- 4:39Speaker 2: of a better term, that are directing them at what
- 4:43Speaker 2: to react to. And you get this swarming behavior.
- 4:45Speaker 1: Okay, we've also seen rebuttals, have we not, or fact checks,
- 4:50Speaker 1: checks but they kind of failed to catch up and
- 4:53Speaker 1: in your data rebuttals made up less than 1% of
- 4:56Speaker 1: the conversation so why are algorithmic mechanics so structurally skewed
- 5:03Speaker 1: towards spreading outrage over corrective facts.
- 5:09Speaker 2: People love sensation it's built into our DNA we value
- 5:13Speaker 2: negative information that might affect our survival that gets conveyed
- 5:17Speaker 2: through emotions like fear and anger and more than positive emotions.
- 5:22Speaker 2: And so those algorithms are tapping into human nature. But
- 5:29Speaker 2: there is another part to that as well, which is
- 5:31Speaker 2: the role of the media in this whole process, because
- 5:35Speaker 2: groups like March and March have been given a free
- 5:37Speaker 2: ride in our media, which would have been the main
- 5:40Speaker 2: place where facts and rebuttals would have had weight. So
- 5:45Speaker 2: when Jacinta Ngobezi-Zuma gets interviewed, very few journalists hold it
- 5:51Speaker 2: to account. Very few journalists do the homework upfront to
- 5:55Speaker 2: familiarize themselves with what the real facts are. How many
- 5:58Speaker 2: foreigners actually committed crime? How many foreigners actually are in
- 6:01Speaker 2: the country? How many asylum seekers there actually are? And
- 6:04Speaker 2: when she comes on and lies with fake numbers to
- 6:07Speaker 2: spread outrage, she's never held to account. And those are
- 6:10Speaker 2: the times when facts are able to compete with false narratives.
- 6:16Speaker 2: By the time you get to social media, That isn't
- 6:18Speaker 2: the place to battle ideas because it's not a genuine fight.
- 6:23Speaker 2: It's a disingenuous fight between one side that's using underhanded
- 6:26Speaker 2: techniques to promote their narrative and the other side thinks
- 6:29Speaker 2: that this is just an open debate. Yeah, I get you.
- 6:33Speaker 1: And I think ultimately we need to understand where the
- 6:35Speaker 1: world is going in respect of that. We know that
- 6:37Speaker 1: Russia has a machine in the IRA. China's got spammer flage.
- 6:41Speaker 1: We know that the West have capabilities. They can mount
- 6:45Speaker 1: these swarm attacks online. There's commercial PR fire firms using
- 6:50Speaker 1: the very same coordinates and networks to destabilize populations. How
- 6:56Speaker 1: do the tactics you observed in this particular campaign compare
- 7:00Speaker 1: maybe to international state-backed playbook strategies that we've been seeing?
- 7:07Speaker 2: Well, so what we're seeing in South Africa is information
- 7:16Speaker 2: operations on... the left and the right of our country.
- 7:21Speaker 2: We're seeing information operations happening amongst conservative Afrikaners, amongst libertarian
- 7:27Speaker 2: South Africans, coming in mostly through the kind of global
- 7:33Speaker 2: right-west vectors. And those are, their narratives globally are starting
- 7:38Speaker 2: to colonize our narratives. And then we're seeing this kind
- 7:43Speaker 2: of like chaos phenomenon fragmenting of society narratives coming in
- 7:47Speaker 2: from the traditional left, for lack of a better word.
- 7:51Speaker 2: Some might say that they're not left or right, they're
- 7:53Speaker 2: both authoritarian. But we're seeing these narratives come in from
- 7:57Speaker 2: nation states on all sides. And what we're seeing is
- 8:01Speaker 2: increasing common ground being found between them. So for example,
- 8:04Speaker 2: March and March is pivoting toward Islamophobia and turning their
- 8:12Speaker 2: issue around anti-foreigners into an Islamic issue. which is the
- 8:17Speaker 2: standard narrative playbook of the global right. So they're connecting
- 8:21Speaker 2: because the global right says that Europe and America is
- 8:25Speaker 2: being invaded by Muslims from North Africa and places like
- 8:30Speaker 2: that on boats. March and Marcher says that South Africa
- 8:34Speaker 2: is being invaded by Muslims from Pakistan and Somalia who
- 8:38Speaker 2: espouse the shopkeepers. And they're finding increasing common ground And
- 8:42Speaker 2: we're seeing that these narratives that are promoted on platforms
- 8:45Speaker 2: like X are merging. And that is intentional. So as
- 8:53Speaker 2: a user, you have to be really, really careful about
- 8:55Speaker 2: the messages that you imbibe. You have to take a
- 8:57Speaker 2: step back and think to yourself, do I live in
- 8:59Speaker 2: a democratic society? Do I live in one where I
- 9:04Speaker 2: believe in inclusivity? Does this contradict my ideas of what
- 9:08Speaker 2: a free and fair society is? Because chances are someone
- 9:12Speaker 2: is feeding you that narrative, whatever side of the political
- 9:15Speaker 2: divide you are. And that's a pretty good sign that
- 9:17Speaker 2: it's probably a narrative that's manipulating it.
- 9:21Speaker 1: Kyle Findlay is with Murmur Intelligence, and he's penned the
- 9:24Speaker 1: article in the Daily Maverick. You've just got to read it.
- 9:28Speaker 1: The intrigue is all over. Okay, so did I hear
- 9:32Speaker 1: you correctly? Are you saying chances are that there are
- 9:35Speaker 1: state actors playing games in South Africa today? on the
- 9:40Speaker 1: eve of our local government elections?
- 9:43Speaker 2: They are state actors playing in our country permanently and
- 9:47Speaker 2: have been for many, many years. And it's not like
- 9:51Speaker 2: they muster themselves all of a sudden around an election period,
- 9:55Speaker 2: but they do definitely heighten their activities during this period. Okay.
- 10:03Speaker 1: Yeah, because it does appear to be coordinated then from
- 10:06Speaker 1: the statistics you give in your article, and it does
- 10:11Speaker 1: seem to be financed by … to enable the kind
- 10:16Speaker 1: of outcome. And it is then looking directly to influence
- 10:21Speaker 1: our voting patterns.
- 10:23Speaker 2: We can't say for sure that they are paid and
- 10:26Speaker 2: that there's money behind it, or we can highlight the
- 10:29Speaker 2: red flags, which are things like the presence of known
- 10:33Speaker 2: paid influencers, things like the extreme levels of buzzing behavior,
- 10:38Speaker 2: which is single-minded reposting of influencers. And what we know about...
- 10:45Speaker 2: the communities involved and what they've been involved in in
- 10:47Speaker 2: the past.
- 10:49Speaker 1: I'm not sure if Eben's comment relates to this conversation. Walid,
- 10:53Speaker 1: should we play that voice note? Does it relate to this? Oh,
- 10:55Speaker 1: it doesn't relate to the conversation. We can play it
- 10:58Speaker 1: a little later on. I went down this rabbit hole
- 11:01Speaker 1: in just trying to understand if maybe the social media
- 11:05Speaker 1: owners could identify and neutralize the swarms, the bots, the
- 11:12Speaker 1: bot network's, and it suggests that they are becoming increasingly
- 11:17Speaker 1: sophisticated and maybe difficult to identify, so it's not necessarily
- 11:21Speaker 1: possible to the extent that it was not too long ago. Kyle?
- 11:26Speaker 2: So there is that. Obviously, AI has come along in
- 11:29Speaker 2: leaps and bounds, and the traditional ways of identifying automated
- 11:32Speaker 2: behavior are circumvented to some degree by AI bots that
- 11:40Speaker 2: act more human-like. So that is a reality. The last
- 11:48Speaker 2: time we saw a botnet in the South African network,
- 11:51Speaker 2: there was this network promoting Beke Kele while he was
- 11:56Speaker 2: still police minister before the Nkwanazi revelations came out. So
- 12:02Speaker 2: that was the last time we saw an overt botnetwork.
- 12:05Speaker 2: Every time since it's been human-based, but... My hunch is
- 12:10Speaker 2: that if you go to America and places like that,
- 12:11Speaker 2: you'll probably see AI playing a far bigger role.
- 12:15Speaker 1: Yeah, let's understand that since you are there. We're talking
- 12:18Speaker 1: about the rise of generative AI. We're talking about LLM's
- 12:21Speaker 1: large language models. I would imagine they've changed the game
- 12:25Speaker 1: for data analysts like you.
- 12:28Speaker 2: In terms of workflow, for sure, in terms of what
- 12:31Speaker 2: we're able to do and identify, what we say as
- 12:36Speaker 2: MoMA Intelligence is that we measure influence. And we actually
- 12:39Speaker 2: have a new platform called LLMino that measures what responses
- 12:44Speaker 2: you get out of AI models. And we're finding that
- 12:47Speaker 2: that's a really interesting new horizon for influence. So if
- 12:51Speaker 2: we're talking about political influence, because brands do it too.
- 12:55Speaker 2: Brands want to be mentioned first and they want their perceptions,
- 12:58Speaker 2: their brand positioning to be portrayed by ChatGPT and Claude
- 13:02Speaker 2: and things like that. So there's a whole cottage industry
- 13:04Speaker 2: about how do you influence AI models. But from a
- 13:06Speaker 2: political perspective, that is also a burgeoning cottage industry. There
- 13:11Speaker 2: are things like AI grooming or AI poisoning. The most
- 13:15Speaker 2: famous example of that was Russia had a project called,
- 13:19Speaker 2: or has an ongoing project called Project Doppelganger. And what
- 13:22Speaker 2: they do is they copy the main European news websites
- 13:26Speaker 2: like Alpi, Deutsche Welle, and they use AI to subtly
- 13:30Speaker 2: alter the wording of the articles so that when chat
- 13:33Speaker 2: GPT scrapes the internet, It ingests those articles, hundreds and
- 13:37Speaker 2: thousands of those articles. And that changes perceptions towards Russia
- 13:42Speaker 2: when people ask ChatGPT about the Ukraine war and things
- 13:45Speaker 2: like that. So there's this new front of influence because
- 13:50Speaker 2: increasingly AI models are the kind of arbiter of truth.
- 13:54Speaker 2: You and I don't go to Google and read the
- 13:57Speaker 2: top 10 search results and synthesize an answer for ourself anymore.
- 14:01Speaker 2: We just go to Claude, Gemini, or ChatGPT, or Grok,
- 14:05Speaker 2: And we ask them what the answer is. And they
- 14:07Speaker 2: tell us the answer in a very succinct, very confident
- 14:11Speaker 2: way that doesn't really leave room for questioning or research.
- 14:14Speaker 2: And so we just take on board what we're told.
- 14:17Speaker 2: And implicit in that is that we believe that the
- 14:20Speaker 2: people that control these models have our best interests at heart,
- 14:23Speaker 2: that align with our worldviews. That's not always the case.
- 14:26Speaker 1: Yeah.
- 14:26Speaker 2: Like, for example … That's the best joke I've heard
- 14:29Speaker 2: in a while. You know, the most egregious example of
- 14:34Speaker 2: this was when Cyril Ramaphosa visited the White House and
- 14:38Speaker 2: Donald Trump ambushed him with the white genocide presentation. Around
- 14:45Speaker 2: that period, Grok for a day would insert white genocide
- 14:49Speaker 2: into any response it gave any user anywhere in the world.
- 14:52Speaker 2: So you could ask for a recipe for pasta and
- 14:55Speaker 2: it would say, you know, use.
- 14:56Speaker 1: Olive oil and … Don't forget the genocide in South Africa.
- 14:59Speaker 2: Yeah. And by the way, exactly.
- 15:00Speaker 1: Exactly. I wanted to ask you, maybe in closing, I
- 15:04Speaker 1: think advertisers need to be very circumspect and demand a
- 15:09Speaker 1: placing free of these contentious issues because ultimately it's not
- 15:13Speaker 1: in the commercial interest of the social media platforms to
- 15:17Speaker 1: limit bot activity because they're ultimately selling that content. that
- 15:22Speaker 1: click to advertisers. Can advertisers demand that the placing of
- 15:28Speaker 1: their ads steers absolutely clear of contentious issues? There are.
- 15:37Speaker 2: Repositories of political advertising and things like that, and there
- 15:41Speaker 2: are ways of choosing where your ad gets placed. But
- 15:46Speaker 2: there are limits to that. And a lot of spam
- 15:49Speaker 2: and fake news content is actually commercially motivated. It's not
- 15:53Speaker 2: even about changing your perception. It's just about catching your
- 15:57Speaker 2: attention with something outrageous and getting you to click it.
- 16:01Speaker 1: Sell it.
- 16:01Speaker 2: And they get monetized for outrage, literally, independent of any
- 16:06Speaker 2: political motive.
- 16:08Speaker 1: And 20% to 30% of those numbers that they sell
- 16:11Speaker 1: to advertisers... 20 to 30% of the clicks they claim
- 16:15Speaker 1: to get are not from warm-blooded people. Kyle, let's end
- 16:20Speaker 1: on that note. Any closing comment?
- 16:24Speaker 2: Just remember what it means to live in a pluralistic society.
- 16:28Speaker 2: South Africa is one of the strongest, most diverse societies,
- 16:31Speaker 2: and that's our strength. And anyone who's telling you a
- 16:33Speaker 2: message about othering the members of our society is almost
- 16:37Speaker 2: certainly trying to manipulate you.
- 16:40Speaker 1: We really thank you for this insight, Kyle. It's a
- 16:43Speaker 1: huge insight. We appreciate it. Kyle Findlay of Mermaid Intelligence.
- 16:47Speaker 1: Go and get that entire article in The Daily Maric.
- 16:50Speaker 1: I'll give you the name of the article again. Go
- 16:52Speaker 1: and look for How a Narrow Court Ruling Became a
- 16:57Speaker 1: Week of Anti-Foreigner Rage Online.