Latest / The Best of the Money Show / Tech Thursday: IEC warns of AI disinformation ahead of elections
Transcript
- 0:00Speaker 1: The Money Show. Tech Thursdays.
- 0:03Speaker 2: Tech Thursdays is brought to you by GoTime Bank. Fund
- 0:07Speaker 2: what's next. Get GoTime business advance. Business growth. Made it beautiful. Well,
- 0:13Speaker 2: the Electoral Commission very worried about AI-generated disinformation campaigns on
- 0:16Speaker 2: social media. Not just here. Been a big issue in Israel.
- 0:20Speaker 2: Also in the midterm elections in the U.S. And I'm
- 0:23Speaker 2: sure in Brazil's elections over the weekend as well. Sipo
- 0:26Speaker 2: Milele Zondi is our tech expert. Hi, Sipo Milele. I mean,
- 0:30Speaker 2: tech companies have been in all sorts of trouble before
- 0:33Speaker 2: for allowing disinformation. There was that Cambridge Analytica story in
- 0:37Speaker 2: the States. But they seem to have pulled back on
- 0:40Speaker 2: fact-checking mechanisms. They don't seem to be interested.
- 0:44Speaker 1: Hello, Stephen. Yes, it seems to have been a big
- 0:47Speaker 1: change because there was that worry with Cambridge Analytica. We
- 0:50Speaker 1: do remember Mark Zuckerberg being hurled in front of lawmakers
- 0:54Speaker 1: and social media companies that said they were going to
- 0:58Speaker 1: do better. In fact, they did. Because for a while,
- 1:00Speaker 1: sometimes you'd remember that during COVID, if you posted something,
- 1:04Speaker 1: then there could be a story from the media that
- 1:07Speaker 1: could actually verify what you'd have posted, or that would say,
- 1:11Speaker 1: if you want to read more on this, here's a
- 1:13Speaker 1: story we found for you. You can read more on this.
- 1:15Speaker 1: If it was wrong, then they would post something to say, well, no,
- 1:19Speaker 1: here's the correct information. We found this website for you.
- 1:22Speaker 1: That can help. But it seems like, and also, interestingly enough, that...
- 1:28Speaker 1: That was the reason that was used by Elon Musk
- 1:32Speaker 1: when he said he wanted to buy X. He said
- 1:34Speaker 1: it seemed like there were a lot of bots that
- 1:36Speaker 1: were sharing this information, even though X at the time
- 1:39Speaker 1: was doing quite a lot in order to counter this
- 1:42Speaker 1: information and this information. But it seems like since Elon
- 1:48Speaker 1: bought X, then they pulled back on fact checkers and
- 1:53Speaker 1: they introduced something else by pulling back on fact checkers.
- 1:58Speaker 2: Are there particular platforms then that almost enable, encourage, empower disinformation? Elon? Elon?
- 2:07Speaker 1: Well, I mean, when you think about, for example, X,
- 2:11Speaker 1: they do say they have community notes. And yes, in
- 2:13Speaker 1: various countries, there are various organizations that do a lot
- 2:17Speaker 1: of this fact checking. But the problem is that it
- 2:20Speaker 1: doesn't happen in real time. So people are getting information
- 2:23Speaker 1: in real time. And they are sharing information in real time.
- 2:27Speaker 1: And A lot of this information is not even human.
- 2:31Speaker 1: It's bots. So you find that a hundred bots that
- 2:33Speaker 1: have been set up by, let's say, organization X are
- 2:37Speaker 1: all sharing information and you're thinking these are real humans
- 2:40Speaker 1: that are sharing this information. And sometimes when you then
- 2:44Speaker 1: click on the screenshots, you then realize that, or on
- 2:47Speaker 1: the photograph, you realize that, hold on, if you can
- 2:50Speaker 1: pick it up, that this is not a human, this
- 2:53Speaker 1: is an AI-generated image that's being used here. But by
- 2:58Speaker 1: the time these fact-checking companies, I think of Africa Check
- 3:01Speaker 1: here in South Africa, get to it, it happens after
- 3:05Speaker 1: the fact, once people have been sharing information and probably
- 3:09Speaker 1: even pulled out of social media to share it in
- 3:12Speaker 1: their natural environment with friends and families.
- 3:15Speaker 2: I mean, we know that bots do this. So it's
- 3:17Speaker 2: an algorithm. It's done almost automatically. How would something like
- 3:21Speaker 2: this work? I mean, it's really hard to stop them.
- 3:25Speaker 1: It's difficult. So I know in Romania, the year was
- 3:29Speaker 1: December 2024, where they actually announced election results. And they
- 3:36Speaker 1: said they found that there were bots. that were influencing
- 3:38Speaker 1: Romanians on what to think and how to view a situation.
- 3:42Speaker 1: I believe that a politician who seems to have 1%
- 3:47Speaker 1: popularity when the polling was done eventually was the winner
- 3:52Speaker 1: of that election. And what they thought is that there
- 3:53Speaker 1: was foreign influence with the Boston. They announced election results
- 3:58Speaker 1: over there. Not every country is going to do this.
- 4:03Speaker 1: But yes, they are quite active in trying to influence
- 4:07Speaker 1: voters in terms of what to think and how to
- 4:10Speaker 1: think about their politicians and their democracies.
- 4:13Speaker 2: I mean, the big problem we have is that we
- 4:16Speaker 2: don't know which accounts are bots and which are AI
- 4:20Speaker 2: and which are actually human beings. And the online platforms
- 4:23Speaker 2: have no interest in trying to verify that for us
- 4:26Speaker 2: when all they could demand is simple credit card information.
- 4:31Speaker 1: And they could also trust because what's happening now is
- 4:34Speaker 1: that there are a lot of these accounts, especially on X,
- 4:37Speaker 1: that are ticked. So you pay for the tick, but
- 4:40Speaker 1: anyone can pay for any account to have a tick.
- 4:42Speaker 1: And there's no verification that the tick is going to
- 4:45Speaker 1: a real human account as it used to be in
- 4:48Speaker 1: the past. When, for example, I know that my account
- 4:52Speaker 1: at some point was verified on X. And what they
- 4:55Speaker 1: did when they were going to verify, they DMed me
- 5:01Speaker 1: and they said, listen, we need your ID document and
- 5:03Speaker 1: this and that and the other. And then it happened
- 5:06Speaker 1: automatically once they verified that I was a human who
- 5:10Speaker 1: does some work in the media space in South Africa.
- 5:13Speaker 1: But they removed all of that. And now you pay
- 5:16Speaker 1: for these checks in. Anyone can pay for whichever account.
- 5:20Speaker 1: And the incentive is that you will get priority or
- 5:23Speaker 1: the bots will get priority because they have paid the platform.
- 5:28Speaker 1: So the platform platforms themselves, some of them are prioritizing
- 5:32Speaker 1: profits over over authenticity and verification of who is on
- 5:37Speaker 1: the platform.
- 5:38Speaker 2: Really is very, very scary. I mean, as you say,
- 5:41Speaker 2: in Romania, this could have a big impact. It could
- 5:43Speaker 2: have an impact on our elections, the U.S. midterms.
- 5:46Speaker 1: And that's why the Electoral Commission has raised this worry.
- 5:52Speaker 1: And there was worry in the last national and provincial
- 5:55Speaker 1: elections two years ago that there were sometimes these videos
- 6:00Speaker 1: that would sometimes appear that the original sound would be
- 6:05Speaker 1: removed and then there'd be a sound of a human
- 6:07Speaker 1: that you wouldn't be able to see and also do
- 6:10Speaker 1: know that even outside elections here in South Africa, we've
- 6:14Speaker 1: seen some of these problems where you find that AI
- 6:19Speaker 1: has been used. to change what someone has been saying.
- 6:23Speaker 1: And you think they were saying something else when it's
- 6:26Speaker 1: AI that was used. You see the mouse moving in
- 6:28Speaker 1: a particular direction. But not everybody gives themselves time to
- 6:33Speaker 1: educate themselves about how to spot these things. And this
- 6:37Speaker 1: is where it becomes problematic and it has implications on
- 6:40Speaker 1: how people vote, how elections are run, and what's actually
- 6:43Speaker 1: being said about elections, those running elections, and those that
- 6:48Speaker 1: are campaigning during those elections.
- 6:51Speaker 2: Sipu Melele-Zondi, our tech expert. Thank you so much.