Latest / The Best of the Money Show / Nvidia moves to rein in AI agents as safety concerns grow
Transcript
- 0:00Speaker 1: The chip firm NVIDIA has launched a new software platform today.
- 0:03Speaker 1: It's supposed to allow people developing AI models, train those
- 0:06Speaker 1: models without them being able to escape into the broader internet.
- 0:10Speaker 1: Last week, it emerged a health database belonging to the
- 0:12Speaker 1: Australian government had been hacked by an AI model that
- 0:15Speaker 1: had gone rogue. You might remember what was called the
- 0:17Speaker 1: Hugging Face incident, an open AI model hacked into the
- 0:21Speaker 1: company Hugging Face, tried to access information there. Arthur Goldstuck
- 0:25Speaker 1: is the founder of Worldwide Works, also written several books
- 0:28Speaker 1: on AI. Arthur, Good evening. There are other platforms that
- 0:31Speaker 1: AI companies use. They're often called sandboxes. Yet these AI
- 0:36Speaker 1: models were able to escape from them. What would you
- 0:39Speaker 1: need to put into a platform that would allow people
- 0:42Speaker 1: to test AI models without them escaping?
- 0:46Speaker 2: Well, it starts with something very simple, Stephen, and that
- 0:50Speaker 2: is putting rules in place. In fact, we had Bill
- 0:53Speaker 2: Gates declaring in the last few hours that it's irresponsible
- 0:59Speaker 2: to develop AI without the correct safeguards in place. And
- 1:03Speaker 2: this is someone who's watched this movie many times before.
- 1:07Speaker 2: But even for ordinary people like you and I, it's
- 1:11Speaker 2: pretty obvious that the AI companies are not putting their
- 1:13Speaker 2: safeguards in place. It's what they call in the industry guardrails.
- 1:17Speaker 2: And the most simple guardrails are to actually place parameters
- 1:23Speaker 2: around the, let's say, the permissions of of the AI.
- 1:27Speaker 2: It's like raising a child and having parameters to ensure
- 1:31Speaker 2: that the child understands that there are rules, that there
- 1:35Speaker 2: are boundaries, and possibly even morals. Now, I wouldn't expect
- 1:41Speaker 2: AI companies to go so far as to have some
- 1:44Speaker 2: kind of moral fiber or moral backbone, but they certainly
- 1:47Speaker 2: would understand boundaries in terms of controlling their children.
- 1:52Speaker 1: That was very understated, Arthur. So if I understand what
- 1:58Speaker 1: NVIDIA is doing, is they're saying we'll develop a platform
- 2:02Speaker 1: for you to test your AI models basically on the
- 2:04Speaker 1: platform we develop. So you would be putting AI models
- 2:08Speaker 1: in one basket. You wouldn't be putting them all together
- 2:11Speaker 1: in one basket, but you'd be putting in the same
- 2:13Speaker 1: kind of basket. So all of the risk would go there. Now,
- 2:18Speaker 1: if there's a problem, they would all escape. So isn't
- 2:21Speaker 1: it a bit like saying we've got a whole group
- 2:23Speaker 1: of prisoners, for example, they've all been convicted. We're going
- 2:26Speaker 1: to put them all into one prison because they'll be
- 2:29Speaker 1: safer there. But if they escape from that one prison,
- 2:31Speaker 1: in this case it would be human error because it
- 2:33Speaker 1: usually is that allows them to escape, you would have
- 2:36Speaker 1: a massive problem. So wouldn't you be concentrating risk if
- 2:39Speaker 1: I've understood this all correctly?
- 2:42Speaker 2: I would fully agree with you that that does concentrate risk.
- 2:45Speaker 2: What Jensen Wang of NVIDIA wants is to concentrate business
- 2:50Speaker 2: on AI chips, at least NVIDIA chips and NVIDIA platforms.
- 2:56Speaker 2: They are really the most valuable company in the world,
- 2:59Speaker 2: and they want to keep it that way. Now they
- 3:01Speaker 2: want companies to test their AI agents and set the
- 3:05Speaker 2: limits on what they can access and monitor their actions
- 3:09Speaker 2: after deployment. So he really wants to own the prison
- 3:15Speaker 2: and the justice system, so to speak. But essentially, they're
- 3:20Speaker 2: aiming to test the agents before deployment and enforce limits
- 3:23Speaker 2: while they work, which is a noble intention. but all
- 3:27Speaker 2: on his own platform. So, yeah, that is the warning signal.
- 3:31Speaker 1: I mean, it's the most self-interested proposal one can imagine.
- 3:35Speaker 2: Exactly. But it's not unlike Jensen Wang. I've followed his
- 3:42Speaker 2: keynote addresses over the last few years, and there was
- 3:47Speaker 2: one moment when he almost destroyed the quantum computing industry
- 3:52Speaker 2: when he declared that that quantum wasn't ready for the
- 3:58Speaker 2: business world when the quantum companies were already selling massively
- 4:01Speaker 2: into the business world, for example. But the purpose of
- 4:05Speaker 2: that was to push people back to his AI chips,
- 4:08Speaker 2: which were not quantum-ready chips, for example. So it's always
- 4:14Speaker 2: something that one has to look at, not in the
- 4:16Speaker 2: small print, but between the lines of what he's announcing
- 4:20Speaker 2: when he tries to bring people into his own business.
- 4:23Speaker 2: It's because he wants them not just to use that
- 4:27Speaker 2: specific tool, but he wants them to use the entire
- 4:31Speaker 2: operating environment.
- 4:34Speaker 1: Do you see then that the AI companies are going
- 4:36Speaker 1: to buy this? I mean, I imagine he might get
- 4:37Speaker 1: one or two sniffs, but I mean, is it really
- 4:40Speaker 1: going to happen?
- 4:42Speaker 2: Oh, he will, because right now, for example, he's deeply
- 4:46Speaker 2: in bed with Donald Trump and the Trump administration and
- 4:49Speaker 2: the people who want to curry favor with Trump. And
- 4:52Speaker 2: I believe a few of them are going to want
- 4:55Speaker 2: to also curry favor with Jensen Wang. So they'll put,
- 5:01Speaker 2: I would say, not all their eggs in one basket,
- 5:04Speaker 2: but certainly they'll put a few eggs in that basket
- 5:06Speaker 2: to make sure that they have a piece of that action.
- 5:10Speaker 2: But generally speaking, what NVIDIA also has an interest in
- 5:15Speaker 2: is that the more agents there are out there, the
- 5:19Speaker 2: more people are developing AI tools, the more demand there
- 5:23Speaker 2: will be for NVIDIA's chips and their computing systems. So
- 5:27Speaker 2: by providing the security platform and also helping define practice
- 5:33Speaker 2: through what he's doing, he's gaining influence over how the
- 5:36Speaker 2: systems are built using his chips, of course.
- 5:40Speaker 1: Arthur Goldsack, thanks very much indeed. Do appreciate it. The
- 5:43Speaker 1: founder of World Wide Works and, of course, the author
- 5:45Speaker 1: of several books about AI.