Powering the AI inference boom: Is it time to downsize the data centre?
In the world of artificial intelligence, the focus used to be on training AI models. Now, increasingly, it's on "inference" – the actual execution of the tasks we ask these systems to perform. David Gurlé is a French tech entrepreneur whose startup Antimatter aims to service the inference boom with energy solutions, mini data centres that fit inside a container and appropriate software – for only a fraction of the cost and time.
Also in the show, we bring you a report about Cape Town, where plans for new data centres are being met with pushback amid concerns about rising electricity costs…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.