Latest / No Priors: Artificial Intelligence | Technology | Startups
The Future is Small Models, with Matei Zaharia, CTO of Databricks
If you have 30 dollars, a few hours, and one server, then you are ready to create a ChatGPT-like model that can do what’s known as instruction-following. Databricks’ latest launch, Dolly, foreshadows a potential move in the industry toward smaller and more accessible but extremely capable AIs. Plus, Dolly is open source, requires less computing power, and fewer data parameters than its counterparts.
Matei Zaharia, Cofounder & Chief Technologist at Databricks, joins Sarah and Elad to talk about how big data sets actually need to be, why manual annotation is becoming less necessary to train…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.