Qualcomm CEO Hints That Smartphones Capable Of Running 100B LLMs Could Arrive By 2028, Without Addressing Two Elephants In The Room; DRAM Supply & Cost
The biggest bottleneck of running denser AI models on smartphones is the memory count, and looking at the DRAM situation, it’s unlikely that we’ll cross the 16GB threshold soon. However, Qualcomm CEO Cristiano Amon believes that we’ll soon be living in an era where handsets can run 100B LLMs continuously and confirms that AI companies are building smartphones that can achieve this feat. As for the practicality of running denser models, Amon has mentioned how phone makers will incorporate hefty amounts of RAM, especially when supply is scarce, and prices are through the roof. The only ways to…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.