Apple’s A20 Pro Demonstrated To Be An On-Device AI Beast, Can Run A 27B Parameter Model At Double The Speed Of The iPhone 17 Pro’s A19 Pro
For the first time in Apple Silicon history, the A20 Pro sports a dual-16-core Neural Engine that’s designed to tackle AI workloads like no other SoC before it, and in short, it’s an upgrade that we thought we didn’t need, but it’s absolutely paramount if you wish to run on-device AI models on a smartphone. In the latest demonstration, an iPhone 18 Pro is shown to run a 27B parameter model at double the speed of the iPhone 17 Pro. The dual-16-core Neural Engine is certainly faster in token generation, but the consequences of limited memory configurations mean that 2-bit quantized…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.