
Reducing Model Size Without Losing Accuracy: Quantization
Reducing Model Size Without Losing Accuracy: Quantization — by Misar.AI Editorial on Misar.Blog. From the article "Reducing Model Size Without Losing Accuracy: Quantization" by Misar.AI Editorial, published on Misar.Blog.
In this episode:
0:00 Introduction
0:12 Quantization Is Presented as the Highest-Leverage Way to Shrink Models
1:31 Quantization Works by Mapping Floating-Point Weights to a Smaller Set
3:16 The Key Design Problem in Quantization Is Choosing the Quantization Grid
4:40 Post-Training Quantization
6:01 Symmetric, Asymmetric
7:57 The Article's Precision Ladder Says FP32
9:53 The…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.