skinny.

Latest / Misar.Blog Podcast

Reducing Model Size Without Losing Accuracy: Quantization

Reducing Model Size Without Losing Accuracy: Quantization — by Misar.AI Editorial on Misar.Blog. From the article "Reducing Model Size Without Losing Accuracy: Quantization" by Misar.AI Editorial, published on Misar.Blog.

In this episode:

0:00 Introduction

0:12 Quantization Is Presented as the Highest-Leverage Way to Shrink Models

1:31 Quantization Works by Mapping Floating-Point Weights to a Smaller Set

3:16 The Key Design Problem in Quantization Is Choosing the Quantization Grid

4:40 Post-Training Quantization

6:01 Symmetric, Asymmetric

7:57 The Article's Precision Ladder Says FP32

9:53 The…

The skinny

The skinny isn't ready yet — notes appear once the transcript is processed.