skinny.

Latest / Misar.Blog Podcast

AI Model Compression: Quantization, Pruning, Distillation, and Deployment

Expert guide to AI model compression in 2026: weight quantization (GPTQ, AWQ, GGUF, bitsandbytes), structural pruning (SparseGPT, Wanda), knowledge… From the article "AI Model Compression: Quantization, Pruning, Distillation, and Deployment" by Synor, published on Misar.Blog.

In this episode:

0:00 Introduction

0:13 Model Compression Reduces LLM Size and Inference Cost by 2-10x

0:40 Quantization

1:01 Pruning—removing Redundant Weights or Attention Heads

1:29 Knowledge Distillation Trains a Smaller “Student” Model to Replicate

2:04 MoEfication Converts Dense Models to Mixture-Of-Experts…

The skinny

The skinny isn't ready yet — notes appear once the transcript is processed.