EP1: Sampling

The Information Bottleneck · Aug 21, 2025 · 1h 10m

Allen and Ravid discuss a topic near and dear to their hearts, LLM Sampling!

In this episode of the Information Bottleneck Podcast, Ravid Shwartz-Ziv and Alan Rausch discuss the latest developments in AI, focusing on the controversial release of GPT-5 and its implications for users. They explore the future of large language models and the importance of sampling techniques in AI.

Chapters

00:00 Introduction to the Information Bottleneck Podcast

01:42 The GPT-5 Debacle: Expectations vs. Reality

05:48 Shifting Paradigms in AI Research

09:46 The Future of Large Language Models

12:56 OpenAI's New…