Latest / Algorithms & Adipose - Clinical AI, Explained
Episode 2: What Are Tokens and Context Windows? AI Basics for Clinicians
In this episode we talk about tokens and context - the model's working memory. What's in it, what falls out, why long chats degrade, and why a bigger context window is not the same as a bigger attention span.
Paper: Liu NF, et al. Lost in the Middle: How Language Models Use Long Contexts. TACL. 2024;12:157-173.
Substack: https://algoadipose.substack.com
Music credit: NCS Dream – Di Young
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.