skinny.

Latest / Frontier AI Architect

The Inference Bill: Cloud APIs, Your Own GPUs and the True Cost

For a fixed level of quality, token prices fall about tenfold a year, and AI bills keep rising. This episode explains why, what running your own GPUs really costs, and how to decide per workload.

In this episode:

- Why Cursor and Anthropic both reworked their flat-price plans in 2025

- Tokens per task and model tier: the two numbers that drive the bill

- The six costs of ownership, and a worked break-even example

- Two software levers to pull before buying hardware: the serving stack and routing

- Two opposite objections: wait for prices to fall, or own everything

Read the full article with…

Log in to save or queue this episode.

The skinny

The skinny isn't ready yet — notes appear once the transcript is processed.