AGI Dreams Podcast – July 14, 2026

AGI Dreams – Open, Uncensored, & Local - AI News Digest · Jul 14, 2026 · 15m · transcript

Open-Weight Cost Revolution

In this episode:

Open-Weight Cost Revolution — Enterprises are migrating to Chinese open-weight models as inference costs balloon, while startups like PrismML and BottleCap AI attack the cost problem through extreme quantization and reasoning-token reduction. A 744B model streaming from disk on consumer hardware signals shifting local inference economics.

Inference Engines: The Rust Wave — Rust is emerging as a serious inference runtime contender, with mistral.rs v0.9.0 claiming 1.8x faster CPU decode than llama.cpp and ferrite implementing Qwen3.5's…