Latest / Impact Vector: AI Tools
NVIDIA AI Releases Nemotron 3.5 Lightning: A 30B Open MoE with 3B Active Parameters, and NeMo Switchyard — 2026-08-12
## Short Segments Amazon SageMaker HyperPod introduces a tiered KV cache architecture, optimizing large language model inference by extending cache hierarchy beyond GPU and CPU memory into a shared NVMe pool. This development reduces infrastructure costs and improves user experience by addressing the KV cache trade-off in LLM inference. Coming up, we'll explore how Solv Labs built verifiable agent payments on Amazon Bedrock, and later, NVIDIA's new AI model and routing library that could reshape AI agent workflows. Solv Labs has implemented a verifiable, auditable agent payments workflow…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.