Going Down the Stack: AI Inference, Kernel Fusion, and Model Tuning with Paul Brookes

The MonkCast · Jul 14, 2026 · 25m · transcript

In this MonkCast conversation, RedMonk's James Governor talks with Paul Brookes, a senior AI engineer at TurinTech, about making AI inference faster and cheaper. TurinTech predates the generative AI boom, having spent years optimizing complex code with genetic algorithms, and now points those tools at the models themselves. Brookes walks through techniques like kernel fusion and model compilation that squeeze more tokens per second out of specific hardware, drawing on the company's work with Intel on OpenVINO and vLLM. The two get into running capable open models such as Qwen on local…