OpenAI’s First-Gen Jalapeno ASIC Blows Competition Out Of The Park, Performs 1.5x to 1.9x More Work Per Kilowatt Than NVIDIA’s Blackwell Chips, While Threatening The CUDA Moat
OpenAI seems to have used its current spate of models that run on NVIDIA GPUs to design the Jalapeno chip, and then paired it with its own Gluon kernel programming language, thereby daring to threaten NVIDIA's legendary CUDA moat. How the tables have turned! The architecture of OpenAI's Jalapeno chip SemiAnalysis has just provided a detailed breakdown of OpenAI's Jalapeno ASIC, describing a somewhat novel architecture that delivers substantial economies of scale. As such, the Jalapeno pairs a single reticle-sized compute die - built on TSMC’s N3P node - with an N3E I/O chiplet and HBM4 memory…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.