Whose numbers are these
A day of performance claims made by the companies whose products are being measured, and what it takes to check any of them.
SemiAnalysis put OpenAI's Jalapeño inference chip through the InferenceX benchmark against Nvidia, AMD and Google parts on open-weight models. OpenAI claims 1.5–1.9x better performance per watt and 1.7–3.6x lower latency. The Nvidia half is reproducible by anyone with the hardware; the Jalapeño half is not, because you can't rent one.
Z.ai confirmed the stealth model Ox Alpha is a new GLM iteration, with weights shipping tonight after it topped OpenRouter's leaderboard…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.