Latest / Machine Learning Tech Brief By HackerNoon
Tokens Per Watt: Why Your Context Window Is a Power Decision
This story was originally published on HackerNoon at: https://hackernoon.com/tokens-per-watt-why-your-context-window-is-a-power-decision.
On an H100, tokens per watt drops 12x between 4K and 64K context. Agents live at the fat end of that curve. The fix comes from semiconductor architecture.
Check more stories related to machine-learning at: https://hackernoon.com/c/machine-learning. You can also check exclusive content about #artificial-intelligence, #agentic-ai, #semiconductors, #llm-inference, #ai-infrastructure, #tokens-per-watt, #software-engineering, #gpu, and more.
This story was…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.