Latest / Deep End Era. Engineering with Sankalp
When the Rack Is the Computer: NVLink, UALink and Ultra Ethernet
When Meta trained Llama 3 on sixteen thousand processors, something broke roughly every three hours. Episode one hundred and fifty two goes inside the networks that let thousands of chips act as one computer: why AI training needs them, how NVIDIA's NVLink grew into a seventy two processor rack wired with thousands of copper cables, what the open challengers UALink and Ultra Ethernet change, and why every rack now needs liquid cooling and talks about megawatts. A fictional hardware lead, Tomasz, chases a link that drops when the coolant cools. Tomasz and his lab are fictional; everything else…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.