Latest / Decrypted: The UK Cyber Briefing / A capacity limit in Frankfurt, and the National Lottery it took offline
Transcript
- 0:03This is Decrypted. Thursday, the twenty-third of July.
- 0:06A capacity limit in Frankfurt, and the National Lottery it took offline.
- 0:12On 16 July, a single capacity limit inside one A W S availability zone in Frankfurt did something no attacke
- 0:22r managed this week. For three and a half hours, it took the UK National Lottery offline.
- 0:28Hugging Face too. And university coursework platforms Canvas and Blackboard, for good measure.
- 0:34Nobody broke in anywhere. A routine internal constraint jammed.
- 0:39It sat in the fleet that manages connections for CloudFront's newer "V P C Origins" feature.
- 0:46That control plane feeds edge locations globally.
- 0:51So sites with nothing wrong in their own region started returning errors anyway.
- 0:55It's a useful reminder that resilience, like security, is a design decision.
- 1:01It's not a feature you can buy afterwards.
- 1:04And this week, it's the National Lottery's turn to make the point.
- 1:08Next. What actually broke.
- 1:11So, what actually broke? CloudFront's V P C Origins lets a customer serve an application from a private back
- 1:21end, without exposing it to the open internet.
- 1:24On its own, that's a sensible design.
- 1:27The problem sat one layer up.
- 1:30The fleet responsible for pushing routing configuration out to CloudFront's network processors hit an interna
- 1:36l capacity limit. In a single availability zone, in A W S's Frankfurt region.
- 1:43That's a regional problem.
- 1:45But the mechanism it broke wasn't regional.
- 1:48It was the single control plane that every edge location worldwide relies on, to know where to send traffic.
- 1:55Picture a single signal box outside Frankfurt jamming.
- 1:59And points failing at stations across a network that never lost a single length of track.
- 2:04Nothing in Ohio or London physically failed.
- 2:08The National Lottery's website still had every server it needed.
- 2:12It simply stopped being told how to reach them.
- 2:15And finally. The design lesson.
- 2:18The specific fault will get patched.
- 2:21The pattern won't go away on its own, because it's structural.
- 2:24Modern C D N convenience is increasingly built on control planes with no visible regional boundary from the
- 2:31customer's side. Which means a single availability zone incident can have a global blast radius by design.
- 2:38Secure by Design, and its close relative, resilience by design, means treating that as a defect to engineer
- 2:47around. Not a fact of life to absorb.
- 2:49If you're a UK organisation that has quietly bet an exam platform, a booking system or a lottery draw on one
- 2:57hyperscaler's edge network, there are three practical questions.
- 3:01What happens if this specific control plane fails, not just the region?
- 3:06Do we have a second path out?
- 3:09And does our contract with the provider say anything about blast radius at all?
- 3:13"It's someone else's infrastructure" has never meant "it's not my risk.
- 3:18"
- 3:24Thanks for listening.