The Curve That Went Back Down: The Mathematics of ML Generalisation

Deep End Era. Engineering with Sankalp · Oct 28, 2026 · 58m

Hume and induction; Hoeffding; bias–variance (Geman, Bienenstock, Doursat 1992), ridge, lasso, AIC; Vapnik–Chervonenkis 1971, shattering, Sauer's lemma, the fundamental theorem; Valiant's PAC 1984; SVMs and margins; Rademacher and norm-based bounds; Zhang et al. 2017; Belkin et al. 2019 and Nakkiran et al. deep double descent; minimum-norm interpolation and benign overfitting; Soudry et al. max-margin bias; flat minima, SAM, edge of stability; Bousquet–Elisseeff stability, Hardt–Recht–Singer; McAllester's PAC-Bayes and Dziugaite–Roy nonvacuous bounds; compression; NTK, lazy training, muP…