Generalization Gap in Over‑Parameterized Models
Textbook bias–variance intuition implies that worst‑case test error should eventually rise as model capacity overtakes the sample size because the variance term in the bound grows while the bias term has already bottomed out (see Vapnik and Chervonenkis, 1971; Bartlett and Mendelson, 2002). Those worst‑case guarantees shrink