Double Descent Explained

This is a post about the famous double descent phenomenon in machine learning. I aim to constrct the simplest possible example of double descent and explain exactly how it arises and why it doesn’t contradict the bias-variance tradeoff.

I was inspired...