LESSON 2 · Calculus Without Tears
Derivatives That Learn
Every neural network learns through derivatives. When an AI model misclassifies an image, the training algorithm computes the gradient — a stack of partial derivatives — that says which weights to nudge and by how much. Billions of tiny derivative updates turn random numbers into a network that recognizes faces or translates languages.
This technique is called gradient descent, and it is the dominant method in modern machine learning. The same mathematics that tells a physicist when a planet moves fastest tells an AI which pixel mattered most in a cat photo. Derivatives became the universal tool for optimization: whenever you want the best answer to a smooth problem, you follow the slope.