Linear approximation
Treating a curve as its tangent line near a point: f(x+Δx) ≈ f(x) + f'(x)·Δx. It predicts what a small nudge will do, and gradient descent is built on it.
Treating a curve as its tangent line near a point: f(x+Δx) ≈ f(x) + f'(x)·Δx. It predicts what a small nudge will do, and gradient descent is built on it.