Learning rate

Also written: η, eta, lr

The small positive number that sets the step size in gradient descent. Too small and training crawls, too big and it overshoots and diverges.