Glossary: Deep Learning Basics

Gradient

Also written: gradients

The list of slopes of the loss with respect to each parameter. Training steps each weight a little downhill along it.