Gradient
Also written: gradients
The values, computed in the backward pass, that say how to change each weight to reduce the loss. Each trained parameter needs memory for its gradient.
Also written: gradients
The values, computed in the backward pass, that say how to change each weight to reduce the loss. Each trained parameter needs memory for its gradient.