Forward pass
Computing every value in a calculation from the inputs to the output, and keeping them for later. The backward pass needs these stored values.
Computing every value in a calculation from the inputs to the output, and keeping them for later. The backward pass needs these stored values.