Glossary: Deep Learning Basics

Autograd

Also written: automatic differentiation

PyTorch's system for computing gradients automatically. Mark a tensor with `requires_grad=True`, call `.backward()` on a result, and read `.grad`.