Skip to content

Glossary: Deep Learning Basics

Dropout

Also written: nn.Dropout

Randomly sets a share `p` of a layer's outputs to zero at each training step, scaling the rest up, so the network can't rely on a few units to memorize rows. It does nothing in evaluation mode.

Where the book teaches it

Related terms

Regularizationmodel.train() / model.eval()