Glossary: Deep Learning Basics

Batch normalization

Also written: batch norm, BatchNorm, nn.BatchNorm1d, nn.BatchNorm2d

A layer that standardizes each feature across the batch to mean 0 and standard deviation 1, then applies a learned scale and shift. In evaluation mode it uses running averages saved during training.