Glossary: Deep Learning Basics

Softmax

Also written: torch.softmax, nn.Softmax

Turns k logits into k probabilities that add up to 1, by exponentiating each and dividing by the total. Don't put it in the model when using `CrossEntropyLoss`, which applies it itself.