Glossary: Deep Learning Basics
Batch
Also written: mini-batch, batches, batch size
A small group of examples (typically 32 to 256) used for one training step. Its gradient is a noisy but cheap estimate of the full gradient.
Glossary: Deep Learning Basics
Also written: mini-batch, batches, batch size
A small group of examples (typically 32 to 256) used for one training step. Its gradient is a noisy but cheap estimate of the full gradient.