Batch
Also written: batches, batch size
A group of training examples processed together in a single training step. For a language model it is typically a stack of random text windows, such as 32 windows of 64 tokens.
Also written: batches, batch size
A group of training examples processed together in a single training step. For a language model it is typically a stack of random text windows, such as 32 windows of 64 tokens.