Skip to content

Glossary: Fine-tuning LLMs

Step

Also written: steps, optimizer step

One optimizer update. With 250 examples and 8 examples per step, an epoch is 32 steps.

Where the book teaches it

Related terms

EpochGradient accumulation