Chinchilla
A 2022 DeepMind model and paper showing that, for a fixed compute budget, model size and training tokens should grow together, at about 20 tokens per parameter.
A 2022 DeepMind model and paper showing that, for a fixed compute budget, model size and training tokens should grow together, at about 20 tokens per parameter.