max_new_tokens
A `generate` setting that caps how many tokens the model may write. A model that never learned to stop keeps going until it hits this limit.
A `generate` setting that caps how many tokens the model may write. A model that never learned to stop keeps going until it hits this limit.