Output speed
Also written: tokens per second
How many tokens per second a model writes once it has started. It only means something for long answers.
Also written: tokens per second
How many tokens per second a model writes once it has started. It only means something for long answers.