Sampling
Also written: sample
Choosing the next token at random according to its probability, rather than always taking the top one.
Also written: sample
Choosing the next token at random according to its probability, rather than always taking the top one.