Temperature
A setting that divides the logits before softmax: below 1 sharpens the distribution toward the top token, above 1 flattens it. Temperature 0 means greedy decoding.
A setting that divides the logits before softmax: below 1 sharpens the distribution toward the top token, above 1 flattens it. Temperature 0 means greedy decoding.