Sampling

Also written: temperature, top_p, top_k

Picking each next token from the likely ones with some randomness, which is why the same prompt gives different replies. Many current models no longer accept `temperature`, so you steer them with clear instructions.