Decode

Also written: generation, decode (generation)

The phase where the model writes its reply one token at a time, after reading the prompt. Its speed is limited by memory bandwidth.