Decoder-only model
Also written: decoder, decoder-only
A transformer made of causal-attention blocks that predicts the next token, like GPT and Llama. Most general-purpose models today are decoder-only and handle other tasks through prompts.
Also written: decoder, decoder-only
A transformer made of causal-attention blocks that predicts the next token, like GPT and Llama. Most general-purpose models today are decoder-only and handle other tasks through prompts.