Special tokens
Also written: <|im_start|>, special token
Reserved tokens such as `<|im_start|>` and `<|im_end|>` that mark where each turn begins and ends. The chat template inserts them, so the model trains on them.
Also written: <|im_start|>, special token
Reserved tokens such as `<|im_start|>` and `<|im_end|>` that mark where each turn begins and ends. The chat template inserts them, so the model trains on them.