Byte-level BPE
BPE that starts from the 256 possible byte values instead of characters, so any text in any language can be encoded without unknown characters. GPT-2 and Llama 3 use it.
BPE that starts from the 256 possible byte values instead of characters, so any text in any language can be encoded without unknown characters. GPT-2 and Llama 3 use it.