Token

Also written: tokens

The small piece of text (a word or part of a word) that a model reads and writes one at a time. Hosted models charge per token, and context length, speed and memory are all counted in tokens.