Token
Also written: tokens
A small piece of text, roughly three quarters of a word, that an LLM reads and writes. Providers charge per token for both input and output.
Also written: tokens
A small piece of text, roughly three quarters of a word, that an LLM reads and writes. Providers charge per token for both input and output.