Token
Also written: tokens, input tokens, output tokens
The small chunks of text a model reads and writes, and what API costs are counted in. Every call re-sends the whole history, so input tokens usually outnumber output tokens.
Also written: tokens, input tokens, output tokens
The small chunks of text a model reads and writes, and what API costs are counted in. Every call re-sends the whole history, so input tokens usually outnumber output tokens.