Tokens (LLM)
Also written: token, input tokens, token counting
The chunks of text a model reads and writes, roughly four characters each. Tool definitions and results cost tokens on every step.
Also written: token, input tokens, token counting
The chunks of text a model reads and writes, roughly four characters each. Tool definitions and results cost tokens on every step.