Token
Also written: tokens, tokenizer, input tokens, output tokens
The chunk of text models read and write, and the unit of billing. Each model family splits text differently, so the same prompt is 3,146 tokens for Claude and 2,038 for OpenAI.
Also written: tokens, tokenizer, input tokens, output tokens
The chunk of text models read and write, and the unit of billing. Each model family splits text differently, so the same prompt is 3,146 tokens for Claude and 2,038 for OpenAI.