Glossary: Building with LLMs Basics
Usage
Also written: usage
The part of an API response that reports the tokens you're billed for, including input, output and cache counts. A `Usage` dataclass can total these across requests and compute the cost.
Glossary: Building with LLMs Basics
Also written: usage
The part of an API response that reports the tokens you're billed for, including input, output and cache counts. A `Usage` dataclass can total these across requests and compute the cost.