Skip to content

Glossary: LLMs in Production

Multipliers

Also written: multiplier

Changes that multiply cost, such as a bigger model, a script asking every second, or a retry loop. The danger to a budget is these, not the average request.

Where the book teaches it

Related terms

Per-user limitsRetry storm