Skip to content

Glossary: LLMs in Production

Daily budget

Also written: DailyBudget, DAILY_BUDGET

A dollar cap for the whole service per day. It warns at 80% and at 100% switches to degraded answers, so even the worst day stays at $25 instead of $956.

Where the book teaches it

Related terms

Per-user limitsGraceful degradation