Skip to content

Glossary: LLMs in Production

Circuit breaker

Also written: circuit breakers, breaker, breakers

A guard that stops calling a model that keeps failing. It is closed when normal, opens after 5 failures in a row, and after 30 seconds goes half-open to let one test call decide whether to close again.

Where the book teaches it

Related terms

FallbackGraceful degradation