Skip to content

Glossary: LLMs in Production

FAULTS

Also written: fault injection, failures on demand

The stand-in model's switchboard for causing failures: scripted errors, random error rates, down models or slow-downs. It lets you test failure handling for free.

Where the book teaches it

Related terms

Stand-in modelGame day