Glossary: Serving LLMs at Scale

N+1

Enough capacity for peak load plus one spare, so the service survives a failure or an update.