Skip to content

Glossary: LLMs in Production

Load test

Sending realistic simulated traffic to the service to measure what users would see: throughput, status codes and percentile times. It reveals the bottleneck.

Where the book teaches it

Related terms

Game dayPercentiles