Skip to content

Glossary: AI System Design

Latency budget

A latency target split into limits per step. P95s of steps don't add up, so check the total by simulation or measurement.

Where the book teaches it

Related terms

p95Lognormal