Skip to content

Glossary: AI System Design

Little's law

Also written: in flight

Requests in progress equal arrivals per second times seconds each takes. At 1.8 calls a second and 4 seconds each, about 7 calls run at once.

Where the book teaches it

Related terms

QPS (queries per second)Burst factor