Skip to content

Glossary: AI System Design

TTFT (time to first token)

Also written: TTFT, time to first token

How long until the first text appears in a streamed answer; the support assistant's target is p95 under 2 seconds.

Where the book teaches it

Related terms

p95StreamingLatency budget