Skip to content

Glossary: AI System Design

Streaming

Sending text as it is generated so users see the first words after the TTFT instead of waiting for the whole answer.

Where the book teaches it

Related terms

TTFT (time to first token)