Skip to content

Glossary: AI Agents Basics

Latency

How long someone waits for a result. An agent's latency is roughly the number of model calls times the time per call, so cutting steps helps most.

Where the book teaches it

Related terms

Prompt cachingEffort