Glossary: AI System Design
How quickly a change, such as a new document or return policy, must show up in answers.
ThroughputQueue and workers