Skip to content

Glossary: LLMs in Production

Amazon SQS

Also written: SQS

A cloud queue service from Amazon where jobs wait until workers take them. It is a common way to hold jobs that nobody is waiting on, such as nightly tagging of chats.

Where the book teaches it

Related terms

Queue / workers