Skip to content

Glossary: LLMs in Production

Flex processing

Also written: flex, service_tier="flex"

An OpenAI option that gives batch prices on ordinary requests in return for slower answers. When capacity is short it fails with 429 Resource Unavailable, so retry later or resend without flex.

Where the book teaches it

Related terms

Batch API