Skip to content

Glossary: LLMs in Production

Mid-stream error

Also written: mid_stream

A failure that happens after text has already reached the user. The gateway marks it mid_stream=True, so it is neither retried nor sent to a fallback, and the stream ends with an error event.

Where the book teaches it

Related terms

FallbackStreaming