Skip to content

Glossary: LLMs in Production

nginx

Also written: proxy, response buffering

A web proxy that can sit in front of the service. Its response buffering must be turned off for streaming paths, or events arrive only at the end.

Where the book teaches it

Related terms

Server-sent events (SSE)