Glossary: Building with LLMs Basics
Streaming
Also written: stream
Receiving a reply in small pieces as it's generated, so the first words appear within a second. Use it when a person is watching.
Glossary: Building with LLMs Basics
Also written: stream
Receiving a reply in small pieces as it's generated, so the first words appear within a second. Use it when a person is watching.