Glossary: LLMs in Production

asyncio.create_task

Also written: create_task

Starts a coroutine running in the background as a task, without waiting for it. The streaming endpoint uses it to run the pipeline while the generator sends events.