Glossary: Building with LLMs Basics

Stand-in server

Also written: fake_llm_server.py, fake server

A small local program that pretends to be both APIs, answering with canned text in the real JSON and streaming formats. It lets you run every example without a key or a bill.