Glossary: LLMs in Production

Observability

Being able to tell what your service is doing, and why, from what it records: logs, traces and a few key numbers.