Glossary: Serving LLMs at Scale
Health check
Also written: /health
An endpoint that returns ready or loading, called by load balancers, routers and Kubernetes to decide where to send traffic. llama-server's needs no API key.
Glossary: Serving LLMs at Scale
Also written: /health
An endpoint that returns ready or loading, called by load balancers, routers and Kubernetes to decide where to send traffic. llama-server's needs no API key.