Skip to content

Glossary: Serving LLMs at Scale

MLX

Apple's machine-learning framework for Macs.

Where the book teaches it

Related terms

TGI (Text Generation Inference)