Glossary: Fine-tuning LLMs

vLLM

Also written: vllm serve

A server for running models on GPUs for many users at once, with an OpenAI-compatible API. It can serve a merged model or a base model with LoRA adapters loaded alongside.