Skip to content

Glossary: Fine-tuning LLMs

Meta device

Also written: meta

A PyTorch device that builds layers with their shapes but no actual numbers, so it uses no memory. It lets you inspect a model's layers and count LoRA parameters without loading weights.

Where the book teaches it

Related terms

Target modulesPEFT (parameter-efficient fine-tuning)