Skip to content

Glossary: Transformers Basics

Hugging Face

Also written: Hub, transformers library, tokenizers, from_pretrained, AutoTokenizer, AutoModelForCausalLM

A company whose Hub website hosts over a million pretrained models and whose free Python libraries, such as `transformers`, load and run them. `from_pretrained` downloads a model's settings, weights and tokenizer by name.

Where the book teaches it

Related terms

PipelineTokenizer