Glossary: NLP with Transformers

Fast tokenizer

Also written: fast tokenizers

A tokenizer written in Rust, which is the default from `AutoTokenizer`. It can report offsets and word IDs.