Skip to content

Glossary: NLP with Transformers

Offsets

Also written: offset_mapping, offset

Each token's (start, end) character positions in the original text, so `text[start:end]` recovers the characters.

Where the book teaches it

Related terms

Word IDsFast tokenizer