Skip to content

Glossary: NLP with Transformers

map

Also written: filter, with_format, save_to_disk

A `datasets` method that runs a function over every row and adds the columns it returns. With `batched=True` it passes 1,000 rows at a time, which is much faster for tokenizers.

Where the book teaches it

Related terms

Dataset, DatasetDict