Glossary: NLP with Transformers
map
Also written: filter, with_format, save_to_disk
A `datasets` method that runs a function over every row and adds the columns it returns. With `batched=True` it passes 1,000 rows at a time, which is much faster for tokenizers.