Glossary: NLP with Transformers
WordPiece
BERT's subword method, where common words are single tokens and rarer ones split into pieces. A `##` prefix marks a piece that continues the previous one.
Glossary: NLP with Transformers
BERT's subword method, where common words are single tokens and rarer ones split into pieces. A `##` prefix marks a piece that continues the previous one.