Skip to content

Glossary: NLP with Transformers

Mean pooling

Also written: pooling

Averaging the per-token vectors, ignoring padding, into one sentence vector.

Where the book teaches it

Related terms

Sentence embeddingAttention mask