Embedding
Also written: embeddings, token embedding, nn.Embedding
A learned vector of numbers standing in for each token id, looked up from a table with one row per token. Tokens that behave alike end up with similar vectors.
Also written: embeddings, token embedding, nn.Embedding
A learned vector of numbers standing in for each token id, looked up from a table with one row per token. Tokens that behave alike end up with similar vectors.