Glossary: Running Open Models Locally
Dense model
Also written: dense
A model that uses all its parameters for every token, unlike a mixture-of-experts model. A dense 27B model reads all 27B weights per token.
Glossary: Running Open Models Locally
Also written: dense
A model that uses all its parameters for every token, unlike a mixture-of-experts model. A dense 27B model reads all 27B weights per token.