Glossary: Running Open Models Locally

Active parameters

Also written: active

In a mixture-of-experts model, the parameters actually used to compute each token. In Qwen3.5-35B-A3B, about 3 billion are active, so speed is like a 3B model while memory is still for all 35B.