Glossary: Running Open Models Locally
Unified memory
Memory shared by the CPU and GPU, as on Apple Silicon Macs. The GPU can use most of it, so a 16 GB Mac can run models up to about 10 GB.
Glossary: Running Open Models Locally
Memory shared by the CPU and GPU, as on Apple Silicon Macs. The GPU can use most of it, so a 16 GB Mac can run models up to about 10 GB.