Will this model run on your hardware?

Can I run Mistral: Mixtral 8x22B Instruct locally?

• 141B parameters (40B active, MoE)
• context up to 64K
• licence: apache-2.0
• Weights: mistralai/Mixtral-8x22B-Instruct-v0.1 · GGUF: mradermacher/Mixtral-8x22B-Instruct-v0.1-i1-GGUF

Open this page in a browser to check it against your own GPU or Mac: the tool detects your hardware locally and shows the best quantization that fits, the memory it needs and an estimated speed.