Will this model run on your hardware?

Can I run PrismML: Ternary Bonsai 2 27B locally?

• 27B parameters
• licence: apache-2.0
• #56 in the AIContenders model ranking
• Weights: prism-ml/Ternary-Bonsai-2-27B-gguf · GGUF: prism-ml/Ternary-Bonsai-2-27B-gguf

Open this page in a browser to check it against your own GPU or Mac: the tool detects your hardware locally and shows the best quantization that fits, the memory it needs and an estimated speed.