This setup does not meet the closest available profile: 4+ GPUs · 253 GB total GPU memory · 512 GB RAM.
Edition: Abliterated edition by Huihui AI
- Model size
- 753B MoE · 1M max
- Model format
- Q2 GGUF · split files
- Runs with
- llama.cpp · multi-GPU
Choose hardware that meets the closest profile before downloading the model.