This setup does not meet the closest available profile: 80 GB GPU memory · 128 GB RAM.
- Model size
- 117B / 5.1B active · 128K max
- Model format
- MXFP4
- Runs with
- vLLM / TensorRT-LLM
Choose hardware that meets the closest profile before downloading the model.