Quantization-specific throughput and VRAM requirements for mistralai/Ministral-3-14B-Instruct-2512 running on NVIDIA H200 SXM 141GB.
Speed values come from the compatibility dataset (`estimatedTokensPerSec`) and are sorted by quantization.
For full verdict logic and alternate GPUs, see the canonical compatibility page.
Open full compatibility report| Quantization | VRAM needed | VRAM available | Speed | Verdict |
|---|---|---|---|---|
| Q4 | 8GB | 141GB | 500 tok/s | ✅ Fits |
| Q8 | 16GB | 141GB | 360 tok/s | ✅ Fits |
| FP16 | 32GB | 141GB | 184 tok/s | ✅ Fits |