Quantization-specific throughput and VRAM requirements for zai-org/GLM-4.7-Flash running on Apple M2 Max.
Speed values come from the compatibility dataset (`estimatedTokensPerSec`) and are sorted by quantization.
For full verdict logic and alternate GPUs, see the canonical compatibility page.
Open full compatibility report| Quantization | VRAM needed | VRAM available | Speed | Verdict |
|---|---|---|---|---|
| Q4 | 18GB | 96GB | 20 tok/s | ✅ Fits |
| Q8 | 35GB | 96GB | 13 tok/s | ✅ Fits |
| FP16 | 70GB | 96GB | 7 tok/s | ✅ Fits |