Quantization-specific throughput and VRAM requirements for meta-llama/Llama-3.1-8B running on Intel Arc B570.
Speed values come from the compatibility dataset (`estimatedTokensPerSec`) and are sorted by quantization.
For full verdict logic and alternate GPUs, see the canonical compatibility page.
Open full compatibility report| Quantization | VRAM needed | VRAM available | Speed | Verdict |
|---|---|---|---|---|
| Q4 | 4GB | 10GB | 61 tok/s | ✅ Fits |
| Q8 | 9GB | 10GB | 42 tok/s | ⚠️ Tight fit |
| FP16 | 17GB | 10GB | 22 tok/s | ❌ Not recommended |