RTX 3090 is $600.00 more expensive than RTX 3070, while offering higher throughput.
| Spec | RTX 3090 | RTX 3070 |
|---|---|---|
| VRAM | 24GB | 8GB |
| Cores | 10,496 | 5,888 |
| TDP | 350W | 220W |
| Architecture | Ampere | Ampere |
| Lowest price | $1,099.00 | $499.00 |
| Model | Quantization | RTX 3090 | RTX 3070 |
|---|---|---|---|
| deepseek-ai/DeepSeek-OCR | Q4 | 209.15 tok/s | 91.54 tok/s |
| unsloth/Llama-3.2-1B-Instruct | Q4 | 203.52 tok/s | 89.36 tok/s |
| google/gemma-3-1b-it | Q4 | 201.55 tok/s | 89.03 tok/s |
| nari-labs/Dia2-2B | Q4 | 200.81 tok/s | 95.44 tok/s |
| allenai/OLMo-2-0425-1B | Q4 | 200.76 tok/s | 94.75 tok/s |