L
localai.computer
ModelsGPUsSystemsAI SetupsBuildsOpenClawMethodology

Resources

  • Methodology
  • Submit Benchmark
  • About

Browse

  • AI Models
  • GPUs
  • PC Builds

Guides

  • OpenClaw Guide
  • How-To Guides

Legal

  • Privacy
  • Terms
  • Contact

© 2025 localai.computer. Hardware recommendations for running AI models locally.

ℹ️We earn from qualifying purchases through affiliate links at no extra cost to you. This supports our free content and research.

  1. Home
  2. GPUs
  3. Intel Arc A750

Quick Answer: Intel Arc A750 offers 8GB VRAM and starts around $199.99. It delivers approximately 107 tokens/sec on deepseek-ai/DeepSeek-OCR. It typically draws 225W under load.

Intel Arc A750

Unknown
By IntelReleased 2022-10MSRP $289.00

This GPU offers reliable throughput for local AI workloads. Pair it with the right model quantization to hit your desired tokens/sec, and monitor prices below to catch the best deal.

Buy on Amazon - $199.99View Benchmarks
Specs snapshot
Key hardware metrics for AI workloads.
VRAM8GB
Cores3,584
TDP225W
ArchitectureAlchemist Xe HPG
Key Takeaways
  • 8GB VRAM - runs models up to ~20B parameters
  • Entry-level to mid-range performance
  • Efficient (225W) - works with standard PSU configurations
  • Strong price-to-VRAM value

What this means for you

With 8GB VRAM, Intel Arc A750 can run models up to approximately 20B parameters using 4-bit quantization. This is suitable for 7B-13B models like Llama 3 8B, Mistral 7B, and Qwen 7B.

Who should buy

  • Running 7B parameter models with quantization
  • Entry-level local AI exploration

Looking to upgrade?

Consider RTX 4070 or RTX 4080 — Significant performance increase for AI workloads.

Where to Buy

Buy directly on Amazon with fast shipping and reliable customer service.

💰Price Analysis
Good price range.
Current Price
Intel Arc A750
$2
Buy on Amazon
+3.7% over 30 days
30-day low
$465
30-day avg
$510
30-day high
$548
DEALNear lowest price! ($465)
Get email when price drops
AmazonUnknown
$199.99
Check availability
Buy on Amazon

Prime shipping available • 30-day returns

Complete Your Build

Essential accessories to pair with Intel Arc A750

Corsair RM750x (2025) 750W
Minimum 750W recommended for RTX 40 series
$119
Find on Amazon
Corsair Vengeance 32GB DDR5-6000
32GB ideal for AI workloads
$129
Find on Amazon
Noctua NF-A12x25 PWM
Quiet and efficient cooling
$35
Find on Amazon
Thermal Grizzly Kryonaut
Premium thermal paste for optimal cooling
$15
Find on Amazon

Total Bundle Price

All items from Amazon

$300
Individual: $300
Find All on AmazonMore GPUs

💡 Not ready to buy? Try cloud GPUs first

Test Intel Arc A750 performance in the cloud before investing in hardware. Pay by the hour with no commitment.

Vast.aifrom $0.20/hrRunPodfrom $0.30/hrLambda Labsenterprise-grade

AI benchmarks

ModelQuantizationTokens/secVRAM used
deepseek-ai/DeepSeek-OCRQ4
106.60 tok/sEstimated

Auto-generated benchmark

2GB
deepseek-ai/DeepSeek-OCR-2Q4
104.81 tok/sEstimated

Auto-generated benchmark

2GB
unsloth/Llama-3.2-1B-InstructQ4
103.08 tok/sEstimated

Auto-generated benchmark

1GB
meta-llama/Llama-3.2-3BQ4
102.55 tok/sEstimated

Auto-generated benchmark

2GB
apple/OpenELM-1_1B-InstructQ4
102.42 tok/sEstimated

Auto-generated benchmark

1GB
facebook/sam3Q4
102.28 tok/sEstimated

Auto-generated benchmark

1GB
unsloth/Llama-3.2-3B-InstructQ4
102.06 tok/sEstimated

Auto-generated benchmark

2GB
google/embeddinggemma-300mQ4
101.79 tok/sEstimated

Auto-generated benchmark

1GB
nari-labs/Dia2-2BQ4
100.86 tok/sEstimated

Auto-generated benchmark

2GB
TinyLlama/TinyLlama-1.1B-Chat-v1.0Q4
100.37 tok/sEstimated

Auto-generated benchmark

1GB
deepseek-ai/deepseek-coder-1.3b-instructQ4
99.22 tok/sEstimated

Auto-generated benchmark

2GB
unsloth/gemma-3-1b-itQ4
98.55 tok/sEstimated

Auto-generated benchmark

1GB
bigcode/starcoder2-3bQ4
98.26 tok/sEstimated

Auto-generated benchmark

2GB
google/gemma-2bQ4
98.22 tok/sEstimated

Auto-generated benchmark

1GB
google/gemma-3-1b-itQ4
96.93 tok/sEstimated

Auto-generated benchmark

1GB
meta-llama/Llama-3.2-1BQ4
96.86 tok/sEstimated

Auto-generated benchmark

1GB
ibm-research/PowerMoE-3bQ4
96.13 tok/sEstimated

Auto-generated benchmark

2GB
LiquidAI/LFM2-1.2BQ4
96.05 tok/sEstimated

Auto-generated benchmark

1GB
meta-llama/Llama-Guard-3-1BQ4
95.64 tok/sEstimated

Auto-generated benchmark

1GB
meta-llama/Llama-3.2-3B-InstructQ4
95.52 tok/sEstimated

Auto-generated benchmark

2GB
google-t5/t5-3bQ4
95.31 tok/sEstimated

Auto-generated benchmark

2GB
google/gemma-2-2b-itQ4
95.22 tok/sEstimated

Auto-generated benchmark

1GB
inference-net/Schematron-3BQ4
94.51 tok/sEstimated

Auto-generated benchmark

2GB
Qwen/Qwen2.5-3B-InstructQ4
94.39 tok/sEstimated

Auto-generated benchmark

2GB
Qwen/Qwen3-ASR-1.7BQ4
94.01 tok/sEstimated

Auto-generated benchmark

2GB
context-labs/meta-llama-Llama-3.2-3B-Instruct-FP16Q4
93.86 tok/sEstimated

Auto-generated benchmark

2GB
nineninesix/kani-tts-2-enQ4
93.81 tok/sEstimated

Auto-generated benchmark

1GB
Qwen/Qwen2.5-3BQ4
93.55 tok/sEstimated

Auto-generated benchmark

2GB
allenai/OLMo-2-0425-1BQ4
91.76 tok/sEstimated

Auto-generated benchmark

1GB
ibm-granite/granite-3.3-2b-instructQ4
90.05 tok/sEstimated

Auto-generated benchmark

1GB
tencent/HunyuanOCRQ4
89.24 tok/sEstimated

Auto-generated benchmark

1GB
google-bert/bert-base-uncasedQ4
88.44 tok/sEstimated

Auto-generated benchmark

1GB
WeiboAI/VibeThinker-1.5BQ4
86.89 tok/sEstimated

Auto-generated benchmark

1GB
meta-llama/Llama-3.2-1B-InstructQ4
86.49 tok/sEstimated

Auto-generated benchmark

1GB
NousResearch/Meta-Llama-3.1-8B-InstructQ4
85.76 tok/sEstimated

Auto-generated benchmark

4GB
ibm-granite/granite-docling-258MQ4
85.50 tok/sEstimated

Auto-generated benchmark

4GB
Qwen/Qwen3-4B-Thinking-2507Q4
85.48 tok/sEstimated

Auto-generated benchmark

2GB
deepseek-ai/DeepSeek-Coder-V2-Lite-InstructQ4
85.41 tok/sEstimated

Auto-generated benchmark

4GB
openai-community/gpt2-xlQ4
85.35 tok/sEstimated

Auto-generated benchmark

4GB
Qwen/Qwen2-7B-InstructQ4
85.24 tok/sEstimated

Auto-generated benchmark

4GB
Nanbeige/Nanbeige4.1-3BQ4
85.20 tok/sEstimated

Auto-generated benchmark

3GB
Qwen/Qwen3-Embedding-4BQ4
85.10 tok/sEstimated

Auto-generated benchmark

2GB
Qwen/Qwen2.5-Math-1.5BQ4
84.97 tok/sEstimated

Auto-generated benchmark

3GB
huggyllama/llama-7bQ4
84.86 tok/sEstimated

Auto-generated benchmark

4GB
trl-internal-testing/tiny-random-LlamaForCausalLMQ4
84.79 tok/sEstimated

Auto-generated benchmark

4GB
Qwen/Qwen2-0.5B-InstructQ4
84.63 tok/sEstimated

Auto-generated benchmark

3GB
Qwen/Qwen3-8B-FP8Q4
84.57 tok/sEstimated

Auto-generated benchmark

4GB
IlyaGusev/saiga_llama3_8bQ4
84.46 tok/sEstimated

Auto-generated benchmark

4GB
Qwen/Qwen2.5-7B-InstructQ4
84.33 tok/sEstimated

Auto-generated benchmark

4GB
rinna/japanese-gpt-neox-smallQ4
84.14 tok/sEstimated

Auto-generated benchmark

4GB
deepseek-ai/DeepSeek-OCR
Q4
2GB
106.60 tok/sEstimated
Auto-generated benchmark
deepseek-ai/DeepSeek-OCR-2
Q4
2GB
104.81 tok/sEstimated
Auto-generated benchmark
unsloth/Llama-3.2-1B-Instruct
Q4
1GB
103.08 tok/sEstimated
Auto-generated benchmark
meta-llama/Llama-3.2-3B
Q4
2GB
102.55 tok/sEstimated
Auto-generated benchmark
apple/OpenELM-1_1B-Instruct
Q4
1GB
102.42 tok/sEstimated
Auto-generated benchmark
facebook/sam3
Q4
1GB
102.28 tok/sEstimated
Auto-generated benchmark
unsloth/Llama-3.2-3B-Instruct
Q4
2GB
102.06 tok/sEstimated
Auto-generated benchmark
google/embeddinggemma-300m
Q4
1GB
101.79 tok/sEstimated
Auto-generated benchmark
nari-labs/Dia2-2B
Q4
2GB
100.86 tok/sEstimated
Auto-generated benchmark
TinyLlama/TinyLlama-1.1B-Chat-v1.0
Q4
1GB
100.37 tok/sEstimated
Auto-generated benchmark
deepseek-ai/deepseek-coder-1.3b-instruct
Q4
2GB
99.22 tok/sEstimated
Auto-generated benchmark
unsloth/gemma-3-1b-it
Q4
1GB
98.55 tok/sEstimated
Auto-generated benchmark
bigcode/starcoder2-3b
Q4
2GB
98.26 tok/sEstimated
Auto-generated benchmark
google/gemma-2b
Q4
1GB
98.22 tok/sEstimated
Auto-generated benchmark
google/gemma-3-1b-it
Q4
1GB
96.93 tok/sEstimated
Auto-generated benchmark
meta-llama/Llama-3.2-1B
Q4
1GB
96.86 tok/sEstimated
Auto-generated benchmark
ibm-research/PowerMoE-3b
Q4
2GB
96.13 tok/sEstimated
Auto-generated benchmark
LiquidAI/LFM2-1.2B
Q4
1GB
96.05 tok/sEstimated
Auto-generated benchmark
meta-llama/Llama-Guard-3-1B
Q4
1GB
95.64 tok/sEstimated
Auto-generated benchmark
meta-llama/Llama-3.2-3B-Instruct
Q4
2GB
95.52 tok/sEstimated
Auto-generated benchmark
google-t5/t5-3b
Q4
2GB
95.31 tok/sEstimated
Auto-generated benchmark
google/gemma-2-2b-it
Q4
1GB
95.22 tok/sEstimated
Auto-generated benchmark
inference-net/Schematron-3B
Q4
2GB
94.51 tok/sEstimated
Auto-generated benchmark
Qwen/Qwen2.5-3B-Instruct
Q4
2GB
94.39 tok/sEstimated
Auto-generated benchmark
Qwen/Qwen3-ASR-1.7B
Q4
2GB
94.01 tok/sEstimated
Auto-generated benchmark
context-labs/meta-llama-Llama-3.2-3B-Instruct-FP16
Q4
2GB
93.86 tok/sEstimated
Auto-generated benchmark
nineninesix/kani-tts-2-en
Q4
1GB
93.81 tok/sEstimated
Auto-generated benchmark
Qwen/Qwen2.5-3B
Q4
2GB
93.55 tok/sEstimated
Auto-generated benchmark
allenai/OLMo-2-0425-1B
Q4
1GB
91.76 tok/sEstimated
Auto-generated benchmark
ibm-granite/granite-3.3-2b-instruct
Q4
1GB
90.05 tok/sEstimated
Auto-generated benchmark
tencent/HunyuanOCR
Q4
1GB
89.24 tok/sEstimated
Auto-generated benchmark
google-bert/bert-base-uncased
Q4
1GB
88.44 tok/sEstimated
Auto-generated benchmark
WeiboAI/VibeThinker-1.5B
Q4
1GB
86.89 tok/sEstimated
Auto-generated benchmark
meta-llama/Llama-3.2-1B-Instruct
Q4
1GB
86.49 tok/sEstimated
Auto-generated benchmark
NousResearch/Meta-Llama-3.1-8B-Instruct
Q4
4GB
85.76 tok/sEstimated
Auto-generated benchmark
ibm-granite/granite-docling-258M
Q4
4GB
85.50 tok/sEstimated
Auto-generated benchmark
Qwen/Qwen3-4B-Thinking-2507
Q4
2GB
85.48 tok/sEstimated
Auto-generated benchmark
deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct
Q4
4GB
85.41 tok/sEstimated
Auto-generated benchmark
openai-community/gpt2-xl
Q4
4GB
85.35 tok/sEstimated
Auto-generated benchmark
Qwen/Qwen2-7B-Instruct
Q4
4GB
85.24 tok/sEstimated
Auto-generated benchmark
Nanbeige/Nanbeige4.1-3B
Q4
3GB
85.20 tok/sEstimated
Auto-generated benchmark
Qwen/Qwen3-Embedding-4B
Q4
2GB
85.10 tok/sEstimated
Auto-generated benchmark
Qwen/Qwen2.5-Math-1.5B
Q4
3GB
84.97 tok/sEstimated
Auto-generated benchmark
huggyllama/llama-7b
Q4
4GB
84.86 tok/sEstimated
Auto-generated benchmark
trl-internal-testing/tiny-random-LlamaForCausalLM
Q4
4GB
84.79 tok/sEstimated
Auto-generated benchmark
Qwen/Qwen2-0.5B-Instruct
Q4
3GB
84.63 tok/sEstimated
Auto-generated benchmark
Qwen/Qwen3-8B-FP8
Q4
4GB
84.57 tok/sEstimated
Auto-generated benchmark
IlyaGusev/saiga_llama3_8b
Q4
4GB
84.46 tok/sEstimated
Auto-generated benchmark
Qwen/Qwen2.5-7B-Instruct
Q4
4GB
84.33 tok/sEstimated
Auto-generated benchmark
rinna/japanese-gpt-neox-small
Q4
4GB
84.14 tok/sEstimated
Auto-generated benchmark

Note: Performance estimates are calculated. Real results may vary. Methodology · Submit real data

Model compatibility

ModelQuantizationVerdictEstimated speedVRAM needed
openai-community/gpt2Q8Fits (tight)
53.20 tok/sEstimated
7GB (have 8GB)
openai-community/gpt2FP16Not supported
29.83 tok/sEstimated
15GB (have 8GB)
Qwen/Qwen2.5-7B-InstructQ4Fits comfortably
84.33 tok/sEstimated
4GB (have 8GB)
Qwen/Qwen2.5-7B-InstructQ8Fits (tight)
59.23 tok/sEstimated
7GB (have 8GB)
Qwen/Qwen2.5-7B-InstructFP16Not supported
30.91 tok/sEstimated
15GB (have 8GB)
Qwen/Qwen3-0.6BQ4Fits comfortably
76.01 tok/sEstimated
3GB (have 8GB)
Qwen/Qwen3-0.6BQ8Fits comfortably
51.82 tok/sEstimated
6GB (have 8GB)
Qwen/Qwen3-0.6BFP16Not supported
31.68 tok/sEstimated
13GB (have 8GB)
Gensyn/Qwen2.5-0.5B-InstructQ4Fits comfortably
79.01 tok/sEstimated
3GB (have 8GB)
Gensyn/Qwen2.5-0.5B-InstructQ8Fits comfortably
53.43 tok/sEstimated
5GB (have 8GB)
Gensyn/Qwen2.5-0.5B-InstructFP16Not supported
27.32 tok/sEstimated
11GB (have 8GB)
meta-llama/Llama-3.1-8B-InstructQ4Fits comfortably
75.52 tok/sEstimated
4GB (have 8GB)
meta-llama/Llama-3.1-8B-InstructQ8Not supported
51.87 tok/sEstimated
9GB (have 8GB)
meta-llama/Llama-3.1-8B-InstructFP16Not supported
30.91 tok/sEstimated
17GB (have 8GB)
dphn/dolphin-2.9.1-yi-1.5-34bQ4Not supported
27.15 tok/sEstimated
17GB (have 8GB)
dphn/dolphin-2.9.1-yi-1.5-34bQ8Not supported
18.31 tok/sEstimated
35GB (have 8GB)
dphn/dolphin-2.9.1-yi-1.5-34bFP16Not supported
9.95 tok/sEstimated
70GB (have 8GB)
openai/gpt-oss-20bQ4Not supported
42.69 tok/sEstimated
10GB (have 8GB)
openai/gpt-oss-20bQ8Not supported
28.63 tok/sEstimated
20GB (have 8GB)
openai/gpt-oss-20bFP16Not supported
17.39 tok/sEstimated
41GB (have 8GB)
google/gemma-3-1b-itQ4Fits comfortably
96.93 tok/sEstimated
1GB (have 8GB)
google/gemma-3-1b-itQ8Fits comfortably
61.81 tok/sEstimated
1GB (have 8GB)
google/gemma-3-1b-itFP16Fits comfortably
37.24 tok/sEstimated
2GB (have 8GB)
Qwen/Qwen3-Embedding-0.6BQ4Fits comfortably
79.67 tok/sEstimated
3GB (have 8GB)
Qwen/Qwen3-Embedding-0.6BQ8Fits comfortably
51.18 tok/sEstimated
6GB (have 8GB)
Qwen/Qwen3-Embedding-0.6BFP16Not supported
27.08 tok/sEstimated
13GB (have 8GB)
Qwen/Qwen2.5-1.5B-InstructQ4Fits comfortably
82.60 tok/sEstimated
3GB (have 8GB)
Qwen/Qwen2.5-1.5B-InstructQ8Fits comfortably
52.66 tok/sEstimated
5GB (have 8GB)
Qwen/Qwen2.5-1.5B-InstructFP16Not supported
27.32 tok/sEstimated
11GB (have 8GB)
facebook/opt-125mQ4Fits comfortably
75.37 tok/sEstimated
4GB (have 8GB)
facebook/opt-125mQ8Fits (tight)
55.71 tok/sEstimated
7GB (have 8GB)
facebook/opt-125mFP16Not supported
27.98 tok/sEstimated
15GB (have 8GB)
TinyLlama/TinyLlama-1.1B-Chat-v1.0Q4Fits comfortably
100.37 tok/sEstimated
1GB (have 8GB)
TinyLlama/TinyLlama-1.1B-Chat-v1.0Q8Fits comfortably
67.64 tok/sEstimated
1GB (have 8GB)
TinyLlama/TinyLlama-1.1B-Chat-v1.0FP16Fits comfortably
33.98 tok/sEstimated
2GB (have 8GB)
trl-internal-testing/tiny-Qwen2ForCausalLM-2.5Q4Fits comfortably
74.99 tok/sEstimated
4GB (have 8GB)
trl-internal-testing/tiny-Qwen2ForCausalLM-2.5Q8Fits (tight)
60.27 tok/sEstimated
7GB (have 8GB)
trl-internal-testing/tiny-Qwen2ForCausalLM-2.5FP16Not supported
32.71 tok/sEstimated
15GB (have 8GB)
Qwen/Qwen3-4B-Instruct-2507Q4Fits comfortably
79.64 tok/sEstimated
2GB (have 8GB)
Qwen/Qwen3-4B-Instruct-2507Q8Fits comfortably
52.50 tok/sEstimated
4GB (have 8GB)
Qwen/Qwen3-4B-Instruct-2507FP16Not supported
31.57 tok/sEstimated
9GB (have 8GB)
meta-llama/Llama-3.2-1B-InstructQ4Fits comfortably
86.49 tok/sEstimated
1GB (have 8GB)
meta-llama/Llama-3.2-1B-InstructQ8Fits comfortably
67.67 tok/sEstimated
1GB (have 8GB)
meta-llama/Llama-3.2-1B-InstructFP16Fits comfortably
37.03 tok/sEstimated
2GB (have 8GB)
openai/gpt-oss-120bQ4Not supported
14.44 tok/sEstimated
59GB (have 8GB)
openai/gpt-oss-120bQ8Not supported
11.76 tok/sEstimated
117GB (have 8GB)
openai/gpt-oss-120bFP16Not supported
5.95 tok/sEstimated
235GB (have 8GB)
Qwen/Qwen2.5-3B-InstructQ4Fits comfortably
94.39 tok/sEstimated
2GB (have 8GB)
Qwen/Qwen2.5-3B-InstructQ8Fits comfortably
68.30 tok/sEstimated
3GB (have 8GB)
openai-community/gpt2Q4Fits comfortably
81.83 tok/sEstimated
4GB (have 8GB)
openai-community/gpt2Q8
Fits (tight)7GB required · 8GB available
53.20 tok/sEstimated
openai-community/gpt2FP16
Not supported15GB required · 8GB available
29.83 tok/sEstimated
Qwen/Qwen2.5-7B-InstructQ4
Fits comfortably4GB required · 8GB available
84.33 tok/sEstimated
Qwen/Qwen2.5-7B-InstructQ8
Fits (tight)7GB required · 8GB available
59.23 tok/sEstimated
Qwen/Qwen2.5-7B-InstructFP16
Not supported15GB required · 8GB available
30.91 tok/sEstimated
Qwen/Qwen3-0.6BQ4
Fits comfortably3GB required · 8GB available
76.01 tok/sEstimated
Qwen/Qwen3-0.6BQ8
Fits comfortably6GB required · 8GB available
51.82 tok/sEstimated
Qwen/Qwen3-0.6BFP16
Not supported13GB required · 8GB available
31.68 tok/sEstimated
Gensyn/Qwen2.5-0.5B-InstructQ4
Fits comfortably3GB required · 8GB available
79.01 tok/sEstimated
Gensyn/Qwen2.5-0.5B-InstructQ8
Fits comfortably5GB required · 8GB available
53.43 tok/sEstimated
Gensyn/Qwen2.5-0.5B-InstructFP16
Not supported11GB required · 8GB available
27.32 tok/sEstimated
meta-llama/Llama-3.1-8B-InstructQ4
Fits comfortably4GB required · 8GB available
75.52 tok/sEstimated
meta-llama/Llama-3.1-8B-InstructQ8
Not supported9GB required · 8GB available
51.87 tok/sEstimated
meta-llama/Llama-3.1-8B-InstructFP16
Not supported17GB required · 8GB available
30.91 tok/sEstimated
dphn/dolphin-2.9.1-yi-1.5-34bQ4
Not supported17GB required · 8GB available
27.15 tok/sEstimated
dphn/dolphin-2.9.1-yi-1.5-34bQ8
Not supported35GB required · 8GB available
18.31 tok/sEstimated
dphn/dolphin-2.9.1-yi-1.5-34bFP16
Not supported70GB required · 8GB available
9.95 tok/sEstimated
openai/gpt-oss-20bQ4
Not supported10GB required · 8GB available
42.69 tok/sEstimated
openai/gpt-oss-20bQ8
Not supported20GB required · 8GB available
28.63 tok/sEstimated
openai/gpt-oss-20bFP16
Not supported41GB required · 8GB available
17.39 tok/sEstimated
google/gemma-3-1b-itQ4
Fits comfortably1GB required · 8GB available
96.93 tok/sEstimated
google/gemma-3-1b-itQ8
Fits comfortably1GB required · 8GB available
61.81 tok/sEstimated
google/gemma-3-1b-itFP16
Fits comfortably2GB required · 8GB available
37.24 tok/sEstimated
Qwen/Qwen3-Embedding-0.6BQ4
Fits comfortably3GB required · 8GB available
79.67 tok/sEstimated
Qwen/Qwen3-Embedding-0.6BQ8
Fits comfortably6GB required · 8GB available
51.18 tok/sEstimated
Qwen/Qwen3-Embedding-0.6BFP16
Not supported13GB required · 8GB available
27.08 tok/sEstimated
Qwen/Qwen2.5-1.5B-InstructQ4
Fits comfortably3GB required · 8GB available
82.60 tok/sEstimated
Qwen/Qwen2.5-1.5B-InstructQ8
Fits comfortably5GB required · 8GB available
52.66 tok/sEstimated
Qwen/Qwen2.5-1.5B-InstructFP16
Not supported11GB required · 8GB available
27.32 tok/sEstimated
facebook/opt-125mQ4
Fits comfortably4GB required · 8GB available
75.37 tok/sEstimated
facebook/opt-125mQ8
Fits (tight)7GB required · 8GB available
55.71 tok/sEstimated
facebook/opt-125mFP16
Not supported15GB required · 8GB available
27.98 tok/sEstimated
TinyLlama/TinyLlama-1.1B-Chat-v1.0Q4
Fits comfortably1GB required · 8GB available
100.37 tok/sEstimated
TinyLlama/TinyLlama-1.1B-Chat-v1.0Q8
Fits comfortably1GB required · 8GB available
67.64 tok/sEstimated
TinyLlama/TinyLlama-1.1B-Chat-v1.0FP16
Fits comfortably2GB required · 8GB available
33.98 tok/sEstimated
trl-internal-testing/tiny-Qwen2ForCausalLM-2.5Q4
Fits comfortably4GB required · 8GB available
74.99 tok/sEstimated
trl-internal-testing/tiny-Qwen2ForCausalLM-2.5Q8
Fits (tight)7GB required · 8GB available
60.27 tok/sEstimated
trl-internal-testing/tiny-Qwen2ForCausalLM-2.5FP16
Not supported15GB required · 8GB available
32.71 tok/sEstimated
Qwen/Qwen3-4B-Instruct-2507Q4
Fits comfortably2GB required · 8GB available
79.64 tok/sEstimated
Qwen/Qwen3-4B-Instruct-2507Q8
Fits comfortably4GB required · 8GB available
52.50 tok/sEstimated
Qwen/Qwen3-4B-Instruct-2507FP16
Not supported9GB required · 8GB available
31.57 tok/sEstimated
meta-llama/Llama-3.2-1B-InstructQ4
Fits comfortably1GB required · 8GB available
86.49 tok/sEstimated
meta-llama/Llama-3.2-1B-InstructQ8
Fits comfortably1GB required · 8GB available
67.67 tok/sEstimated
meta-llama/Llama-3.2-1B-InstructFP16
Fits comfortably2GB required · 8GB available
37.03 tok/sEstimated
openai/gpt-oss-120bQ4
Not supported59GB required · 8GB available
14.44 tok/sEstimated
openai/gpt-oss-120bQ8
Not supported117GB required · 8GB available
11.76 tok/sEstimated
openai/gpt-oss-120bFP16
Not supported235GB required · 8GB available
5.95 tok/sEstimated
Qwen/Qwen2.5-3B-InstructQ4
Fits comfortably2GB required · 8GB available
94.39 tok/sEstimated
Qwen/Qwen2.5-3B-InstructQ8
Fits comfortably3GB required · 8GB available
68.30 tok/sEstimated
openai-community/gpt2Q4
Fits comfortably4GB required · 8GB available
81.83 tok/sEstimated

Note: Performance estimates are calculated. Real results may vary. Methodology · Submit real data

Alternative GPUs

RTX 5070
12GB

Explore how RTX 5070 stacks up for local inference workloads.

RTX 4060 Ti 16GB
16GB

Explore how RTX 4060 Ti 16GB stacks up for local inference workloads.

RX 6800 XT
16GB

Explore how RX 6800 XT stacks up for local inference workloads.

RTX 4070 Super
12GB

Explore how RTX 4070 Super stacks up for local inference workloads.

RTX 3080
10GB

Explore how RTX 3080 stacks up for local inference workloads.

Can it play popular games?

Cyberpunk 2077
8GB VRAM

RPG • 2020

Baldur's Gate 3
8GB VRAM

RPG • 2023

Starfield
8GB VRAM

RPG • 2023

Elden Ring
8GB VRAM

Action RPG • 2022

Red Dead Redemption 2
8GB VRAM

Action Adventure • 2019

Grand Theft Auto V
4GB VRAM

Action Adventure • 2015

The Witcher 3: Wild Hunt
6GB VRAM

RPG • 2015

Forza Horizon 5
8GB VRAM

Racing • 2021

Assassin's Creed Mirage
8GB VRAM

Action Adventure • 2023

Assassin's Creed Valhalla
8GB VRAM

Action RPG • 2020

Path of Exile 2
8GB VRAM

Action RPG • 2024

Diablo IV
8GB VRAM

Action RPG • 2023

View all 41 compatible games