Models GPUs Systems AI Setups Builds Methodology

Loading developer profiles...

Loading content...

Resources

Methodology
Submit Benchmark
About

Browse

AI Models
GPUs
PC Builds

Community

Leaderboard

Legal

Privacy
Terms
Contact

We earn from qualifying purchases through affiliate links at no extra cost to you. This supports our free content and research.

Loading developer profile...

Loading developer profiles...

Loading developer profile...

Home
Home
Developers
RedHatAI

RedHatAI

RedHatAI publishes models from 70B to 90B parameters focused on workstation-grade inference.

3 models70B to 90B parametersPricing soon

Models

Search and sort every tracked release before opening a dedicated requirements page.

RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic

90B

Minimum VRAM: Q4 · 44GB

Throughput: 142.5 tok/s

From $329View requirements →

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

70B

Minimum VRAM: Q4 · 34GB

Throughput: 259.8 tok/s

From $329View requirements →

RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

70B

Minimum VRAM: Q4 · 34GB

Throughput: 277.3 tok/s

From $329View requirements →

Recommended hardware

Budget$300-$700

AMD Instinct MI300X • Pricing soon

34GB VRAM target • Q4

Edge inference, personal copilots, prototype agents.

Mid-range$700-$2,000

AMD Instinct MI300X • Pricing soon

68GB VRAM target • Q8

Team chatbots, offline knowledge bases, enterprise POCs.

High-end$2,000+

AMD Instinct MI300X • Pricing soon

137GB VRAM target • FP16

Agent orchestration, evaluation pipelines, long-context tasks.

RedHatAI AI Models & GPU Requirements - localai.computer