NVIDIA RTX 4090
Ada Lovelace · 2022
VRAM
24 GB
Bandwidth
1008 GB/s
MSRP
$1,599
Models
9 compatible
Compatible Models (9)
Qwen 3.5 27B
Alibaba · 27B
Q4_K_M
✓ Full qualityQwen 3.5 3B
Alibaba · 3B
Q8_0
✓ Full qualityQwen 3.5 9B
Alibaba · 9B
Q8_0
✓ Full qualityDeepSeek R1 7B
DeepSeek · 7B
Q8_0
✓ Full qualityGemma 4 27B
Google · 27B (4B active MoE)
Q4_K_M
✓ Full qualityGemma 4 E4B
Google · 4B active (MoE)
Q8_0
✓ Full qualityPhi-4
Microsoft · 14B
Q8_0
✓ Full qualityMistral Small 3.2
Mistral AI · 22B
Q4_K_M
✓ Full qualityGLM 5.1
Zhipu AI · ~32B
Q4_K_M
✓ Full qualityRequires more VRAM (3)
Qwen 3.5 72B
Alibaba
Needs 27GB+
Llama 4 Scout
Meta
Needs 35GB+
MiniMax M2.7
MiniMax
Needs 31GB+