NVIDIA RTX 3080 12GB
Ampere · 2022
VRAM
12 GB
Bandwidth
912 GB/s
MSRP
$799
Models
11 compatible
Compatible Models (11)
Qwen 3.5 3B
Alibaba · 3B
Q8_0
✓ Full qualityQwen 3.5 9B
Alibaba · 9B
Q8_0
✓ Full qualityDeepSeek R1 7B
DeepSeek · 7B
Q8_0
✓ Full qualityGemma 4 E2B
Google · 2.3B active / 5B total
Q8_0
✓ Full qualityGemma 4 E4B
Google · 4B active (MoE)
Q8_0
✓ Full qualityPhi-4
Microsoft · 14B
Q4_K_M
✓ Full qualityTernary Bonsai 1.7B
PrismML · 1.7B
1.58-bit (MLX)
✓ Full qualityTernary Bonsai 4B
PrismML · 4B
1.58-bit (MLX)
✓ Full qualityTernary Bonsai 8B
PrismML · 8B
1.58-bit (MLX)
✓ Full qualityQwen 3.5 27B
Alibaba · 27B
Q2_K
⚡ LimitedGemma 4 31B
Google · 31B
Q2_K
⚡ LimitedRequires more VRAM (9)
Qwen 3.5 72B
Alibaba
Needs 27GB+
Qwen 3.6 35B-A3B
Alibaba
Needs 13GB+
Gemma 4 27B
Needs 11.5GB+
Llama 4 Scout
Meta
Needs 35GB+
MiniMax M2.7
MiniMax
Needs 31GB+
Mistral Small 3.2
Mistral AI
Needs 13.5GB+
GLM 4.6
Zhipu AI
Needs 105GB+
GLM 5
Zhipu AI
Needs 215GB+
GLM 5.1
Zhipu AI
Needs 220GB+