NVIDIA RTX 4060
Ada Lovelace · 2023
VRAM
8 GB
Bandwidth
272 GB/s
MSRP
$299
Models
10 compatible
Compatible Models (10)
Qwen 3.5 3B
Alibaba · 3B
Q8_0
✓ Full qualityQwen 3.5 9B
Alibaba · 9B
Q4_K_M
✓ Full qualityDeepSeek R1 7B
DeepSeek · 7B
Q4_K_M
✓ Full qualityGemma 4 E2B
Google · 2.3B active / 5B total
Q8_0
✓ Full qualityGemma 4 E4B
Google · 4B active (MoE)
Q8_0
✓ Full qualityMiniCPM 4.6
OpenBMB · 1.2B
Q8_0
✓ Full qualityTernary Bonsai 1.7B
PrismML · 1.7B
1.58-bit (MLX)
✓ Full qualityTernary Bonsai 4B
PrismML · 4B
1.58-bit (MLX)
✓ Full qualityTernary Bonsai 8B
PrismML · 8B
1.58-bit (MLX)
✓ Full qualityZyphra ZAYA1-8B
Zyphra AI · 8B (MoE)
Q4_K_M
✓ Full qualityRequires more VRAM (17)
Qwen 3.5 27B
Alibaba
Needs 11GB+
Qwen 3.5 72B
Alibaba
Needs 27GB+
Qwen 3.6 27B
Alibaba
Needs 11GB+
Qwen 3.6 35B-A3B
Alibaba
Needs 13GB+
Gemma 4 27B
Needs 11.5GB+
Gemma 4 31B
Needs 11GB+
Gemma 4 26B-A4B
Google DeepMind
Needs 10.5GB+
micro-kiki v3
L'Électron Rare
Needs 13GB+
Llama 4 Scout
Meta
Needs 35GB+
Phi-4
Microsoft
Needs 9GB+
MiniMax M2.7
MiniMax
Needs 31GB+
Mistral Small 3.2
Mistral AI
Needs 13.5GB+
Nemotron-3 Nano Omni 30B-A3B
NVIDIA
Needs 12GB+
Poolside Laguna XS.2
Poolside AI
Needs 12.5GB+
GLM 4.6
Zhipu AI
Needs 105GB+
GLM 5
Zhipu AI
Needs 215GB+
GLM 5.1
Zhipu AI
Needs 220GB+