Qwen 3.5 9B
Qwen
Highly capable 9B model, excellent for consumer hardware. Punches well above its weight class in reasoning tasks.
Provider
Alibaba
Parameters
9B
Context
131.072K
Released
2025-09-01
VRAM Requirements by Quantization
| Method | Disk Size | VRAM Required | Fits GPUs |
|---|---|---|---|
| Q8_0 | 9.2 GB | 10.5 GB | 14 GPUs |
| Q4_K_M | 5.2 GB | 6.5 GB | 15 GPUs |
| Q4_0 | 5 GB | 6.2 GB | 15 GPUs |
Install with Ollama
Benchmark Scores
mmlu78.4%
humaneval74.2%
Scores are approximate and may vary by quantization level.
Compatible GPUs (15)
AMD RX 7900 GRE (16GB)AMD RX 7900 XTX (24GB)Apple M4 Pro (24GB) (24GB)Apple M3 Max (36GB) (36GB)Apple M4 Max (48GB) (48GB)NVIDIA RTX 4060 (8GB)NVIDIA RTX 4070 SUPER (12GB)NVIDIA RTX 3080 12GB (12GB)NVIDIA RTX 4080 SUPER (16GB)NVIDIA RTX 4060 Ti 16GB (16GB)NVIDIA RTX 4070 Ti SUPER (16GB)NVIDIA RTX 5080 (16GB)NVIDIA RTX 3090 (24GB)NVIDIA RTX 4090 (24GB)NVIDIA RTX 5090 (32GB)
HuggingFace
Qwen/Qwen3.5-9B-Instruct