RTX 4060 Ti 16GB: what AI models can it run?
16 GB GDDR6, 128-bit bus. Spec source
Sample price: $449 (USD sample), not real offers.
Fits at Q4_K_M (10)
| Model | Q4 VRAM | Q8 VRAM |
|---|---|---|
| Llama 3.2 3B | 3.2 GB | ✅ 4.7 GB |
| Llama 3.1 8B | 6.4 GB | ✅ 10.4 GB |
| Qwen3 4B | 3.8 GB | ✅ 5.7 GB |
| Qwen3 8B | 6.5 GB | ✅ 10.6 GB |
| Qwen3 14B | 10.9 GB | ❌ 18.3 GB |
| Gemma 3 4B | 3.8 GB | ✅ 5.5 GB |
| Gemma 3 12B | 9 GB | ✅ 14.8 GB |
| Mistral 7B | 5.8 GB | ✅ 9.5 GB |
| Phi-4 14B | 11 GB | ❌ 18.2 GB |
| DeepSeek-R1-Distill-Qwen 14B | 10.9 GB | ❌ 18.3 GB |