Which model fits my GPU?
Pick your hardware and what you want to do. We'll list Ollama models that fit, how much memory they need, and a rough speed estimate.
Turn on JavaScript to use the picker. The full model table is below.
How we estimate: memory needed = Ollama's download size for the 4-bit tag + about 1.5 GB for context and overhead. Speed is an estimate from typical memory bandwidth for your hardware class (generation speed is mostly limited by how fast the model's weights can be read). Real speeds vary with your exact card, drivers, context length and settings. Check with ollama ps that the model shows "100% GPU".
All models in the picker
Sizes are Ollama library download sizes for the default 4-bit tag, checked 2026-10-17. Model facts come from each model's Ollama page and model card.
| Ollama tag | Family | Parameters | Quant | Download | Est. memory | Context | Good for | Sources |
|---|---|---|---|---|---|---|---|---|
gemma3:1b | Gemma 3 | 1B | Q4_K_M | 0.8 GB | 2.3 GB | 32K | general, lowpower | Ollama · Model card |
gemma3:4b | Gemma 3 | 4B | Q4_K_M | 3.4 GB | 4.9 GB | 128K | general, vision, lowpower | Ollama · Model card |
gemma3:12b | Gemma 3 | 12B | Q4_K_M | 8.2 GB | 9.7 GB | 128K | general, vision, writing | Ollama · Model card |
gemma3:27b | Gemma 3 | 27B | Q4_K_M | 17 GB | 18.5 GB | 128K | general, vision, writing | Ollama · Model card |
gemma4:e2b | Gemma 4 | E2B (effective 2B) | Q4_K_M | 4.6 GB | 6.1 GB | 128K | general, vision, lowpower | Ollama · Model card |
gemma4:e4b | Gemma 4 | E4B (effective 4B) | Q4_K_M | 6.6 GB | 8.1 GB | 128K | general, vision, lowpower | Ollama · Model card |
gemma4:12b | Gemma 4 | 12B | Q4_K_M | 8 GB | 9.5 GB | 256K | general, vision, writing, reasoning | Ollama · Model card |
gemma4:26b | Gemma 4 | 26B MoE (~4B active) | Q4_K_M | 18 GB | 19.5 GB | 256K | general, vision, reasoning, coding | Ollama · Model card |
gemma4:31b | Gemma 4 | 31B | Q4_K_M | 20 GB | 21.5 GB | 256K | general, vision, reasoning, writing | Ollama · Model card |
qwen3:4b | Qwen3 | 4B | Q4_K_M | 2.5 GB | 4.0 GB | 256K | general, reasoning, lowpower | Ollama · Model card |
qwen3:8b | Qwen3 | 8B | Q4_K_M | 5.2 GB | 6.7 GB | 40K | general, reasoning | Ollama · Model card |
qwen3:14b | Qwen3 | 14B | Q4_K_M | 9.3 GB | 10.8 GB | 40K | general, reasoning | Ollama · Model card |
qwen3:30b | Qwen3 | 30B MoE (3B active) | Q4_K_M | 19 GB | 20.5 GB | 256K | general, reasoning, rag | Ollama · Model card |
qwen3.5:4b | Qwen3.5 | 4B | Q4_K_M | 3.3 GB | 4.8 GB | 256K | general, vision, lowpower | Ollama · Model card |
qwen3.5:9b | Qwen3.5 | 9B | Q4_K_M | 6.6 GB | 8.1 GB | 256K | general, vision, reasoning, rag | Ollama · Model card |
qwen3.5:27b | Qwen3.5 | 27B | Q4_K_M | 17 GB | 18.5 GB | 256K | general, vision, reasoning, coding, rag | Ollama · Model card |
qwen3.5:35b | Qwen3.5 | 35B MoE (3B active) | Q4_K_M | 22 GB | 23.5 GB | 256K | general, vision, reasoning, rag | Ollama · Model card |
qwen3.6:27b | Qwen3.6 | 27B | Q4_K_M | 17 GB | 18.5 GB | 256K | general, vision, reasoning, coding, rag | Ollama · Model card |
qwen3.6:27b-coding | Qwen3.6 | 27B (coding tune) | Q4_K_M | 18 GB | 19.5 GB | 256K | coding | Ollama · Model card |
qwen3.6:35b | Qwen3.6 | 35B MoE (3B active) | Q4_K_M | 24 GB | 25.5 GB | 256K | general, vision, reasoning, coding, rag | Ollama · Model card |
qwen3-coder:30b | Qwen3-Coder | 30B MoE (3B active) | Q4_K_M | 19 GB | 20.5 GB | 256K | coding | Ollama · Model card |
qwen2.5-coder:1.5b | Qwen2.5-Coder | 1.5B | Q4_K_M | 1 GB | 2.5 GB | 32K | coding, autocomplete, lowpower | Ollama · Model card |
qwen2.5-coder:7b | Qwen2.5-Coder | 7B | Q4_K_M | 4.7 GB | 6.2 GB | 32K | coding, autocomplete | Ollama · Model card |
qwen2.5-coder:14b | Qwen2.5-Coder | 14B | Q4_K_M | 9 GB | 10.5 GB | 32K | coding | Ollama · Model card |
qwen3-vl:8b | Qwen3-VL | 8B | Q4_K_M | 6.1 GB | 7.6 GB | 256K | vision | Ollama · Model card |
llama3.2:1b | Llama 3.2 | 1B | Q4_K_M | 0.8 GB | 2.3 GB | 128K | general, lowpower | Ollama · Model card |
llama3.2:3b | Llama 3.2 | 3B | Q4_K_M | 2 GB | 3.5 GB | 128K | general, lowpower | Ollama · Model card |
llama3.1:8b | Llama 3.1 | 8B | Q4_K_M | 4.9 GB | 6.4 GB | 128K | general, rag | Ollama · Model card |
llama3.3:70b | Llama 3.3 | 70B | Q4_K_M | 43 GB | 44.5 GB | 128K | general, writing | Ollama · Model card |
ministral-3:3b | Ministral 3 | 3B | Q4_K_M | 3 GB | 4.5 GB | 256K | general, vision, lowpower | Ollama · Model card |
ministral-3:8b | Ministral 3 | 8B | Q4_K_M | 6 GB | 7.5 GB | 256K | general, vision, rag | Ollama · Model card |
ministral-3:14b | Ministral 3 | 14B | Q4_K_M | 9.1 GB | 10.6 GB | 256K | general, vision, rag, writing | Ollama · Model card |
mistral-nemo | Mistral NeMo | 12B | Q4_K_M | 7.1 GB | 8.6 GB | 128K | general, writing, rag | Ollama · Model card |
mistral-small3.2 | Mistral Small 3.2 | 24B | Q4_K_M | 15 GB | 16.5 GB | 128K | general, vision, writing, rag | Ollama · Model card |
magistral | Magistral Small | 24B | Q4_K_M | 14 GB | 15.5 GB | 39K | reasoning | Ollama · Model card |
devstral-small-2 | Devstral Small 2 | 24B | Q4_K_M | 15 GB | 16.5 GB | 384K | coding | Ollama · Model card |
deepseek-r1:1.5b | DeepSeek-R1 (distill) | 1.5B | Q4_K_M | 1.1 GB | 2.6 GB | 128K | reasoning, lowpower | Ollama · Model card |
deepseek-r1:8b | DeepSeek-R1 (0528 Qwen3 distill) | 8B | Q4_K_M | 5.2 GB | 6.7 GB | 128K | reasoning | Ollama · Model card |
deepseek-r1:14b | DeepSeek-R1 (distill) | 14B | Q4_K_M | 9 GB | 10.5 GB | 128K | reasoning | Ollama · Model card |
deepseek-r1:32b | DeepSeek-R1 (distill) | 32B | Q4_K_M | 20 GB | 21.5 GB | 128K | reasoning | Ollama · Model card |
phi4-mini | Phi-4-mini | 3.8B | Q4_K_M | 2.5 GB | 4.0 GB | 128K | general, reasoning, lowpower | Ollama · Model card |
phi4 | Phi-4 | 14B | Q4_K_M | 9.1 GB | 10.6 GB | 16K | reasoning | Ollama · Model card |
phi4-reasoning | Phi-4-reasoning | 14B | Q4_K_M | 11 GB | 12.5 GB | 32K | reasoning | Ollama · Model card |
gpt-oss:20b | gpt-oss | 21B MoE (3.6B active) | MXFP4 | 14 GB | 15.5 GB | 128K | general, reasoning, coding | Ollama · Model card |
gpt-oss:120b | gpt-oss | 117B MoE (5.1B active) | MXFP4 | 65 GB | 66.5 GB | 128K | general, reasoning, coding | Ollama · Model card |
granite4.2:3b | Granite 4.2 | 3B | Q4_K_M | 2.2 GB | 3.7 GB | 128K | general, rag, lowpower | Ollama · Model card |
granite4.2:8b | Granite 4.2 | 8B | Q4_K_M | 5.3 GB | 6.8 GB | 128K | general, rag | Ollama · Model card |
nemotron-3-nano:4b | Nemotron 3 Nano | 4B | Q4_K_M | 2.8 GB | 4.3 GB | 256K | general, reasoning, lowpower | Ollama · Model card |
nomic-embed-text | Nomic Embed | 137M | Q4_K_M | 0.27 GB | 0.6 GB | 2K | embed | Ollama · Model card |
qwen3-embedding:0.6b | Qwen3-Embedding | 0.6B | Q4_K_M | 0.64 GB | 0.9 GB | 32K | embed | Ollama · Model card |
Get the Local AI weekly
New models worth running, what fits which GPU, and setup fixes. One short email a week, free. Unsubscribe any time.
Local-LLM App Starter
A tested starter for building your own app on Ollama: chat, RAG and a GPU-fit checker. Skip the setup hours.
kits.lilaforge.com → VibeEngineBest local LLM tools, ranked
Ollama, LM Studio, Open WebUI and llama.cpp scored from public evidence, with top picks.
vibeengine.lilaforge.com →