ReferenceReference

📋Model Reference

Model Reference

Last verified: October 2026. Every Ollama tag and download size below was checked against its page on ollama.com. New releases land weekly, so if something looks outdated, check Ollama’s library and HuggingFace trending.

How the RAM numbers work. “Download” is the size Ollama shows on the model’s tags page. “RAM” is that size plus about 4 GB for the OS, the runtime, and a at everyday context lengths, rounded up. Long contexts need more. Close to your limit, pick the next size down.


One pick per tier. Install Ollama, then run the command.

Your RAMModelCommandWhy this one
4 GB or lessQwen 3.5 0.8Bollama pull qwen3.5:0.8b1.2 GB download. Tiny but functional, and tight on a 4 GB machine.
8 GBQwen 3.5 4Bollama pull qwen3.5:4b with . 3.3 GB download, 256K .
16 GBQwen 3.5 9Bollama pull qwen3.5:9bSame family with thinking mode and image input. 6.6 GB download, 256K context. Gemma 4 12B (gemma4:12b) is the other good pick here.
32 GBQwen 3.8 27Bollama pull qwen3.8:27bDense 27B with thinking mode and image input. 18 GB download, 256K context, Apache 2.0.
64 GBQwen 3.8 27B at Q8ollama pull qwen3.8:27b-q8_0The same model at higher precision (30 GB download). For more speed, try the qwen3.6:35b, which has only 3B active .
96 GB+GPT-OSS 120Bollama pull gpt-oss:120b65 GB download, 128K context, Apache 2.0. Needs about 96 GB to run comfortably.

All Models by Hardware Tier

8 GB RAM: Small Models (up to 4B)

ModelParamsDownloadRAMStrengthsOllama
Qwen 3.5 4B4B (dense)3.3 GB~7 GBImage input, thinking mode, 256K contextqwen3.5:4b
Nemotron 3 Nano 4B4B2.8 GB~7 GBHybrid Mamba-, tool calling, thinking mode, 256K contextnemotron-3-nano:4b
Phi-4 Mini3.8B (dense)2.5 GB~7 GBMicrosoft, MIT license, tool calling, 128K contextphi4-mini
Gemma 4 E2B~2B effective4.6 GB~9 GBImage and audio input, 128K context. Tight on 8 GB, use short contexts.gemma4:e2b

16 GB RAM: Medium Models (7B-14B)

ModelParamsDownloadRAMStrengthsOllama
Qwen 3.5 9B9B (dense)6.6 GB~11 GBImage input, thinking mode, 256K contextqwen3.5:9b
Gemma 4 E4B~4B effective6.6 GB~11 GBImage and audio input, 128K contextgemma4:e4b
Gemma 4 12B12B (dense)7.7 GB~12 GBApache 2.0, 256K contextgemma4:12b
Phi-4 14B14B (dense)9.1 GB~13 GBStrong reasoning for its size. Only 16K context.phi4:14b

32 GB RAM: Large Models (20B-35B)

ModelParamsActiveDownloadRAMStrengthsOllama
Qwen 3.8 27B27B27B (dense)18 GB~22 GBThinking mode, image input, 256K context, Apache 2.0qwen3.8:27b
Qwen 3.6 35B-A3B35B3B (MoE)23 GB~27 GBFast for its size, 256K context, Apache 2.0qwen3.6:35b
Gemma 4 31B31B31B (dense)19 GB~23 GB256K context, Apache 2.0gemma4:31b
Gemma 4 26B-A4B26B~4B (MoE)16 GB~20 GBLighter than the 31B, 256K contextgemma4:26b
GPT-OSS 20B21B3.6B (MoE)14 GB~18 GBOpenAI’s model, 128K context, Apache 2.0gpt-oss:20b
Muse Glimmer30Bn/a18 GB~22 GBMeta, built for agent tasks, image input, 128K context, Apache 2.0muse-glimmer
Nemotron 3.5 Lightning30B3B (MoE)19 GB~23 GBNVIDIA, 1M context, tool calling. Long contexts need much more RAM.nemotron-3.5-lightning
GLM-4.7 Flash30B3B (MoE)19 GB~23 GBAgentic coding, tool calling, 198K contextglm-4.7-flash

96 GB+ RAM: Very Large Models (100B+)

These do not fit a 64 GB machine at the default quantization.

ModelParamsActiveDownloadRAMStrengthsOllama
GPT-OSS 120B117B5.1B (MoE)65 GB~69 GB128K context, Apache 2.0gpt-oss:120b
Llama 4 Scout109B17B (MoE)67 GB~71 GBImage input, 10M token context per Ollama’s listingllama4:16x17b
Nemotron 3.5 Super120B12B (MoE)80 GB~84 GB1M context, tool callingnemotron-3.5-super
Qwen 3.5 122B-A10B122B10B (MoE)81 GB~85 GB256K context, Apache 2.0qwen3.5:122b-a10b
Nemotron 3 Super120B12B (MoE)87 GB~91 GB256K context, tool callingnemotron-3-super

Server / Multi-GPU: Frontier-Class Open Models

These need hundreds of GB of memory or a multi-GPU server. The newest ones run on Ollama only as cloud models (:cloud tags), so for local use you need the Hugging Face weights and a serving stack like vLLM or llama.cpp.

ModelTotal paramsLicenseWhere
Llama 4 Maverick (17B active)400BLlama 4 Community LicenseOllama llama4:128x17b, 245 GB download, 1M context
DeepSeek V4.1 Flash763BMITHuggingFace, 1M context. Ollama: cloud only.
DeepSeek V4 Pro1.6TMITHuggingFace. Ollama: cloud only.
GLM-5.3753BCustom (“other”)HuggingFace, 1M context. Ollama: cloud only.
Kimi K32.78TCustom (“other”)HuggingFace, 1M context. Ollama: cloud only.
Qwen 3.8 2.4T-A95B (95B active)2.4TCustom (“other”)HuggingFace
Mistral Small 4119BApache 2.0HuggingFace

Models by Use Case

These are editorial picks from the tables above, not a benchmark ranking.

Best for Coding

TierModelWhy
Small (8 GB)Qwen 3.5 4BThinking mode helps with code reasoning
Medium (16 GB)Qwen 3.5 9BThinking mode, 6.6 GB download
Large (32 GB)Qwen 3.8 27BModel card reports 61.7 on SWE-bench Pro and 90.3 on LiveCodeBench v6 (vendor-reported)
XL (96 GB+)GPT-OSS 120BStrong agentic coding with only 5.1B active params
ServerDeepSeek V4 Pro / Kimi K3 / GLM-5.3Current open-weight flagships

Best for Reasoning and Math

TierModelWhy
Small (8 GB)Qwen 3.5 4BThinking mode
Medium (16 GB)Qwen 3.5 9BThinking mode, 6.6 GB download
Large (32 GB)Qwen 3.8 27BModel card reports 89.2 on GPQA Diamond (vendor-reported)
XL (96 GB+)Qwen 3.5 122B-A10BThinking mode with 10B active params
ServerDeepSeek V4 Pro / Qwen 3.8 2.4T-A95BLargest open checkpoints

Best for Long Context

TierModelContextWhy
Small (8 GB)Nemotron 3 Nano 4B256K tokensHybrid Mamba-Transformer, 2.8 GB download
Medium (16 GB)Gemma 4 12B256K tokens7.7 GB download
Large (32 GB)Nemotron 3.5 Lightning1M tokensNeeds far more than 23 GB at full context
XL (96 GB+)Llama 4 Scout10M tokensOllama’s listed context. Real usable length depends on your KV cache memory.

Best for Multimodal (Text + Images)

TierModelModalities
Small (8 GB)Qwen 3.5 4BText + images
Small (8 GB)Gemma 4 E2BText + images + audio
Medium (16 GB)Qwen 3.5 9BText + images
Medium (16 GB)Gemma 4 E4BText + images + audio
Large (32 GB)Qwen 3.8 27BText + images
XL (96 GB+)Llama 4 ScoutText + images

Best for Writing and Creative Tasks

I have no benchmark for this one. These are picks based on size and context length, so test them on your own prompts.

TierModelWhy
Medium (16 GB)Gemma 4 12BNewest mid-size general model
Large (32 GB)Qwen 3.8 27BLarge context for keeping tone across long pieces
XL (96 GB+)GPT-OSS 120BLarge general model that fits a 128 GB machine

Instruct vs. Base Models

Base models predict the next token and are not trained to be helpful. They will continue a prompt as if completing a document, not answer a question.

Instruct models are fine-tuned to follow instructions and hold conversations. For everyday use, always download the instruct variant.

When downloading, look for “Instruct” or “it” in the model name (e.g., gemma-4-12B-it). HuggingFace model cards label these clearly. The only reason to use a base model is if you are doing further fine-tuning and want the raw weights.

Most models in the Ollama library are instruct variants by default unless the name says otherwise.


Model Families: Who Makes What

Qwen (Alibaba)

  • Qwen 3.5: February 2026. Sizes 0.8B, 2B, 4B, 9B, 27B, 35B-A3B, 122B-A10B, 397B-A17B. Apache 2.0.
  • Qwen 3.6: April 2026. 27B and 35B-A3B on Ollama. Apache 2.0.
  • Qwen 3.8: August 2026. 27B is Apache 2.0, 256K native context (extendable to 1M), thinking mode on by default, image input. The 2.4T-A95B flagship uses a custom license.
  • Links: HuggingFace Qwen3.8-27B · Ollama qwen3.8 · Ollama qwen3.6 · Ollama qwen3.5

GPT-OSS (OpenAI)

  • Released: August 2025
  • Sizes: 20B (3.6B active), 120B (5.1B active)
  • License: Apache 2.0
  • Key features: MoE, MXFP4 weights, tool calling, thinking mode, 128K context
  • Links: HuggingFace · GitHub · Ollama

Nemotron (NVIDIA)

  • Nemotron 3: Nano 4B, Nano 30B-A3B (December 2025), Super 120B-A12B. NVIDIA Open Model License.
  • Nemotron 3.5: Lightning 30B-A3B (August 2026, 1M context, OpenMDW 1.1 license) and Super 120B-A12B (1M context).
  • Key features: Hybrid Mamba-Transformer MoE, tool calling, agentic reasoning
  • Links: NVIDIA Developer · Ollama Lightning · Ollama 3.5 Super · Ollama Nano

Llama 4 and Muse (Meta)

  • Llama 4 released: April 2025
  • Sizes: Scout 109B (17B active), Maverick 400B (17B active)
  • License: Llama 4 Community License
  • Key features: MoE, image input, Scout has a 10M token context window on Ollama
  • Muse Glimmer: Meta’s newer local model. 30B, Apache 2.0, 128K context, 18 GB on Ollama.
  • Links: llama.com · Ollama Llama 4 · Ollama Muse Glimmer

Gemma 4 (Google DeepMind)

  • Released: April 2026 (12B added June 2026)
  • Sizes: E2B, E4B, 12B, 26B-A4B, 31B
  • License: Apache 2.0
  • Key features: E2B and E4B take image and audio input and have 128K context. 12B, 26B and 31B have 256K context.
  • Links: DeepMind Blog · HuggingFace Blog · Ollama

GLM (Zhipu AI / Z.AI)

  • Local pick: GLM-4.7 Flash (30B-A3B, MIT, January 2026), 19 GB on Ollama, 198K context.
  • Flagship: GLM-5.3 (753B, August 2026, custom license). Ollama cloud only.
  • Links: Ollama GLM-4.7 Flash · HuggingFace GLM-5.3

DeepSeek

  • Current: V4 Pro (1.6T) and V4.1 Flash (763B, September 2026), both MIT with 1M context on Flash. Neither is local-size.
  • Older: R1 and its distilled sizes (1.5B to 70B) are still on Ollama as deepseek-r1.
  • Links: HuggingFace V4.1 Flash · Ollama R1

Kimi (Moonshot AI)

  • Current: Kimi K3 (June 2026), 2.78T total params, custom license, 1M context. Ollama cloud only.
  • Links: HuggingFace

Mistral

  • Mistral Small 3: 24B, January 2025, Apache 2.0, 14 GB on Ollama (mistral-small), 32K context. It still works but is no longer a first pick.
  • Mistral Small 4: 119B, Apache 2.0, March 2026. Server-class.
  • Links: Ollama · HuggingFace Small 4

Phi-4 (Microsoft)


Where to Find Models

  • Unsloth Dynamic GGUFs produces dynamic quantizations that are widely considered the best GGUF variants for most models. The dynamic format allocates more bits to sensitive layers and fewer to layers where precision matters less, giving better quality at the same file size. Start here when downloading GGUFs from HuggingFace.
  • Ollama Library has pre- models with one-command install. Best for getting started quickly.
  • HuggingFace Models is the largest collection. Original weights plus community quantizations (, GPTQ, AWQ).
  • LM Studio provides a visual model browser with one-click downloads from HuggingFace.

Understanding Model Names

When you see a model name like qwen3.5:9b-q4_K_M, here’s what each part means:

PartMeaningExample
FamilyWho made it and which generationqwen3.5 = Alibaba’s Qwen, version 3.5
SizeTotal count9b = 9 billion parameters
Active (if MoE)Parameters used per tokenA3B = 3 billion active
QuantizationCompression levelq4_K_M = 4-bit, , medium quality

quick guide:

LevelQualityNotes
Q8~99% of originalLargest file. Near-lossless.
Q6_K~97%Slightly smaller, barely any loss.
Q5_K_M~95%Good default if you have the space.
Q4_K_M~93%The sweet spot for most people. Half the size.
Q3_K~85%Noticeable quality drop. Only if you’re tight on memory.
Q2_K~70%Real quality loss. Last resort.

Want to understand how quantization works? See Module 2: Compressed Models for the intuition, or Module 3B: How Models Fit for the deep dive.


Emerging Techniques Changing the Game

TurboQuant (Google)

Google Research’s March 2026 blog post describes compressing KV caches to 3 bits without retraining. The authors report at least 6x lower KV memory in needle-in-a-haystack tests and up to 8x faster attention logits on H100 GPUs (4-bit keys versus 32-bit). Those are the authors’ own results. Support in llama.cpp, MLX and Ollama varies, so check their release notes before counting on it. The paper is arXiv 2504.19874.

LLM in a Flash (Apple)

Runs models larger than your available by streaming weights from SSD/flash storage. Apple Research describes the technique in this paper. It is slow compared with keeping weights in memory.

Mixture of Experts (MoE) Everywhere

Most new large models use MoE: huge total parameter counts but only a fraction active per token. A “120B” MoE model with 5B active runs at roughly 5B speed and compute cost, but stores knowledge across all 120B parameters. You need RAM for the full 120B, which is why the tables above show models larger than you might expect for a given tier.


For the latest in model releases and AI news, see our News Feed and Research Feed.