picksbycard
November 22, 2026No. 204
Will it run?

Which models fit which card.

50 open-weight models against the 20 cards in our catalog. Weights are sized from the parameter count (all experts count for MoE), a 1.5 GiB reserve covers the runtime and a small KV cache, and what is left is your context headroom. Tap any cell for the full verdict at Q4, Q8 and FP16. This is an estimated memory fit, not a benchmark: a fit means the weights and a working context should load, not that speed is acceptable or that every runtime supports the model.

The grid

Q4_K_M verdicts
fits comfortablytightCPU offloadno
Model · weights at Q4RTX 509032GBRTX 3090 (used)24GBRTX 4090 (used)24GBRX 7900 XTX24GBRX 7900 XT (used)20GBRTX 4080 Super (used)16GBRTX 5060 Ti 16GB16GBRTX 5070 Ti16GBRTX 508016GBRX 7800 XT16GBRX 9060 XT 16GB16GBRX 907016GBRX 9070 XT16GBArc B58012GBRTX 3060 12GB (used)12GBRTX 4070 Super12GBRTX 507012GBArc B57010GBRTX 50608GBRTX 5060 Ti 8GB8GB
Qwen3 0.6B0.6B · 0.3 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Gemma 3 1B IT1B · 0.6 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Llama 3.2 1B Instruct1.23B · 0.7 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Qwen3 1.7B1.7B · 0.9 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Llama 3.2 3B Instruct3.21B · 1.8 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Phi-3.5 mini Instruct3.82B · 2.1 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Phi-4 mini Instruct3.84B · 2.1 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Qwen3 4B4B · 2.2 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Gemma 3 4B IT4.3B · 2.4 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Qwen3.5 4B4.66B · 2.6 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Mistral 7B Instruct v0.37.25B · 4.1 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Qwen2.5 7B Instruct7.61B · 4.3 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Qwen2.5 Coder 7B Instruct7.61B · 4.3 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
DeepSeek R1 Distill Qwen 7B7.62B · 4.3 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
DeepSeek R1 Distill Llama 8B8.03B · 4.5 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Hermes 3 Llama 3.1 8B8.03B · 4.5 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Llama 3.1 8B Instruct8.03B · 4.5 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Qwen3 8B8.2B · 4.6 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Qwen2.5-VL 7B Instruct8.29B · 4.6 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Gemma 2 9B IT9.24B · 5.2 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYes
Qwen3.5 9B9.65B · 5.4 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesTightTight
Gemma 3 12B IT12.2B · 6.8 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesOffloadOffload
Mistral NeMo 12B Instruct (2407)12.2B · 6.8 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesOffloadOffload
Phi-4 (14B)14.7B · 8.2 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesTightOffloadOffload
DeepSeek R1 Distill Qwen 14B14.8B · 8.3 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesTightOffloadOffload
Qwen3 14B14.8B · 8.3 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesYesTightOffloadOffload
gpt-oss-20b21B MoE (3.6B active) · 11.7 GiB YesYesYesYesYesYesYesYesYesYesYesYesYesOffloadOffloadOffloadOffloadOffloadOffloadOffload
Codestral 22B v0.122.2B · 12.4 GiB YesYesYesYesYesTightTightTightTightTightTightTightTightOffloadOffloadOffloadOffloadOffloadOffloadOffload
Mistral Small 3.2 24B Instruct (2506)24B · 13.4 GiB YesYesYesYesYesTightTightTightTightTightTightTightTightOffloadOffloadOffloadOffloadOffloadOffloadOffload
Gemma 4 26B-A4B IT25.8B MoE (3.8B active) · 14.4 GiB YesYesYesYesYesTightTightTightTightTightTightTightTightOffloadOffloadOffloadOffloadOffloadOffloadOffload
Gemma 3 27B IT27.4B · 15.3 GiB YesYesYesYesYesOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadNoNo
Qwen3.6 27B27.8B · 15.5 GiB YesYesYesYesTightOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadNoNo
GLM-4.7-Flash30B MoE (3B active) · 16.8 GiB YesYesYesYesTightOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadNoNo
Qwen3 30B-A3B30.5B MoE (3.3B active) · 17.0 GiB YesYesYesYesTightOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadNoNo
Gemma 4 31B IT31.3B · 17.5 GiB YesYesYesYesTightOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadNoNo
Qwen2.5 Coder 32B Instruct32.5B · 18.2 GiB YesYesYesYesTightOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadNoNo
DeepSeek R1 Distill Qwen 32B32.8B · 18.3 GiB YesYesYesYesTightOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadNoNo
Qwen3 32B32.8B · 18.3 GiB YesYesYesYesTightOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadNoNo
Qwen3.6 35B-A3B36B MoE (3B active) · 20.1 GiB YesTightTightTightOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadNoNoNo
Mixtral 8x7B Instruct v0.146.7B MoE (12.9B active) · 26.1 GiB TightOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadOffloadNoNoNoNoNoNoNo
Llama 3.3 70B Instruct70.6B · 39.5 GiB OffloadOffloadOffloadOffloadNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNo
GLM-4.5-Air106B MoE (12B active) · 59.2 GiB OffloadNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNo
Llama 4 Scout (17B x 16E) Instruct109B MoE (17B active) · 60.9 GiB OffloadNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNo
gpt-oss-120b117B MoE (5.1B active) · 65.4 GiB NoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNo
Mixtral 8x22B Instruct v0.1141B MoE (39B active) · 78.8 GiB NoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNo
Qwen3 235B-A22B235B MoE (22B active) · 131.3 GiB NoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNo
DeepSeek V4 Flash284B MoE (13B active) · 158.7 GiB NoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNo
Llama 4 Maverick (17B x 128E) Instruct400B MoE (17B active) · 223.5 GiB NoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNo
DeepSeek R1 (671B)671B MoE (37B active) · 375.0 GiB NoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNo
Kimi K2 Instruct1000B MoE (32B active) · 558.8 GiB NoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNoNo

Method: weights in GiB = parameters x bytes per parameter (Q4_K_M 0.60, Q8_0 1.06, FP16 2.0), plus a fixed 1.5 GiB reserve. "Fits comfortably" means that total sits within 85% of the card's memory; "tight" means it fits with little room for context; "CPU offload" means the weights exceed VRAM by up to 2x and can still run slowly with layers offloaded to system RAM. Parameter counts come from each model's card or release notes; the per-token KV cache depends on the architecture and is not in this table, so treat the headroom figures as a budget, not a promise.

The Silicon Note

One short read on the GPU market, most mornings. No spam, one-click out.