picksbycard
October 7, 2026No. 158
Home / Will it run? / Qwen3 1.7B / GeForce RTX 4090 (used)
GeForce RTX 4090 (used) ยท 24GB GDDR6X

Can the GeForce RTX 4090 (used) run Qwen3 1.7B?

Fits comfortably at Q4_K_M.

Qwen3 1.7B is 1.7B parameters. At Q4_K_M the weights are about 0.9 GiB; with the 1.5 GiB runtime reserve that is 2.4 GiB against the card's 24GB, leaving about 21.6 GiB for context.

All three quants

24GB card
QuantWeightsWith reserveVerdictHeadroom
Q4_K_Mthe everyday quant0.9 GiB2.4 GiBFits comfortably21.6 GiB
Q8_0near-lossless1.7 GiB3.2 GiBFits comfortably20.8 GiB
FP16full weights3.2 GiB4.7 GiBFits comfortably19.3 GiB

Verdict rules: fits comfortably when weights plus reserve sit within 85% of VRAM; tight when they fit with little left for context; CPU offload when they exceed VRAM by up to 2x (runs, slowly, with layers in system RAM); no beyond that. The KV cache per token depends on the model's architecture and is not modelled here.

The numbers for this pairing

At Q4_K_M the weights take about 0.9 GiB; with the 1.5 GiB we set aside for the runtime that is 2.4 of the card's 24 GB, leaving about 21.6 GB for the context cache.

The highest-quality version that fits entirely in memory is FP16 (full quality).

The cheapest card on our list that runs it comfortably at Q4 is the Arc B570 at about $260, against about $3,300 for this card.

At about $3,300, this card costs roughly $137 per GB of VRAM.

Running it at its full 450 W board power for 4 hours a day would use about 54 kWh a month, about $9.94 at the US average residential rate of 18.4 cents per kWh (2026-05); real use sits below that ceiling.

Prices are the lowest current listings our tracker saw on Oct 7, 2026, since averages include premium variants; launch prices are marked where we have no listing.

Good match. Get the card.

The GeForce RTX 4090 (used) clears Qwen3 1.7B at Q4_K_M and at Q8_0. Live listings below; this page was rebuilt 2026-10-07.

Amazon links may earn us a commission. Prices move daily; the links open live listings.

About the model

Qwen3 1.7B by Alibaba Qwen: 32,768-token native context, text, released 2025 under the Apache-2.0. Model card →

The Silicon Note

One short read on the GPU market, most mornings. No spam, one-click out.