picksbycard
August 23, 2026No. 113
Home / Will it run? / Gemma 4 26B-A4B IT / Radeon RX 7800 XT
Radeon RX 7800 XT · 16GB GDDR6

Can the Radeon RX 7800 XT run Gemma 4 26B-A4B IT?

Fits, tight on context at Q4_K_M.

Gemma 4 26B-A4B IT is 25.8B parameters (MoE; all experts resident). At Q4_K_M the weights are about 14.4 GiB; with the 1.5 GiB runtime reserve that is 15.9 GiB against the card's 16GB, leaving about 0.1 GiB for context.

All three quants

16GB card
QuantWeightsWith reserveVerdictHeadroom
Q4_K_Mthe everyday quant14.4 GiB15.9 GiBFits, tight on context0.1 GiB
Q8_0near-lossless25.5 GiB27.0 GiBOnly with CPU offloadshort 11.0 GiB
FP16full weights48.1 GiB49.6 GiBDoes not fitshort 33.6 GiB

Verdict rules: fits comfortably when weights plus reserve sit within 85% of VRAM; tight when they fit with little left for context; CPU offload when they exceed VRAM by up to 2x (runs, slowly, with layers in system RAM); no beyond that. The KV cache per token depends on the model's architecture and is not modelled here.

Good match. Get the card.

The Radeon RX 7800 XT clears Gemma 4 26B-A4B IT at Q4_K_M. Live listings below; this page was rebuilt 2026-08-23.

Amazon links may earn us a commission. Prices move daily; the links open live listings.

About the model

Gemma 4 26B-A4B IT by Google: 262,144-token native context, text + vision, released 2026 under the Apache-2.0. Model card → · Hosted pricing on PicksByModel →

The Silicon Note

One short read on the GPU market, most mornings. No spam, one-click out.