Llama 3.3 70B is 70.6B, 128K tokens on the official card. GLM 5.3 Flash is 320B total / 18B active, 1,048,576 tokens. Q6 / Q5 / Q4 file sizes come from the listed GGUFs on each /models page, or a calculator estimate when a listing is missing. Q3 stays off. Q4 does not sit in one R9700 VRAM on either side — expect RAM offload. Neither model was measured on the local desktop. Fit numbers are calculator estimates. llama.cpp first.
How we test — Measured cells cite official amdai-bench/run@1 cards. Estimates stay labeled. Q3 is estimate-only. Q1/Q2 stay off.
Cited, not measured on the local desktop
32–64 GB dense — cited, not measured
Full model page · Official card · GGUF · Can an R9700 run it? · Open in calculator
Cited, not measured on the local desktop
320B / 18B MoE — cited, not measured
Full model page · Official card · GGUF · Can an R9700 run it? · Open in calculator
Existing GPU sheets only: R9700, RX 7900 XTX, RX 7900 XT, RX 7800 XT. llama.cpp, f16 KV. Totals are calculator estimates. Speed is measured only on R9700 35B cells that already exist; everything else stays not measured yet. This table lists Q6 / Q5 / Q4. Q3 stays on the calculator as a labeled estimate.
| Quant | Kind | Llama 3.3 70B 4K | Llama 3.3 70B 32K | Llama 3.3 70B 125K | GLM 5.3 Flash 4K | GLM 5.3 Flash 32K | GLM 5.3 Flash 256K |
|---|---|---|---|---|---|---|---|
|
Q6
Q6_K / UD-Q6_K_XL |
Estimate |
56.4 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
65.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
94.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
276.5 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
277.0 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
281.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
|
Q5
Q5_K_M / UD-Q5_K_XL |
Estimate |
48.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
57.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
87.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
227.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
228.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
232.6 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
|
Q4
Q4_K_M / UD-Q4_K_XL |
Estimate |
41.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
50.7 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
80.2 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
189.4 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
189.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
194.2 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
| Quant | Kind | Llama 3.3 70B 4K | Llama 3.3 70B 32K | Llama 3.3 70B 125K | GLM 5.3 Flash 4K | GLM 5.3 Flash 32K | GLM 5.3 Flash 256K |
|---|---|---|---|---|---|---|---|
|
Q6
Q6_K / UD-Q6_K_XL |
Estimate |
56.4 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
65.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
94.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
276.5 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
277.0 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
281.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
|
Q5
Q5_K_M / UD-Q5_K_XL |
Estimate |
48.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
57.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
87.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
227.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
228.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
232.6 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
|
Q4
Q4_K_M / UD-Q4_K_XL |
Estimate |
41.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
50.7 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
80.2 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
189.4 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
189.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
194.2 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
| Quant | Kind | Llama 3.3 70B 4K | Llama 3.3 70B 32K | Llama 3.3 70B 125K | GLM 5.3 Flash 4K | GLM 5.3 Flash 32K | GLM 5.3 Flash 256K |
|---|---|---|---|---|---|---|---|
|
Q6
Q6_K / UD-Q6_K_XL |
Estimate |
56.4 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
65.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
94.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
276.5 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
277.0 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
281.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
|
Q5
Q5_K_M / UD-Q5_K_XL |
Estimate |
48.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
57.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
87.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
227.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
228.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
232.6 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
|
Q4
Q4_K_M / UD-Q4_K_XL |
Estimate |
41.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
50.7 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
80.2 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
189.4 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
189.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
194.2 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
| Quant | Kind | Llama 3.3 70B 4K | Llama 3.3 70B 32K | Llama 3.3 70B 125K | GLM 5.3 Flash 4K | GLM 5.3 Flash 32K | GLM 5.3 Flash 256K |
|---|---|---|---|---|---|---|---|
|
Q6
Q6_K / UD-Q6_K_XL |
Estimate |
56.4 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
65.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
94.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
276.5 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
277.0 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
281.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
|
Q5
Q5_K_M / UD-Q5_K_XL |
Estimate |
48.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
57.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
87.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
227.8 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
228.3 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
232.6 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
|
Q4
Q4_K_M / UD-Q4_K_XL |
Estimate |
41.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
50.7 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
80.2 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
189.4 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
189.9 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
194.2 GB Does not fit this GPU not measured yet No official local desktop cell for this model × card. Not measured yet. |
When a shopper file does not fit, the spill is system RAM. Shopper lines stay Minimum system RAM needed and RAM needed at full context on one R9700 at the model’s shopper quant, 32K selected and the official-card full context. Estimate unless a measured R9700 card overlays the kit.
Q4_K_M at 4K or 32K does not fit every listed card on the calculator.
Minimum system RAM needed
48 GB kit
Estimate · 42.7 GiB raw · 32K context
RAM needed at full context
48 GB kit
Estimate · 35.1 GiB raw · 8K full context
Estimate. Offloaded weights + KV in RAM + runtime + OS/desktop + headroom, rounded up to a 48 GB DIMM kit.
UD-Q4_K_XL at 4K or 32K does not fit every listed card on the calculator.
Minimum system RAM needed
192 GB kit
Estimate · 181.9 GiB raw · 32K context
RAM needed at full context
192 GB kit
Estimate · 181.5 GiB raw · 8K full context
Estimate. Offloaded weights + KV in RAM + runtime + OS/desktop + headroom, rounded up to a 192 GB DIMM kit. The local desktop ships 256 GB DDR5; measured host-RAM usage is not recorded until Local AI numbers arrive.
Commands and recipes already on the model pages. Cited-model shapes are not measured local desktop recipes. House Flash keeps its existing Strata recipe plus the llama.cpp backend page.
Llama 3.3 70B llama.cpp Q4_K_M llama.cpp
# Shape only — not a measured local desktop recipe. ./build-vk/bin/llama-server \ -m ~/models/Llama-3.3-70B-Instruct-Q4_K_M.gguf \ -ngl 99 \ -c 8192 \ --cache-type-k f16 \ --cache-type-v f16 \ --host 127.0.0.1 --port 8080
GLM 5.3 Flash llama.cpp UD-Q4_K_XL llama.cpp
# Shape only — not a measured local desktop recipe. ./build-vk/bin/llama-server \ -m ~/models/UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf \ -ngl 99 \ -c 8192 \ --cache-type-k f16 \ --cache-type-v f16 \ --host 127.0.0.1 --port 8080
Neither model holds Q4 in one R9700 VRAM on the calculator. Chat still works with RAM offload — read Minimum system RAM needed and RAM needed at full context below.
Both sides offload shopper Q4 on one R9700. A coding agent will share that RAM spill. Minimum system RAM needed and RAM needed at full context are the shopper lines. We do not invent a tokens-per-tool figure.
Cited context is 128K tokens vs 1,048,576 tokens. KV grows with context. Q4 at 32K spills on Llama 3.3 70B and spills on GLM 5.3 Flash on one R9700. Read /long-context for measured R9700 35B 128K–262K cards. We do not invent a 128K decode figure here.
Llama 3.3 70B files: Q6_K 57.89 GB, Q5_K_M 49.95 GB, Q4_K_M 42.52 GB. GLM 5.3 Flash files: UD-Q6_K_XL 291.83 GB, UD-Q5_K_XL 240.31 GB, UD-Q4_K_XL 199.71 GB. Fit on the four existing GPU sheets below. Empty speed cells stay not measured yet.
Open in Stack Lab only where the handoff is already allowlisted. Doctor is always here. House daily / Flash / agent profiles appear only when that house model is on the pair.
If the app is not installed, packages are not published yet. There is no public download URL. Read the Stack Lab install notes . If Stack Lab is already running on this machine, open the local app .
Pages: Llama 3.3 70B · GLM 5.3 Flash · All model compares · Compare GPUs · Compare 35B · Benchmarks · Stack Lab · Long context · Calculator