Compare · Qwen3.6-35B-A3B · llama.cpp

Which quant on this 35B?

Quality vs speed vs VRAM for the house 35B on llama.cpp Vulkan. Q6 / UD-Q5 / Q5_K_M / Q4 are measured on the local desktop. UD-Q3_K_XL is a labeled estimate (Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB)) — not a local desktop run. Prefer Q5 over Q4 when the file still fits. Q1/Q2 stay off. To convert and quantize a new GGUF, use /guides/quantize-gguf.

How we test — Measured cells cite official amdai-bench/run@1 cards. Estimates stay labeled. Q3 is estimate-only. Q1/Q2 stay off.

“Minimum system RAM needed” and “RAM needed at full context” use a measured peak when a card recorded one, otherwise a calculator estimate rounded up to a real DIMM kit (48 / 64 / 96 / 128 / 192 / 256 GB).

One R9700 · short

Measured

UD-Q5_K_XL

Decode: 102.39 tok/s
Prefill: 2761.6 tok/s
VRAM / card: 25.45 GB
VRAM total: 25.97 GB
Minimum system RAM: 48 GB kit (measured · 37.32 GB peak)
RAM at full context: 48 GB kit (measured · 42.9 GB peak)

Measured

Q5_K_M

Decode: 109.73 tok/s
Prefill: 2710.8 tok/s
VRAM / card: 24.16 GB
VRAM total: 24.68 GB
Minimum system RAM: 48 GB kit (measured · 37.32 GB peak)
RAM at full context: 48 GB kit (measured · 42.9 GB peak)

Measured

Q4_K_M

Decode: 117.69 tok/s
Prefill: 2733.9 tok/s
VRAM / card: 20.84 GB
VRAM total: 21.43 GB
Minimum system RAM: 48 GB kit (measured · 33.74 GB peak)
RAM at full context: 48 GB kit (measured · 39.05 GB peak)

Measured

Q6_K

Decode: 103.23 tok/s
Prefill: 2623.6 tok/s
VRAM / card: 28.78 GB
VRAM total: 29.26 GB
Minimum system RAM: 48 GB kit (measured · 40.91 / 40.15 GB peak)
RAM at full context: 48 GB kit (measured · 43.69 GB peak)

Q6_K single-GPU 4K table cell is 103.23 tok/s from the 23:55 card (the 4K point in the complete Q6_K single-GPU series). The earlier 23:26 card at 82.62 tok/s stays on /results and is not averaged into the cell.

Estimate

UD-Q3_K_XL

Decode: not measured
Prefill: not measured
VRAM / card: 16.4 GB (estimate)
VRAM total: 16.4 GB (estimate)
Minimum system RAM: 32 GB kit (estimate)
RAM at full context: 32 GB kit (estimate)

Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

One R9700 · 32K

Measured

UD-Q5_K_XL

Decode: 90.52 tok/s
Prefill: 1937.9 tok/s
VRAM / card: 26.16 GB
VRAM total: 26.7 GB
Minimum system RAM: 48 GB kit (measured · 37.83 GB peak)
RAM at full context: 48 GB kit (measured · 42.9 GB peak)

Measured

Q5_K_M

Decode: 96.21 tok/s
Prefill: 1902.6 tok/s
VRAM / card: 24.87 GB
VRAM total: 25.39 GB
Minimum system RAM: 48 GB kit (measured · 37.83 GB peak)
RAM at full context: 48 GB kit (measured · 42.9 GB peak)

Measured

Q4_K_M

Decode: 101.88 tok/s
Prefill: 1902.1 tok/s
VRAM / card: 21.55 GB
VRAM total: 22.17 GB
Minimum system RAM: 48 GB kit (measured · 34.58 GB peak)
RAM at full context: 48 GB kit (measured · 39.05 GB peak)

Measured

Q6_K

Decode: 71.19 tok/s
Prefill: 1683 tok/s
VRAM / card: 28.68 GB
VRAM total: 29.17 GB
Minimum system RAM: 48 GB kit (measured · 44.01 GB peak)
RAM at full context: 48 GB kit (measured · 43.69 GB peak)

Partly offloaded to DDR5 on one GPU (llama.cpp --fit-target 1024). Decode is not an in-VRAM figure.

Estimate

UD-Q3_K_XL

Decode: not measured
Prefill: not measured
VRAM / card: 17.0 GB (estimate)
VRAM total: 17.0 GB (estimate)
Minimum system RAM: 32 GB kit (estimate)
RAM at full context: 32 GB kit (estimate)

Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

One R9700 · 128K

Measured

UD-Q5_K_XL

Decode: 66.43 tok/s
Prefill: 942.8 tok/s
VRAM / card: 28.22 GB
VRAM total: 28.82 GB
Minimum system RAM: 48 GB kit (measured · 40.18 GB peak)
RAM at full context: 48 GB kit (measured · 42.9 GB peak)

Measured

Q5_K_M

Decode: 69.64 tok/s
Prefill: 940.3 tok/s
VRAM / card: 26.93 GB
VRAM total: 27.43 GB
Minimum system RAM: 48 GB kit (measured · 40.18 GB peak)
RAM at full context: 48 GB kit (measured · 42.9 GB peak)

Measured

Q4_K_M

Decode: 72.48 tok/s
Prefill: 942.1 tok/s
VRAM / card: 23.61 GB
VRAM total: 24.27 GB
Minimum system RAM: 48 GB kit (measured · 36.5 GB peak)
RAM at full context: 48 GB kit (measured · 39.05 GB peak)

Measured

Q6_K

Decode: 54.51 tok/s
Prefill: 800.3 tok/s
VRAM / card: 28.78 GB
VRAM total: 29.25 GB
Minimum system RAM: 48 GB kit (measured · 45.43 GB peak)
RAM at full context: 48 GB kit (measured · 43.69 GB peak)

Partly offloaded to DDR5 on one GPU (llama.cpp --fit-target 1024). Decode is not an in-VRAM figure.

Estimate

UD-Q3_K_XL

Decode: not measured
Prefill: not measured
VRAM / card: 18.9 GB (estimate)
VRAM total: 18.9 GB (estimate)
Minimum system RAM: 32 GB kit (estimate)
RAM at full context: 32 GB kit (estimate)

Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

One R9700 · 256K

Measured

UD-Q5_K_XL

Decode: 44.4 tok/s
Prefill: 519.2 tok/s
VRAM / card: 28.73 GB
VRAM total: 29.34 GB
Minimum system RAM: 48 GB kit (measured · 42.9 GB peak)
RAM at full context: 48 GB kit (measured · 42.9 GB peak)

Measured

Q5_K_M

Decode: 40.54 tok/s
Prefill: 541.7 tok/s
VRAM / card: 28.56 GB
VRAM total: 29.15 GB
Minimum system RAM: 48 GB kit (measured · 42.9 GB peak)
RAM at full context: 48 GB kit (measured · 42.9 GB peak)

Measured

Q4_K_M

Decode: 47.77 tok/s
Prefill: 558.5 tok/s
VRAM / card: 26.36 GB
VRAM total: 27.03 GB
Minimum system RAM: 48 GB kit (measured · 39.05 GB peak)
RAM at full context: 48 GB kit (measured · 39.05 GB peak)

Measured

Q6_K

Decode: 37.78 tok/s
Prefill: 471.6 tok/s
VRAM / card: 28.81 GB
VRAM total: 29.3 GB
Minimum system RAM: 48 GB kit (measured · 43.69 GB peak)
RAM at full context: 48 GB kit (measured · 43.69 GB peak)

Partly offloaded to DDR5 on one GPU (llama.cpp --fit-target 1024). Decode is not an in-VRAM figure.

Estimate

UD-Q3_K_XL

Decode: not measured
Prefill: not measured
VRAM / card: 21.4 GB (estimate)
VRAM total: 21.4 GB (estimate)
Minimum system RAM: 32 GB kit (estimate)
RAM at full context: 32 GB kit (estimate)

Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

Split · short

Measured

UD-Q5_K_XL

Decode: 82.78 tok/s
Prefill: 2637.3 tok/s
VRAM / card: 13.28 / 13.11 GB
VRAM total: 26.39 GB
Minimum system RAM: 48 GB kit (measured · 37.6 GB peak)
RAM at full context: 48 GB kit (measured · 44.71 GB peak)

Measured

Q5_K_M

Decode: 88.19 tok/s
Prefill: 2647.2 tok/s
VRAM / card: 12.71 / 12.41 GB
VRAM total: 25.13 GB
Minimum system RAM: 48 GB kit (measured · 37.6 GB peak)
RAM at full context: 48 GB kit (measured · 44.71 GB peak)

Measured

Q4_K_M

Decode: 93.28 tok/s
Prefill: 2660.4 tok/s
VRAM / card: 10.83 / 10.85 GB
VRAM total: 21.69 GB
Minimum system RAM: 48 GB kit (measured · 33.74 GB peak)
RAM at full context: 48 GB kit (measured · 40.84 GB peak)

Measured

Q6_K

Decode: 83.5 tok/s
Prefill: 2572.1 tok/s
VRAM / card: 15.01 / 14.63 GB
VRAM total: 29.64 GB
Minimum system RAM: 48 GB kit (measured · 38.22 GB peak)
RAM at full context: 48 GB kit (measured · 45.15 GB peak)

Estimate

UD-Q3_K_XL

Decode: not measured
Prefill: not measured
VRAM / card: 8.21 GB (estimate)
VRAM total: 16.4 GB (estimate)
Minimum system RAM: 32 GB kit (estimate)
RAM at full context: 32 GB kit (estimate)

Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

Split · 32K

Measured

UD-Q5_K_XL

Decode: 74.8 tok/s
Prefill: 1916 tok/s
VRAM / card: 13.77 / 13.64 GB
VRAM total: 27.41 GB
Minimum system RAM: 48 GB kit (measured · 38.16 GB peak)
RAM at full context: 48 GB kit (measured · 44.71 GB peak)

Measured

Q5_K_M

Decode: 78.91 tok/s
Prefill: 1920.9 tok/s
VRAM / card: 13.2 / 12.95 GB
VRAM total: 26.13 GB
Minimum system RAM: 48 GB kit (measured · 38.16 GB peak)
RAM at full context: 48 GB kit (measured · 44.71 GB peak)

Measured

Q4_K_M

Decode: 82.57 tok/s
Prefill: 1933.1 tok/s
VRAM / card: 11.34 / 11.39 GB
VRAM total: 22.72 GB
Minimum system RAM: 48 GB kit (measured · 34.39 GB peak)
RAM at full context: 48 GB kit (measured · 40.84 GB peak)

Measured

Q6_K

Decode: 75.43 tok/s
Prefill: 1890.7 tok/s
VRAM / card: 15.5 / 15.16 GB
VRAM total: 30.66 GB
Minimum system RAM: 48 GB kit (measured · 38.98 GB peak)
RAM at full context: 48 GB kit (measured · 45.15 GB peak)

Estimate

UD-Q3_K_XL

Decode: not measured
Prefill: not measured
VRAM / card: 8.49 GB (estimate)
VRAM total: 17.0 GB (estimate)
Minimum system RAM: 32 GB kit (estimate)
RAM at full context: 32 GB kit (estimate)

Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

Split · 128K

Measured

UD-Q5_K_XL

Decode: 57.94 tok/s
Prefill: 1071.1 tok/s
VRAM / card: 15.47 / 15.48 GB
VRAM total: 30.94 GB
Minimum system RAM: 48 GB kit (measured · 41.02 GB peak)
RAM at full context: 48 GB kit (measured · 44.71 GB peak)

Measured

Q5_K_M

Decode: 59.86 tok/s
Prefill: 1067.3 tok/s
VRAM / card: 14.98 / 14.79 GB
VRAM total: 29.76 GB
Minimum system RAM: 48 GB kit (measured · 41.02 GB peak)
RAM at full context: 48 GB kit (measured · 44.71 GB peak)

Measured

Q4_K_M

Decode: 62.12 tok/s
Prefill: 1078.4 tok/s
VRAM / card: 13.03 / 13.23 GB
VRAM total: 26.26 GB
Minimum system RAM: 48 GB kit (measured · 38.04 GB peak)
RAM at full context: 48 GB kit (measured · 40.84 GB peak)

Measured

Q6_K

Decode: 58.04 tok/s
Prefill: 1059.7 tok/s
VRAM / card: 17.21 / 17 GB
VRAM total: 34.21 GB
Minimum system RAM: 48 GB kit (measured · 41.41 GB peak)
RAM at full context: 48 GB kit (measured · 45.15 GB peak)

Estimate

UD-Q3_K_XL

Decode: not measured
Prefill: not measured
VRAM / card: 9.44 GB (estimate)
VRAM total: 18.9 GB (estimate)
Minimum system RAM: 32 GB kit (estimate)
RAM at full context: 32 GB kit (estimate)

Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

Split · 256K

Measured

UD-Q5_K_XL

Decode: 42.03 tok/s
Prefill: 671.7 tok/s
VRAM / card: 17.8 / 17.99 GB
VRAM total: 35.74 GB
Minimum system RAM: 48 GB kit (measured · 44.71 GB peak)
RAM at full context: 48 GB kit (measured · 44.71 GB peak)

Measured

Q5_K_M

Decode: 42.33 tok/s
Prefill: 664.6 tok/s
VRAM / card: 17.45 / 17.3 GB
VRAM total: 34.54 GB
Minimum system RAM: 48 GB kit (measured · 44.71 GB peak)
RAM at full context: 48 GB kit (measured · 44.71 GB peak)

Measured

Q4_K_M

Decode: 42.88 tok/s
Prefill: 673 tok/s
VRAM / card: 15.28 / 15.74 GB
VRAM total: 31.02 GB
Minimum system RAM: 48 GB kit (measured · 40.84 GB peak)
RAM at full context: 48 GB kit (measured · 40.84 GB peak)

Measured

Q6_K

Decode: 42.2 tok/s
Prefill: 666.2 tok/s
VRAM / card: 19.46 / 19.51 GB
VRAM total: 38.96 GB
Minimum system RAM: 48 GB kit (measured · 45.15 GB peak)
RAM at full context: 48 GB kit (measured · 45.15 GB peak)

Estimate

UD-Q3_K_XL

Decode: not measured
Prefill: not measured
VRAM / card: 10.7 GB (estimate)
VRAM total: 21.4 GB (estimate)
Minimum system RAM: 32 GB kit (estimate)
RAM at full context: 32 GB kit (estimate)

Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

One R9700 · short

Q6, Q5, and Q4 on the same 35B file, plus a labeled Q3 estimate. Figures from local desktop run cards.
Metric	UD-Q5_K_XL measured	Q5_K_M measured	Q4_K_M measured	Q6_K measured	UD-Q3_K_XL estimate
Decode	102.39 tok/s	109.73 tok/s	117.69 tok/s	103.23 tok/s	not measured
Prefill	2761.6 tok/s	2710.8 tok/s	2733.9 tok/s	2623.6 tok/s	not measured
VRAM / card	25.45 GB	24.16 GB	20.84 GB	28.78 GB	16.4 GB (estimate)
VRAM total	25.97 GB	24.68 GB	21.43 GB	29.26 GB	16.4 GB (estimate)
Peak system RAM	37.32 GB	35.83 GB	33.74 GB	40.15 GB	32 GB kit (estimate)
Minimum system RAM needed	48 GB kit (measured · 37.32 GB peak)	48 GB kit (measured · 37.32 GB peak)	48 GB kit (measured · 33.74 GB peak)	48 GB kit (measured · 40.91 / 40.15 GB peak)	32 GB kit (estimate)
RAM needed at full context	48 GB kit (measured · 42.9 GB peak)	48 GB kit (measured · 42.9 GB peak)	48 GB kit (measured · 39.05 GB peak)	48 GB kit (measured · 43.69 GB peak)	32 GB kit (estimate)
Notes	none	none	none	Q6_K single-GPU 4K table cell is 103.23 tok/s from the 23:55 card (the 4K point in the complete Q6_K single-GPU series). The earlier 23:26 card at 82.62 tok/s stays on /results and is not averaged into the cell.	Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

One R9700 · 32K

Q6, Q5, and Q4 on the same 35B file, plus a labeled Q3 estimate. Figures from local desktop run cards.
Metric	UD-Q5_K_XL measured	Q5_K_M measured	Q4_K_M measured	Q6_K measured	UD-Q3_K_XL estimate
Decode	90.52 tok/s	96.21 tok/s	101.88 tok/s	71.19 tok/s	not measured
Prefill	1937.9 tok/s	1902.6 tok/s	1902.1 tok/s	1683 tok/s	not measured
VRAM / card	26.16 GB	24.87 GB	21.55 GB	28.68 GB	17.0 GB (estimate)
VRAM total	26.7 GB	25.39 GB	22.17 GB	29.17 GB	17.0 GB (estimate)
Peak system RAM	37.83 GB	36.46 GB	34.58 GB	44.01 GB	32 GB kit (estimate)
Minimum system RAM needed	48 GB kit (measured · 37.83 GB peak)	48 GB kit (measured · 37.83 GB peak)	48 GB kit (measured · 34.58 GB peak)	48 GB kit (measured · 44.01 GB peak)	32 GB kit (estimate)
RAM needed at full context	48 GB kit (measured · 42.9 GB peak)	48 GB kit (measured · 42.9 GB peak)	48 GB kit (measured · 39.05 GB peak)	48 GB kit (measured · 43.69 GB peak)	32 GB kit (estimate)
Notes	none	none	none	Partly offloaded to DDR5 on one GPU (llama.cpp --fit-target 1024). Decode is not an in-VRAM figure.	Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

One R9700 · 128K

Q6, Q5, and Q4 on the same 35B file, plus a labeled Q3 estimate. Figures from local desktop run cards.
Metric	UD-Q5_K_XL measured	Q5_K_M measured	Q4_K_M measured	Q6_K measured	UD-Q3_K_XL estimate
Decode	66.43 tok/s	69.64 tok/s	72.48 tok/s	54.51 tok/s	not measured
Prefill	942.8 tok/s	940.3 tok/s	942.1 tok/s	800.3 tok/s	not measured
VRAM / card	28.22 GB	26.93 GB	23.61 GB	28.78 GB	18.9 GB (estimate)
VRAM total	28.82 GB	27.43 GB	24.27 GB	29.25 GB	18.9 GB (estimate)
Peak system RAM	40.18 GB	38.65 GB	36.5 GB	45.43 GB	32 GB kit (estimate)
Minimum system RAM needed	48 GB kit (measured · 40.18 GB peak)	48 GB kit (measured · 40.18 GB peak)	48 GB kit (measured · 36.5 GB peak)	48 GB kit (measured · 45.43 GB peak)	32 GB kit (estimate)
RAM needed at full context	48 GB kit (measured · 42.9 GB peak)	48 GB kit (measured · 42.9 GB peak)	48 GB kit (measured · 39.05 GB peak)	48 GB kit (measured · 43.69 GB peak)	32 GB kit (estimate)
Notes	none	none	none	Partly offloaded to DDR5 on one GPU (llama.cpp --fit-target 1024). Decode is not an in-VRAM figure.	Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

One R9700 · 256K

Q6, Q5, and Q4 on the same 35B file, plus a labeled Q3 estimate. Figures from local desktop run cards.
Metric	UD-Q5_K_XL measured	Q5_K_M measured	Q4_K_M measured	Q6_K measured	UD-Q3_K_XL estimate
Decode	44.4 tok/s	40.54 tok/s	47.77 tok/s	37.78 tok/s	not measured
Prefill	519.2 tok/s	541.7 tok/s	558.5 tok/s	471.6 tok/s	not measured
VRAM / card	28.73 GB	28.56 GB	26.36 GB	28.81 GB	21.4 GB (estimate)
VRAM total	29.34 GB	29.15 GB	27.03 GB	29.3 GB	21.4 GB (estimate)
Peak system RAM	42.9 GB	42.79 GB	39.05 GB	43.69 GB	32 GB kit (estimate)
Minimum system RAM needed	48 GB kit (measured · 42.9 GB peak)	48 GB kit (measured · 42.9 GB peak)	48 GB kit (measured · 39.05 GB peak)	48 GB kit (measured · 43.69 GB peak)	32 GB kit (estimate)
RAM needed at full context	48 GB kit (measured · 42.9 GB peak)	48 GB kit (measured · 42.9 GB peak)	48 GB kit (measured · 39.05 GB peak)	48 GB kit (measured · 43.69 GB peak)	32 GB kit (estimate)
Notes	none	none	none	Partly offloaded to DDR5 on one GPU (llama.cpp --fit-target 1024). Decode is not an in-VRAM figure.	Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

Split · short

Q6, Q5, and Q4 on the same 35B file, plus a labeled Q3 estimate. Figures from local desktop run cards.
Metric	UD-Q5_K_XL measured	Q5_K_M measured	Q4_K_M measured	Q6_K measured	UD-Q3_K_XL estimate
Decode	82.78 tok/s	88.19 tok/s	93.28 tok/s	83.5 tok/s	not measured
Prefill	2637.3 tok/s	2647.2 tok/s	2660.4 tok/s	2572.1 tok/s	not measured
VRAM / card	13.28 / 13.11 GB	12.71 / 12.41 GB	10.83 / 10.85 GB	15.01 / 14.63 GB	8.21 GB (estimate)
VRAM total	26.39 GB	25.13 GB	21.69 GB	29.64 GB	16.4 GB (estimate)
Peak system RAM	37.6 GB	37.17 GB	33.74 GB	38.22 GB	32 GB kit (estimate)
Minimum system RAM needed	48 GB kit (measured · 37.6 GB peak)	48 GB kit (measured · 37.6 GB peak)	48 GB kit (measured · 33.74 GB peak)	48 GB kit (measured · 38.22 GB peak)	32 GB kit (estimate)
RAM needed at full context	48 GB kit (measured · 44.71 GB peak)	48 GB kit (measured · 44.71 GB peak)	48 GB kit (measured · 40.84 GB peak)	48 GB kit (measured · 45.15 GB peak)	32 GB kit (estimate)
Notes	none	none	none	none	Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

Split · 32K

Q6, Q5, and Q4 on the same 35B file, plus a labeled Q3 estimate. Figures from local desktop run cards.
Metric	UD-Q5_K_XL measured	Q5_K_M measured	Q4_K_M measured	Q6_K measured	UD-Q3_K_XL estimate
Decode	74.8 tok/s	78.91 tok/s	82.57 tok/s	75.43 tok/s	not measured
Prefill	1916 tok/s	1920.9 tok/s	1933.1 tok/s	1890.7 tok/s	not measured
VRAM / card	13.77 / 13.64 GB	13.2 / 12.95 GB	11.34 / 11.39 GB	15.5 / 15.16 GB	8.49 GB (estimate)
VRAM total	27.41 GB	26.13 GB	22.72 GB	30.66 GB	17.0 GB (estimate)
Peak system RAM	38.16 GB	37.8 GB	34.39 GB	38.98 GB	32 GB kit (estimate)
Minimum system RAM needed	48 GB kit (measured · 38.16 GB peak)	48 GB kit (measured · 38.16 GB peak)	48 GB kit (measured · 34.39 GB peak)	48 GB kit (measured · 38.98 GB peak)	32 GB kit (estimate)
RAM needed at full context	48 GB kit (measured · 44.71 GB peak)	48 GB kit (measured · 44.71 GB peak)	48 GB kit (measured · 40.84 GB peak)	48 GB kit (measured · 45.15 GB peak)	32 GB kit (estimate)
Notes	none	none	none	none	Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

Split · 128K

Q6, Q5, and Q4 on the same 35B file, plus a labeled Q3 estimate. Figures from local desktop run cards.
Metric	UD-Q5_K_XL measured	Q5_K_M measured	Q4_K_M measured	Q6_K measured	UD-Q3_K_XL estimate
Decode	57.94 tok/s	59.86 tok/s	62.12 tok/s	58.04 tok/s	not measured
Prefill	1071.1 tok/s	1067.3 tok/s	1078.4 tok/s	1059.7 tok/s	not measured
VRAM / card	15.47 / 15.48 GB	14.98 / 14.79 GB	13.03 / 13.23 GB	17.21 / 17 GB	9.44 GB (estimate)
VRAM total	30.94 GB	29.76 GB	26.26 GB	34.21 GB	18.9 GB (estimate)
Peak system RAM	41.02 GB	40.73 GB	38.04 GB	41.41 GB	32 GB kit (estimate)
Minimum system RAM needed	48 GB kit (measured · 41.02 GB peak)	48 GB kit (measured · 41.02 GB peak)	48 GB kit (measured · 38.04 GB peak)	48 GB kit (measured · 41.41 GB peak)	32 GB kit (estimate)
RAM needed at full context	48 GB kit (measured · 44.71 GB peak)	48 GB kit (measured · 44.71 GB peak)	48 GB kit (measured · 40.84 GB peak)	48 GB kit (measured · 45.15 GB peak)	32 GB kit (estimate)
Notes	none	none	none	none	Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

Split · 256K

Q6, Q5, and Q4 on the same 35B file, plus a labeled Q3 estimate. Figures from local desktop run cards.
Metric	UD-Q5_K_XL measured	Q5_K_M measured	Q4_K_M measured	Q6_K measured	UD-Q3_K_XL estimate
Decode	42.03 tok/s	42.33 tok/s	42.88 tok/s	42.2 tok/s	not measured
Prefill	671.7 tok/s	664.6 tok/s	673 tok/s	666.2 tok/s	not measured
VRAM / card	17.8 / 17.99 GB	17.45 / 17.3 GB	15.28 / 15.74 GB	19.46 / 19.51 GB	10.7 GB (estimate)
VRAM total	35.74 GB	34.54 GB	31.02 GB	38.96 GB	21.4 GB (estimate)
Peak system RAM	44.71 GB	46.21 GB	40.84 GB	45.15 GB	32 GB kit (estimate)
Minimum system RAM needed	48 GB kit (measured · 44.71 GB peak)	48 GB kit (measured · 44.71 GB peak)	48 GB kit (measured · 40.84 GB peak)	48 GB kit (measured · 45.15 GB peak)	32 GB kit (estimate)
RAM needed at full context	48 GB kit (measured · 44.71 GB peak)	48 GB kit (measured · 44.71 GB peak)	48 GB kit (measured · 40.84 GB peak)	48 GB kit (measured · 45.15 GB peak)	32 GB kit (estimate)
Notes	none	none	none	none	Hugging Face listing for Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf (16.8 GB). Q3 is an option labeled estimate — not a local desktop run.

Card sheet: R9700 measured page · Layout picker: one vs two GPU · quant explainer · calculator

AMDai Lab Notes digest

Email only — no account. Double opt-in. About once a week, and only when run cards, guides, ROCm problems, or Stack Lab actually changed. Not a daily drip. Issues may include one labeled Sponsored mention. Slots and rates: Sponsor.

Topics New measured run cards Official amdai-bench/run@1 cards as they land on /results. Guides and tutorials New or updated getting-started notes, tutorials, and blog posts. ROCm problem updates Cited /rocm-problems rows when status or workaround changes. Stack Lab releases Radeon Stack Lab companion notes — Ubuntu 24.04+, packages not published yet.

Which quant on this 35B?

Nothing matches that filter

One R9700 · short

UD-Q5_K_XL

Q5_K_M

Q4_K_M

Q6_K

UD-Q3_K_XL

One R9700 · 32K

UD-Q5_K_XL

Q5_K_M

Q4_K_M

Q6_K

UD-Q3_K_XL

One R9700 · 128K

UD-Q5_K_XL

Q5_K_M

Q4_K_M

Q6_K

UD-Q3_K_XL

One R9700 · 256K

UD-Q5_K_XL

Q5_K_M

Q4_K_M

Q6_K

UD-Q3_K_XL

Split · short

UD-Q5_K_XL

Q5_K_M

Q4_K_M

Q6_K

UD-Q3_K_XL

Split · 32K

UD-Q5_K_XL

Q5_K_M

Q4_K_M

Q6_K

UD-Q3_K_XL

Split · 128K

UD-Q5_K_XL

Q5_K_M

Q4_K_M

Q6_K

UD-Q3_K_XL

Split · 256K

UD-Q5_K_XL

Q5_K_M

Q4_K_M

Q6_K

UD-Q3_K_XL

One R9700 · short

One R9700 · 32K

One R9700 · 128K

One R9700 · 256K

Split · short

Split · 32K

Split · 128K

Split · 256K

AMDai Lab Notes digest