local desktop · 2026-10-13
Flash as a daily driver
Qwen 3.8 Flash (Qwen/Qwen3.8-Flash-Next) from unsloth/Qwen3.8-Flash-Next-GGUF. Full context 262,144 tokens. RAM is Linux GiB labeled GB, against a 256 GB kit (about 249 usable).
Visible factor
DDR5 speed moves Flash
Same two-card Q6, same 262K. Only the DIMM clock changes for the llama.cpp pair. Strata prefill at 5200 is the unexplained regression.
| Engine | DDR5 | 8K | 32K | 100K | Trust |
|---|---|---|---|---|---|
| Strata v0.1.42 | 5200 | 32.8 tok/s | 32.8 tok/s | 31.8 tok/s | Measured on our rig, 2026-10 |
| llama.cpp | 5200 | 18.5 tok/s | 18.2 tok/s | 17.9 tok/s | Measured on our rig, 2026-10 |
| llama.cpp | 3600 | 15.9 tok/s | 15.6 tok/s | 15.3 tok/s | Measured on our rig, 2026-10 |
| Strata prefill | 5200 vs 3600 | Strata prefill drops 9–20% at DDR5-5200 versus 3600. Unexplained. | Measured on our rig, 2026-10 | ||
Strata ~32.6 tok/s vs llama.cpp ~16 on Flash Q6 (Measured on our rig, 2026-10). A different run from the 32.8 / 31.8 two-card points.
Estimate · file size + KV
VRAM plus DDR5 offload at 262K
Q3 and Q5 RAM is publisher file size plus KV math — labeled estimate. Q4 uses the ~111 GB UD-Q4_K_XL listing. Q6 uses the ~169 GB folder. Minimum system RAM and RAM-at-full-context come from the same calculator as /calculator. Kit: 256 GB · about 249 GB usable.
Two R9700s · 64 GB VRAM
two AMD Radeon AI PRO R9700 32 GB (64 GB VRAM). Split pool. Every GiB column is an estimate.
| Quant | File | Weights | KV · 262K | Offload | Min RAM kit | RAM at 262K | Decode |
|---|---|---|---|---|---|---|---|
| UD-Q3_K_XL | 90 GB | 83.8 GB est. | 7.61 GB est. | 19.8 GB est. | 64 GB | 64 GB | not measured on the local desktop |
| UD-Q4_K_XL | 111 GB | 103.4 GB est. | 7.61 GB est. | 39.4 GB est. | 96 GB | 96 GB | not measured on the local desktop |
| UD-Q5_K_XL | 158.3 GB | 147.4 GB est. | 7.61 GB est. | 83.4 GB est. | 128 GB | 128 GB | not measured on the local desktop |
| UD-Q6_K_XL | 169 GB | 157.4 GB est. | 7.61 GB est. | 93.4 GB est. | 192 GB | 192 GB | 32.8 / 31.8 tok/s · measured |
One R9700 · 32 GB VRAM
one AMD Radeon AI PRO R9700 32 GB. More of the file lands on DDR5. Every GiB column is an estimate.
| Quant | File | Weights | KV · 262K | Offload | Min RAM kit | RAM at 262K | Decode |
|---|---|---|---|---|---|---|---|
| UD-Q3_K_XL | 90 GB | 83.8 GB est. | 7.61 GB est. | 51.8 GB est. | 96 GB | 96 GB | not measured on the local desktop at this card count |
| UD-Q4_K_XL | 111 GB | 103.4 GB est. | 7.61 GB est. | 71.4 GB est. | 128 GB | 128 GB | not measured on the local desktop at this card count |
| UD-Q5_K_XL | 158.3 GB | 147.4 GB est. | 7.61 GB est. | 115.4 GB est. | 192 GB | 192 GB | not measured on the local desktop at this card count |
| UD-Q6_K_XL | 169 GB | 157.4 GB est. | 7.61 GB est. | 125.4 GB est. | 192 GB | 192 GB | not measured on the local desktop at this card count |
Linux GiB labeled GB. Raw host-RAM estimate includes offloaded weights, KV that missed VRAM, runtime overhead, 8 GB OS/desktop, and 16 GB headroom, then rounds up to a DIMM kit.
UD-Q3_K_XL · two cards · estimate
Minimum system RAM needed
64 GB kit
Estimate · 54.0 GiB raw · 256K context
RAM needed at full context
64 GB kit
Estimate · 54.0 GiB raw · 256K full context
Estimate. Offloaded weights + KV in RAM + runtime + OS/desktop + headroom, rounded up to a 64 GB DIMM kit.
Breakdown
- Offloaded weights ·
- 19.8 GiB
- Separable embed in RAM ·
- 0 GiB
- KV in RAM at selected ·
- 7.61 GiB
- KV in RAM at full context ·
- 7.61 GiB
- Runtime / backend ·
- 2.53 GiB
- OS / desktop baseline ·
- 8.00 GiB
- Headroom ·
- 16.0 GiB
UD-Q4_K_XL · two cards · estimate
Minimum system RAM needed
96 GB kit
Estimate · 73.9 GiB raw · 256K context
RAM needed at full context
96 GB kit
Estimate · 73.9 GiB raw · 256K full context
Estimate. Offloaded weights + KV in RAM + runtime + OS/desktop + headroom, rounded up to a 96 GB DIMM kit.
Breakdown
- Offloaded weights ·
- 39.4 GiB
- Separable embed in RAM ·
- 0 GiB
- KV in RAM at selected ·
- 7.61 GiB
- KV in RAM at full context ·
- 7.61 GiB
- Runtime / backend ·
- 2.92 GiB
- OS / desktop baseline ·
- 8.00 GiB
- Headroom ·
- 16.0 GiB
UD-Q5_K_XL · two cards · estimate
Minimum system RAM needed
128 GB kit
Estimate · 118.8 GiB raw · 256K context
RAM needed at full context
128 GB kit
Estimate · 118.8 GiB raw · 256K full context
Estimate. Offloaded weights + KV in RAM + runtime + OS/desktop + headroom, rounded up to a 128 GB DIMM kit.
Breakdown
- Offloaded weights ·
- 83.4 GiB
- Separable embed in RAM ·
- 0 GiB
- KV in RAM at selected ·
- 7.61 GiB
- KV in RAM at full context ·
- 7.61 GiB
- Runtime / backend ·
- 3.80 GiB
- OS / desktop baseline ·
- 8.00 GiB
- Headroom ·
- 16.0 GiB
UD-Q6_K_XL · two cards · estimate
Minimum system RAM needed
192 GB kit
Estimate · 129.0 GiB raw · 256K context
RAM needed at full context
192 GB kit
Estimate · 129.0 GiB raw · 256K full context
Estimate. Offloaded weights + KV in RAM + runtime + OS/desktop + headroom, rounded up to a 192 GB DIMM kit. The local desktop ships 256 GB DDR5; measured host-RAM usage is not recorded until Local AI numbers arrive.
Breakdown
- Offloaded weights ·
- 93.4 GiB
- Separable embed in RAM ·
- 0 GiB
- KV in RAM at selected ·
- 7.61 GiB
- KV in RAM at full context ·
- 7.61 GiB
- Runtime / backend ·
- 4.00 GiB
- OS / desktop baseline ·
- 8.00 GiB
- Headroom ·
- 16.0 GiB
Community · not measured on the local desktop
Q3 and Q5 speeds we did not run
Q3 and Q5 decode on this page is only what other people posted. IQ3_S is not UD-Q3_K_XL. We do not invent a Q5 tok/s.
-
Q3 · not measured on the local desktop · 2026-10-08
IQ3_S, not UD-Q3_K_XL. Official Strata PR #1638 on one 32 GB R9700, frozen 0.1.40.3, 2026-10-08.
decode 101.9 tok/s at 1K, 96.4 at 4K, 95.6 at 32K, 87.6 at 128K
-
Q3 · not measured on the local desktop · 2026-10-09
IQ3_S tuned port on one R9700, Ryzen 9 5900X, 128 GiB RAM, 2026-10-09.
tuned output 46.54–57.22 tok/s across the posted workloads
-
Q4 · not measured on the local desktop · 2026-10-10
UD-Q4_K_XL on NVIDIA RTX PRO 6000 96 GB, Strata, INT8 KV, 256K, MTP-4. Not an R9700.
185.8 tok/s prose decode
-
Q5 · not measured on the local desktop · retrieved 2026-10-13
No cited community decode for Flash UD-Q5_K_XL as of 2026-10-13.
No cited tok/s.
Overnight results.json
Space for overnight results.json rows. Empty until that file lands.
Empty
No overnight results.json rows yet. This slot stays reserved so a drop-in file can fill the table without a layout rewrite.
Sources
- Unsloth — Qwen3.8-Flash-Next (UD-Q4_K_XL 111.3 GB, UD-Q5_K_XL 158.3 GB) · retrieved 2026-10-13
- Hugging Face — UD-Q4_K_XL folder (111 GB) · retrieved 2026-10-13
- Hugging Face — UD-Q5_K_XL folder (158 GB) · retrieved 2026-10-13
- Hugging Face — Qwen3.8-Flash-Next-GGUF · retrieved 2026-10-13
- llmhardware.io — UD-Q4_K_XL shard sum 111.33 GB · 2026-10-09
- Strata PR #1638 — one R9700 IQ3_S · 2026-10-08
- lcchan0525sg — R9700 IQ3_S tuned rates · 2026-10-09
- r/LocalLLaMA mirror — Strata UD-Q4_K_XL on RTX PRO 6000 · 2026-10-10