Measured
Verified
Credited to AMDai @amdai · local-desktop verified submitter
2026-10 (date not recorded)
- Prefill
- not measured
- Decode
- 16 tok/s
- Aggregate
- not measured
- Peak VRAM
- not measured
- Peak system RAM
- not measured
- Errors · duration
- 0 · not recorded
Hardware
- GPUs in the box
- AMD Radeon AI PRO R9700 32 GB gfx1201 · AMD Radeon AI PRO R9700 32 GB gfx1201
- GPUs used · PCIe
- 2 · not recorded
- CPU
- not recorded
- RAM kit / usable / MT/s
- 256 GB / 249 GB / 5200
- Board · BIOS · ReBAR
- not recorded · not recorded · not recorded
Software
- OS · kernel
- Linux · not recorded
- Backend
- llama.cpp
Model and config
- Repo · file
- unsloth/Qwen3.8-Flash-Next-GGUF · UD-Q6_K_XL (folder)
- File size · sha256
- 169 GB · not recorded
- KV · offload
- f16 · experts to RAM — Publisher folder ~169 GB — expect RAM to hold most of it on one 32 GB card.
- Concurrency · prompt / gen
- 1 · not recorded / not recorded
Measured on our rig, 2026-10. Prior first-party Flash Q6: llama.cpp ~16 tok/s versus Strata ~32.6. Card count was not published; recorded on the two-R9700 host.
Launch command
Exact command as recorded. Shape-only lines stay not recorded — we do not invent flags.
# Shape only — exact flags TODO on stacks.
./build-vk/bin/llama-server \
-m ~/models/UD-Q6_K_XL \
-ngl 99 \
-c 262144 \
--cache-type-k f16 \
--cache-type-v f16 \
--host 127.0.0.1 --port 8080