amdai-bench/run@1 · single · 100K
Qwen 3.8 Flash · UD-Q6_K_XL
Strata v0.1.42 · 2 GPUs · 100,000 tokens
Measured
Verified
Credited to AMDai @amdai · local-desktop verified submitter
2026-10 (date not recorded)
- Prefill
- not measured
- Decode
- 31.8 tok/s
- Aggregate
- not measured
- Peak VRAM
- not measured
- Peak system RAM
- not measured
- Errors · duration
- 0 · not recorded
Hardware
- GPUs in the box
- AMD Radeon AI PRO R9700 32 GB gfx1201 · AMD Radeon AI PRO R9700 32 GB gfx1201
- GPUs used · PCIe
- 2 · not recorded
- CPU
- not recorded
- RAM kit / usable / MT/s
- 256 GB / 249 GB / 5200
- Board · BIOS · ReBAR
- not recorded · not recorded · not recorded
Software
- OS · kernel
- Linux · not recorded
- Backend
- Strata v0.1.42
Model and config
- Repo · file
- unsloth/Qwen3.8-Flash-Next-GGUF · UD-Q6_K_XL (folder)
- File size · sha256
- 169 GB · not recorded
- KV · offload
- f16 · experts to RAM — Two-card Q6 loaded at 262K. Decode measured at 100K.
- Concurrency · prompt / gen
- 1 · not recorded / not recorded
Measured on our rig, 2026-10. Two-card Flash Q6 at 262K load. Strata 31.8 tok/s at 100K.
Launch command
Exact command as recorded. Shape-only lines stay not recorded — we do not invent flags.
# Shape only — exact Strata flags TODO. Recipe strata-flash-q6, no MTP.
# This site’s convention: 127.0.0.1:8083 so llama-server can keep :8080.
curl -s http://127.0.0.1:8083/v1/models