amdai-bench/run@1 · single · short
Qwen3.6-35B-A3B · INT4-W4A16
vLLM stilldeadcode/vllm-radiance:0.5.8 · 1 GPU · 4,096 tokens
Measured
Verified
Credited to AMDai @amdai · local-desktop verified submitter
2026-10 (date not recorded)
- Prefill
- not measured
- Decode
- not measured
- Aggregate
- not measured
- Peak VRAM
- not measured
- Peak system RAM
- not measured
- Errors · duration
- 0 · not recorded
Hardware
- GPUs in the box
- AMD Radeon AI PRO R9700 32 GB gfx1201 · AMD Radeon AI PRO R9700 32 GB gfx1201
- GPUs used · PCIe
- 1 · not recorded
- CPU
- not recorded
- RAM kit / usable / MT/s
- 256 GB / 249 GB / 5200
- Board · BIOS · ReBAR
- not recorded · not recorded · not recorded
Software
- OS · kernel
- Linux · not recorded
- Backend
- vLLM stilldeadcode/vllm-radiance:0.5.8
Model and config
- Repo · file
- Qwen/Qwen3.6-35B-A3B · INT4-W4A16 (image weights)
- File size · sha256
- not recorded · not recorded
- KV · offload
- not recorded · no RAM offload — vLLM image; used_on_our_rig catalog is false.
- Concurrency · prompt / gen
- 1 · not recorded / not recorded
Estimates
50–61 tok/s
First-party 50–61 tok/s band on one R9700. Better for concurrency and prefill, worse for single-user decode than llama.cpp. Community table r/LocalLLaMA 1viq0pq is cited separately.
Measured on our rig, 2026-10. Band only — no single decode_tps. Image stilldeadcode/vllm-radiance:0.5.8. Exact serve flags not recorded.
Launch command
Exact command as recorded. Shape-only lines stay not recorded — we do not invent flags.
# Image only — exact serve flags not recorded.
# stilldeadcode/vllm-radiance:0.5.8
# This site’s convention: 127.0.0.1:8000