r9700 · gfx1201 · 1 card
Qwen3.6-35B-A3B
Tested on our rig Q5_K_M llama.cpp short
Sibling Q5 file. Measured on our rig, 2026-10 — 109.73 tok/s short (24.68 GB VRAM). Official llama-bench c060ca974.
Launch
llama.cpp is the consumer default. Strata is the Flash try. Exact extra flags stay not recorded when marked.
llama.cpp · Vulkan flags not recorded
# Shape only — exact flags TODO on stacks.
./build-vk/bin/llama-server \
-m ~/models/Qwen3.6-35B-A3B-Q5_K_M.gguf \
-ngl 99 \
-c 4096 \
--cache-type-k f16 \
--cache-type-v f16 \
--host 127.0.0.1 --port 8080
Gates
Our checklist, in our words — not Sybil’s six-gate wording. Recipe-gate definitions live on methodology. Measured tok/s: How we test.
How we test — measured cells cite run cards; estimates stay labeled.
-
Loads on the named GPU Pass
The process attaches to the discrete card (rocminfo / --list-devices agrees). We do not publish a time-limit SLA.
-
A reply finishes Pass
Generate ends. The server does not hang mid-token. This is not a quality score.
-
Thinking channel (when the model has one) Not measured
A distinct thought block and a final answer both appear. Not measured on our seeded recipes yet.
-
A tool call is used Not measured
The server emits a tool call and consumes the result. Not measured on our seeded recipes yet.
-
Stated context actually ran Not measured
The run used the context we printed (262144 for the daily driver). We do not publish a planted-token recall score.
-
Decode recorded Pass
tok/s at the stated context, sourced. No invented floor.
Host RAM
Kit sizes are estimates unless a Local AI RSS number lands.
Minimum system RAM needed
37.32 GB
Measured · 37.3 GiB raw · 4K context
local-desktop-20261012-2311-35b-udq5kxl-1gpu-4k-llamacpp-f16
RAM needed at full context
42.9 GB
Measured · 42.9 GiB raw · 256K full context
local-desktop-20261012-2314-35b-udq5kxl-1gpu-256k-llamacpp-f16
Measured peak system RAM on the local desktop: 37.32 GB (Linux GiB labeled GB). Measured, pending re-verify after RAM fix.
Breakdown
- Offloaded weights ·
- 0 GiB
- Separable embed in RAM ·
- 0 GiB
- KV in RAM at selected ·
- 0 GiB
- KV in RAM at full context ·
- 0 GiB
- Runtime / backend ·
- 0.77 GiB
- OS / desktop baseline ·
- 8.00 GiB
- Headroom ·
- 16.0 GiB
- Weights
- unsloth/Qwen3.6-35B-A3B-GGUF / Qwen3.6-35B-A3B-Q5_K_M.gguf
- ROCm / override
- not recorded · none
- Proof
- local desktop · 2026-10 · local desktop strata-test report / Local AI measurements
- Decode / prefill
- 109.73 / —
Calculator All recipes r9700 page Model page Stack Lab
If the app is not installed, packages are not published yet. There is no public download URL. Read the Stack Lab install notes . If Stack Lab is already running on this machine, open the local app .
AMDai Lab Notes digest
Email only — no account. Double opt-in. About once a week, and only when run cards, guides, ROCm problems, or Stack Lab actually changed. Not a daily drip. Issues may include one labeled Sponsored mention. Slots and rates: Sponsor.