Can Strix Halo run Gemma 3 27B?

Q6 / Q5 / Q4 plus a Q3 estimate

Weights are official GGUF listings when the model page has them. Totals include KV at f16. 1-GPU and 2-GPU columns use the same calculator as this share URL.

System RAM

The shopper Q4_K_M file stays in 64 GB at 4K. Longer context can still spill. Shopper lines stay Minimum system RAM needed and RAM needed at full context for Q4_K_M on this card. Estimate unless a measured R9700 card overlays the kit.

llama.cpp launch

Vulkan first, then ROCm/HIP. Copy a house recipe when one exists. llama.cpp stays first. Strata / vLLM stay on /backends.

# llama.cpp Vulkan. House pin when a recipe exists; otherwise a shape only.
./build-vk/bin/llama-server \
  -m ~/models/gemma-3-27b-it-Q4_K_M.gguf \
  -ngl 99 \
  -c 262144 \
  --cache-type-k f16 \
  --cache-type-v f16 \
  --host 127.0.0.1 --port 8080

# HIP shape only — house 35B cards are Vulkan. HIP decode is not measured yet.
./build-hip/bin/llama-server \
  -m ~/models/gemma-3-27b-it-Q4_K_M.gguf \
  -ngl 99 \
  -c 262144 \
  --cache-type-k f16 \
  --cache-type-v f16 \
  --host 127.0.0.1 --port 8080

Same model, other cards

Gemma 3 27B on the other published Radeon sheets.

• Gemma 3 27B on R9700
• Gemma 3 27B on PRO W7900
• Gemma 3 27B on PRO W7800
• Gemma 3 27B on PRO W7700
• Gemma 3 27B on PRO W6800
• Gemma 3 27B on RX 7900 XTX
• Gemma 3 27B on RX 7900 XT
• Gemma 3 27B on RX 9070 XT
• Gemma 3 27B on RX 9070
• Gemma 3 27B on RX 9070 GRE
• Gemma 3 27B on RX 9060 XT
• Gemma 3 27B on RX 7900 GRE
• Gemma 3 27B on RX 7800 XT
• Gemma 3 27B on RX 7700 XT
• Gemma 3 27B on RX 7600 XT
• Gemma 3 27B on RX 7600
• Gemma 3 27B on RX 6800 XT
• Gemma 3 27B on RX 6950 XT
• Gemma 3 27B on RX 6700 XT

Other models on Strix Halo

• Qwen3.6-35B
• Qwen 3.8 Flash
• gpt-oss 20B
• Llama 3.3 70B
• GLM 5.3 Flash
• Qwen3.6 27B
• Qwen3.8 27B

Check price

Existing /go/ routes for this GPU sheet. Buttons say Check price — we do not print a figure.

FAQ

Can Strix Halo run Gemma 3 27B?

Fits fully on GPU on the calculator at the shopper Q4_K_M file and 256K. Q6 / Q5 / Q4 are listed. Q3_K_M is a labeled estimate. llama.cpp first.

This pair · Strix Halo · Gemma 3 27B · Calculator

Which quant should I download?

Prefer the shopper Q4_K_M file when it still fits. Q6 / Q5 / Q4 are the listed shopper steps. Q3_K_M is a labeled estimate — not a house pick. Q1/Q2 stay off.

Quants · Q6 / Q5 / Q4 + Q3 estimate

How fast is it?

Measured decode is only the official local desktop 35B llama.cpp Vulkan sweep on one or two R9700s. Every other model × card stays not measured yet. Record a card with amdai-bench.

Contribute · amdai-bench · Benchmarks

Stack Lab

Measure the pair on your box. Doctor and planner are allowlisted. House daily / Flash profiles appear only for those house models.