Llama 3.3 70B

Official model card

Parameters

70.6B total

Active 70.6B active

Context

128K tokens

From the official card

License

On the official Hugging Face card

AMDai does not reprint a license string that is not already cited on this site. Read the license on the model’s own card.

Recommended

Q4_K_M

8K · llama.cpp first

Dense 70B, GQA 8×128, full-attention KV on 80 layers. Official card context is 128K tokens.

Official card: meta-llama/Llama-3.3-70B-Instruct · GGUF: bartowski/Llama-3.3-70B-Instruct-GGUF. Abliterated derivatives are educational only — read /abliterated, never the default on this page.

GGUF file sizes

Q6, Q5, and Q4 sizes are cited from the GGUF repo listing. Q3 is a labeled estimate. GB here is the publisher’s decimal listing, not measured VRAM. Q1 and Q2 stay off.

System RAM

Kit sizes are real DIMM steps. Measured peaks come from run cards when we have them; otherwise the line is an estimate. Wherever RAM offload appears, both shopper labels stay on the page.

Speeds

not yet measured on our R9700s. Contribute an amdai-bench/run@1 card, or open Stack Lab doctor. Do not treat calculator GB as tok/s.

not yet measured on our R9700s. Record a card with amdai-bench or open Stack Lab doctor. Other backends on the official card stay secondary.

Configuration table

Q6 / Q5 / Q4, plus Q3 as a labeled estimate. 1 GPU and 2 GPU. Decode, prefill, peak VRAM per card, VRAM total, and peak system RAM come from amdai-bench/run@1 cards when a cell is measured. A null field stays not on the card. Untested cells say no data — contribute or not yet measured on our R9700s. Q1 and Q2 stay off.

Launch commands

llama.cpp first. Strata only where this site already documents it. Flags marked on the recipe stay shape-only. Recommended context is 8K. vLLM, Ollama, and Transformers appear on the official card as secondary paths — they are not the AMDai default.

# Shape only — not a measured local desktop recipe.
./build-vk/bin/llama-server \
  -m ~/models/Llama-3.3-70B-Instruct-Q4_K_M.gguf \
  -ngl 99 \
  -c 8192 \
  --cache-type-k f16 \
  --cache-type-v f16 \
  --host 127.0.0.1 --port 8080

Fit by GPU

Calculator VRAM at the shopper quant, 1 GPU and 2 GPUs (split). The R9700 35B one-card badge is the measured card; other SKUs stay estimates. Speed is not invented here. Offload rows still show both RAM labels on this page.

Compare with…

Head-to-head pages use the same sizes, cited context, and calculator fit already on the model pages. Q3 is a labeled estimate. No invented prices. Llama 3.3 70B against the other cited /models pages:

• Compare models
• vs GLM 5.3 Flash
• vs Qwen3.6-35B

Also: Gemma 3 27B · gpt-oss 20B · Qwen 3.8 Flash · Qwen3.6 27B · Qwen3.8 27B