FreshContextA context lab · Fife
Drawing
02 · Benchmarks
Sheet
2 of 3
Rev
A · 2026-10-01

Model← Models

Qwen3-8B

8B dense, Q4_K_M, 4.7 GB.

Parameters
8B
Quant
Q4_K_M
Size
4.7 GB
Family
qwen3
RecordStatus · runtime · seat

qwen3-8b

Measured, not seateddenseresidentllama.cppmlx

Model card ↗

Outcome as of 20 September 2026, from the seat registry. The write-up below was made when the model was tested.

Why it was tested

The small reference and runtime test subject - the only model held in GGUF, MLX-native and BF16 simultaneously, which carried the whole runtime comparison. HumanEval 86.8% strict, beating qwen3.6-35b-a3b by being less verbose.

What came of it

Its August record predates the agentic suites entirely. Measured on them 2026-09-10: 0/60 on toolcall - it answers the schema directly instead of reaching for the tool - while scoring 100% on toolscale. synthesis 83.3% ties the best on the board at 4.7 GB, but worldview 45.0% and nullschema 34.7%. Good at everything except noticing it should ask.

Recorded runs0 scored · 95% intervals

No runs recorded against this identifier.