FreshContextA context lab · Fife
Drawing
02 · Benchmarks
Sheet
2 of 3
Rev
A · 2026-10-01

Qwen3.6-35B-A3B · file← Qwen3.6-35B-A3B

Splash package

A package for the Splash runtime: the fastest this model ran on short requests, but below the quality bar. Incoai, q4 MoE.

Size
19.5 GB
Status
On disk
Scored runs
7
Smallest Mac
36 GB estimate, 8K context
Results7 scored · 95% intervals
SuiteScore95% interval PassedRuntime · profileRecorded
epistemicsqwen3.6-a3b-splash-nothink100.0%92.6–100.0Passed 48/48splashstudy-nothink2026-09-28
groundingqwen3.6-a3b-splash-nothink70.4%61.9–77.7Passed 88/125splashstudy-nothink2026-09-28
nullschemaqwen3.6-a3b-splash-nothink34.7%24.8–46.2Passed 25/72splashstudy-nothink2026-09-28
synthesisqwen3.6-a3b-splash-nothink78.3%66.4–86.9Passed 47/60splashstudy-nothink2026-09-28
toolcallqwen3.6-a3b-splash-nothink56.7%44.1–68.4Passed 34/60splashstudy-nothink2026-09-28
toolscaleqwen3.6-a3b-splash-nothink77.5%62.5–87.7Passed 31/40splashstudy-nothink2026-09-28
worldviewqwen3.6-a3b-splash-nothink40.0%26.3–55.4Passed 16/40splashstudy-nothink2026-09-28

Runs marked unenforced were measured on a suite that requires constrained decoding, on a server shown not to apply the schema: mlx_lm accepts it and ignores it, and a few other servers and models break it. Those numbers do not measure what the suite is designed to measure. They are kept and labelled rather than deleted.

The recordHow it was made · how it was served · what went wrong · what happened to it

Rebuilt from the lab's records by Claude, an AI model. The results above come straight from the automated runs. How these pages are made.

FileHF cache models--incoai--Qwen3.6-35B-A3B-Splash @ 0f4714b2
FormatSplash package, splash-packed-q4-moe (q4/q8, group 64), target 19,541,082,112 B + DFlash2 draft 479,444,992 B + vision 901,939,200 B = 20,922,466,304 B
Where fromdownloaded 2026-09-28 by Splash make install
Statuson disk; benched; "benchmark datapoint only"
Hugging Facehttps://huggingface.co/incoai/Qwen3.6-35B-A3B-Splash

Where it came from

  • Repo: incoai/Qwen3.6-35B-A3B-Splash, snapshot 0f4714b2db37b5f3c42a10de07281e74f88e4adc (HF cache, read 2026-10-23).
  • Command: HF_XET_HIGH_PERFORMANCE=1 make install MODEL=incoai/Qwen3.6-35B-A3B-Splash in builds/splash-m1.
  • Size: 20,922,466,304 B: target 19,541,082,112 + DFlash2 draft 479,444,992 + vision 901,939,200. sha256: not on record; whether make install hash-verified this package is not on record (a lab note says so for the dense package).
  • Format: Splash schema 4 / splash-packed-q4-moe (q4/q8, group 64), with its own trained DFlash 2 draft.
  • Who / why: Alan, after the dense package: "I suppose we have to do the qwen 3.6 too? that's done btw", having said earlier "I'm less interested in 3.6 as I have better models". The assistant's reason: same A3B class as the ornith judgment seat, so it shows what Splash's MoE path could do for that class.

How it was served

labeldates (UTC)port / runtimeflags that matteredharness profilewhy this label exists
(speed only, unlabelled)2026-09-28 10:43Z–10:45ZSplash M1 fork ghaslbe/splash-apple7-m1-kernels-fork @ 6d45618./splash serve --model incoai/Qwen3.6-35B-A3B-Splash --max-memory 28Gdepth-swept SSE protocol, not the harnessspeed arm vs ornith
qwen3.6-a3b-splash-nothink2026-09-28 15:09Z–15:15Zsame--default-reasoning-effort none (Splash ignores chat_template_kwargs.enable_thinking)study-nothink (temperature 0, seed 42, max_tokens 10000)quality battery, seven suites

Harness command: python3.12 -m harness.runner --suite $s --model <server> --model-id incoai/Qwen3.6-35B-A3B-Splash --label qwen3.6-a3b-splash-nothink --profile study-nothink. Run-log runtime splash splash-m1 6d45618 matches git -C builds/splash-m1 log -1 (2026-10-23). Schema enforcement: sentinel probe passed, 0/97 constrained responses violate.

Seats held: none.

Decisions

  • No roster role: "every roster role is quality-gated and it fails the gates its speed would serve", after Alan's "so no place for the a3b then... speeds were juicy".
  • Kept in the HF cache (not swept on 2026-10-11).

What went wrong

  • The thinking leak that voided the first dense battery (qwen3.8-27b-splash) was avoided here by serving with --default-reasoning-effort none from the start.
  • An earlier lab note states that "no same-model llama.cpp comparator for Qwen3.6 exists on the current harness". The UD-Q5_K_M runs on llama.cpp exist (grounding 82.4, nullschema 61.1, screening 86.7, extraction profile).

What happened to it

Downloaded 2026-09-28 → speed arm and quality battery 2026-09-28 → not seated → on disk 2026-10-23 (HF cache, ~20 GB). No RESTORE entry needed. Re-downloadable from incoai/Qwen3.6-35B-A3B-Splash @ 0f4714b2.