FreshContextA context lab · Fife
Drawing
02 · Benchmarks
Sheet
2 of 3
Rev
A · 2026-10-01

Model · measured only← Models

bonsai-27b-mlx2-m4pro

13 recorded runs. This model has no written entry yet.

Scored runs
13
Run log entries
13
RecordIdentifier

bonsai-27b-mlx2-m4pro

Every result below is as recorded. Without a written entry there is no stated reason for the test and no verdict.

Recorded runs13 scored · 95% intervals
SuiteScore95% interval PassedRuntime · profileRecorded
chainwalk0.0%0.0–65.8Passed 0/2mlxagentic-fast2026-09-14
contract75.0%61.2–85.1Passed 36/48mlxextraction2026-09-14
enrichment72.2%59.1–82.4Passed 39/54mlxextraction2026-09-14
epistemics89.6%77.8–95.5Passed 43/48mlxstudy-nothink2026-09-14
groundingunenforced71.2%62.7–78.4Passed 89/125mlxextraction2026-09-14
screening93.3%84.1–97.4Passed 56/60mlxextraction2026-09-14
synthesis66.7%54.1–77.3Passed 40/60mlxextraction2026-09-14
tagger87.9%83.2–91.5Passed 211/240mlxextraction2026-09-14
tagger_nullable89.2%84.6–92.5Passed 214/240mlxextraction2026-09-14
toolcall100.0%94.0–100.0Passed 60/60mlxextraction2026-09-14
tools100.0%79.6–100.0Passed 15/15mlxagentic-fast2026-09-14
toolscale100.0%91.2–100.0Passed 40/40mlxagentic-fast2026-09-14
worldview42.5%28.5–57.8Passed 17/40mlxextraction2026-09-14

Runs marked unenforced were measured through mlx_lm on a suite that requires constrained decoding. mlx_lm accepts the schema and ignores it, so those numbers do not measure what the suite is designed to measure. They are kept and labelled rather than deleted.

Every run log entry for this model (13)
FinishedSuiteRuntime · profileScoreCoverageGrader · dataset · config
tagger_nullabletagger-nullable/1mlxextraction89.2%Coverage 240/240g 04e875431e26c4b5d db3addf23a2bc4cec 29c36e514c29b1c2
taggertagger/2mlxextraction87.9%Coverage 240/240g 63e04d139a0e5ed3d 7ef587bf33e5788ac 821ca1ce68849b25
enrichmentenrichment/3mlxextraction72.2%Coverage 54/54g b51222c2ca38cfdfd 75361864baa727abc e41b038c77c413b8
contractcontract/2mlxextraction75.0%Coverage 48/48g cc2d23c5bae45474d 1fe53d30cb5480f6c 5836be70b11516a5
chainwalkchainwalk/3mlxagentic-fast0.0%Coverage 2/2g f4bfcf6f040b0978d 129a9e74408c8919c 16fb378c7bf6e96a
epistemicsepistemics/4mlxstudy-nothink89.6%Coverage 48/48g acf84972a0ad5f38d 4bce453fd376553cc 3c03af0d96b59518
groundinggrounding/1mlxextraction71.2%Coverage 125/125g 30b933dcc6a7e2d4d dcb396faf8b83b0ac 86fb3d4c7b477c6c
screeningscreening/1mlxextraction93.3%Coverage 60/60g 0661b49a10be2d2ad 64c97ca2269c29afc 4082207a1256c4b6
synthesissynthesis/2mlxextraction66.7%Coverage 60/60g 4156dd3c13361e8bd 267d1954e225c5b6c 14f4738d0f91fc84
worldviewworldview/2mlxextraction42.5%Coverage 40/40g 9acfba1b704feb28d e97835de9e6fc227c a4f61e2b7e694288
toolstools/1mlxagentic-fast100.0%Coverage 15/15g 2763675a5c3da564d 33a44812f0ad4c39c 98ea18969989ee4e
toolscaletoolscale/1mlxagentic-fast100.0%Coverage 40/40g a2bc3751abfa28e0d b24abb108c409178c 52e205dd25e5567b
toolcalltoolcall/1mlxextraction100.0%Coverage 60/60g 804e8fc9457649d8d 10af88c170513155c 8e73d545a7ffd2aa