FreshContextA context lab · Fife
Drawing
02 · Benchmarks
Sheet
2 of 3
Rev
A · 2026-10-01

Model · measured only← Models

q36-toolparser

1 recorded run. This model has no written entry yet.

Scored runs
1
Run log entries
1
RecordIdentifier

q36-toolparser

Every result below is as recorded. Without a written entry there is no stated reason for the test and no verdict.

Recorded runs1 scored · 95% intervals
SuiteScore95% interval PassedRuntime · profileRecorded
contract0.0%0.0–7.4Passed 0/48llama.cppextraction—

Runs marked unenforced were measured through mlx_lm on a suite that requires constrained decoding. mlx_lm accepts the schema and ignores it, so those numbers do not measure what the suite is designed to measure. They are kept and labelled rather than deleted.

Every run log entry for this model (1)
FinishedSuiteRuntime · profileScoreCoverageGrader · dataset · config
contractcontract/2not recordedextractionn/aCoverage 0% coverageg 486601ba23034dd6d 1fe53d30cb5480f6c 2225a59526198b68