- Scored runs
- 9
- Run log entries
- 9
RecordIdentifier
gemma4-e4b
Every result below is as recorded. Without a written entry there is no stated reason for the test and no verdict.
Recorded runs9 scored · 95% intervals
| Suite | Score | 95% interval | Passed | Runtime · profile | Recorded |
|---|---|---|---|---|---|
| chainwalk | 0.0% | 0.0–65.8 | Passed 0/2 | llama.cppagentic-fast | 2026-08-24 |
| enrichment | 70.4% | 57.2–80.9 | Passed 38/54 | llama.cppstudy-nothink | 2026-08-24 |
| epistemics | 97.9% | 89.1–99.6 | Passed 47/48 | llama.cppstudy-nothink | 2026-08-24 |
| grounding | 62.4% | 53.7–70.4 | Passed 78/125 | llama.cppextraction | 2026-08-24 |
| nullschema | 13.9% | 7.7–23.7 | Passed 10/72 | llama.cppextraction | 2026-08-24 |
| screening | 93.3% | 84.1–97.4 | Passed 56/60 | llama.cppextraction | 2026-08-24 |
| tagger | 45.4% | 41.0–49.9 | Passed 218/480 | llama.cppstudy-nothink | — |
| tools | 100.0% | 79.6–100.0 | Passed 15/15 | llama.cppagentic-fast | 2026-08-24 |
| toolscale | 100.0% | 91.2–100.0 | Passed 40/40 | llama.cppagentic-fast | 2026-08-24 |
Runs marked unenforced were measured through mlx_lm on a suite that requires constrained decoding. mlx_lm accepts the schema and ignores it, so those numbers do not measure what the suite is designed to measure. They are kept and labelled rather than deleted.
Every run log entry for this model (9)
| Finished | Suite | Runtime · profile | Score | Coverage | Grader · dataset · config |
|---|---|---|---|---|---|
| screeningscreening/1 | llama.cppextraction | 93.3% | Coverage 60/60 | g 0661b49a10be2d2ad 64c97ca2269c29afc 824bef7dab174615 | |
| nullschemanullschema/1 | llama.cppextraction | 13.9% | Coverage 72/72 | g d7448e0f5fc3f9afd 3b91280bb40372efc addbcab5facddd0b | |
| groundinggrounding/1 | llama.cppextraction | 62.4% | Coverage 125/125 | g 30b933dcc6a7e2d4d dcb396faf8b83b0ac 267624907124ed7e | |
| toolscaletoolscale/1 | llama.cppagentic-fast | 100.0% | Coverage 40/40 | g 1bae1f3e1b606eaed b24abb108c409178c 64d002411f012d3c | |
| enrichmentenrichment/3 | llama.cppstudy-nothink | 70.4% | Coverage 54/54 | g 7d661b93852b5ffdd 75361864baa727abc 60945fac08964a72 | |
| epistemicsepistemics/4 | llama.cppstudy-nothink | 97.9% | Coverage 48/48 | g 2a2f7e4e90d6dd63d 4bce453fd376553cc 37147fa352af2d7a | |
| chainwalkchainwalk/2 | llama.cppagentic-fast | 0.0% | Coverage 2/2 | g 48abd22e0117fddad 129a9e74408c8919c 8e18e895c23f4485 | |
| toolstools/1 | llama.cppagentic-fast | 100.0% | Coverage 15/15 | g d6a32c09e57bea7bd 33a44812f0ad4c39c 50b166f799c52d51 | |
| taggertagger/2 | llama.cppstudy-nothink | 90.8% | Coverage 50% coverage | g 28983856e4bf2dd9d 7ef587bf33e5788ac 60e6c55236269057 |