- Parameters
- 31B / ~3B active
- Quant
- Q8_0
- Size
- 30.0 GB
- Family
- glm
glm-4.7-flash-q8
Measured, not seatedMoEresidentllama.cppmlx
Model card ↗Outcome as of 20 September 2026, from the seat registry. The write-up below was made when the model was tested.
Why it was tested
Tested as a fast MoE with a 202k context window, and as the first model we quantised ourselves for MLX.
What came of it
Weak at abstention: 48.6% nullschema means it invents values on half the cases where a field is absent, and 4-bit costs a further 19 points over 8-bit. But its context behaviour is strong and was initially misjudged here: it holds 131k in 36.42 GB total at 37.2 tok/s. A first assessment predicted 88 GB from its head counts and was wrong by 7x. Good for long-context work that does not depend on declining to answer.
| Suite | Score | 95% interval | Passed | Runtime · profile | Recorded |
|---|---|---|---|---|---|
| grounding | 76.0% | 67.8–82.6 | Passed 95/125 | llama.cppextraction | 2026-08-26 |
| nullschema | 48.6% | 37.4–59.9 | Passed 35/72 | llama.cppextraction | 2026-08-26 |
| screening | 95.0% | 86.3–98.3 | Passed 57/60 | llama.cppextraction | 2026-08-26 |
Runs marked unenforced were measured through mlx_lm on a suite that requires constrained decoding. mlx_lm accepts the schema and ignores it, so those numbers do not measure what the suite is designed to measure. They are kept and labelled rather than deleted.
Every run log entry for this model (5)
| Finished | Suite | Runtime · profile | Score | Coverage | Grader · dataset · config |
|---|---|---|---|---|---|
| nullschemanullschema/1 | llama.cppextraction | 48.6% | Coverage 72/72 | g d7448e0f5fc3f9afd 3b91280bb40372efc 3d836e2b73f9cd77 | |
| screeningscreening/1 | llama.cppextraction | 95.0% | Coverage 60/60 | g 0661b49a10be2d2ad 64c97ca2269c29afc b7d076058290ae5f | |
| groundinggrounding/1 | llama.cppextraction | 76.0% | Coverage 125/125 | g 30b933dcc6a7e2d4d dcb396faf8b83b0ac f7116f1eb6a7f001 | |
| nullschemanullschema/1 | llama.cppextraction | n/a | Coverage 0% coverage | g d7448e0f5fc3f9afd 3b91280bb40372efc 3d836e2b73f9cd77 | |
| screeningscreening/1 | llama.cppextraction | n/a | Coverage 0% coverage | g 0661b49a10be2d2ad 64c97ca2269c29afc b7d076058290ae5f |