Model · measured only← Models
flint-q4_1-np4-b11846
4 run log entries, none with a scored result. This model has no written entry yet.
- Scored runs
- 0
- Run log entries
- 4
- File
- 26.0 GB
- Needs
- 26.4 GB measured, 64K context
- Smallest Mac
- 36 GB
RecordIdentifier
flint-q4_1-np4-b11846
Every result below is as recorded. Without a written entry there is no stated reason for the test and no verdict.
SetupHow it was run
Stopped
Stopped part-way. Its partial suites are in the run log and aren't scored.
The run’s own note: Stopped after about 5 minutes: 16K per request is below the 64K Hermes needs, so the single-slot rule replaced it. Partial suites only; not scored as results.
- Server
- 4 slots, 16K of context per request, KV cache q4_0, flash attention on, 4 suites at a time
- Runtime
- llama.cpp b11846 (1a24df163), plain upstream
- Speed
- not recorded
- Peak memory
- 24.3 GB resident, with 64K of context allocated
- Weights
- 26.0 GB file · sha256
43c07baccdba42eb… - Coherence check
- not recorded
- Left out by plan
- none
- Machine
- Mac Studio (M1 Max, 64 GB)
- Released
- 24 October 2026, bundle
2026-10-24-80653652
Recorded runs0 scored · 95% intervals
No runs recorded against this identifier.
Every run log entry for this model (4)
| Finished | Suite | Runtime · profile | Score | Coverage | Grader · dataset · config |
|---|---|---|---|---|---|
| taggertagger/2 | llama.cppextraction | 54.2% | Coverage 10% coverage | g 63e04d139a0e5ed3d 7ef587bf33e5788ac fcbc238912075840 | |
| needleneedle/1 | llama.cppextraction | 85.7% | Coverage 6.4% coverage | g c38dec33aa1c86c2d 5c5199b9eee8a595c d4b82caabaad3205 | |
| tagger_nullabletagger-nullable/1 | llama.cppextraction | 57.1% | Coverage 11.7% coverage | g 04e875431e26c4b5d db3addf23a2bc4cec 5dd5624f007db447 | |
| groundinggrounding/1 | llama.cppextraction | 66.1% | Coverage 44.8% coverage | g 30b933dcc6a7e2d4d dcb396faf8b83b0ac 48d85d169f54be82 |