- Cases
- varies
- Scored runs
- 4
- Models
- 4
- Top score
- 85.5%
SpecificationMethod · grading · caveat
This suite has runs in the record but no entry in the published suite documentation, so there is no stated method, grading rule or caveat to show.
Recorded runs4 runs · sorted by accuracy
Sorted by accuracy. The bar shows the 95 percent confidence interval. Where intervals overlap, the models are not distinguishable on this suite at this number of cases.
Top of the suite minicpm5-2b-exl3 85.5% 95% interval 77.7–90.8
| Model | Score | 95% interval | Passed | Runtime · profile | Recorded |
|---|---|---|---|---|---|
| minicpm5-2b-exl3 | 85.5% | 77.7–90.8 | Passed 94/110 | llama.cppextraction | 2026-09-17 |
| edge0-35b | 62.7% | 53.4–71.2 | Passed 69/110 | llama.cppextraction | 2026-09-18 |
| ornith-9b-kv-f16 | 58.2% | 48.8–67.0 | Passed 64/110 | llama.cppextraction | 2026-09-12 |
| ornith-9b-kv-q40 | 55.5% | 46.1–64.4 | Passed 61/110 | llama.cppextraction | 2026-09-13 |
Run log4 logged runs of this suite
Every logged run, newest first (4)
| Finished | Model | Runtime · profile | Score | Coverage | Grader · dataset · config |
|---|---|---|---|---|---|
| edge0-35b | not recordedextraction | 62.7% | Coverage 110/110 | g c38dec33aa1c86c2d 5c5199b9eee8a595c cc08042253cc6e13 | |
| minicpm5-2b-exl3 | not recordedextraction | 85.5% | Coverage 110/110 | g c38dec33aa1c86c2d 5c5199b9eee8a595c 2b303f0a51347e71 | |
| ornith-9b-kv-q40 | not recordedextraction | 55.5% | Coverage 110/110 | g c38dec33aa1c86c2d 5c5199b9eee8a595c 09bf0b1e19047eb2 | |
| ornith-9b-kv-f16 | not recordedextraction | 58.2% | Coverage 110/110 | g c38dec33aa1c86c2d 5c5199b9eee8a595c 72650e0b4ba22c6c |