- Parameters
- 36B / 4B active
- Quant
- Q4_K_M
- Size
- 20.8 GB
- Family
- k2-horizon
k2-horizon-36b-a4b
Seated · agentMoEresidentllama.cpp (k2horizon fork)
Model card ↗Outcome as of 20 September 2026, from the seat registry. The write-up below was made when the model was tested.
Why it was tested
MoVA (Mixture-of-Value Attention) extends sparsity into the value component of attention. 4B active gives it 25 tok/s at 5k where a dense 27B manages 8.6. Ties the top of the board on tool invocation and holds a 200-step chain without deviating.
What came of it
The actor seat. 100% toolcall on all five arms, 36 of 36 adversarial injection attempts thwarted at temperature 0.7 with verified sampling. Weak epistemically: nullschema 54.2% at Q4 (70.8% at Q8, +16.6 for 16 GB), worldview 52.5%. Suggestible rather than unreliable - it takes a plausible wrong value 83% of the time and produced a fabricated citation in production the same day. Do not let it cite unchecked. Native 524,288 context; 131,072 per slot is the measured ceiling on this box.
No runs recorded against this identifier.
- K2-Horizon-3.7B (IFM)Seated · Dispatch
3.7B · dense · Q4_K_M · 2.9 GB
The smallest model measured that perceives tool need. Held at three precisions (Q4/Q8/BF16) which made it the subject of the precision ladder.