Granite Guardian 4.1 8B · file← Granite Guardian 4.1 8B
MLX bf16
An MLX copy with no rounding, as the control. Deleted the same day. Unquantised conversion, made here.
- Size
- 16.0 GB
- Status
- Deleted 9 Sep 2026
- Scored runs
- 1
- Smallest Mac
- 32 GB estimate, 8K context
| Suite | Score | 95% interval | Passed | Runtime · profile | Recorded |
|---|---|---|---|---|---|
| screeninggranite-guardian-4.1-8b-mlx-bf16 | 98.3% | 91.1–99.7 | Passed 59/60 | mlx_lmextraction | 2026-09-09 |
Runs marked unenforced were measured on a suite that requires constrained decoding, on a server shown not to apply the schema: mlx_lm accepts it and ignores it, and a few other servers and models break it. Those numbers do not measure what the suite is designed to measure. They are kept and labelled rather than deleted.
Rebuilt from the lab's records by Claude, an AI model. The results above come straight from the automated runs. How these pages are made.
| File | granite-guardian-4.1-8b-mlx-bf16/ |
| Format | MLX, no quantisation, 16 GB by du |
| Where from | made here 2026-09-09 ~12:49Z |
| Status | deleted 2026-09-09 14:08Z |
How it was made
- Input: the safetensors in the HF cache (Granite Guardian 4.1 8B BF16 safetensors (IBM, HF cache)).
- Command:
mlx-venv/bin/python -m mlx_lm convert --hf-path ibm-granite/granite-guardian-4.1-8b \
--mlx-path models/granite-guardian-4.1-8b-mlx-bf16(no -q: unquantised; the source dtype is bfloat16, so the label "fp16" in the script name is loose).
- Tool: mlx_lm in
mlx-venv(run log: 0.31.3, recorded later from the venv). - Date: 2026-09-09 ~12:49Z. Size: 16 GB by du; exact bytes not recorded.
- Who asked: Alan, "can we do an fp16 -> mlx test, also omlx has native kernels for various model families, without them it defaults to generic implementation".
How it was served
| label | dates (UTC) | binary and version | flags | harness profile | why this label exists |
|---|---|---|---|---|---|
granite-guardian-4.1-8b-mlx-bf16 | 2026-09-09 ~12:50Z–12:54Z | mlx-venv/bin/python -m mlx_lm server --model <path> | defaults | extraction | the fp16 control. Command passed --label guardian-bf16-mlxlm; results were filed under the path-derived name, and the run-log label is a later rename |
No seat.
Decisions
- Made as the no-quantisation control; equal to 8-bit (59/60), so "no measurable conversion cost and no 8-bit cost".
- Deleted 2026-09-09 14:08Z with the 8-bit.
What went wrong
- Label not honoured (see Served as).
What happened to it
Converted 2026-09-09 ~12:49Z → benched → deleted 2026-09-09 14:08Z. No RESTORE entry. Re-creatable from the HF-cache safetensors.