FreshContextA context lab · Fife
Drawing
02 · Benchmarks
Sheet
2 of 3
Rev
A · 2026-10-01

Qwen3-8B · file← Qwen3-8B

Squish INT8

An 8-bit Squish copy that would not run. Known only from a note. MLX, made here; existence inferred.

Size
not recorded
Status
gone by 2026-09-10; never served
Scored runs
0
ResultsNever scored

This file never completed a scored run. Its record below says why.

The recordHow it was made · how it was served · what went wrong · what happened to it

Rebuilt from the lab's records by Claude, an AI model. The results above come straight from the automated runs. How these pages are made.

Filemodels/Qwen3-8B-int8/ (existence inferred)
FormatSquish INT8
Where frommade with Squish from the BF16 (inferred)
Statusgone by 2026-09-10; never served

How it was made

  • What is on record: the lab's runtime note says Squish INT8 - BLOCKED by an unresolved ImportError in its server subprocess and gives the workaround command ln -sfn models/Qwen3-8B-bf16 models/Qwen3-8B-int8-bf16, so a squished directory models/Qwen3-8B-int8 (Squish's naming: <squished-dir>-bf16 is its config/tokenizer sibling) must have existed. Nothing else survives: no size, no date, no conversion command, no listing.
  • Source: the BF16 safetensors (Qwen3-8B BF16 safetensors (mlx-community)).
  • Existence is inferred; no ls of the directory is on record, and the next evidence (2026-09-07) shows it gone.

How it was served

labeldates (UTC)binary and versionctx / -np / KV / -fa / --jinja / --reasoning-formatharness profilewhy this label exists
none — failed to serve2026-08-11/12Squish (squish-venv)n/anoneattempted INT8 leg of the runtime comparison; server subprocess died on an AutoTokenizer ImportError even with transformers<5

Decisions

  • Dropped when INT8 could not be served; INT3 was used instead (per a lab note).

What went wrong

  • The AutoTokenizer ImportError in Squish's server subprocess (a lab note's changelog, item 7). Cost: the INT8 row of the runtime table; fix: none, INT3 substituted.
  • Standing checks: not applicable.

What happened to it

Made 2026-08-11/12 (inferred) -> failed to serve -> gone by 2026-09-07 -> no RESTORE entry. Not re-creatable without a BF16 download and Squish; command not on record.