Gated DeltaNet linear attention + full attention, native vision, 262K context, and zero refusals — on Apple Silicon via MLX. Pick a quant, copy a command, run it.
The repo is gated — sign in on Hugging Face, accept the terms, then hf auth login.
The server exposes an OpenAI-compatible endpoint at http://localhost:8080/v1.
Vision: add --image path/to/image.png to mlx_vlm generate.
Only the language-model linear layers are quantized (affine, group size 64). The vision tower, norms and conv layers stay BF16. All builds verified by generation on GPU; refusal probes return 0 refusals on 4/6/8-bit.
hidden 5120 · 24 attn heads · 4 KV heads · 17408 intermediate · conv kernel 4 · MTP (1 layer) · 248,320 vocab