Models / Jeff

Jev at home, with the receipts to prove it was done at home. Jeff is three open-weight fine-tunes (Qwen3.5-0.8B, Qwen3.5-2B, Gemma4-E2B) that do zero-shot classification in the same request format as Jev: hand them a situation in plain words plus any list of options, hand it a situation and your options, it answers back with a confidence score on each option in one look, about 22 ms on an RTX PRO 6000 and 28 ms on an Apple M4 Max. Apache 2.0, independent project, not affiliated with TypeSafe; the training code starts from their open-source AutoJev recipe.

The benchmark picture, both halves. On the five-benchmark panel the 2B scores 83.1 against Jev’s published 83.0 - a tie - and Financial PhraseBank (96.3 vs 77.0) and RAGTruth (88.9 vs 77.3, tied with the 27B AutoJev) go to Jeff outright. The reasoning-heavy rows do not: BBH 68.0 vs 94.3, WinoGrande 79.0 vs 90.7, and JevBench’s hard tier 53.3 vs 73.3. Zero-shot classification and grounding at 2B match a flagship; reasoning at 2B does not. An early production comparison from an HN commenter landed the other direction entirely: 70% vs Jev’s 94% on their own routing task. Both are true, and the difference is workload: benchmark-typical classification holds, out-of-distribution demands the fine-tune - which the author demonstrates by moving held-out accuracy from 31.7% to 95.8% in under half an hour on one GPU.

Everything in the making was local. Trained on one RTX PRO 6000 (0.8B in ~2 hours, 2B in ~3.5), synthetic training data written by open Qwen3.8-Flash-Next on two DGX Sparks, tested on a MacBook - no cloud GPUs, and no closed-model output in the training data. The training bill is two hours of one workstation GPU. That is the real headline: the recipe is reproducible with the hardware that is already in the house.

Limits, read before deploying. The released models handle at most 26 options per question - options are letter-coded A-Z, and anything past position 26 is effectively never chosen (the server refuses the request; 255-option retraining is in progress). At 0.8B-2B parameters, none of these reason multi-step, for any model in class. And benchmark scores do not predict game play: the model that wins the benchmark suite lost the games to a smaller sibling.

Where this sits in the family map. Jev (TypeSafe) made the decision-model category credible at flagship scale; AutoJev reproduced it open at 27B; GLiNER2.5-Decide covers the CPU-class fixed-schema niche; Jeff is the smallest reproducible end of the spread - a decision model that trains in an evening, ships under 8 GB of RAM, and returns a choice for about nothing. For the routing-and-gating calls that currently burn frontier tokens, the answer is now installable rather than subscribed.

classification routing gating decision-model edge
Parameters
2.0B
Context
262k
License
apache 2.0
Released
Sep 2026

Save your hardware and every model page answers the real question: will it run on your machine, and how fast?

Join free - save your rig →

Run it locally

Per-quant memory needs and a static "can you run it?" reference - no rig entry required

Q4_K_M
1.2GB 1.0GB min 4.0GB rec
Balanced - the usual local sweet spot
BF16
4.2GB 5.0GB min 8.0GB rec
Full quality, largest

The reference hardware

Schematic of the 4x H100 80GB (320GB) reference rig - 320GB VRAM, 13400 GB/s aggregate bandwidth
Schematic of the NVIDIA DGX Station 748GB reference rig - 748GB unified memory, 8000 GB/s aggregate bandwidth
Schematic of the 8x RTX 3090 rack (192GB) reference rig - 192GB VRAM, 7489 GB/s aggregate bandwidth
Schematic of the 4x RTX 5090 (128GB) reference rig - 128GB VRAM, 7168 GB/s aggregate bandwidth
Schematic of the AMD Instinct MI300X (192GB) reference rig - 192GB VRAM, 5324 GB/s aggregate bandwidth
Schematic of the 4x RTX 4090 (96GB) reference rig - 96GB VRAM, 4032 GB/s aggregate bandwidth
Schematic of the 2x RTX 5090 (64GB) reference rig - 64GB VRAM, 3584 GB/s aggregate bandwidth
Schematic of the 2x RTX 3090 (48GB) reference rig - 48GB VRAM, 1872 GB/s aggregate bandwidth
Schematic of the Single RTX 5090 (32GB) reference rig - 32GB VRAM, 1792 GB/s aggregate bandwidth
Schematic of the RTX PRO 6000 Blackwell (96GB) reference rig - 96GB VRAM, 1792 GB/s aggregate bandwidth
Schematic of the Mac Studio M4 Ultra 192GB reference rig - 192GB unified memory, 1092 GB/s aggregate bandwidth
Schematic of the Mac Studio M4 Ultra 512GB reference rig - 512GB unified memory, 1092 GB/s aggregate bandwidth
Schematic of the Single RTX 4090 (24GB) reference rig - 24GB VRAM, 1008 GB/s aggregate bandwidth
Schematic of the MacBook Pro M5 Max 128GB reference rig - 128GB unified memory, 614 GB/s aggregate bandwidth
Schematic of the Single GTX 1080 Ti (11GB) reference rig - 11GB VRAM, 484 GB/s aggregate bandwidth
Schematic of the Dual EPYC 9004 + 768GB DDR5-4800 reference rig - 768GB unified memory, 460 GB/s aggregate bandwidth
Schematic of the DGX Spark 128GB unified reference rig - 128GB unified memory, 273 GB/s aggregate bandwidth
Schematic of the Ryzen AI Max+ 395 128GB reference rig - 128GB unified memory, 256 GB/s aggregate bandwidth
Schematic of the Jetson AGX Orin 64GB reference rig - 64GB unified memory, 204 GB/s aggregate bandwidth
Schematic of the Epyc + 512GB DDR4-3200 + 2x RTX 3090 reference rig - 560GB unified memory, 204 GB/s aggregate bandwidth
Schematic of the Epyc + 512GB DDR4-2400 + 2x RTX 3090 reference rig - 560GB unified memory, 153 GB/s aggregate bandwidth
Schematic of the NVIDIA Jetson Orin NX 16GB reference rig - 16GB unified memory, 102 GB/s aggregate bandwidth

22 reference configs, drawn in-house. Scroll for more.

Can you run it? - reference rigs

Rig Q4_K_M BF16
4x H100 80GB (320GB) fast 6140.4t/s fast 1754.7t/s
NVIDIA DGX Station 748GB fast 3665.9t/s fast 1047.6t/s
8x RTX 3090 rack (192GB) fast 3432.1t/s fast 980.7t/s
4x RTX 5090 (128GB) fast 3284.7t/s fast 938.6t/s
AMD Instinct MI300X (192GB) fast 2440.1t/s fast 697.3t/s
4x RTX 4090 (96GB) fast 1847.6t/s fast 528.0t/s
2x RTX 5090 (64GB) fast 1642.3t/s fast 469.3t/s
2x RTX 3090 (48GB) fast 858.0t/s fast 245.2t/s
Single RTX 5090 (32GB) fast 821.2t/s fast 234.7t/s
RTX PRO 6000 Blackwell (96GB) fast 821.2t/s fast 234.7t/s
Mac Studio M4 Ultra 192GB fast 545.9t/s fast 156.0t/s
Mac Studio M4 Ultra 512GB fast 545.9t/s fast 156.0t/s
Single RTX 4090 (24GB) fast 461.9t/s fast 132.0t/s
MacBook Pro M5 Max 128GB fast 306.9t/s fast 87.7t/s
Single GTX 1080 Ti (11GB) fast 221.8t/s fast 63.4t/s
Dual EPYC 9004 + 768GB DDR5-4800 fast 211.2t/s fast 60.3t/s
DGX Spark 128GB unified fast 125.1t/s fast 35.8t/s
Ryzen AI Max+ 395 128GB fast 117.3t/s fast 33.5t/s
Jetson AGX Orin 64GB fast 93.9t/s fast 26.8t/s
Epyc + 512GB DDR4-3200 + 2x RTX 3090 fast 93.9t/s fast 26.8t/s
Epyc + 512GB DDR4-2400 + 2x RTX 3090 fast 70.4t/s fast 20.1t/s
NVIDIA Jetson Orin NX 16GB fast 46.9t/s ok 13.4t/s

Fit tiers use the same will-it-run logic as the rig finder. For comfortable fits, the badge reflects decode speed: fast >=20 t/s, ok 8-20 t/s, slow <8 t/s. t/s is a bandwidth estimate, not a measured benchmark.

Download options

Q4_K_M community -2% vs fp16
1.2GB dl 1.0GB min 4.0GB rec
REC RAM vs largest quant
BF16 official
4.2GB dl 5.0GB min 8.0GB rec
REC RAM vs largest quant

Or run it in the cloud

No per-token API provider pricing tracked for Jeff yet. For flagship list prices, see the calculator.

PRICE HISTORY

Inference cost over time

Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.

Loading price history...