Jev at home, with the receipts to prove it was done at home. Jeff is three open-weight fine-tunes (Qwen3.5-0.8B, Qwen3.5-2B, Gemma4-E2B) that do zero-shot classification in the same request format as Jev: hand them a situation in plain words plus any list of options, hand it a situation and your options, it answers back with a confidence score on each option in one look, about 22 ms on an RTX PRO 6000 and 28 ms on an Apple M4 Max. Apache 2.0, independent project, not affiliated with TypeSafe; the training code starts from their open-source AutoJev recipe.
The benchmark picture, both halves. On the five-benchmark panel the 2B scores 83.1 against Jev’s published 83.0 - a tie - and Financial PhraseBank (96.3 vs 77.0) and RAGTruth (88.9 vs 77.3, tied with the 27B AutoJev) go to Jeff outright. The reasoning-heavy rows do not: BBH 68.0 vs 94.3, WinoGrande 79.0 vs 90.7, and JevBench’s hard tier 53.3 vs 73.3. Zero-shot classification and grounding at 2B match a flagship; reasoning at 2B does not. An early production comparison from an HN commenter landed the other direction entirely: 70% vs Jev’s 94% on their own routing task. Both are true, and the difference is workload: benchmark-typical classification holds, out-of-distribution demands the fine-tune - which the author demonstrates by moving held-out accuracy from 31.7% to 95.8% in under half an hour on one GPU.
Everything in the making was local. Trained on one RTX PRO 6000 (0.8B in ~2 hours, 2B in ~3.5), synthetic training data written by open Qwen3.8-Flash-Next on two DGX Sparks, tested on a MacBook - no cloud GPUs, and no closed-model output in the training data. The training bill is two hours of one workstation GPU. That is the real headline: the recipe is reproducible with the hardware that is already in the house.
Limits, read before deploying. The released models handle at most 26 options per question - options are letter-coded A-Z, and anything past position 26 is effectively never chosen (the server refuses the request; 255-option retraining is in progress). At 0.8B-2B parameters, none of these reason multi-step, for any model in class. And benchmark scores do not predict game play: the model that wins the benchmark suite lost the games to a smaller sibling.
Where this sits in the family map. Jev (TypeSafe) made the decision-model category credible at flagship scale; AutoJev reproduced it open at 27B; GLiNER2.5-Decide covers the CPU-class fixed-schema niche; Jeff is the smallest reproducible end of the spread - a decision model that trains in an evening, ships under 8 GB of RAM, and returns a choice for about nothing. For the routing-and-gating calls that currently burn frontier tokens, the answer is now installable rather than subscribed.
- 2.0B
- 262k
- apache 2.0
- Sep 2026
Save your hardware and every model page answers the real question: will it run on your machine, and how fast?
Join free - save your rig →Run it locally
Per-quant memory needs and a static "can you run it?" reference - no rig entry required
The reference hardware
22 reference configs, drawn in-house. Scroll for more.
Can you run it? - reference rigs
| Rig | Q4_K_M | BF16 |
|---|---|---|
| 4x H100 80GB (320GB) | fast 6140.4t/s | fast 1754.7t/s |
| NVIDIA DGX Station 748GB | fast 3665.9t/s | fast 1047.6t/s |
| 8x RTX 3090 rack (192GB) | fast 3432.1t/s | fast 980.7t/s |
| 4x RTX 5090 (128GB) | fast 3284.7t/s | fast 938.6t/s |
| AMD Instinct MI300X (192GB) | fast 2440.1t/s | fast 697.3t/s |
| 4x RTX 4090 (96GB) | fast 1847.6t/s | fast 528.0t/s |
| 2x RTX 5090 (64GB) | fast 1642.3t/s | fast 469.3t/s |
| 2x RTX 3090 (48GB) | fast 858.0t/s | fast 245.2t/s |
| Single RTX 5090 (32GB) | fast 821.2t/s | fast 234.7t/s |
| RTX PRO 6000 Blackwell (96GB) | fast 821.2t/s | fast 234.7t/s |
| Mac Studio M4 Ultra 192GB | fast 545.9t/s | fast 156.0t/s |
| Mac Studio M4 Ultra 512GB | fast 545.9t/s | fast 156.0t/s |
| Single RTX 4090 (24GB) | fast 461.9t/s | fast 132.0t/s |
| MacBook Pro M5 Max 128GB | fast 306.9t/s | fast 87.7t/s |
| Single GTX 1080 Ti (11GB) | fast 221.8t/s | fast 63.4t/s |
| Dual EPYC 9004 + 768GB DDR5-4800 | fast 211.2t/s | fast 60.3t/s |
| DGX Spark 128GB unified | fast 125.1t/s | fast 35.8t/s |
| Ryzen AI Max+ 395 128GB | fast 117.3t/s | fast 33.5t/s |
| Jetson AGX Orin 64GB | fast 93.9t/s | fast 26.8t/s |
| Epyc + 512GB DDR4-3200 + 2x RTX 3090 | fast 93.9t/s | fast 26.8t/s |
| Epyc + 512GB DDR4-2400 + 2x RTX 3090 | fast 70.4t/s | fast 20.1t/s |
| NVIDIA Jetson Orin NX 16GB | fast 46.9t/s | ok 13.4t/s |
Fit tiers use the same will-it-run logic as the rig finder. For comfortable fits, the badge reflects decode speed: fast >=20 t/s, ok 8-20 t/s, slow <8 t/s. t/s is a bandwidth estimate, not a measured benchmark.
Download options
Or run it in the cloud
No per-token API provider pricing tracked for Jeff yet. For flagship list prices, see the calculator.
Inference cost over time
Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.