Jev at home, with the receipts to prove it was done at home. Jeff is three open-weight fine-tunes (Qwen3.5-0.8B, Qwen3.5-2B, Gemma4-E2B) that do zero-shot classification in the same request format as Jev: hand them a situation in plain words plus any list of options, hand it a situation and your options, it answers back with a confidence score on each option in one look, about 22 ms on an RTX PRO 6000 and 28 ms on an Apple M4 Max. Apache 2.0, independent project, not affiliated with TypeSafe; the training code starts from their open-source AutoJev recipe.
The benchmark picture, both halves. On the five-benchmark panel the 2B scores 83.1 against Jev’s published 83.0 - a tie - and Financial PhraseBank (96.3 vs 77.0) and RAGTruth (88.9 vs 77.3, tied with the 27B AutoJev) go to Jeff outright. The reasoning-heavy rows do not: BBH 68.0 vs 94.3, WinoGrande 79.0 vs 90.7, and JevBench’s hard tier 53.3 vs 73.3. Zero-shot classification and grounding at 2B match a flagship; reasoning at 2B does not. An early production comparison from an HN commenter landed the other direction entirely: 70% vs Jev’s 94% on their own routing task. Both are true, and the difference is workload: benchmark-typical classification holds, out-of-distribution demands the fine-tune - which the author demonstrates by moving held-out accuracy from 31.7% to 95.8% in under half an hour on one GPU.
Everything in the making was local. Trained on one RTX PRO 6000 (0.8B in ~2 hours, 2B in ~3.5), synthetic training data written by open Qwen3.8-Flash-Next on two DGX Sparks, tested on a MacBook - no cloud GPUs, and no closed-model output in the training data. The training bill is two hours of one workstation GPU. That is the real headline: the recipe is reproducible with the hardware that is already in the house.
Limits, read before deploying. The released models handle at most 26 options per question - options are letter-coded A-Z, and anything past position 26 is effectively never chosen (the server refuses the request; 255-option retraining is in progress). At 0.8B-2B parameters, none of these reason multi-step, for any model in class. And benchmark scores do not predict game play: the model that wins the benchmark suite lost the games to a smaller sibling.
Where this sits in the family map. Jev (TypeSafe) made the decision-model category credible at flagship scale; AutoJev reproduced it open at 27B; GLiNER2.5-Decide covers the CPU-class fixed-schema niche; Jeff is the smallest reproducible end of the spread - a decision model that trains in an evening, ships under 8 GB of RAM, and returns a choice for about nothing. For the routing-and-gating calls that currently burn frontier tokens, the answer is now installable rather than subscribed.
- 2.0B
- 262k
- apache 2.0
- Sep 2026
Save your hardware and every model page answers the real question: will it run on your machine, and how fast?
Join free - save your rig →Run it locally
Per-quant memory needs and a static "can you run it?" reference - no rig entry required
The reference hardware
22 reference configs, drawn in-house. Scroll for more.
Can you run it? - reference rigs
| Rig | Q4_K_M | BF16 |
|---|---|---|
| 4x H100 80GB (320GB) | fast 5097.7t/s | fast 1657.8t/s |
| NVIDIA DGX Station 748GB | fast 3043.4t/s | fast 989.7t/s |
| 8x RTX 3090 rack (192GB) | fast 2849.2t/s | fast 926.6t/s |
| 4x RTX 5090 (128GB) | fast 2726.9t/s | fast 886.8t/s |
| AMD Instinct MI300X (192GB) | fast 2025.7t/s | fast 658.8t/s |
| 4x RTX 4090 (96GB) | fast 1533.9t/s | fast 498.8t/s |
| 2x RTX 5090 (64GB) | fast 1363.4t/s | fast 443.4t/s |
| 2x RTX 3090 (48GB) | fast 712.3t/s | fast 231.6t/s |
| Single RTX 5090 (32GB) | fast 681.7t/s | fast 221.7t/s |
| RTX PRO 6000 Blackwell (96GB) | fast 681.7t/s | fast 221.7t/s |
| Mac Studio M4 Ultra 192GB | fast 453.2t/s | fast 147.4t/s |
| Mac Studio M4 Ultra 512GB | fast 453.2t/s | fast 147.4t/s |
| Single RTX 4090 (24GB) | fast 383.5t/s | fast 124.7t/s |
| MacBook Pro M5 Max 128GB | fast 254.8t/s | fast 82.9t/s |
| Single GTX 1080 Ti (11GB) | fast 184.1t/s | fast 59.9t/s |
| Dual EPYC 9004 + 768GB DDR5-4800 | fast 175.3t/s | fast 57.0t/s |
| DGX Spark 128GB unified | fast 103.9t/s | fast 33.8t/s |
| Ryzen AI Max+ 395 128GB | fast 97.4t/s | fast 31.7t/s |
| Jetson AGX Orin 64GB | fast 77.9t/s | fast 25.3t/s |
| Epyc + 512GB DDR4-3200 + 2x RTX 3090 | fast 77.9t/s | fast 25.3t/s |
| Epyc + 512GB DDR4-2400 + 2x RTX 3090 | fast 58.4t/s | ok 19.0t/s |
| NVIDIA Jetson Orin NX 16GB | fast 39.0t/s | ok 12.7t/s |
Fit tiers use the same will-it-run logic as the rig finder. For comfortable fits, the badge reflects decode speed: fast >=20 t/s, ok 8-20 t/s, slow <8 t/s. t/s is a bandwidth estimate, not a measured benchmark.
Download options
Or run it in the cloud
No per-token API provider pricing tracked for Jeff yet. For flagship list prices, see the calculator.
Inference cost over time
Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.