Models / JEV-35B

The 35B step up in the open decision line. Autotrust’s JEV-35B (weights October 11) is a finetune of Qwen3.5-35B-A3B: a 256-expert MoE that keeps about 3B parameters active per token, scored at 59.73 on the public Decision Index 0.3 suite, ahead of the smaller JEV siblings and aimed at the same job: read a question with up to 256 fixed options, return one label and a probability per option in a single forward pass.

Latency and fit. Median of 184 ms per decision on one B200; the same card runs the model in bf16 with room to move, and a q4 build at roughly 17.5GB of weights plus 80MB of cache per 1,000 tokens (40 layers, 2 KV heads, 256 head dim) fits a 24GB card with real context. Community quants shipped within days (mradermacher), Apache 2.0 means the finetune recipe is inspectable too.

The vision sibling is in the family. On the rebuilt vision benchmarks JEV-35B scored 71.94 against JEV-27B-VL’s 71.67: a tie within noise, so the 35B covers the vision cases without a second model.

decision-model agents classification moe
Parameters
35.0B
Context
262k
License
apache 2.0
Developer
AutoTrust
Origin
🇺🇸 USA
Released
Oct 2026

Related models

Save your hardware and every model page answers the real question: will it run on your machine, and how fast?

Join free - save your rig →

Run it locally

Per-quant memory needs and a static "can you run it?" reference - no rig entry required

Q4_K_M
17.5GB 20.0GB min 24.0GB rec
Balanced - the usual local sweet spot
BF16
70.0GB 72.0GB min 80.0GB rec
Full quality, largest

The reference hardware

Schematic of the NVIDIA Jetson Orin NX 16GB reference rig - 16GB unified memory, 102 GB/s aggregate bandwidth
Schematic of the Single GTX 1080 Ti (11GB) reference rig - 11GB VRAM, 484 GB/s aggregate bandwidth
Schematic of the 4x H100 80GB (320GB) reference rig - 320GB VRAM, 13400 GB/s aggregate bandwidth
Schematic of the NVIDIA DGX Station 748GB reference rig - 748GB unified memory, 8000 GB/s aggregate bandwidth
Schematic of the 8x RTX 3090 rack (192GB) reference rig - 192GB VRAM, 7489 GB/s aggregate bandwidth
Schematic of the 4x RTX 5090 (128GB) reference rig - 128GB VRAM, 7168 GB/s aggregate bandwidth
Schematic of the AMD Instinct MI300X (192GB) reference rig - 192GB VRAM, 5324 GB/s aggregate bandwidth
Schematic of the 4x RTX 4090 (96GB) reference rig - 96GB VRAM, 4032 GB/s aggregate bandwidth
Schematic of the 2x RTX 5090 (64GB) reference rig - 64GB VRAM, 3584 GB/s aggregate bandwidth
Schematic of the 2x RTX 3090 (48GB) reference rig - 48GB VRAM, 1872 GB/s aggregate bandwidth
Schematic of the Single RTX 5090 (32GB) reference rig - 32GB VRAM, 1792 GB/s aggregate bandwidth
Schematic of the RTX PRO 6000 Blackwell (96GB) reference rig - 96GB VRAM, 1792 GB/s aggregate bandwidth
Schematic of the Mac Studio M4 Ultra 192GB reference rig - 192GB unified memory, 1092 GB/s aggregate bandwidth
Schematic of the Mac Studio M4 Ultra 512GB reference rig - 512GB unified memory, 1092 GB/s aggregate bandwidth
Schematic of the Single RTX 4090 (24GB) reference rig - 24GB VRAM, 1008 GB/s aggregate bandwidth
Schematic of the MacBook Pro M5 Max 128GB reference rig - 128GB unified memory, 614 GB/s aggregate bandwidth
Schematic of the Dual EPYC 9004 + 768GB DDR5-4800 reference rig - 768GB unified memory, 460 GB/s aggregate bandwidth
Schematic of the DGX Spark 128GB unified reference rig - 128GB unified memory, 273 GB/s aggregate bandwidth
Schematic of the Ryzen AI Max+ 395 128GB reference rig - 128GB unified memory, 256 GB/s aggregate bandwidth
Schematic of the Jetson AGX Orin 64GB reference rig - 64GB unified memory, 204 GB/s aggregate bandwidth
Schematic of the Epyc + 512GB DDR4-3200 + 2x RTX 3090 reference rig - 560GB unified memory, 204 GB/s aggregate bandwidth
Schematic of the Epyc + 512GB DDR4-2400 + 2x RTX 3090 reference rig - 560GB unified memory, 153 GB/s aggregate bandwidth

22 reference configs, drawn in-house. Scroll for more.

Can you run it? - reference rigs

Rig Q4_K_M BF16
NVIDIA Jetson Orin NX 16GB no -> cloud no -> cloud
Single GTX 1080 Ti (11GB) no -> cloud no -> cloud
4x H100 80GB (320GB) fast 4049.5t/s fast 1166.1t/s
NVIDIA DGX Station 748GB fast 2417.6t/s fast 696.2t/s
8x RTX 3090 rack (192GB) fast 2263.3t/s fast 651.8t/s
4x RTX 5090 (128GB) fast 2166.2t/s fast 623.8t/s
AMD Instinct MI300X (192GB) fast 1609.1t/s fast 463.4t/s
4x RTX 4090 (96GB) fast 1218.5t/s fast 350.9t/s
2x RTX 5090 (64GB) fast 1083.1t/s offload
2x RTX 3090 (48GB) fast 565.8t/s offload
Single RTX 5090 (32GB) fast 541.5t/s no -> cloud
RTX PRO 6000 Blackwell (96GB) fast 541.5t/s fast 156.0t/s
Mac Studio M4 Ultra 192GB fast 360.0t/s fast 103.7t/s
Mac Studio M4 Ultra 512GB fast 360.0t/s fast 103.7t/s
Single RTX 4090 (24GB) fast 304.6t/s no -> cloud
MacBook Pro M5 Max 128GB fast 202.4t/s fast 58.3t/s
Dual EPYC 9004 + 768GB DDR5-4800 fast 139.3t/s fast 40.1t/s
DGX Spark 128GB unified fast 82.5t/s fast 23.8t/s
Ryzen AI Max+ 395 128GB fast 77.4t/s fast 22.3t/s
Jetson AGX Orin 64GB fast 61.9t/s no -> cloud
Epyc + 512GB DDR4-3200 + 2x RTX 3090 fast 61.9t/s ok 17.8t/s
Epyc + 512GB DDR4-2400 + 2x RTX 3090 fast 46.4t/s ok 13.4t/s

Fit tiers use the same will-it-run logic as the rig finder. For comfortable fits, the badge reflects decode speed: fast >=20 t/s, ok 8-20 t/s, slow <8 t/s. t/s is a bandwidth estimate, not a measured benchmark.

Download options

Q4_K_M community
17.5GB dl 20.0GB min 24.0GB rec
REC RAM vs largest quant
17.5GB q4 weights + KV 80MB/1k (40L x 2 kv x 256); 24GB class card holds real context
BF16 official
70.0GB dl 72.0GB min 80.0GB rec
REC RAM vs largest quant
70GB bf16 + KV 80MB/1k; one B200 or any 80GB-class card, the card the card's own latency table uses

Or run it in the cloud

No per-token API provider pricing tracked for JEV-35B yet. For flagship list prices, see the calculator.

PRICE HISTORY

Inference cost over time

Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.

Loading price history...