Models / Ornith-1.5-35B-A3B

~36B total, ~3B active per token (MoE) - the local-favorite Ornith-1.5 size, released 2026-08-18. Activates only 3B parameters per token yet outperforms dense models like Gemma 4-31B and Qwen 3.6-35B on agentic coding. 262K context, MIT-licensed on HuggingFace at ornith-ai/Ornith-1.5-35B-A3B (GGUF, FP8, and NVFP4 quantizations).

  • Coding (vendor self-reported): Terminal-Bench 2.1 67.8, SWE-bench Verified 79.0, SWE-bench Pro 59.6, NL2Repo 46.2.
  • Reasoning: HLE 25.6 (no tools) / 33.4 (with tools), GPQA-Diamond 89.2.
  • Agentic: MCP-Atlas 70.2, Toolathlon-Verified 48.7, ClawEval 72.5.

Local-friendly. Runs on enthusiast-class GPUs via GGUF quantizations; a strong open-weight pick for local agentic coding. Vendor benchmarks are claims pending independent replication.

coding reasoning agentic
Parameters
36.0B
Context
262k
License
mit
Developer
Ornith AI
Origin
πŸ‡ΊπŸ‡Έ USA
Released
Aug 2026

Benchmark scores

Vendor-reported - from the developer's own model card / tech report

GPQA-Diamond
89.2
HLE
25.6
MCP-Atlas
70.2
NL2Repo-Bench
46.2
SWE-bench Pro
59.6
SWE-bench Verified
79.0
Terminal-Bench 2.1
67.8
Toolathlon Verified
48.7

Vendor-reported - from the developer's own model card / tech report

Ran this model on your own hardware? Join free and add your measured tok/s to the community numbers.

Related models

Save your hardware and every model page answers the real question: will it run on your machine, and how fast?

Join free - save your rig β†’

Run it locally

Per-quant memory needs and a static "can you run it?" reference - no rig entry required

Q4_K_M
21.7GB 22.0GB min 24.0GB rec
Balanced - the usual local sweet spot
Q5_K_M
25.3GB 26.0GB min 28.0GB rec
High quality, larger than Q4
Q6_K
29.2GB 30.0GB min 32.0GB rec
Near-lossless, large
Q8_0
37.8GB 38.0GB min 42.0GB rec
Near-lossless
BF16
71.1GB 72.0GB min 80.0GB rec
Full quality, largest

The reference hardware

Schematic of the NVIDIA Jetson Orin NX 16GB reference rig - 16GB unified memory, 102 GB/s aggregate bandwidth
Schematic of the Single GTX 1080 Ti (11GB) reference rig - 11GB VRAM, 484 GB/s aggregate bandwidth
Schematic of the 4x H100 80GB (320GB) reference rig - 320GB VRAM, 13400 GB/s aggregate bandwidth
Schematic of the NVIDIA DGX Station 748GB reference rig - 748GB unified memory, 8000 GB/s aggregate bandwidth
Schematic of the 8x RTX 3090 rack (192GB) reference rig - 192GB VRAM, 7489 GB/s aggregate bandwidth
Schematic of the 4x RTX 5090 (128GB) reference rig - 128GB VRAM, 7168 GB/s aggregate bandwidth
Schematic of the AMD Instinct MI300X (192GB) reference rig - 192GB VRAM, 5324 GB/s aggregate bandwidth
Schematic of the 4x RTX 4090 (96GB) reference rig - 96GB VRAM, 4032 GB/s aggregate bandwidth
Schematic of the 2x RTX 5090 (64GB) reference rig - 64GB VRAM, 3584 GB/s aggregate bandwidth
Schematic of the 2x RTX 3090 (48GB) reference rig - 48GB VRAM, 1872 GB/s aggregate bandwidth
Schematic of the Single RTX 5090 (32GB) reference rig - 32GB VRAM, 1792 GB/s aggregate bandwidth
Schematic of the RTX PRO 6000 Blackwell (96GB) reference rig - 96GB VRAM, 1792 GB/s aggregate bandwidth
Schematic of the Mac Studio M4 Ultra 192GB reference rig - 192GB unified memory, 1092 GB/s aggregate bandwidth
Schematic of the Mac Studio M4 Ultra 512GB reference rig - 512GB unified memory, 1092 GB/s aggregate bandwidth
Schematic of the Single RTX 4090 (24GB) reference rig - 24GB VRAM, 1008 GB/s aggregate bandwidth
Schematic of the MacBook Pro M5 Max 128GB reference rig - 128GB unified memory, 614 GB/s aggregate bandwidth
Schematic of the Dual EPYC 9004 + 768GB DDR5-4800 reference rig - 768GB unified memory, 460 GB/s aggregate bandwidth
Schematic of the DGX Spark 128GB unified reference rig - 128GB unified memory, 273 GB/s aggregate bandwidth
Schematic of the Ryzen AI Max+ 395 128GB reference rig - 128GB unified memory, 256 GB/s aggregate bandwidth
Schematic of the Jetson AGX Orin 64GB reference rig - 64GB unified memory, 204 GB/s aggregate bandwidth
Schematic of the Epyc + 512GB DDR4-3200 + 2x RTX 3090 reference rig - 560GB unified memory, 204 GB/s aggregate bandwidth
Schematic of the Epyc + 512GB DDR4-2400 + 2x RTX 3090 reference rig - 560GB unified memory, 153 GB/s aggregate bandwidth

22 reference configs, drawn in-house. Scroll for more.

Can you run it? - reference rigs

Rig Q4_K_M Q5_K_M Q6_K Q8_0 BF16
NVIDIA Jetson Orin NX 16GB no -> cloud no -> cloud no -> cloud no -> cloud no -> cloud
Single GTX 1080 Ti (11GB) no -> cloud no -> cloud no -> cloud no -> cloud no -> cloud
4x H100 80GB (320GB) fast 1815.1t/s fast 1690.2t/s fast 1573.0t/s fast 1364.3t/s fast 901.3t/s
NVIDIA DGX Station 748GB fast 1083.7t/s fast 1009.1t/s fast 939.1t/s fast 814.5t/s fast 538.1t/s
8x RTX 3090 rack (192GB) fast 1014.5t/s fast 944.7t/s fast 879.2t/s fast 762.6t/s fast 503.8t/s
4x RTX 5090 (128GB) fast 971.0t/s fast 904.2t/s fast 841.4t/s fast 729.8t/s fast 482.1t/s
AMD Instinct MI300X (192GB) fast 721.3t/s fast 671.7t/s fast 625.1t/s fast 542.1t/s fast 358.2t/s
4x RTX 4090 (96GB) fast 546.2t/s fast 508.6t/s fast 473.3t/s fast 410.5t/s fast 271.2t/s
2x RTX 5090 (64GB) fast 485.5t/s fast 452.1t/s fast 420.7t/s fast 364.9t/s offload
2x RTX 3090 (48GB) fast 253.6t/s fast 236.2t/s fast 219.8t/s fast 190.6t/s offload
Single RTX 5090 (32GB) fast 242.7t/s fast 226.0t/s fast 210.4t/s offload no -> cloud
RTX PRO 6000 Blackwell (96GB) fast 242.7t/s fast 226.0t/s fast 210.4t/s fast 182.5t/s fast 120.5t/s
Mac Studio M4 Ultra 192GB fast 161.4t/s fast 150.3t/s fast 139.8t/s fast 121.3t/s fast 80.1t/s
Mac Studio M4 Ultra 512GB fast 161.4t/s fast 150.3t/s fast 139.8t/s fast 121.3t/s fast 80.1t/s
Single RTX 4090 (24GB) fast 136.5t/s offload offload offload no -> cloud
MacBook Pro M5 Max 128GB fast 90.7t/s fast 84.5t/s fast 78.6t/s fast 68.2t/s fast 45.1t/s
Dual EPYC 9004 + 768GB DDR5-4800 fast 62.4t/s fast 58.1t/s fast 54.1t/s fast 46.9t/s fast 31.0t/s
DGX Spark 128GB unified fast 37.0t/s fast 34.4t/s fast 32.1t/s fast 27.8t/s ok 18.4t/s
Ryzen AI Max+ 395 128GB fast 34.7t/s fast 32.3t/s fast 30.1t/s fast 26.1t/s ok 17.2t/s
Jetson AGX Orin 64GB fast 27.7t/s fast 25.8t/s fast 24.0t/s fast 20.9t/s no -> cloud
Epyc + 512GB DDR4-3200 + 2x RTX 3090 fast 27.7t/s fast 25.8t/s fast 24.0t/s fast 20.9t/s ok 13.8t/s
Epyc + 512GB DDR4-2400 + 2x RTX 3090 fast 20.8t/s ok 19.4t/s ok 18.0t/s ok 15.6t/s ok 10.3t/s

Fit tiers use the same will-it-run logic as the rig finder. For comfortable fits, the badge reflects decode speed: fast >=20 t/s, ok 8-20 t/s, slow <8 t/s. t/s is a bandwidth estimate, not a measured benchmark.

Download options

Q4_K_M official -5% vs fp16
21.7GB dl 22.0GB min 24.0GB rec
REC RAM vs largest quant
21.7GB Q4_K_M weights + overhead + KV cache; ~22GB to run in RAM
GGUF on HF β†’
Q5_K_M official -3% vs fp16
25.3GB dl 26.0GB min 28.0GB rec
REC RAM vs largest quant
GGUF on HF β†’
Q6_K official -1% vs fp16
29.2GB dl 30.0GB min 32.0GB rec
REC RAM vs largest quant
GGUF on HF β†’
Q8_0 official -1% vs fp16
37.8GB dl 38.0GB min 42.0GB rec
REC RAM vs largest quant
GGUF on HF β†’
BF16 official
71.1GB dl 72.0GB min 80.0GB rec
REC RAM vs largest quant

Or run it in the cloud

No per-token API provider pricing tracked for Ornith-1.5-35B-A3B yet. For flagship list prices, see the calculator.

PRICE HISTORY

Inference cost over time

Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.

Loading price history...