Torchcast Decision 12B
consumerOne more voice in the flood, with the strictest license of the wave. Torchcast Decision 12B is an 11.96B-parameter decision model on the Gemma 4 Unified backbone from torchcast-ai, released October 2, 2026: the same typed-answer contract as its peers (a fixed set of options, one pick, a confidence number), 6.8GB in 4-bit so it lands comfortably on a 16GB card.
The license is the decision. CC BY-NC 4.0 means non-commercial: research, evaluation, hobby rigs, and coursework can run it; anything a business charges for cannot, not without a separate commercial license. Every other open row in the October decision wave (Clef, pplx-decider, GEV, JEV-VL) shipped Apache 2.0, so this is the card whose fine print a deployment checklist catches. The community quantizers published GGUF builds anyway (9,647 downloads on mradermacher’s 12B quant within days); nobody shipping it into a product can keep them there.
Where it sits. Compared with its Apache siblings at 2-4x the size, the interesting question is whether the 12B class earns its memory at all: the honest use is as an evaluation baseline (does a twice-as-small Apache model match it on your routing set?) or as a personal-standalone classifier. Not the default recommendation for production routing.
- 12.0B
- 262k
- cc by nc 4.0
- Torchcast
- 🇺🇸 USA
- Oct 2026
Guides covering Torchcast Decision 12B
Save your hardware and every model page answers the real question: will it run on your machine, and how fast?
Join free - save your rig →Run it locally
Per-quant memory needs and a static "can you run it?" reference - no rig entry required
The reference hardware
22 reference configs, drawn in-house. Scroll for more.
Can you run it? - reference rigs
| Rig | Q4_K_M |
|---|---|
| Single GTX 1080 Ti (11GB) | tight |
| 4x H100 80GB (320GB) | fast 884.1t/s |
| NVIDIA DGX Station 748GB | fast 527.8t/s |
| 8x RTX 3090 rack (192GB) | fast 494.2t/s |
| 4x RTX 5090 (128GB) | fast 472.9t/s |
| AMD Instinct MI300X (192GB) | fast 351.3t/s |
| 4x RTX 4090 (96GB) | fast 266.0t/s |
| 2x RTX 5090 (64GB) | fast 236.5t/s |
| 2x RTX 3090 (48GB) | fast 123.5t/s |
| Single RTX 5090 (32GB) | fast 118.2t/s |
| RTX PRO 6000 Blackwell (96GB) | fast 118.2t/s |
| Mac Studio M4 Ultra 192GB | fast 78.6t/s |
| Mac Studio M4 Ultra 512GB | fast 78.6t/s |
| Single RTX 4090 (24GB) | fast 66.5t/s |
| MacBook Pro M5 Max 128GB | fast 44.2t/s |
| Dual EPYC 9004 + 768GB DDR5-4800 | fast 30.4t/s |
| DGX Spark 128GB unified | ok 18.0t/s |
| Ryzen AI Max+ 395 128GB | ok 16.9t/s |
| Jetson AGX Orin 64GB | ok 13.5t/s |
| Epyc + 512GB DDR4-3200 + 2x RTX 3090 | ok 13.5t/s |
| Epyc + 512GB DDR4-2400 + 2x RTX 3090 | ok 10.1t/s |
| NVIDIA Jetson Orin NX 16GB | slow 6.8t/s |
Fit tiers use the same will-it-run logic as the rig finder. For comfortable fits, the badge reflects decode speed: fast >=20 t/s, ok 8-20 t/s, slow <8 t/s. t/s is a bandwidth estimate, not a measured benchmark.
Download options
Or run it in the cloud
No per-token API provider pricing tracked for Torchcast Decision 12B yet. For flagship list prices, see the calculator.
Inference cost over time
Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.