Gemma 4 26B A4B
MoE enthusiast25.2B total, 3.8B active per token (MoE: 128 experts, top-8 + 1 shared). Multimodal (text + image). The small-MoE sweet spot - near-4B decode speed with 25B-class quality. NVFP4 (~14GB) needs NVIDIA Blackwell (vLLM) or Apple Silicon (MLX); Q4_K_M (~13GB weights, ~18GB runtime) for Ollama/llama.cpp.
AI-generated content marks
The provider reports that this model does not add embedded watermarks or provenance metadata to generated output.
- 25.2B
- 256k
- other
- πΊπΈ USA
- Apr 2026
Scores
Score per dollar
2000 pts per $/M input
general_score (84) divided by cheapest input price ($0.04/M). Higher is better value. See live pricing.
Related models
Guides covering Gemma 4 26B A4B
Save your hardware and every model page answers the real question: will it run on your machine, and how fast?
Join free - save your rig βRun it locally
Per-quant memory needs and a static "can you run it?" reference - no rig entry required
The reference hardware
22 reference configs, drawn in-house. Scroll for more.
Can you run it? - reference rigs
| Rig | NVFP4 | Q4_K_M | Q8_0 | BF16 |
|---|---|---|---|---|
| NVIDIA Jetson Orin NX 16GB | no -> cloud | tight | no -> cloud | no -> cloud |
| Single GTX 1080 Ti (11GB) | no -> cloud | offload | no -> cloud | no -> cloud |
| 4x H100 80GB (320GB) | no -> cloud | fast 3754.2t/s | fast 1953.5t/s | fast 977.1t/s |
| NVIDIA DGX Station 748GB | no -> cloud | fast 2241.3t/s | fast 1166.3t/s | fast 583.4t/s |
| 8x RTX 3090 rack (192GB) | no -> cloud | fast 2098.3t/s | fast 1091.9t/s | fast 546.1t/s |
| 4x RTX 5090 (128GB) | fast 1865.0t/s | fast 2008.2t/s | fast 1045.0t/s | fast 522.7t/s |
| AMD Instinct MI300X (192GB) | no -> cloud | fast 1491.8t/s | fast 776.3t/s | fast 388.3t/s |
| 4x RTX 4090 (96GB) | no -> cloud | fast 1129.6t/s | fast 587.8t/s | fast 294.0t/s |
| 2x RTX 5090 (64GB) | fast 932.5t/s | fast 1004.1t/s | fast 522.5t/s | fast 261.4t/s |
| 2x RTX 3090 (48GB) | no -> cloud | fast 524.6t/s | fast 273.0t/s | offload |
| Single RTX 5090 (32GB) | fast 466.2t/s | fast 502.1t/s | fast 261.3t/s | offload |
| RTX PRO 6000 Blackwell (96GB) | fast 466.2t/s | fast 502.1t/s | fast 261.3t/s | fast 130.7t/s |
| Mac Studio M4 Ultra 192GB | fast 310.0t/s | fast 333.8t/s | fast 173.7t/s | fast 86.9t/s |
| Mac Studio M4 Ultra 512GB | fast 310.0t/s | fast 333.8t/s | fast 173.7t/s | fast 86.9t/s |
| Single RTX 4090 (24GB) | no -> cloud | fast 282.4t/s | offload | no -> cloud |
| MacBook Pro M5 Max 128GB | fast 174.3t/s | fast 187.7t/s | fast 97.7t/s | fast 48.8t/s |
| Dual EPYC 9004 + 768GB DDR5-4800 | no -> cloud | fast 129.1t/s | fast 67.2t/s | fast 33.6t/s |
| DGX Spark 128GB unified | fast 71.0t/s | fast 76.5t/s | fast 39.8t/s | ok 19.9t/s |
| Ryzen AI Max+ 395 128GB | no -> cloud | fast 71.7t/s | fast 37.3t/s | ok 18.7t/s |
| Jetson AGX Orin 64GB | no -> cloud | fast 57.4t/s | fast 29.9t/s | ok 14.9t/s |
| Epyc + 512GB DDR4-3200 + 2x RTX 3090 | no -> cloud | fast 57.4t/s | fast 29.9t/s | ok 14.9t/s |
| Epyc + 512GB DDR4-2400 + 2x RTX 3090 | no -> cloud | fast 43.0t/s | fast 22.4t/s | ok 11.2t/s |
Fit tiers use the same will-it-run logic as the rig finder. For comfortable fits, the badge reflects decode speed: fast >=20 t/s, ok 8-20 t/s, slow <8 t/s. t/s is a bandwidth estimate, not a measured benchmark.
Download options
Or run it in the cloud
Live per-provider pricing, throughput and uptime - refreshed about 9 hours ago via OpenRouter. Click a column to sort.
| Provider | Type | Input $/M | Output $/M | Cache $/M | Tok/s | Latency | Uptime | Value |
|---|---|---|---|---|---|---|---|---|
|
Darkbloom
|
API | 0.04 | 0.22 | 0.021 | - | - | 100.00% | best uptime |
|
Io Net
|
API | 0.15 | 0.50 | 0.150 | - | - | 100.00% | |
|
Makora
|
API | 0.08 | 0.32 | 0.032 | - | - | 99.99% | |
|
CoreWeave
|
API | 0.10 | 0.30 | 0.050 | - | - | 99.99% | |
|
DekaLLM
|
API | 0.06 | 0.33 | 0.042 | - | - | 99.97% | |
|
Reka
|
API | 0.06 | 0.20 | 0.035 | - | - | 99.95% | |
|
Cloudflare
|
API | 0.10 | 0.30 | 0.042 | - | - | 99.94% | |
|
NextBit
|
API | 0.08 | 0.26 | 0.042 | - | - | 99.93% | |
|
Novita
|
API | 0.13 | 0.40 | 0.042 | - | - | 99.78% | |
|
DeepInfra
|
API | 0.07 | 0.34 | 0.042 | - | - | 99.61% | |
|
Google
|
API | 0.15 | 0.60 | 0.042 | - | - | 99.44% | |
|
Parasail
|
API | 0.13 | 0.40 | 0.050 | - | - | 99.42% | |
|
Venice
|
API | 0.13 | 0.40 | 0.050 | - | - | 99.36% | |
|
SiliconFlow
|
API | 0.14 | 0.40 | 0.050 | - | - | 98.29% |
Default order: throughput among 95%+ uptime providers, then latency; subscriptions last. Sort by any column. Subscription rows show $/mo in the Value column - per-token columns are "-". Affiliate links are marked sponsored / nofollow. Confirm current pricing on the provider's site before committing.
Detailed API pricing page + JSON endpoint β
See who runs Google in production β
Inference cost over time
Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.