Models / Gemma 3 4B / Calculator

Gemma 3 4B cost & VRAM calculator

What does Gemma 3 4B cost to run for your workload, and can you run it on your own hardware? Set your workload below - we compute per-provider API cost live and tell you honestly whether local hardware can run it.

Your workload

Casual Power user Team of 5 Codebase task

API cost for your workload

Provider Rate ($/1M) Monthly cost
Parasail $0.04 in · $0.05 out · $0.02 cache $0.0 cheapest
DeepInfra $0.05 in · $0.10 out · $0.02 cache $0.0 cheapest

Monthly cost is an estimate from list prices and your workload - verify against the provider before committing. Cached fraction applies the cache rate to that share of input.

Can you run it locally?

YES - IT RUNS ON HARDWARE YOU CAN BUY

Gemma 3 4B fits on individual rigs. Here's the hardware that runs it comfortably; the full per-quant VRAM matrix and tok/s estimates live on the model page.

4x H100 80GB (320GB) 320GB Q4_K_M
2455.7t/s
NVIDIA DGX Station 748GB 748GB Q4_K_M
1466.1t/s
8x RTX 3090 rack (192GB) 192GB Q4_K_M
1372.5t/s
4x RTX 5090 (128GB) 128GB Q4_K_M
1313.6t/s
AMD Instinct MI300X (192GB) 192GB Q4_K_M
975.8t/s
4x RTX 4090 (96GB) 96GB Q4_K_M
738.9t/s
2x RTX 5090 (64GB) 64GB Q4_K_M
656.8t/s
2x RTX 3090 (48GB) 48GB Q4_K_M
343.1t/s
Single RTX 5090 (32GB) 32GB Q4_K_M
328.4t/s
RTX PRO 6000 Blackwell (96GB) 96GB Q4_K_M
328.4t/s
Mac Studio M4 Ultra 192GB 192GB Q4_K_M
218.3t/s
Mac Studio M4 Ultra 512GB 512GB Q4_K_M
218.3t/s
Single RTX 4090 (24GB) 24GB Q4_K_M
184.7t/s
MacBook Pro M5 Max 128GB 128GB Q4_K_M
122.8t/s
Single GTX 1080 Ti (11GB) 11GB Q4_K_M
88.7t/s
Dual EPYC 9004 + 768GB DDR5-4800 768GB Q4_K_M
84.5t/s
DGX Spark 128GB unified 128GB Q4_K_M
50.0t/s
Ryzen AI Max+ 395 128GB 128GB Q4_K_M
46.9t/s
Jetson AGX Orin 64GB 64GB Q4_K_M
37.5t/s
Epyc + 512GB DDR4-3200 + 2x RTX 3090 560GB Q4_K_M
37.5t/s
Epyc + 512GB DDR4-2400 + 2x RTX 3090 560GB Q4_K_M
28.2t/s
NVIDIA Jetson Orin NX 16GB 16GB Q4_K_M
18.8t/s
Q4_K_M
3.0GB weights 3.0GB min 3.5GB rec
Q8_0
5.0GB weights 5.0GB min 5.5GB rec

Want the own-vs-rent payback (capex vs your monthly API bill)? The budget tool computes that against representative rigs.

Full model card API pricing table Generic token calculator