Qwen3 32B cost & VRAM calculator
What does Qwen3 32B cost to run for your workload, and can you run it on your own hardware? Set your workload below - we compute per-provider API cost live and tell you honestly whether local hardware can run it.
Your workload
API cost for your workload
| Provider | Rate ($/1M) | Monthly cost |
|---|---|---|
| SiliconFlow | $0.14 in · $0.57 out | $0.0 cheapest |
| Tenstorrent | $0.14 in · $0.40 out · $0.09 cache | $0.0 cheapest |
| DeepInfra avoid | $0.08 in · $0.28 out | $0.0 cheapest |
Monthly cost is an estimate from list prices and your workload - verify against the provider before committing. Cached fraction applies the cache rate to that share of input.
Can you run it locally?
YES - IT RUNS ON HARDWARE YOU CAN BUY
Qwen3 32B fits on individual rigs. Here's the hardware that runs it comfortably; the full per-quant VRAM matrix and tok/s estimates live on the model page.
4x H100 80GB (320GB)
320GB
Q4_K_M
322.3t/s
NVIDIA DGX Station 748GB
748GB
Q4_K_M
192.4t/s
8x RTX 3090 rack (192GB)
192GB
Q4_K_M
180.1t/s
4x RTX 5090 (128GB)
128GB
Q4_K_M
172.4t/s
AMD Instinct MI300X (192GB)
192GB
Q4_K_M
128.1t/s
4x RTX 4090 (96GB)
96GB
Q4_K_M
97.0t/s
2x RTX 5090 (64GB)
64GB
Q4_K_M
86.2t/s
2x RTX 3090 (48GB)
48GB
Q4_K_M
45.0t/s
Single RTX 5090 (32GB)
32GB
Q4_K_M
43.1t/s
RTX PRO 6000 Blackwell (96GB)
96GB
Q4_K_M
43.1t/s
Mac Studio M4 Ultra 192GB
192GB
Q4_K_M
28.7t/s
Mac Studio M4 Ultra 512GB
512GB
Q4_K_M
28.7t/s
Single RTX 4090 (24GB)
24GB
Q4_K_M
24.2t/s
MacBook Pro M5 Max 128GB
128GB
Q4_K_M
16.1t/s
Dual EPYC 9004 + 768GB DDR5-4800
768GB
Q4_K_M
11.1t/s
DGX Spark 128GB unified
128GB
Q4_K_M
6.6t/s
Ryzen AI Max+ 395 128GB
128GB
Q4_K_M
6.2t/s
Jetson AGX Orin 64GB
64GB
Q4_K_M
4.9t/s
Epyc + 512GB DDR4-3200 + 2x RTX 3090
560GB
Q4_K_M
4.9t/s
Epyc + 512GB DDR4-2400 + 2x RTX 3090
560GB
Q4_K_M
3.7t/s
Q4_K_M
20.0GB weights
20.0GB min
22.2GB rec
Q5_K_M
24.5GB weights
24.5GB min
26.7GB rec
Q6_K
28.5GB weights
28.5GB min
31.0GB rec
Q8_0
34.0GB weights
34.0GB min
38.0GB rec
Want the own-vs-rent payback (capex vs your monthly API bill)? The budget tool computes that against representative rigs.