YES - IT RUNS ON HARDWARE YOU CAN BUY
Qwen3 235B A22B fits on individual rigs. Here's the hardware that runs it comfortably; the full per-quant VRAM matrix and tok/s estimates live on the
model page.
4x H100 80GB (320GB)
320GB
Q2_K
1156.3t/s
NVIDIA DGX Station 748GB
748GB
Q2_K
690.3t/s
8x RTX 3090 rack (192GB)
192GB
Q2_K
646.3t/s
4x RTX 5090 (128GB)
128GB
Q2_K
618.5t/s
AMD Instinct MI300X (192GB)
192GB
Q2_K
459.5t/s
4x RTX 4090 (96GB)
96GB
Q2_K
347.9t/s
RTX PRO 6000 Blackwell (96GB)
96GB
Q2_K
154.6t/s
Mac Studio M4 Ultra 192GB
192GB
Q2_K
102.8t/s
Mac Studio M4 Ultra 512GB
512GB
Q2_K
102.8t/s
MacBook Pro M5 Max 128GB
128GB
Q2_K
57.8t/s
Dual EPYC 9004 + 768GB DDR5-4800
768GB
Q2_K
39.8t/s
DGX Spark 128GB unified
128GB
Q2_K
23.6t/s
Ryzen AI Max+ 395 128GB
128GB
Q2_K
22.1t/s
Epyc + 512GB DDR4-3200 + 2x RTX 3090
560GB
Q2_K
17.7t/s
Epyc + 512GB DDR4-2400 + 2x RTX 3090
560GB
Q2_K
13.3t/s
Want the own-vs-rent payback (capex vs your monthly API bill)? The
budget tool
computes that against representative rigs.