Skip to content

M3 Ultra 512GB

116 models / sorted by best_quality

Runs comfortably
GLM-5.3-Flash UD-IQ1_S Unsloth
93.1GB 1000k ctx
FIT Runs comfortably
SPEED 94 tok/s
ⓘ estimated
MEMORY 93/512GB
GLM-5.3-Flash UD-Q2_K_XL Unsloth
109.0GB 1000k ctx
FIT Runs comfortably
SPEED 80 tok/s
ⓘ estimated
MEMORY 109/512GB
GLM-5.3-Flash UD-IQ3_XXS Unsloth
120.0GB 1000k ctx
FIT Runs comfortably
SPEED 73 tok/s
ⓘ estimated
MEMORY 120/512GB
GLM-5.3-Flash UD-Q4_K_XL Unsloth
200.0GB 1000k ctx
FIT Runs comfortably
SPEED 44 tok/s
ⓘ estimated
MEMORY 200/512GB
260.0GB 1000k ctx
FIT Runs comfortably
SPEED 65 tok/s
ⓘ estimated
MEMORY 260/512GB
224.6GB 1000k ctx
FIT Runs comfortably
SPEED 75 tok/s
ⓘ estimated
MEMORY 225/512GB
DeepSeek V4.1 Flash UD-Q2_K_XL
346.4GB 1000k ctx
FIT Runs comfortably
SPEED 49 tok/s
ⓘ estimated
MEMORY 346/512GB
DeepSeek V4 Flash 0731 UD-Q8_K_XL Unsloth
162.0GB 1000k ctx
FIT Runs comfortably
SPEED 66 tok/s
ⓘ estimated
MEMORY 162/512GB
DeepSeek V4 Flash 0731 UD-Q4_K_XL Unsloth
155.0GB 1000k ctx
FIT Runs comfortably
SPEED 69 tok/s
ⓘ estimated
MEMORY 155/512GB
244.0GB 132k cap
FIT Runs comfortably
SPEED 2 tok/s
ⓘ estimated
MEMORY 244/512GB
286.0GB 111k cap
FIT Runs comfortably
SPEED 2 tok/s
ⓘ estimated
MEMORY 286/512GB
331.0GB 88k cap
FIT Runs comfortably
SPEED 1 tok/s
ⓘ estimated
MEMORY 331/512GB
429.0GB 38k cap
FIT Runs comfortably
SPEED 1 tok/s
ⓘ estimated
MEMORY 429/512GB
Qwen3.8-Flash-Next UD-IQ1_S Unsloth
72.5GB 262k ctx
FIT Runs comfortably
SPEED 105 tok/s
ⓘ estimated
MEMORY 73/512GB
Qwen3.8-Flash-Next EXL3_2BPW
62.7GB 262k ctx
FIT Runs comfortably
SPEED 129 tok/s
ⓘ estimated
MEMORY 63/512GB
Qwen3.8-Flash-Next EXL3_3BPW
85.0GB 262k ctx
FIT Runs comfortably
SPEED 108 tok/s
ⓘ estimated
MEMORY 85/512GB
GLM 5.2 Q2_K Unsloth
240.0GB 1000k ctx
FIT Runs comfortably
SPEED 38 tok/s
ⓘ estimated
MEMORY 240/512GB
GLM 5.2 Q3_K_M Unsloth
365.0GB 1000k ctx
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 365/512GB
GLM 5.2 Q4_K_M Unsloth
410.0GB 1000k ctx
FIT Runs comfortably
SPEED 22 tok/s
ⓘ estimated
MEMORY 410/512GB
188.0GB 128k ctx
FIT Runs comfortably
SPEED 47 tok/s
ⓘ estimated
MEMORY 188/512GB
368.0GB 128k ctx
FIT Runs comfortably
SPEED 24 tok/s
ⓘ estimated
MEMORY 368/512GB
37.8GB 262k ctx
FIT Runs comfortably
SPEED 91 tok/s
ⓘ estimated
MEMORY 38/512GB
71.1GB 262k ctx
FIT Runs comfortably
SPEED 60 tok/s
ⓘ estimated
MEMORY 71/512GB
21.7GB 262k ctx
FIT Runs comfortably
SPEED 121 tok/s
ⓘ estimated
MEMORY 22/512GB
25.3GB 262k ctx
FIT Runs comfortably
SPEED 113 tok/s
ⓘ estimated
MEMORY 25/512GB
29.2GB 262k ctx
FIT Runs comfortably
SPEED 105 tok/s
ⓘ estimated
MEMORY 29/512GB
37.0GB 262k ctx
FIT Runs comfortably
SPEED 91 tok/s
ⓘ estimated
MEMORY 37/512GB
20.0GB 262k ctx
FIT Runs comfortably
SPEED 124 tok/s
ⓘ estimated
MEMORY 20/512GB
56.0GB 760k cap
FIT Runs comfortably
SPEED 8 tok/s
ⓘ estimated
MEMORY 56/512GB
28.0GB 803k cap
FIT Runs comfortably
SPEED 16 tok/s
ⓘ estimated
MEMORY 28/512GB
16.0GB 823k cap
FIT Runs comfortably
SPEED 27 tok/s
ⓘ estimated
MEMORY 16/512GB
68.0GB 128k ctx
FIT Runs comfortably
SPEED 34 tok/s
ⓘ estimated
MEMORY 68/512GB
125.0GB 128k ctx
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 125/512GB
Qwen3.8-27B UD-Q4_K_XL Unsloth
17.6GB 262k ctx
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 18/512GB
Qwen3.8-27B UD-Q2_K_XL Unsloth
9.8GB 262k ctx
FIT Runs comfortably
SPEED 41 tok/s
ⓘ estimated
MEMORY 10/512GB
Qwen3.8-27B UD-IQ1_S Unsloth
6.2GB 262k ctx
FIT Runs comfortably
SPEED 58 tok/s
ⓘ estimated
MEMORY 6/512GB
Qwen3.8-27B NVFP4 Unsloth
15.2GB 262k ctx
FIT Runs comfortably
SPEED 28 tok/s
ⓘ estimated
MEMORY 15/512GB
Gemma 4 31B NVFP4
16.0GB 256k ctx
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 16/512GB
61.4GB 256k ctx
FIT Runs comfortably
SPEED 8 tok/s
ⓘ estimated
MEMORY 61/512GB
18.0GB 256k ctx
FIT Runs comfortably
SPEED 23 tok/s
ⓘ estimated
MEMORY 18/512GB
32.6GB 256k ctx
FIT Runs comfortably
SPEED 14 tok/s
ⓘ estimated
MEMORY 33/512GB
Gemma 4 31B Q4_K_M
18.3GB 256k ctx
FIT Runs comfortably
SPEED 23 tok/s
ⓘ estimated
MEMORY 18/512GB
50.0GB 256k ctx
FIT Runs comfortably
SPEED 47 tok/s
ⓘ estimated
MEMORY 50/512GB
25.0GB 256k ctx
FIT Runs comfortably
SPEED 74 tok/s
ⓘ estimated
MEMORY 25/512GB
13.0GB 256k ctx
FIT Runs comfortably
SPEED 102 tok/s
ⓘ estimated
MEMORY 13/512GB
14.0GB 256k ctx
FIT Runs comfortably
SPEED 99 tok/s
ⓘ estimated
MEMORY 14/512GB
28.0GB 128k ctx
FIT Runs comfortably
SPEED 16 tok/s
ⓘ estimated
MEMORY 28/512GB
Qwen3.6 27B Q4_K_M
16.5GB 128k ctx
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 17/512GB
Qwen3 32B Q5_K_M
24.5GB 128k ctx
FIT Runs comfortably
SPEED 18 tok/s
ⓘ estimated
MEMORY 25/512GB
Qwen3 32B Q8_0
34.0GB 128k ctx
FIT Runs comfortably
SPEED 13 tok/s
ⓘ estimated
MEMORY 34/512GB
Qwen3 32B Q6_K
28.5GB 128k ctx
FIT Runs comfortably
SPEED 16 tok/s
ⓘ estimated
MEMORY 29/512GB
Qwen3 32B Q4_K_M
20.0GB 128k ctx
FIT Runs comfortably
SPEED 21 tok/s
ⓘ estimated
MEMORY 20/512GB
177.7GB 83k cap
FIT Runs comfortably
SPEED 20 tok/s
ⓘ estimated
MEMORY 178/512GB
77.0GB 108k cap
FIT Runs comfortably
SPEED 24 tok/s
ⓘ estimated
MEMORY 77/512GB
58.0GB 999k cap
FIT Runs comfortably
SPEED 58 tok/s
ⓘ estimated
MEMORY 58/512GB
32.0GB 1000k ctx
FIT Runs comfortably
SPEED 90 tok/s
ⓘ estimated
MEMORY 32/512GB
60.0GB 995k cap
FIT Runs comfortably
SPEED 57 tok/s
ⓘ estimated
MEMORY 60/512GB
7.6GB 262k ctx
FIT Runs comfortably
SPEED 51 tok/s
ⓘ estimated
MEMORY 8/512GB
Ornith-1.5-9B Q4_K_M
5.8GB 262k ctx
FIT Runs comfortably
SPEED 63 tok/s
ⓘ estimated
MEMORY 6/512GB
Ornith-1.5-9B Q5_K_M
6.6GB 262k ctx
FIT Runs comfortably
SPEED 57 tok/s
ⓘ estimated
MEMORY 7/512GB
18.4GB 262k ctx
FIT Runs comfortably
SPEED 24 tok/s
ⓘ estimated
MEMORY 18/512GB
9.8GB 262k ctx
FIT Runs comfortably
SPEED 42 tok/s
ⓘ estimated
MEMORY 10/512GB
Qwen3 30B A3B Q4_K_M
15.5GB 128k ctx
FIT Runs comfortably
SPEED 130 tok/s
ⓘ estimated
MEMORY 16/512GB
31.0GB 128k ctx
FIT Runs comfortably
SPEED 93 tok/s
ⓘ estimated
MEMORY 31/512GB
Phi-4 14B Q4_K_M
8.5GB 16k ctx
FIT Runs comfortably
SPEED 48 tok/s
ⓘ estimated
MEMORY 9/512GB
Phi-4 14B Q8_0
15.0GB 16k ctx
FIT Runs comfortably
SPEED 30 tok/s
ⓘ estimated
MEMORY 15/512GB
Phi-4 14B FP16
29.0GB 16k ctx
FIT Runs comfortably
SPEED 16 tok/s
ⓘ estimated
MEMORY 29/512GB
62.4GB 256k ctx
FIT Runs comfortably
SPEED 36 tok/s
ⓘ estimated
MEMORY 62/512GB
20.1GB 256k ctx
FIT Runs comfortably
SPEED 64 tok/s
ⓘ estimated
MEMORY 20/512GB
30.0GB 128k ctx
FIT Runs comfortably
SPEED 14 tok/s
ⓘ estimated
MEMORY 30/512GB
21.5GB 128k ctx
FIT Runs comfortably
SPEED 18 tok/s
ⓘ estimated
MEMORY 22/512GB
42.0GB 128k ctx
FIT Runs comfortably
SPEED 10 tok/s
ⓘ estimated
MEMORY 42/512GB
74.0GB 128k ctx
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 74/512GB
Qwen3 14B Q4_K_M
9.0GB 128k ctx
FIT Runs comfortably
SPEED 44 tok/s
ⓘ estimated
MEMORY 9/512GB
Qwen3 14B Q8_0
15.0GB 128k ctx
FIT Runs comfortably
SPEED 29 tok/s
ⓘ estimated
MEMORY 15/512GB
13.0GB 128k ctx
FIT Runs comfortably
SPEED 33 tok/s
ⓘ estimated
MEMORY 13/512GB
Gemma 4 12B Q4_K_M
7.2GB 128k ctx
FIT Runs comfortably
SPEED 54 tok/s
ⓘ estimated
MEMORY 7/512GB
28.0GB 128k ctx
FIT Runs comfortably
SPEED 16 tok/s
ⓘ estimated
MEMORY 28/512GB
Gemma 3 27B Q4_K_M
17.0GB 128k ctx
FIT Runs comfortably
SPEED 24 tok/s
ⓘ estimated
MEMORY 17/512GB
Qwen3 8B Q8_0
8.5GB 128k ctx
FIT Runs comfortably
SPEED 47 tok/s
ⓘ estimated
MEMORY 9/512GB
Qwen3 8B Q4_K_M
5.2GB 128k ctx
FIT Runs comfortably
SPEED 68 tok/s
ⓘ estimated
MEMORY 5/512GB
Gemma 3 12B Q4_K_M
7.5GB 128k ctx
FIT Runs comfortably
SPEED 53 tok/s
ⓘ estimated
MEMORY 8/512GB
13.5GB 128k ctx
FIT Runs comfortably
SPEED 32 tok/s
ⓘ estimated
MEMORY 14/512GB
19.0GB 32k ctx
FIT Runs comfortably
SPEED 67 tok/s
ⓘ estimated
MEMORY 19/512GB
26.5GB 32k ctx
FIT Runs comfortably
SPEED 52 tok/s
ⓘ estimated
MEMORY 27/512GB
Kolibri 1 BF16
156.2GB 1048k ctx
FIT Runs comfortably
SPEED 3 tok/s
ⓘ estimated
MEMORY 156/512GB
13.2GB 128k ctx
FIT Runs comfortably
SPEED 33 tok/s
ⓘ estimated
MEMORY 13/512GB
7.3GB 128k ctx
FIT Runs comfortably
SPEED 55 tok/s
ⓘ estimated
MEMORY 7/512GB
Qwen3 4B Q4_K_M
2.6GB 32k ctx
FIT Runs comfortably
SPEED 131 tok/s
ⓘ estimated
MEMORY 3/512GB
Phi-4 Mini Q4_K_M
2.5GB 128k ctx
FIT Runs comfortably
SPEED 148 tok/s
ⓘ estimated
MEMORY 3/512GB
Phi-4 Mini Q8_0
4.1GB 128k ctx
FIT Runs comfortably
SPEED 100 tok/s
ⓘ estimated
MEMORY 4/512GB
4.5GB 128k ctx
FIT Runs comfortably
SPEED 75 tok/s
ⓘ estimated
MEMORY 5/512GB
8.0GB 128k ctx
FIT Runs comfortably
SPEED 49 tok/s
ⓘ estimated
MEMORY 8/512GB
16.0GB 128k ctx
FIT Runs comfortably
SPEED 27 tok/s
ⓘ estimated
MEMORY 16/512GB
Gemma 3 4B Q4_K_M
3.0GB 128k ctx
FIT Runs comfortably
SPEED 116 tok/s
ⓘ estimated
MEMORY 3/512GB
Gemma 3 4B Q8_0
5.0GB 128k ctx
FIT Runs comfortably
SPEED 79 tok/s
ⓘ estimated
MEMORY 5/512GB
3.5GB 128k ctx
FIT Runs comfortably
SPEED 110 tok/s
ⓘ estimated
MEMORY 4/512GB
2.0GB 128k ctx
FIT Runs comfortably
SPEED 165 tok/s
ⓘ estimated
MEMORY 2/512GB
7.0GB 131k ctx
FIT Runs comfortably
SPEED 295 tok/s
ⓘ estimated
MEMORY 7/512GB
24.3GB 131k ctx
FIT Runs comfortably
SPEED 94 tok/s
ⓘ estimated
MEMORY 24/512GB
60.0GB 128k ctx
FIT Runs comfortably
SPEED 8 tok/s
ⓘ estimated
MEMORY 60/512GB
33.0GB 128k ctx
FIT Runs comfortably
SPEED 14 tok/s
ⓘ estimated
MEMORY 33/512GB
18.0GB 128k ctx
FIT Runs comfortably
SPEED 24 tok/s
ⓘ estimated
MEMORY 18/512GB
484.0GB 1024k ctx
FIT Runs comfortably
SPEED 20 tok/s
ⓘ estimated
MEMORY 484/512GB
311.0GB 1024k ctx
FIT Runs comfortably
SPEED 31 tok/s
ⓘ estimated
MEMORY 311/512GB
176.0GB 1024k ctx
FIT Runs comfortably
SPEED 54 tok/s
ⓘ estimated
MEMORY 176/512GB
MiniMax M2.7 UD-IQ1_M Unsloth
60.7GB 200k ctx
FIT Runs comfortably
SPEED 8 tok/s
ⓘ estimated
MEMORY 61/512GB
MiniMax M2.7 UD-Q4_K_XL Unsloth
140.8GB 200k ctx
FIT Runs comfortably
SPEED 3 tok/s
ⓘ estimated
MEMORY 141/512GB
MiniMax M2.7 UD-Q2_K_XL Unsloth
75.3GB 200k ctx
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 75/512GB
MiniMax M3 MXFP4
256.5GB 1048k ctx
FIT Runs comfortably
SPEED 2 tok/s
ⓘ estimated
MEMORY 257/512GB
MiniMax M3 UD-Q4_K_XL Unsloth
264.9GB 1048k ctx
FIT Runs comfortably
SPEED 2 tok/s
ⓘ estimated
MEMORY 265/512GB
MiniMax M3 UD-IQ1_M Unsloth
128.4GB 1048k ctx
FIT Runs comfortably
SPEED 4 tok/s
ⓘ estimated
MEMORY 128/512GB
MiniMax M3 UD-Q2_K_XL Unsloth
143.0GB 1048k ctx
FIT Runs comfortably
SPEED 3 tok/s
ⓘ estimated
MEMORY 143/512GB
24.0GB 131k ctx
FIT Runs comfortably
SPEED 212 tok/s
ⓘ estimated
MEMORY 24/512GB
13.7GB 131k ctx
FIT Runs comfortably
SPEED 336 tok/s
ⓘ estimated
MEMORY 14/512GB
Runs tight
GLM 5.2 Q5_K_M Unsloth
510.0GB 409k cap
FIT Runs tight
SPEED 18 tok/s
ⓘ estimated
MEMORY 510/512GB

Run GLM-5.3-Flash in the cloud

No hardware? Host it - per-token API or flat subscription

Relace per-token
$0.08
/MONTH
Darkbloom per-token
$0.14
/MONTH
PrimeIntellect per-token
$0.15
/MONTH
Morph per-token
$0.16
/MONTH
Wafer per-token
$0.16
/MONTH
OpenInference per-token
$0.18
/MONTH
Tenstorrent per-token
$0.18
/MONTH
GMICloud per-token
$0.18
/MONTH
Novita per-token
$0.2
/MONTH
StreamLake per-token
$0.21
/MONTH
Reka per-token
$0.25
/MONTH
Makora per-token
$0.26
/MONTH
InferenceNet per-token
$0.26
/MONTH
DigitalOcean per-token
$0.27
/MONTH
Near AI per-token
$0.28
/MONTH
CoreWeave per-token
$0.28
/MONTH
DekaLLM per-token
$0.3
/MONTH
NextBit per-token
$0.31
/MONTH
Particle AI per-token
$0.32
/MONTH
Modal per-token
Serverless GPU inference platform. Serves open-weight models including reason...
$0.36
/MONTH
Nebius per-token
$0.36
/MONTH
Mistral per-token
$0.36
/MONTH
Z.AI per-token
$0.36
/MONTH
Venice per-token
$0.36
/MONTH
Friendli per-token
$0.36
/MONTH
Fireworks per-token
$0.36
/MONTH
Z.ai per-token
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
pricing may be outdated
$0.36
/MONTH
KT per-token
$0.36
/MONTH
DeepInfra per-token
$0.36
/MONTH
SiliconFlow per-token
$0.36
/MONTH
Cohere per-token
$0.36
/MONTH
Together per-token
$0.36
/MONTH
BaseTen per-token
$0.36
/MONTH
Crusoe per-token
$0.36
/MONTH
AtlasCloud per-token
$0.36
/MONTH
Inceptron per-token
$0.39
/MONTH
Sail Research per-token
$0.44
/MONTH
Parasail per-token
$0.45
/MONTH
Z.ai Coding Plan Lite subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$10.0
/MONTH
OpenCode Go Go ($5 first month) subscription
Low-cost subscription for open coding models. $5 first month, then $10/month....
$10.0
/MONTH
Z.ai Coding Plan Pro subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$30.0
/MONTH
Z.ai Coding Plan Max subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$80.0
/MONTH

Coding alternatives

Hosted coding assistants for comparison - per seat

Cursor Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
/MONTH
GitHub Copilot Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
/MONTH
GitHub Copilot Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
/MONTH
Cursor Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
/MONTH
GitHub Copilot Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
/MONTH
Cursor Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
/MONTH

Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.

Sign in with GitHub to save this rig and get weekly model updates

Sign in with GitHub

Tokenstead community

Not sure this is the right fit?

Post your rig and the shortlist in the community and get a sanity check from people running the same memory and stack.