Skip to content

M5 Max 128GB

90 models / sorted by best_quality

Quality Fastest Least mem Newest
Runs comfortably
GLM-5.3-Flash UD-Q2_K_XL Unsloth
109.0GB 1000k ctx
FIT Runs comfortably
SPEED 60 tok/s
ⓘ estimated
MEMORY 109/128GB
GLM-5.3-Flash UD-IQ1_S Unsloth
93.1GB 1000k ctx
FIT Runs comfortably
SPEED 70 tok/s
ⓘ estimated
MEMORY 93/128GB
Qwen3.8-Flash-Next EXL3_2BPW
62.7GB 247k cap
FIT Runs comfortably
SPEED 97 tok/s
ⓘ estimated
MEMORY 63/128GB
Qwen3.8-Flash-Next EXL3_3BPW
85.0GB 247k cap
FIT Runs comfortably
SPEED 81 tok/s
ⓘ estimated
MEMORY 85/128GB
Qwen3.8-Flash-Next UD-IQ1_S Unsloth
72.5GB 90k cap
FIT Runs comfortably
SPEED 79 tok/s
ⓘ estimated
MEMORY 73/128GB
Ornith-1.5-35B-A3B Q8_0
37.8GB 163k cap
FIT Runs comfortably
SPEED 68 tok/s
ⓘ estimated
MEMORY 38/128GB
Ornith-1.5-35B-A3B Q4_K_M
21.7GB 192k cap
FIT Runs comfortably
SPEED 91 tok/s
ⓘ estimated
MEMORY 22/128GB
Ornith-1.5-35B-A3B Q6_K
29.2GB 178k cap
FIT Runs comfortably
SPEED 79 tok/s
ⓘ estimated
MEMORY 29/128GB
Ornith-1.5-35B-A3B Q5_K_M
25.3GB 185k cap
FIT Runs comfortably
SPEED 84 tok/s
ⓘ estimated
MEMORY 25/128GB
Ornith-1.5-35B-A3B BF16
71.1GB 101k cap
FIT Runs comfortably
SPEED 45 tok/s
ⓘ estimated
MEMORY 71/128GB
Qwen3.6 35B A3B Q8_0
37.0GB 165k cap
FIT Runs comfortably
SPEED 68 tok/s
ⓘ estimated
MEMORY 37/128GB
Qwen3.6 35B A3B Q4_K_M
20.0GB 196k cap
FIT Runs comfortably
SPEED 93 tok/s
ⓘ estimated
MEMORY 20/128GB
Pokee-Isaac 28B Q8_0
28.0GB 163k cap
FIT Runs comfortably
SPEED 12 tok/s
ⓘ estimated
MEMORY 28/128GB
Pokee-Isaac 28B Q4_K_M
16.0GB 183k cap
FIT Runs comfortably
SPEED 20 tok/s
ⓘ estimated
MEMORY 16/128GB
Pokee-Isaac 28B FP16
56.0GB 120k cap
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 56/128GB
Qwen3 235B A22B Q2_K
68.0GB 30k cap
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 68/128GB
Qwen3.8-27B UD-IQ1_S Unsloth
6.2GB 218k cap
FIT Runs comfortably
SPEED 44 tok/s
ⓘ estimated
MEMORY 6/128GB
Qwen3.8-27B UD-Q2_K_XL Unsloth
9.8GB 212k cap
FIT Runs comfortably
SPEED 30 tok/s
ⓘ estimated
MEMORY 10/128GB
Qwen3.8-27B UD-Q4_K_XL Unsloth
17.6GB 198k cap
FIT Runs comfortably
SPEED 19 tok/s
ⓘ estimated
MEMORY 18/128GB
Qwen3.8-27B NVFP4 Unsloth
15.2GB 200k cap
FIT Runs comfortably
SPEED 21 tok/s
ⓘ estimated
MEMORY 15/128GB
Gemma 4 31B Q4_K_M
18.3GB 135k cap
FIT Runs comfortably
SPEED 17 tok/s
ⓘ estimated
MEMORY 18/128GB
Gemma 4 31B Q8_0
32.6GB 117k cap
FIT Runs comfortably
SPEED 10 tok/s
ⓘ estimated
MEMORY 33/128GB
Gemma 4 31B BF16
61.4GB 81k cap
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 61/128GB
Gemma 4 31B NVFP4
16.0GB 135k cap
FIT Runs comfortably
SPEED 19 tok/s
ⓘ estimated
MEMORY 16/128GB
Gemma 4 31B QAT
18.0GB 136k cap
FIT Runs comfortably
SPEED 17 tok/s
ⓘ estimated
MEMORY 18/128GB
Gemma 4 26B A4B Q4_K_M
13.0GB 159k cap
FIT Runs comfortably
SPEED 76 tok/s
ⓘ estimated
MEMORY 13/128GB
Gemma 4 26B A4B Q8_0
25.0GB 144k cap
FIT Runs comfortably
SPEED 56 tok/s
ⓘ estimated
MEMORY 25/128GB
Gemma 4 26B A4B BF16
50.0GB 108k cap
FIT Runs comfortably
SPEED 35 tok/s
ⓘ estimated
MEMORY 50/128GB
Gemma 4 26B A4B NVFP4
14.0GB 161k cap
FIT Runs comfortably
SPEED 74 tok/s
ⓘ estimated
MEMORY 14/128GB
Qwen3.6 27B Q4_K_M
16.5GB 128k ctx
FIT Runs comfortably
SPEED 19 tok/s
ⓘ estimated
MEMORY 17/128GB
Qwen3.6 27B Q8_0
28.0GB 128k ctx
FIT Runs comfortably
SPEED 12 tok/s
ⓘ estimated
MEMORY 28/128GB
Qwen3 32B Q5_K_M
24.5GB 128k ctx
FIT Runs comfortably
SPEED 13 tok/s
ⓘ estimated
MEMORY 25/128GB
Qwen3 32B Q6_K
28.5GB 128k ctx
FIT Runs comfortably
SPEED 12 tok/s
ⓘ estimated
MEMORY 29/128GB
Qwen3 32B Q4_K_M
20.0GB 128k ctx
FIT Runs comfortably
SPEED 16 tok/s
ⓘ estimated
MEMORY 20/128GB
Qwen3 32B Q8_0
34.0GB 128k ctx
FIT Runs comfortably
SPEED 10 tok/s
ⓘ estimated
MEMORY 34/128GB
MiMo-V2.6-Flash Q2_K
77.0GB 12k cap
FIT Runs comfortably
SPEED 18 tok/s
ⓘ estimated
MEMORY 77/128GB
Nemotron 3.5 Lightning Q4_K_M
32.0GB 208k cap
FIT Runs comfortably
SPEED 67 tok/s
ⓘ estimated
MEMORY 32/128GB
Nemotron 3.5 Lightning Q8_0
58.0GB 146k cap
FIT Runs comfortably
SPEED 44 tok/s
ⓘ estimated
MEMORY 58/128GB
Nemotron 3.5 Lightning FP16
60.0GB 142k cap
FIT Runs comfortably
SPEED 42 tok/s
ⓘ estimated
MEMORY 60/128GB
Ornith-1.5-9B BF16
18.4GB 218k cap
FIT Runs comfortably
SPEED 18 tok/s
ⓘ estimated
MEMORY 18/128GB
Ornith-1.5-9B Q5_K_M
6.6GB 242k cap
FIT Runs comfortably
SPEED 42 tok/s
ⓘ estimated
MEMORY 7/128GB
Ornith-1.5-9B Q4_K_M
5.8GB 244k cap
FIT Runs comfortably
SPEED 47 tok/s
ⓘ estimated
MEMORY 6/128GB
Ornith-1.5-9B Q6_K
7.6GB 240k cap
FIT Runs comfortably
SPEED 38 tok/s
ⓘ estimated
MEMORY 8/128GB
Ornith-1.5-9B Q8_0
9.8GB 236k cap
FIT Runs comfortably
SPEED 31 tok/s
ⓘ estimated
MEMORY 10/128GB
Qwen3 30B A3B Q8_0
31.0GB 128k ctx
FIT Runs comfortably
SPEED 69 tok/s
ⓘ estimated
MEMORY 31/128GB
Qwen3 30B A3B Q4_K_M
15.5GB 128k ctx
FIT Runs comfortably
SPEED 98 tok/s
ⓘ estimated
MEMORY 16/128GB
Phi-4 14B FP16
29.0GB 16k ctx
FIT Runs comfortably
SPEED 12 tok/s
ⓘ estimated
MEMORY 29/128GB
Phi-4 14B Q4_K_M
8.5GB 16k ctx
FIT Runs comfortably
SPEED 36 tok/s
ⓘ estimated
MEMORY 9/128GB
Phi-4 14B Q8_0
15.0GB 16k ctx
FIT Runs comfortably
SPEED 22 tok/s
ⓘ estimated
MEMORY 15/128GB
Xing4.0-29B-A4B BF16
62.4GB 53k cap
FIT Runs comfortably
SPEED 27 tok/s
ⓘ estimated
MEMORY 62/128GB
Xing4.0-29B-A4B Q4_K_M
20.1GB 94k cap
FIT Runs comfortably
SPEED 48 tok/s
ⓘ estimated
MEMORY 20/128GB
Llama 3.3 70B Instruct Q8_0
74.0GB 36k cap
FIT Runs comfortably
SPEED 5 tok/s
ⓘ estimated
MEMORY 74/128GB
Llama 3.3 70B Instruct Q4_K_M
42.0GB 57k cap
FIT Runs comfortably
SPEED 8 tok/s
ⓘ estimated
MEMORY 42/128GB
Llama 3.3 70B Instruct Q2_K
21.5GB 71k cap
FIT Runs comfortably
SPEED 13 tok/s
ⓘ estimated
MEMORY 22/128GB
Llama 3.3 70B Instruct Q3_K_M
30.0GB 65k cap
FIT Runs comfortably
SPEED 10 tok/s
ⓘ estimated
MEMORY 30/128GB
Qwen3 14B Q4_K_M
9.0GB 128k ctx
FIT Runs comfortably
SPEED 33 tok/s
ⓘ estimated
MEMORY 9/128GB
Qwen3 14B Q8_0
15.0GB 128k ctx
FIT Runs comfortably
SPEED 22 tok/s
ⓘ estimated
MEMORY 15/128GB
Gemma 4 12B Q8_0
13.0GB 128k ctx
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 13/128GB
Gemma 4 12B Q4_K_M
7.2GB 128k ctx
FIT Runs comfortably
SPEED 41 tok/s
ⓘ estimated
MEMORY 7/128GB
Gemma 3 27B Q4_K_M
17.0GB 128k ctx
FIT Runs comfortably
SPEED 18 tok/s
ⓘ estimated
MEMORY 17/128GB
Gemma 3 27B Q8_0
28.0GB 128k ctx
FIT Runs comfortably
SPEED 12 tok/s
ⓘ estimated
MEMORY 28/128GB
Qwen3 8B Q8_0
8.5GB 128k ctx
FIT Runs comfortably
SPEED 35 tok/s
ⓘ estimated
MEMORY 9/128GB
Qwen3 8B Q4_K_M
5.2GB 128k ctx
FIT Runs comfortably
SPEED 51 tok/s
ⓘ estimated
MEMORY 5/128GB
Mixtral 8x7B Instruct Q4_K_M
26.5GB 32k ctx
FIT Runs comfortably
SPEED 39 tok/s
ⓘ estimated
MEMORY 27/128GB
Mixtral 8x7B Instruct Q3_K_M
19.0GB 32k ctx
FIT Runs comfortably
SPEED 50 tok/s
ⓘ estimated
MEMORY 19/128GB
Gemma 3 12B Q8_0
13.5GB 128k ctx
FIT Runs comfortably
SPEED 24 tok/s
ⓘ estimated
MEMORY 14/128GB
Gemma 3 12B Q4_K_M
7.5GB 128k ctx
FIT Runs comfortably
SPEED 40 tok/s
ⓘ estimated
MEMORY 8/128GB
Mistral Nemo 12B Q8_0
13.2GB 128k ctx
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 13/128GB
Mistral Nemo 12B Q4_K_M
7.3GB 128k ctx
FIT Runs comfortably
SPEED 41 tok/s
ⓘ estimated
MEMORY 7/128GB
Qwen3 4B Q4_K_M
2.6GB 32k ctx
FIT Runs comfortably
SPEED 98 tok/s
ⓘ estimated
MEMORY 3/128GB
Phi-4 Mini Q4_K_M
2.5GB 128k ctx
FIT Runs comfortably
SPEED 111 tok/s
ⓘ estimated
MEMORY 3/128GB
Phi-4 Mini Q8_0
4.1GB 128k ctx
FIT Runs comfortably
SPEED 75 tok/s
ⓘ estimated
MEMORY 4/128GB
Llama 3.1 8B Instruct FP16
16.0GB 128k ctx
FIT Runs comfortably
SPEED 20 tok/s
ⓘ estimated
MEMORY 16/128GB
Llama 3.1 8B Instruct Q8_0
8.0GB 128k ctx
FIT Runs comfortably
SPEED 37 tok/s
ⓘ estimated
MEMORY 8/128GB
Llama 3.1 8B Instruct Q4_K_M
4.5GB 128k ctx
FIT Runs comfortably
SPEED 56 tok/s
ⓘ estimated
MEMORY 5/128GB
Gemma 3 4B Q8_0
5.0GB 128k ctx
FIT Runs comfortably
SPEED 59 tok/s
ⓘ estimated
MEMORY 5/128GB
Gemma 3 4B Q4_K_M
3.0GB 128k ctx
FIT Runs comfortably
SPEED 87 tok/s
ⓘ estimated
MEMORY 3/128GB
Llama 3.2 3B Instruct Q4_K_M
2.0GB 128k ctx
FIT Runs comfortably
SPEED 123 tok/s
ⓘ estimated
MEMORY 2/128GB
Llama 3.2 3B Instruct Q8_0
3.5GB 128k ctx
FIT Runs comfortably
SPEED 82 tok/s
ⓘ estimated
MEMORY 4/128GB
Mellum2.1 12B Thinking Q4_K_M
7.0GB 131k ctx
FIT Runs comfortably
SPEED 221 tok/s
ⓘ estimated
MEMORY 7/128GB
Mellum2.1 12B Thinking FP16
24.3GB 131k ctx
FIT Runs comfortably
SPEED 71 tok/s
ⓘ estimated
MEMORY 24/128GB
Muse Glimmer 30B FP16
60.0GB 53k cap
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 60/128GB
Muse Glimmer 30B Q8_0
33.0GB 128k ctx
FIT Runs comfortably
SPEED 10 tok/s
ⓘ estimated
MEMORY 33/128GB
Muse Glimmer 30B Q4_K_M
18.0GB 128k ctx
FIT Runs comfortably
SPEED 18 tok/s
ⓘ estimated
MEMORY 18/128GB
MiniMax M2.7 UD-IQ1_M Unsloth
60.7GB 200k ctx
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 61/128GB
MiniMax M2.7 UD-Q2_K_XL Unsloth
75.3GB 200k ctx
FIT Runs comfortably
SPEED 5 tok/s
ⓘ estimated
MEMORY 75/128GB
LFM2.5-24B-A2B FP8
24.0GB 131k ctx
FIT Runs comfortably
SPEED 159 tok/s
ⓘ estimated
MEMORY 24/128GB
LFM2.5-24B-A2B Q4_K_M
13.7GB 131k ctx
FIT Runs comfortably
SPEED 252 tok/s
ⓘ estimated
MEMORY 14/128GB
Runs tight
GLM-5.3-Flash UD-IQ3_XXS Unsloth
120.0GB ctx headroom ~0
FIT Runs tight
SPEED 55 tok/s
ⓘ estimated
MEMORY 120/128GB
Qwen3 235B A22B Q4_K_M
125.0GB 1k cap
FIT Runs tight
SPEED 19 tok/s
ⓘ estimated
MEMORY 125/128GB

Run GLM-5.3-Flash in the cloud

No hardware? Host it - per-token API or flat subscription

Relace per-token
$0.08
/MONTH
Darkbloom per-token
$0.14
/MONTH
Wafer per-token
$0.16
/MONTH
OpenInference per-token
$0.18
/MONTH
Tenstorrent per-token
$0.18
/MONTH
GMICloud per-token
$0.18
/MONTH
Morph per-token
$0.18
/MONTH
Novita per-token
$0.2
/MONTH
StreamLake per-token
$0.21
/MONTH
Reka per-token
$0.25
/MONTH
InferenceNet per-token
$0.26
/MONTH
Makora per-token
$0.26
/MONTH
SiliconFlow per-token
$0.26
/MONTH
DigitalOcean per-token
$0.27
/MONTH
Near AI per-token
$0.28
/MONTH
CoreWeave per-token
$0.28
/MONTH
River per-token
$0.29
/MONTH
DekaLLM per-token
$0.3
/MONTH
NextBit per-token
$0.31
/MONTH
Particle AI per-token
$0.32
/MONTH
Nebius per-token
$0.36
/MONTH
Mistral per-token
$0.36
/MONTH
Modal per-token
Serverless GPU inference platform. Serves open-weight models including reason...
$0.36
/MONTH
Z.AI per-token
$0.36
/MONTH
Venice per-token
$0.36
/MONTH
Friendli per-token
$0.36
/MONTH
Z.ai per-token
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
pricing may be outdated
$0.36
/MONTH
AtlasCloud per-token
$0.36
/MONTH
Crusoe per-token
$0.36
/MONTH
BaseTen per-token
$0.36
/MONTH
Together per-token
$0.36
/MONTH
Cohere per-token
$0.36
/MONTH
DeepInfra per-token
$0.36
/MONTH
KT per-token
$0.36
/MONTH
Inceptron per-token
$0.38
/MONTH
Sail Research per-token
$0.44
/MONTH
Parasail per-token
$0.45
/MONTH
Fireworks per-token
$0.54
/MONTH
Z.ai Coding Plan Lite subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$10.0
/MONTH
OpenCode Go Go ($5 first month) subscription
Low-cost subscription for open coding models. $5 first month, then $10/month....
$10.0
/MONTH
Z.ai Coding Plan Pro subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$30.0
/MONTH
Z.ai Coding Plan Max subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$80.0
/MONTH

Coding alternatives

Hosted coding assistants for comparison - per seat

Cursor Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
/MONTH
GitHub Copilot Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
/MONTH
GitHub Copilot Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
/MONTH
Cursor Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
/MONTH
GitHub Copilot Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
/MONTH
Cursor Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
/MONTH

Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.

On a monthly budget? Compare owning hardware vs renting cloud →

Sign in with GitHub to save this rig and get weekly model updates

Sign in with GitHub

Tokenstead community

Not sure this is the right fit?

Post your rig and the shortlist in the community and get a sanity check from people running the same memory and stack.

Join the community Share your rig