M5 Ultra 96GB

86 models / sorted by best_quality

Runs comfortably
Qwen3.8-Flash-Next UD-IQ1_S Unsloth
72.5GB 262k ctx
FIT Runs comfortably
SPEED 298 tok/s
ⓘ estimated
MEMORY 73/96GB
Qwen3.8-Flash-Next EXL3_2BPW
62.7GB 171k cap
FIT Runs comfortably
SPEED 189 tok/s
ⓘ estimated
MEMORY 63/96GB
Qwen3.8-Flash-Next EXL3_3BPW
85.0GB 171k cap
FIT Runs comfortably
SPEED 158 tok/s
ⓘ estimated
MEMORY 85/96GB
21.7GB 262k ctx
FIT Runs comfortably
SPEED 398 tok/s
ⓘ estimated
MEMORY 22/96GB
29.2GB 262k ctx
FIT Runs comfortably
SPEED 296 tok/s
ⓘ estimated
MEMORY 29/96GB
25.3GB 262k ctx
FIT Runs comfortably
SPEED 341 tok/s
ⓘ estimated
MEMORY 25/96GB
71.1GB 262k ctx
FIT Runs comfortably
SPEED 121 tok/s
ⓘ estimated
MEMORY 71/96GB
37.8GB 262k ctx
FIT Runs comfortably
SPEED 228 tok/s
ⓘ estimated
MEMORY 38/96GB
37.0GB 262k ctx
FIT Runs comfortably
SPEED 227 tok/s
ⓘ estimated
MEMORY 37/96GB
20.0GB 262k ctx
FIT Runs comfortably
SPEED 419 tok/s
ⓘ estimated
MEMORY 20/96GB
56.0GB 10000k ctx
FIT Runs comfortably
SPEED 13 tok/s
ⓘ estimated
MEMORY 56/96GB
28.0GB 10000k ctx
FIT Runs comfortably
SPEED 26 tok/s
ⓘ estimated
MEMORY 28/96GB
16.0GB 10000k ctx
FIT Runs comfortably
SPEED 45 tok/s
ⓘ estimated
MEMORY 16/96GB
68.0GB 128k ctx
FIT Runs comfortably
SPEED 113 tok/s
ⓘ estimated
MEMORY 68/96GB
Qwen3.8-27B UD-Q4_K_XL Unsloth
17.6GB 262k ctx
FIT Runs comfortably
SPEED 41 tok/s
ⓘ estimated
MEMORY 18/96GB
Qwen3.8-27B UD-Q2_K_XL Unsloth
9.8GB 262k ctx
FIT Runs comfortably
SPEED 73 tok/s
ⓘ estimated
MEMORY 10/96GB
Qwen3.8-27B UD-IQ1_S Unsloth
6.2GB 262k ctx
FIT Runs comfortably
SPEED 116 tok/s
ⓘ estimated
MEMORY 6/96GB
Qwen3.8-27B NVFP4 Unsloth
15.2GB 262k ctx
FIT Runs comfortably
SPEED 47 tok/s
ⓘ estimated
MEMORY 15/96GB
18.0GB 256k ctx
FIT Runs comfortably
SPEED 40 tok/s
ⓘ estimated
MEMORY 18/96GB
Gemma 4 31B NVFP4
16.0GB 256k ctx
FIT Runs comfortably
SPEED 45 tok/s
ⓘ estimated
MEMORY 16/96GB
61.4GB 256k ctx
FIT Runs comfortably
SPEED 12 tok/s
ⓘ estimated
MEMORY 61/96GB
32.6GB 256k ctx
FIT Runs comfortably
SPEED 22 tok/s
ⓘ estimated
MEMORY 33/96GB
Gemma 4 31B Q4_K_M
18.3GB 256k ctx
FIT Runs comfortably
SPEED 39 tok/s
ⓘ estimated
MEMORY 18/96GB
14.0GB 256k ctx
FIT Runs comfortably
SPEED 341 tok/s
ⓘ estimated
MEMORY 14/96GB
50.0GB 256k ctx
FIT Runs comfortably
SPEED 95 tok/s
ⓘ estimated
MEMORY 50/96GB
25.0GB 256k ctx
FIT Runs comfortably
SPEED 191 tok/s
ⓘ estimated
MEMORY 25/96GB
13.0GB 256k ctx
FIT Runs comfortably
SPEED 367 tok/s
ⓘ estimated
MEMORY 13/96GB
Qwen3.6 27B Q4_K_M
16.5GB 128k ctx
FIT Runs comfortably
SPEED 44 tok/s
ⓘ estimated
MEMORY 17/96GB
28.0GB 128k ctx
FIT Runs comfortably
SPEED 26 tok/s
ⓘ estimated
MEMORY 28/96GB
Qwen3 32B Q4_K_M
20.0GB 128k ctx
FIT Runs comfortably
SPEED 36 tok/s
ⓘ estimated
MEMORY 20/96GB
Qwen3 32B Q5_K_M
24.5GB 128k ctx
FIT Runs comfortably
SPEED 29 tok/s
ⓘ estimated
MEMORY 25/96GB
Qwen3 32B Q8_0
34.0GB 128k ctx
FIT Runs comfortably
SPEED 21 tok/s
ⓘ estimated
MEMORY 34/96GB
Qwen3 32B Q6_K
28.5GB 128k ctx
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 29/96GB
77.0GB 4k cap
FIT Runs comfortably
SPEED 36 tok/s
ⓘ estimated
MEMORY 77/96GB
32.0GB 1000k ctx
FIT Runs comfortably
SPEED 197 tok/s
ⓘ estimated
MEMORY 32/96GB
58.0GB 1000k ctx
FIT Runs comfortably
SPEED 109 tok/s
ⓘ estimated
MEMORY 58/96GB
Ornith-1.5-9B Q4_K_M
5.8GB 262k ctx
FIT Runs comfortably
SPEED 125 tok/s
ⓘ estimated
MEMORY 6/96GB
Ornith-1.5-9B Q5_K_M
6.6GB 262k ctx
FIT Runs comfortably
SPEED 108 tok/s
ⓘ estimated
MEMORY 7/96GB
60.0GB 1000k ctx
FIT Runs comfortably
SPEED 105 tok/s
ⓘ estimated
MEMORY 60/96GB
7.6GB 262k ctx
FIT Runs comfortably
SPEED 95 tok/s
ⓘ estimated
MEMORY 8/96GB
9.8GB 262k ctx
FIT Runs comfortably
SPEED 74 tok/s
ⓘ estimated
MEMORY 10/96GB
18.4GB 262k ctx
FIT Runs comfortably
SPEED 39 tok/s
ⓘ estimated
MEMORY 18/96GB
Qwen3 30B A3B Q4_K_M
15.5GB 128k ctx
FIT Runs comfortably
SPEED 472 tok/s
ⓘ estimated
MEMORY 16/96GB
31.0GB 128k ctx
FIT Runs comfortably
SPEED 236 tok/s
ⓘ estimated
MEMORY 31/96GB
Phi-4 14B Q8_0
15.0GB 16k ctx
FIT Runs comfortably
SPEED 48 tok/s
ⓘ estimated
MEMORY 15/96GB
Phi-4 14B FP16
29.0GB 16k ctx
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 29/96GB
Phi-4 14B Q4_K_M
8.5GB 16k ctx
FIT Runs comfortably
SPEED 85 tok/s
ⓘ estimated
MEMORY 9/96GB
62.4GB 26k cap
FIT Runs comfortably
SPEED 53 tok/s
ⓘ estimated
MEMORY 62/96GB
20.1GB 67k cap
FIT Runs comfortably
SPEED 94 tok/s
ⓘ estimated
MEMORY 20/96GB
30.0GB 128k ctx
FIT Runs comfortably
SPEED 24 tok/s
ⓘ estimated
MEMORY 30/96GB
21.5GB 128k ctx
FIT Runs comfortably
SPEED 33 tok/s
ⓘ estimated
MEMORY 22/96GB
42.0GB 128k ctx
FIT Runs comfortably
SPEED 17 tok/s
ⓘ estimated
MEMORY 42/96GB
74.0GB 128k ctx
FIT Runs comfortably
SPEED 10 tok/s
ⓘ estimated
MEMORY 74/96GB
Qwen3 14B Q4_K_M
9.0GB 128k ctx
FIT Runs comfortably
SPEED 80 tok/s
ⓘ estimated
MEMORY 9/96GB
Qwen3 14B Q8_0
15.0GB 128k ctx
FIT Runs comfortably
SPEED 48 tok/s
ⓘ estimated
MEMORY 15/96GB
Gemma 4 12B Q4_K_M
7.2GB 128k ctx
FIT Runs comfortably
SPEED 100 tok/s
ⓘ estimated
MEMORY 7/96GB
13.0GB 128k ctx
FIT Runs comfortably
SPEED 55 tok/s
ⓘ estimated
MEMORY 13/96GB
28.0GB 128k ctx
FIT Runs comfortably
SPEED 26 tok/s
ⓘ estimated
MEMORY 28/96GB
Gemma 3 27B Q4_K_M
17.0GB 128k ctx
FIT Runs comfortably
SPEED 42 tok/s
ⓘ estimated
MEMORY 17/96GB
Qwen3 8B Q4_K_M
5.2GB 128k ctx
FIT Runs comfortably
SPEED 138 tok/s
ⓘ estimated
MEMORY 5/96GB
Qwen3 8B Q8_0
8.5GB 128k ctx
FIT Runs comfortably
SPEED 85 tok/s
ⓘ estimated
MEMORY 9/96GB
26.5GB 32k ctx
FIT Runs comfortably
SPEED 98 tok/s
ⓘ estimated
MEMORY 27/96GB
19.0GB 32k ctx
FIT Runs comfortably
SPEED 137 tok/s
ⓘ estimated
MEMORY 19/96GB
13.5GB 128k ctx
FIT Runs comfortably
SPEED 53 tok/s
ⓘ estimated
MEMORY 14/96GB
Gemma 3 12B Q4_K_M
7.5GB 128k ctx
FIT Runs comfortably
SPEED 96 tok/s
ⓘ estimated
MEMORY 8/96GB
13.2GB 128k ctx
FIT Runs comfortably
SPEED 55 tok/s
ⓘ estimated
MEMORY 13/96GB
7.3GB 128k ctx
FIT Runs comfortably
SPEED 99 tok/s
ⓘ estimated
MEMORY 7/96GB
Qwen3 4B Q4_K_M
2.6GB 32k ctx
FIT Runs comfortably
SPEED 277 tok/s
ⓘ estimated
MEMORY 3/96GB
Phi-4 Mini Q8_0
4.1GB 128k ctx
FIT Runs comfortably
SPEED 176 tok/s
ⓘ estimated
MEMORY 4/96GB
Phi-4 Mini Q4_K_M
2.5GB 128k ctx
FIT Runs comfortably
SPEED 288 tok/s
ⓘ estimated
MEMORY 3/96GB
16.0GB 128k ctx
FIT Runs comfortably
SPEED 45 tok/s
ⓘ estimated
MEMORY 16/96GB
8.0GB 128k ctx
FIT Runs comfortably
SPEED 90 tok/s
ⓘ estimated
MEMORY 8/96GB
4.5GB 128k ctx
FIT Runs comfortably
SPEED 160 tok/s
ⓘ estimated
MEMORY 5/96GB
Gemma 3 4B Q8_0
5.0GB 128k ctx
FIT Runs comfortably
SPEED 144 tok/s
ⓘ estimated
MEMORY 5/96GB
Gemma 3 4B Q4_K_M
3.0GB 128k ctx
FIT Runs comfortably
SPEED 240 tok/s
ⓘ estimated
MEMORY 3/96GB
3.5GB 128k ctx
FIT Runs comfortably
SPEED 206 tok/s
ⓘ estimated
MEMORY 4/96GB
2.0GB 128k ctx
FIT Runs comfortably
SPEED 360 tok/s
ⓘ estimated
MEMORY 2/96GB
7.0GB 131k ctx
FIT Runs comfortably
SPEED 433 tok/s
ⓘ estimated
MEMORY 7/96GB
24.3GB 131k ctx
FIT Runs comfortably
SPEED 138 tok/s
ⓘ estimated
MEMORY 24/96GB
33.0GB 100k cap
FIT Runs comfortably
SPEED 20 tok/s
ⓘ estimated
MEMORY 33/96GB
18.0GB 120k cap
FIT Runs comfortably
SPEED 35 tok/s
ⓘ estimated
MEMORY 18/96GB
MiniMax M2.7 UD-IQ1_M Unsloth
60.7GB 142k cap
FIT Runs comfortably
SPEED 12 tok/s
ⓘ estimated
MEMORY 61/96GB
MiniMax M2.7 UD-Q2_K_XL Unsloth
75.3GB 83k cap
FIT Runs comfortably
SPEED 9 tok/s
ⓘ estimated
MEMORY 75/96GB
24.0GB 131k ctx
FIT Runs comfortably
SPEED 310 tok/s
ⓘ estimated
MEMORY 24/96GB
13.7GB 131k ctx
FIT Runs comfortably
SPEED 492 tok/s
ⓘ estimated
MEMORY 14/96GB
Runs tight
60.0GB 0k cap
FIT Runs tight
SPEED 12 tok/s
ⓘ estimated
MEMORY 60/96GB

Coding alternatives

Hosted coding assistants for comparison - per seat

Cursor Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
/MONTH
GitHub Copilot Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
/MONTH
GitHub Copilot Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
/MONTH
Cursor Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
/MONTH
GitHub Copilot Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
/MONTH
Cursor Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
/MONTH

Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.

Sign in with GitHub to save this rig and get weekly model updates

Sign in with GitHub