RTX 5090 32GB

69 models / sorted by best_quality

Quality Fastest Least mem Newest
Runs comfortably
Ornith-1.5-35B-A3B Q6_K
29.2GB 262k ctx
FIT Runs comfortably
SPEED 405 tok/s
ⓘ estimated
MEMORY 29/32GB
Ornith-1.5-35B-A3B Q5_K_M
25.3GB 262k ctx
FIT Runs comfortably
SPEED 467 tok/s
ⓘ estimated
MEMORY 25/32GB
Ornith-1.5-35B-A3B Q4_K_M
21.7GB 262k ctx
FIT Runs comfortably
SPEED 544 tok/s
ⓘ estimated
MEMORY 22/32GB
Qwen3.6 35B A3B Q4_K_M
20.0GB 262k ctx
FIT Runs comfortably
SPEED 574 tok/s
ⓘ estimated
MEMORY 20/32GB
Pokee-Isaac 28B Q4_K_M
16.0GB 10000k ctx
FIT Runs comfortably
SPEED 62 tok/s
ⓘ estimated
MEMORY 16/32GB
Pokee-Isaac 28B Q8_0
28.0GB 3413k cap
FIT Runs comfortably
SPEED 35 tok/s
ⓘ estimated
MEMORY 28/32GB
Qwen3.8-27B UD-Q4_K_XL Unsloth
17.6GB 262k ctx
FIT Runs comfortably
SPEED 56 tok/s
ⓘ estimated
MEMORY 18/32GB
Qwen3.8-27B UD-Q2_K_XL Unsloth
9.8GB 262k ctx
FIT Runs comfortably
SPEED 100 tok/s
ⓘ estimated
MEMORY 10/32GB
Qwen3.8-27B UD-IQ1_S Unsloth
6.2GB 262k ctx
FIT Runs comfortably
SPEED 159 tok/s
ⓘ estimated
MEMORY 6/32GB
Qwen3.8-27B NVFP4 Unsloth
15.2GB 262k ctx
FIT Runs comfortably
SPEED 65 tok/s
ⓘ estimated
MEMORY 15/32GB
Gemma 4 31B Q4_K_M
18.3GB 256k ctx
FIT Runs comfortably
SPEED 54 tok/s
ⓘ estimated
MEMORY 18/32GB
Gemma 4 31B QAT
18.0GB 256k ctx
FIT Runs comfortably
SPEED 55 tok/s
ⓘ estimated
MEMORY 18/32GB
Gemma 4 31B NVFP4
16.0GB 256k ctx
FIT Runs comfortably
SPEED 62 tok/s
ⓘ estimated
MEMORY 16/32GB
Gemma 4 26B A4B Q4_K_M
13.0GB 256k ctx
FIT Runs comfortably
SPEED 502 tok/s
ⓘ estimated
MEMORY 13/32GB
Gemma 4 26B A4B NVFP4
14.0GB 256k ctx
FIT Runs comfortably
SPEED 466 tok/s
ⓘ estimated
MEMORY 14/32GB
Gemma 4 26B A4B Q8_0
25.0GB 256k ctx
FIT Runs comfortably
SPEED 261 tok/s
ⓘ estimated
MEMORY 25/32GB
Qwen3.6 27B Q8_0
28.0GB 128k ctx
FIT Runs comfortably
SPEED 35 tok/s
ⓘ estimated
MEMORY 28/32GB
Qwen3.6 27B Q4_K_M
16.5GB 128k ctx
FIT Runs comfortably
SPEED 60 tok/s
ⓘ estimated
MEMORY 17/32GB
Qwen3 32B Q6_K
28.5GB 128k ctx
FIT Runs comfortably
SPEED 35 tok/s
ⓘ estimated
MEMORY 29/32GB
Qwen3 32B Q5_K_M
24.5GB 128k ctx
FIT Runs comfortably
SPEED 40 tok/s
ⓘ estimated
MEMORY 25/32GB
Qwen3 32B Q4_K_M
20.0GB 128k ctx
FIT Runs comfortably
SPEED 49 tok/s
ⓘ estimated
MEMORY 20/32GB
Ornith-1.5-9B Q5_K_M
6.6GB 262k ctx
FIT Runs comfortably
SPEED 148 tok/s
ⓘ estimated
MEMORY 7/32GB
Ornith-1.5-9B Q6_K
7.6GB 262k ctx
FIT Runs comfortably
SPEED 130 tok/s
ⓘ estimated
MEMORY 8/32GB
Ornith-1.5-9B Q8_0
9.8GB 262k ctx
FIT Runs comfortably
SPEED 101 tok/s
ⓘ estimated
MEMORY 10/32GB
Ornith-1.5-9B BF16
18.4GB 262k ctx
FIT Runs comfortably
SPEED 54 tok/s
ⓘ estimated
MEMORY 18/32GB
Ornith-1.5-9B Q4_K_M
5.8GB 262k ctx
FIT Runs comfortably
SPEED 170 tok/s
ⓘ estimated
MEMORY 6/32GB
Qwen3 30B A3B Q4_K_M
15.5GB 128k ctx
FIT Runs comfortably
SPEED 646 tok/s
ⓘ estimated
MEMORY 16/32GB
Phi-4 14B FP16
29.0GB 16k ctx
FIT Runs comfortably
SPEED 34 tok/s
ⓘ estimated
MEMORY 29/32GB
Phi-4 14B Q8_0
15.0GB 16k ctx
FIT Runs comfortably
SPEED 66 tok/s
ⓘ estimated
MEMORY 15/32GB
Phi-4 14B Q4_K_M
8.5GB 16k ctx
FIT Runs comfortably
SPEED 116 tok/s
ⓘ estimated
MEMORY 9/32GB
Xing4.0-29B-A4B Q4_K_M
20.1GB 256k ctx
FIT Runs comfortably
SPEED 355 tok/s
ⓘ estimated
MEMORY 20/32GB
Llama 3.3 70B Instruct Q2_K
21.5GB 128k ctx
FIT Runs comfortably
SPEED 46 tok/s
ⓘ estimated
MEMORY 22/32GB
Qwen3 14B Q8_0
15.0GB 128k ctx
FIT Runs comfortably
SPEED 66 tok/s
ⓘ estimated
MEMORY 15/32GB
Qwen3 14B Q4_K_M
9.0GB 128k ctx
FIT Runs comfortably
SPEED 109 tok/s
ⓘ estimated
MEMORY 9/32GB
Gemma 4 12B Q8_0
13.0GB 128k ctx
FIT Runs comfortably
SPEED 76 tok/s
ⓘ estimated
MEMORY 13/32GB
Gemma 4 12B Q4_K_M
7.2GB 128k ctx
FIT Runs comfortably
SPEED 137 tok/s
ⓘ estimated
MEMORY 7/32GB
Gemma 3 27B Q4_K_M
17.0GB 128k ctx
FIT Runs comfortably
SPEED 58 tok/s
ⓘ estimated
MEMORY 17/32GB
Gemma 3 27B Q8_0
28.0GB 128k ctx
FIT Runs comfortably
SPEED 35 tok/s
ⓘ estimated
MEMORY 28/32GB
Qwen3 8B Q8_0
8.5GB 128k ctx
FIT Runs comfortably
SPEED 116 tok/s
ⓘ estimated
MEMORY 9/32GB
Qwen3 8B Q4_K_M
5.2GB 128k ctx
FIT Runs comfortably
SPEED 189 tok/s
ⓘ estimated
MEMORY 5/32GB
Gemma 3 12B Q8_0
13.5GB 128k ctx
FIT Runs comfortably
SPEED 73 tok/s
ⓘ estimated
MEMORY 14/32GB
Mixtral 8x7B Instruct Q4_K_M
26.5GB 32k ctx
FIT Runs comfortably
SPEED 135 tok/s
ⓘ estimated
MEMORY 27/32GB
Mixtral 8x7B Instruct Q3_K_M
19.0GB 32k ctx
FIT Runs comfortably
SPEED 188 tok/s
ⓘ estimated
MEMORY 19/32GB
Gemma 3 12B Q4_K_M
7.5GB 128k ctx
FIT Runs comfortably
SPEED 131 tok/s
ⓘ estimated
MEMORY 8/32GB
Mistral Nemo 12B Q8_0
13.2GB 128k ctx
FIT Runs comfortably
SPEED 75 tok/s
ⓘ estimated
MEMORY 13/32GB
Mistral Nemo 12B Q4_K_M
7.3GB 128k ctx
FIT Runs comfortably
SPEED 135 tok/s
ⓘ estimated
MEMORY 7/32GB
Qwen3 4B Q4_K_M
2.6GB 32k ctx
FIT Runs comfortably
SPEED 379 tok/s
ⓘ estimated
MEMORY 3/32GB
Phi-4 Mini Q4_K_M
2.5GB 128k ctx
FIT Runs comfortably
SPEED 394 tok/s
ⓘ estimated
MEMORY 3/32GB
Phi-4 Mini Q8_0
4.1GB 128k ctx
FIT Runs comfortably
SPEED 240 tok/s
ⓘ estimated
MEMORY 4/32GB
Llama 3.1 8B Instruct FP16
16.0GB 128k ctx
FIT Runs comfortably
SPEED 62 tok/s
ⓘ estimated
MEMORY 16/32GB
Llama 3.1 8B Instruct Q8_0
8.0GB 128k ctx
FIT Runs comfortably
SPEED 123 tok/s
ⓘ estimated
MEMORY 8/32GB
Llama 3.1 8B Instruct Q4_K_M
4.5GB 128k ctx
FIT Runs comfortably
SPEED 219 tok/s
ⓘ estimated
MEMORY 5/32GB
Gemma 3 4B Q8_0
5.0GB 128k ctx
FIT Runs comfortably
SPEED 197 tok/s
ⓘ estimated
MEMORY 5/32GB
Gemma 3 4B Q4_K_M
3.0GB 128k ctx
FIT Runs comfortably
SPEED 328 tok/s
ⓘ estimated
MEMORY 3/32GB
Llama 3.2 3B Instruct Q8_0
3.5GB 128k ctx
FIT Runs comfortably
SPEED 282 tok/s
ⓘ estimated
MEMORY 4/32GB
Llama 3.2 3B Instruct Q4_K_M
2.0GB 128k ctx
FIT Runs comfortably
SPEED 493 tok/s
ⓘ estimated
MEMORY 2/32GB
Runs tight
Qwen3 30B A3B Q8_0
31.0GB 128k ctx
FIT Runs tight
SPEED 323 tok/s
ⓘ estimated
MEMORY 31/32GB
Llama 3.3 70B Instruct Q3_K_M
30.0GB 128k ctx
FIT Runs tight
SPEED 33 tok/s
ⓘ estimated
MEMORY 30/32GB
Muse Glimmer 30B Q4_K_M
18.0GB 128k ctx
FIT Runs tight
SPEED 55 tok/s
ⓘ estimated
MEMORY 18/32GB
Runs with CPU offload
Qwen3.8-Flash-Next EXL3_3BPW
85.0GB 262k ctx
FIT Runs with CPU offload
SPEED 348 tok/s
ⓘ estimated
MEMORY 85/32GB
Qwen3.8-Flash-Next EXL3_2BPW
62.7GB 262k ctx
FIT Runs with CPU offload
SPEED 471 tok/s
ⓘ estimated
MEMORY 63/32GB
Ornith-1.5-35B-A3B Q8_0
37.8GB 0k cap
FIT Runs with CPU offload
SPEED 313 tok/s
ⓘ estimated
MEMORY 38/32GB
Qwen3.6 35B A3B Q8_0
37.0GB 0k cap
FIT Runs with CPU offload
SPEED 311 tok/s
ⓘ estimated
MEMORY 37/32GB
Gemma 4 31B Q8_0
32.6GB 0k cap
FIT Runs with CPU offload
SPEED 30 tok/s
ⓘ estimated
MEMORY 33/32GB
Gemma 4 26B A4B BF16
50.0GB 0k cap
FIT Runs with CPU offload
SPEED 131 tok/s
ⓘ estimated
MEMORY 50/32GB
Qwen3 32B Q8_0
34.0GB 0k cap
FIT Runs with CPU offload
SPEED 29 tok/s
ⓘ estimated
MEMORY 34/32GB
Nemotron 3.5 Lightning Q4_K_M
32.0GB 0k cap
FIT Runs with CPU offload
SPEED 270 tok/s
ⓘ estimated
MEMORY 32/32GB
Llama 3.3 70B Instruct Q4_K_M
42.0GB 0k cap
FIT Runs with CPU offload
SPEED 23 tok/s
ⓘ estimated
MEMORY 42/32GB
Muse Glimmer 30B Q8_0
33.0GB 0k cap
FIT Runs with CPU offload
SPEED 30 tok/s
ⓘ estimated
MEMORY 33/32GB

Coding alternatives

Hosted coding assistants for comparison - per seat

Cursor Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
/MONTH
GitHub Copilot Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
/MONTH
GitHub Copilot Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
/MONTH
Cursor Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
/MONTH
GitHub Copilot Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
/MONTH
Cursor Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
/MONTH

Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.

On a monthly budget? Compare owning hardware vs renting cloud →

Sign in with GitHub to save this rig and get weekly model updates

Sign in with GitHub