Skip to content

RTX 3090 192GB

103 models / sorted by best_quality

Quality Fastest Least mem Newest
Runs comfortably
GLM-5.3-Flash UD-IQ3_XXS Unsloth
120.0GB 1000k ctx
FIT Runs comfortably
SPEED 76 tok/s
ⓘ estimated
MEMORY 120/192GB
GLM-5.3-Flash UD-Q2_K_XL Unsloth
109.0GB 1000k ctx
FIT Runs comfortably
SPEED 84 tok/s
ⓘ estimated
MEMORY 109/192GB
GLM-5.3-Flash UD-IQ1_S Unsloth
93.1GB 1000k ctx
FIT Runs comfortably
SPEED 98 tok/s
ⓘ estimated
MEMORY 93/192GB
DeepSeek V4 Flash 0731 UD-Q8_K_XL Unsloth
162.0GB 1000k ctx
FIT Runs comfortably
SPEED 69 tok/s
ⓘ estimated
MEMORY 162/192GB
DeepSeek V4 Flash 0731 UD-Q4_K_XL Unsloth
155.0GB 1000k ctx
FIT Runs comfortably
SPEED 171 tok/s
extrapolated
MEMORY 155/192GB
Qwen3.8-Flash-Next UD-IQ1_S Unsloth
72.5GB 207k cap
FIT Runs comfortably
SPEED 110 tok/s
ⓘ estimated
MEMORY 73/192GB
Qwen3.8-Flash-Next EXL3_2BPW
62.7GB 262k ctx
FIT Runs comfortably
SPEED 135 tok/s
ⓘ estimated
MEMORY 63/192GB
Qwen3.8-Flash-Next EXL3_3BPW
85.0GB 262k ctx
FIT Runs comfortably
SPEED 113 tok/s
ⓘ estimated
MEMORY 85/192GB
Ornith-1.5-35B-A3B Q8_0
37.8GB 262k ctx
FIT Runs comfortably
SPEED 95 tok/s
ⓘ estimated
MEMORY 38/192GB
Ornith-1.5-35B-A3B Q4_K_M
21.7GB 262k ctx
FIT Runs comfortably
SPEED 127 tok/s
ⓘ estimated
MEMORY 22/192GB
Ornith-1.5-35B-A3B Q6_K
29.2GB 262k ctx
FIT Runs comfortably
SPEED 110 tok/s
ⓘ estimated
MEMORY 29/192GB
Ornith-1.5-35B-A3B BF16
71.1GB 218k cap
FIT Runs comfortably
SPEED 63 tok/s
ⓘ estimated
MEMORY 71/192GB
Ornith-1.5-35B-A3B Q5_K_M
25.3GB 262k ctx
FIT Runs comfortably
SPEED 118 tok/s
ⓘ estimated
MEMORY 25/192GB
Qwen3.6 35B A3B Q4_K_M
20.0GB 262k ctx
FIT Runs comfortably
SPEED 130 tok/s
ⓘ estimated
MEMORY 20/192GB
Qwen3.6 35B A3B Q8_0
37.0GB 262k ctx
FIT Runs comfortably
SPEED 95 tok/s
ⓘ estimated
MEMORY 37/192GB
Pokee-Isaac 28B FP16
56.0GB 226k cap
FIT Runs comfortably
SPEED 9 tok/s
ⓘ estimated
MEMORY 56/192GB
Pokee-Isaac 28B Q8_0
28.0GB 270k cap
FIT Runs comfortably
SPEED 17 tok/s
ⓘ estimated
MEMORY 28/192GB
Pokee-Isaac 28B Q4_K_M
16.0GB 290k cap
FIT Runs comfortably
SPEED 28 tok/s
ⓘ estimated
MEMORY 16/192GB
Qwen3 235B A22B Q2_K
68.0GB 62k cap
FIT Runs comfortably
SPEED 35 tok/s
ⓘ estimated
MEMORY 68/192GB
Qwen3 235B A22B Q4_K_M
125.0GB 33k cap
FIT Runs comfortably
SPEED 26 tok/s
ⓘ estimated
MEMORY 125/192GB
Qwen3.8-27B UD-Q4_K_XL Unsloth
17.6GB 262k ctx
FIT Runs comfortably
SPEED 26 tok/s
ⓘ estimated
MEMORY 18/192GB
Qwen3.8-27B UD-Q2_K_XL Unsloth
9.8GB 262k ctx
FIT Runs comfortably
SPEED 43 tok/s
ⓘ estimated
MEMORY 10/192GB
Qwen3.8-27B UD-IQ1_S Unsloth
6.2GB 262k ctx
FIT Runs comfortably
SPEED 61 tok/s
ⓘ estimated
MEMORY 6/192GB
Gemma 4 31B QAT
18.0GB 216k cap
FIT Runs comfortably
SPEED 24 tok/s
ⓘ estimated
MEMORY 18/192GB
Gemma 4 31B Q4_K_M
18.3GB 215k cap
FIT Runs comfortably
SPEED 24 tok/s
ⓘ estimated
MEMORY 18/192GB
Gemma 4 31B Q8_0
32.6GB 197k cap
FIT Runs comfortably
SPEED 14 tok/s
ⓘ estimated
MEMORY 33/192GB
Gemma 4 31B BF16
61.4GB 161k cap
FIT Runs comfortably
SPEED 8 tok/s
ⓘ estimated
MEMORY 61/192GB
Gemma 4 26B A4B BF16
50.0GB 199k cap
FIT Runs comfortably
SPEED 49 tok/s
ⓘ estimated
MEMORY 50/192GB
Gemma 4 26B A4B Q8_0
25.0GB 235k cap
FIT Runs comfortably
SPEED 78 tok/s
ⓘ estimated
MEMORY 25/192GB
Gemma 4 26B A4B Q4_K_M
13.0GB 251k cap
FIT Runs comfortably
SPEED 107 tok/s
ⓘ estimated
MEMORY 13/192GB
Qwen3.6 27B Q4_K_M
16.5GB 128k ctx
FIT Runs comfortably
SPEED 27 tok/s
ⓘ estimated
MEMORY 17/192GB
Qwen3.6 27B Q8_0
28.0GB 128k ctx
FIT Runs comfortably
SPEED 17 tok/s
ⓘ estimated
MEMORY 28/192GB
Qwen3 32B Q8_0
34.0GB 128k ctx
FIT Runs comfortably
SPEED 14 tok/s
ⓘ estimated
MEMORY 34/192GB
Qwen3 32B Q6_K
28.5GB 128k ctx
FIT Runs comfortably
SPEED 16 tok/s
ⓘ estimated
MEMORY 29/192GB
Qwen3 32B Q5_K_M
24.5GB 128k ctx
FIT Runs comfortably
SPEED 19 tok/s
ⓘ estimated
MEMORY 25/192GB
Qwen3 32B Q4_K_M
20.0GB 128k ctx
FIT Runs comfortably
SPEED 23 tok/s
ⓘ estimated
MEMORY 20/192GB
MiMo-V2.6-Flash Q2_K
77.0GB 28k cap
FIT Runs comfortably
SPEED 26 tok/s
ⓘ estimated
MEMORY 77/192GB
Ornith-1.5-9B Q4_K_M
5.8GB 262k ctx
FIT Runs comfortably
SPEED 66 tok/s
ⓘ estimated
MEMORY 6/192GB
Ornith-1.5-9B Q5_K_M
6.6GB 262k ctx
FIT Runs comfortably
SPEED 59 tok/s
ⓘ estimated
MEMORY 7/192GB
Nemotron 3.5 Lightning FP16
60.0GB 284k cap
FIT Runs comfortably
SPEED 59 tok/s
ⓘ estimated
MEMORY 60/192GB
Nemotron 3.5 Lightning Q8_0
58.0GB 288k cap
FIT Runs comfortably
SPEED 61 tok/s
ⓘ estimated
MEMORY 58/192GB
Nemotron 3.5 Lightning Q4_K_M
32.0GB 350k cap
FIT Runs comfortably
SPEED 94 tok/s
ⓘ estimated
MEMORY 32/192GB
Ornith-1.5-9B Q6_K
7.6GB 262k ctx
FIT Runs comfortably
SPEED 54 tok/s
ⓘ estimated
MEMORY 8/192GB
Ornith-1.5-9B Q8_0
9.8GB 262k ctx
FIT Runs comfortably
SPEED 44 tok/s
ⓘ estimated
MEMORY 10/192GB
Ornith-1.5-9B BF16
18.4GB 262k ctx
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 18/192GB
Qwen3 30B A3B Q8_0
31.0GB 128k ctx
FIT Runs comfortably
SPEED 97 tok/s
ⓘ estimated
MEMORY 31/192GB
Qwen3 30B A3B Q4_K_M
15.5GB 128k ctx
FIT Runs comfortably
SPEED 136 tok/s
ⓘ estimated
MEMORY 16/192GB
Phi-4 14B Q4_K_M
8.5GB 16k ctx
FIT Runs comfortably
SPEED 51 tok/s
ⓘ estimated
MEMORY 9/192GB
Phi-4 14B FP16
29.0GB 16k ctx
FIT Runs comfortably
SPEED 17 tok/s
ⓘ estimated
MEMORY 29/192GB
Phi-4 14B Q8_0
15.0GB 16k ctx
FIT Runs comfortably
SPEED 31 tok/s
ⓘ estimated
MEMORY 15/192GB
Xing4.0-29B-A4B BF16
62.4GB 106k cap
FIT Runs comfortably
SPEED 38 tok/s
ⓘ estimated
MEMORY 62/192GB
Xing4.0-29B-A4B Q4_K_M
20.1GB 147k cap
FIT Runs comfortably
SPEED 67 tok/s
ⓘ estimated
MEMORY 20/192GB
Llama 3.3 70B Instruct Q2_K
21.5GB 113k cap
FIT Runs comfortably
SPEED 19 tok/s
ⓘ estimated
MEMORY 22/192GB
Llama 3.3 70B Instruct Q3_K_M
30.0GB 108k cap
FIT Runs comfortably
SPEED 14 tok/s
ⓘ estimated
MEMORY 30/192GB
Llama 3.3 70B Instruct Q4_K_M
42.0GB 100k cap
FIT Runs comfortably
SPEED 11 tok/s
ⓘ estimated
MEMORY 42/192GB
Llama 3.3 70B Instruct Q8_0
74.0GB 78k cap
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 74/192GB
Qwen3 14B Q8_0
15.0GB 128k ctx
FIT Runs comfortably
SPEED 30 tok/s
ⓘ estimated
MEMORY 15/192GB
Qwen3 14B Q4_K_M
9.0GB 128k ctx
FIT Runs comfortably
SPEED 47 tok/s
ⓘ estimated
MEMORY 9/192GB
Gemma 4 12B Q4_K_M
7.2GB 128k ctx
FIT Runs comfortably
SPEED 57 tok/s
ⓘ estimated
MEMORY 7/192GB
Gemma 4 12B Q8_0
13.0GB 128k ctx
FIT Runs comfortably
SPEED 35 tok/s
ⓘ estimated
MEMORY 13/192GB
Gemma 3 27B Q8_0
28.0GB 128k ctx
FIT Runs comfortably
SPEED 17 tok/s
ⓘ estimated
MEMORY 28/192GB
Gemma 3 27B Q4_K_M
17.0GB 128k ctx
FIT Runs comfortably
SPEED 26 tok/s
ⓘ estimated
MEMORY 17/192GB
Qwen3 8B Q8_0
8.5GB 128k ctx
FIT Runs comfortably
SPEED 49 tok/s
ⓘ estimated
MEMORY 9/192GB
Qwen3 8B Q4_K_M
5.2GB 128k ctx
FIT Runs comfortably
SPEED 71 tok/s
ⓘ estimated
MEMORY 5/192GB
Mixtral 8x7B Instruct Q4_K_M
26.5GB 32k ctx
FIT Runs comfortably
SPEED 55 tok/s
ⓘ estimated
MEMORY 27/192GB
Mixtral 8x7B Instruct Q3_K_M
19.0GB 32k ctx
FIT Runs comfortably
SPEED 71 tok/s
ⓘ estimated
MEMORY 19/192GB
Gemma 3 12B Q8_0
13.5GB 128k ctx
FIT Runs comfortably
SPEED 34 tok/s
ⓘ estimated
MEMORY 14/192GB
Gemma 3 12B Q4_K_M
7.5GB 128k ctx
FIT Runs comfortably
SPEED 56 tok/s
ⓘ estimated
MEMORY 8/192GB
Kolibri 1 BF16
156.2GB 1048k ctx
FIT Runs comfortably
SPEED 3 tok/s
ⓘ estimated
MEMORY 156/192GB
Mistral Nemo 12B Q8_0
13.2GB 128k ctx
FIT Runs comfortably
SPEED 35 tok/s
ⓘ estimated
MEMORY 13/192GB
Mistral Nemo 12B Q4_K_M
7.3GB 128k ctx
FIT Runs comfortably
SPEED 58 tok/s
ⓘ estimated
MEMORY 7/192GB
Qwen3 4B Q4_K_M
2.6GB 32k ctx
FIT Runs comfortably
SPEED 137 tok/s
ⓘ estimated
MEMORY 3/192GB
Phi-4 Mini Q4_K_M
2.5GB 128k ctx
FIT Runs comfortably
SPEED 155 tok/s
ⓘ estimated
MEMORY 3/192GB
Phi-4 Mini Q8_0
4.1GB 128k ctx
FIT Runs comfortably
SPEED 105 tok/s
ⓘ estimated
MEMORY 4/192GB
Llama 3.1 8B Instruct Q8_0
8.0GB 128k ctx
FIT Runs comfortably
SPEED 51 tok/s
ⓘ estimated
MEMORY 8/192GB
Llama 3.1 8B Instruct Q4_K_M
4.5GB 128k ctx
FIT Runs comfortably
SPEED 79 tok/s
ⓘ estimated
MEMORY 5/192GB
Llama 3.1 8B Instruct FP16
16.0GB 128k ctx
FIT Runs comfortably
SPEED 29 tok/s
ⓘ estimated
MEMORY 16/192GB
Gemma 3 4B Q8_0
5.0GB 128k ctx
FIT Runs comfortably
SPEED 83 tok/s
ⓘ estimated
MEMORY 5/192GB
Gemma 3 4B Q4_K_M
3.0GB 128k ctx
FIT Runs comfortably
SPEED 122 tok/s
ⓘ estimated
MEMORY 3/192GB
Llama 3.2 3B Instruct Q8_0
3.5GB 128k ctx
FIT Runs comfortably
SPEED 115 tok/s
ⓘ estimated
MEMORY 4/192GB
Llama 3.2 3B Instruct Q4_K_M
2.0GB 128k ctx
FIT Runs comfortably
SPEED 173 tok/s
ⓘ estimated
MEMORY 2/192GB
Mellum2.1 12B Thinking Q4_K_M
7.0GB 131k ctx
FIT Runs comfortably
SPEED 309 tok/s
ⓘ estimated
MEMORY 7/192GB
Mellum2.1 12B Thinking FP16
24.3GB 131k ctx
FIT Runs comfortably
SPEED 99 tok/s
ⓘ estimated
MEMORY 24/192GB
Muse Glimmer 30B FP16
60.0GB 128k ctx
FIT Runs comfortably
SPEED 8 tok/s
ⓘ estimated
MEMORY 60/192GB
Muse Glimmer 30B Q8_0
33.0GB 128k ctx
FIT Runs comfortably
SPEED 15 tok/s
ⓘ estimated
MEMORY 33/192GB
Muse Glimmer 30B Q4_K_M
18.0GB 128k ctx
FIT Runs comfortably
SPEED 25 tok/s
ⓘ estimated
MEMORY 18/192GB
MiniMax M2.7 UD-IQ1_M Unsloth
60.7GB 200k ctx
FIT Runs comfortably
SPEED 8 tok/s
ⓘ estimated
MEMORY 61/192GB
MiniMax M2.7 UD-Q4_K_XL Unsloth
140.8GB 200k ctx
FIT Runs comfortably
SPEED 4 tok/s
ⓘ estimated
MEMORY 141/192GB
MiniMax M2.7 UD-Q2_K_XL Unsloth
75.3GB 200k ctx
FIT Runs comfortably
SPEED 7 tok/s
ⓘ estimated
MEMORY 75/192GB
MiniMax M3 UD-IQ1_M Unsloth
128.4GB 529k cap
FIT Runs comfortably
SPEED 4 tok/s
ⓘ estimated
MEMORY 128/192GB
MiniMax M3 UD-Q2_K_XL Unsloth
143.0GB 407k cap
FIT Runs comfortably
SPEED 4 tok/s
ⓘ estimated
MEMORY 143/192GB
LFM2.5-24B-A2B FP8
24.0GB 131k ctx
FIT Runs comfortably
SPEED 222 tok/s
ⓘ estimated
MEMORY 24/192GB
LFM2.5-24B-A2B Q4_K_M
13.7GB 131k ctx
FIT Runs comfortably
SPEED 352 tok/s
ⓘ estimated
MEMORY 14/192GB
Runs tight
DeepSeek V3 0324 Q2_K
188.0GB 128k ctx
FIT Runs tight
SPEED 50 tok/s
ⓘ estimated
MEMORY 188/192GB
MiMo-V2.6-Flash FP8
177.7GB 3k cap
FIT Runs tight
SPEED 21 tok/s
ⓘ estimated
MEMORY 178/192GB
Muse Spark Open 816B-A42B UD-IQ1_S
176.0GB 1024k ctx
FIT Runs tight
SPEED 57 tok/s
ⓘ estimated
MEMORY 176/192GB
Runs with CPU offload
GLM-5.3-Flash UD-Q4_K_XL Unsloth
200.0GB ctx spills to ram
FIT Runs with CPU offload
SPEED 1 tok/s
ⓘ estimated
MEMORY 200/192GB
DeepSeek V4.1 Flash Q4_K_M
224.6GB 1000k ctx
FIT Runs with CPU offload
SPEED 0.5 tok/s
ⓘ estimated
MEMORY 225/192GB
Ornith-1.5-397B Q4_K_M
244.0GB ctx spills to ram
FIT Runs with CPU offload
SPEED 2 tok/s
ⓘ estimated
MEMORY 244/192GB
Ornith-1.5-397B Q5_K_M
286.0GB ctx spills to ram
FIT Runs with CPU offload
SPEED 2 tok/s
ⓘ estimated
MEMORY 286/192GB
GLM 5.2 Q2_K Unsloth
240.0GB ctx spills to ram
FIT Runs with CPU offload
SPEED 0.53 tok/s
ⓘ estimated
MEMORY 240/192GB
MiniMax M3 UD-Q4_K_XL Unsloth
264.9GB ctx spills to ram
FIT Runs with CPU offload
SPEED 2 tok/s
ⓘ estimated
MEMORY 265/192GB
MiniMax M3 MXFP4
256.5GB ctx spills to ram
FIT Runs with CPU offload
SPEED 2 tok/s
ⓘ estimated
MEMORY 257/192GB

Run GLM-5.3-Flash in the cloud

No hardware? Host it - per-token API or flat subscription

Relace per-token
$0.08
/MONTH
OpenInference per-token
$0.12
/MONTH
Wafer per-token
$0.14
/MONTH
Darkbloom per-token
$0.14
/MONTH
Tenstorrent per-token
$0.18
/MONTH
GMICloud per-token
$0.18
/MONTH
Novita per-token
$0.2
/MONTH
StreamLake per-token
$0.21
/MONTH
Morph per-token
$0.24
/MONTH
Reka per-token
$0.25
/MONTH
Makora per-token
$0.26
/MONTH
InferenceNet per-token
$0.26
/MONTH
Phala per-token
$0.27
/MONTH
DigitalOcean per-token
$0.27
/MONTH
Near AI per-token
$0.28
/MONTH
CoreWeave per-token
$0.28
/MONTH
Particle AI per-token
$0.3
/MONTH
NextBit per-token
$0.31
/MONTH
PrimeIntellect per-token
$0.36
/MONTH
Modal per-token
Serverless GPU inference platform. Serves open-weight models including reason...
$0.36
/MONTH
Z.AI per-token
$0.36
/MONTH
Venice per-token
$0.36
/MONTH
Friendli per-token
$0.36
/MONTH
DeepInfra per-token
$0.36
/MONTH
Nebius per-token
$0.36
/MONTH
AtlasCloud per-token
$0.36
/MONTH
SiliconFlow per-token
$0.36
/MONTH
Crusoe per-token
$0.36
/MONTH
Cohere per-token
$0.36
/MONTH
BaseTen per-token
$0.36
/MONTH
Mistral per-token
$0.36
/MONTH
Z.ai per-token
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
pricing may be outdated
$0.36
/MONTH
Together per-token
$0.36
/MONTH
Inceptron per-token
$0.37
/MONTH
Sail Research per-token
$0.44
/MONTH
Parasail per-token
$0.45
/MONTH
Fireworks per-token
$0.54
/MONTH
Z.ai Coding Plan Lite subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$10.0
/MONTH
OpenCode Go Go ($5 first month) subscription
Low-cost subscription for open coding models. $5 first month, then $10/month....
$10.0
/MONTH
Z.ai Coding Plan Pro subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$30.0
/MONTH
Z.ai Coding Plan Max subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$80.0
/MONTH

Coding alternatives

Hosted coding assistants for comparison - per seat

Cursor Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
/MONTH
GitHub Copilot Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
/MONTH
GitHub Copilot Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
/MONTH
Cursor Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
/MONTH
GitHub Copilot Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
/MONTH
Cursor Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
/MONTH

Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.

On a monthly budget? Compare owning hardware vs renting cloud →

Sign in with GitHub to save this rig and get weekly model updates

Sign in with GitHub

Tokenstead community

Not sure this is the right fit?

Post your rig and the shortlist in the community and get a sanity check from people running the same memory and stack.

Join the community Share your rig