Model
Fit
Speed
Memory
Scores / Run
Runs comfortably
93.1GB
1000k ctx
Runs comfortably
125
tok/s
ⓘ estimated
93
/ 512GB
93
/
92
/
91
Runs comfortably
125 tok/s
ⓘ estimated
93/512GB
109.0GB
1000k ctx
Runs comfortably
107
tok/s
ⓘ estimated
109
/ 512GB
93
/
92
/
91
Runs comfortably
107 tok/s
ⓘ estimated
109/512GB
120.0GB
1000k ctx
Runs comfortably
97
tok/s
ⓘ estimated
120
/ 512GB
93
/
92
/
91
Runs comfortably
97 tok/s
ⓘ estimated
120/512GB
200.0GB
1000k ctx
Runs comfortably
58
tok/s
ⓘ estimated
200
/ 512GB
93
/
92
/
91
Runs comfortably
58 tok/s
ⓘ estimated
200/512GB
DeepSeek V4.1 Flash
NVFP4
260.0GB
1000k ctx
Runs comfortably
87
tok/s
ⓘ estimated
260
/ 512GB
93
/
92
/
90
Runs comfortably
87 tok/s
ⓘ estimated
260/512GB
DeepSeek V4.1 Flash
Q4_K_M
224.6GB
1000k ctx
Runs comfortably
101
tok/s
ⓘ estimated
225
/ 512GB
93
/
92
/
90
Runs comfortably
101 tok/s
ⓘ estimated
225/512GB
DeepSeek V4.1 Flash
UD-Q2_K_XL
346.4GB
1000k ctx
Runs comfortably
65
tok/s
ⓘ estimated
346
/ 512GB
93
/
92
/
90
Runs comfortably
65 tok/s
ⓘ estimated
346/512GB
162.0GB
1000k ctx
Runs comfortably
88
tok/s
ⓘ estimated
162
/ 512GB
93
/
91
/
90
Runs comfortably
88 tok/s
ⓘ estimated
162/512GB
155.0GB
1000k ctx
Runs comfortably
92
tok/s
ⓘ estimated
155
/ 512GB
93
/
91
/
90
Runs comfortably
92 tok/s
ⓘ estimated
155/512GB
Ornith-1.5-397B
Q4_K_M
244.0GB
132k cap
Runs comfortably
3
tok/s
ⓘ estimated
244
/ 512GB
93
/
91
/
89
Runs comfortably
3 tok/s
ⓘ estimated
244/512GB
Ornith-1.5-397B
Q5_K_M
286.0GB
111k cap
Runs comfortably
2
tok/s
ⓘ estimated
286
/ 512GB
93
/
91
/
89
Runs comfortably
2 tok/s
ⓘ estimated
286/512GB
Runs comfortably
2 tok/s
ⓘ estimated
331/512GB
Runs comfortably
2 tok/s
ⓘ estimated
429/512GB
72.5GB
262k ctx
Runs comfortably
140
tok/s
ⓘ estimated
73
/ 512GB
92
/
92
/
89
Runs comfortably
140 tok/s
ⓘ estimated
73/512GB
Qwen3.8-Flash-Next
EXL3_2BPW
62.7GB
262k ctx
Runs comfortably
172
tok/s
ⓘ estimated
63
/ 512GB
92
/
92
/
89
Runs comfortably
172 tok/s
ⓘ estimated
63/512GB
Qwen3.8-Flash-Next
EXL3_3BPW
85.0GB
262k ctx
Runs comfortably
144
tok/s
ⓘ estimated
85
/ 512GB
92
/
92
/
89
Runs comfortably
144 tok/s
ⓘ estimated
85/512GB
240.0GB
1000k ctx
Runs comfortably
51
tok/s
ⓘ estimated
240
/ 512GB
91
/
92
/
88
Runs comfortably
51 tok/s
ⓘ estimated
240/512GB
365.0GB
1000k ctx
Runs comfortably
33
tok/s
ⓘ estimated
365
/ 512GB
91
/
92
/
88
Runs comfortably
33 tok/s
ⓘ estimated
365/512GB
410.0GB
1000k ctx
Runs comfortably
30
tok/s
ⓘ estimated
410
/ 512GB
91
/
92
/
88
Runs comfortably
30 tok/s
ⓘ estimated
410/512GB
DeepSeek V3 0324
Q2_K
188.0GB
128k ctx
Runs comfortably
63
tok/s
ⓘ estimated
188
/ 512GB
92
/
88
/
87
Runs comfortably
63 tok/s
ⓘ estimated
188/512GB
DeepSeek V3 0324
Q4_K_M
368.0GB
128k ctx
Runs comfortably
32
tok/s
ⓘ estimated
368
/ 512GB
92
/
88
/
87
Runs comfortably
32 tok/s
ⓘ estimated
368/512GB
Ornith-1.5-35B-A3B
Q8_0
37.8GB
262k ctx
Runs comfortably
121
tok/s
ⓘ estimated
38
/ 512GB
91
/
89
/
86
Runs comfortably
121 tok/s
ⓘ estimated
38/512GB
Ornith-1.5-35B-A3B
BF16
71.1GB
262k ctx
Runs comfortably
80
tok/s
ⓘ estimated
71
/ 512GB
91
/
89
/
86
Runs comfortably
80 tok/s
ⓘ estimated
71/512GB
Ornith-1.5-35B-A3B
Q4_K_M
21.7GB
262k ctx
Runs comfortably
161
tok/s
ⓘ estimated
22
/ 512GB
91
/
89
/
86
Runs comfortably
161 tok/s
ⓘ estimated
22/512GB
Ornith-1.5-35B-A3B
Q5_K_M
25.3GB
262k ctx
Runs comfortably
150
tok/s
ⓘ estimated
25
/ 512GB
91
/
89
/
86
Runs comfortably
150 tok/s
ⓘ estimated
25/512GB
Ornith-1.5-35B-A3B
Q6_K
29.2GB
262k ctx
Runs comfortably
140
tok/s
ⓘ estimated
29
/ 512GB
91
/
89
/
86
Runs comfortably
140 tok/s
ⓘ estimated
29/512GB
Runs comfortably
121 tok/s
ⓘ estimated
37/512GB
Qwen3.6 35B A3B
Q4_K_M
20.0GB
262k ctx
Runs comfortably
165
tok/s
ⓘ estimated
20
/ 512GB
90
/
91
/
87
Runs comfortably
165 tok/s
ⓘ estimated
20/512GB
Runs comfortably
11 tok/s
ⓘ estimated
56/512GB
Runs comfortably
22 tok/s
ⓘ estimated
28/512GB
Pokee-Isaac 28B
Q4_K_M
16.0GB
823k cap
Runs comfortably
36
tok/s
ⓘ estimated
16
/ 512GB
90
/
88
/
88
Runs comfortably
36 tok/s
ⓘ estimated
16/512GB
Runs comfortably
45 tok/s
ⓘ estimated
68/512GB
Qwen3 235B A22B
Q4_K_M
125.0GB
128k ctx
Runs comfortably
33
tok/s
ⓘ estimated
125
/ 512GB
88
/
90
/
85
Runs comfortably
33 tok/s
ⓘ estimated
125/512GB
17.6GB
262k ctx
Runs comfortably
33
tok/s
ⓘ estimated
18
/ 512GB
88
/
89
/
85
Runs comfortably
33 tok/s
ⓘ estimated
18/512GB
9.8GB
262k ctx
Runs comfortably
54
tok/s
ⓘ estimated
10
/ 512GB
88
/
89
/
85
Runs comfortably
54 tok/s
ⓘ estimated
10/512GB
6.2GB
262k ctx
Runs comfortably
78
tok/s
ⓘ estimated
6
/ 512GB
88
/
89
/
85
Runs comfortably
78 tok/s
ⓘ estimated
6/512GB
15.2GB
262k ctx
Runs comfortably
38
tok/s
ⓘ estimated
15
/ 512GB
88
/
89
/
85
Runs comfortably
38 tok/s
ⓘ estimated
15/512GB
Runs comfortably
34 tok/s
ⓘ estimated
16/512GB
Runs comfortably
10 tok/s
ⓘ estimated
61/512GB
Runs comfortably
31 tok/s
ⓘ estimated
18/512GB
Runs comfortably
18 tok/s
ⓘ estimated
33/512GB
Runs comfortably
30 tok/s
ⓘ estimated
18/512GB
Runs comfortably
63 tok/s
ⓘ estimated
50/512GB
Runs comfortably
99 tok/s
ⓘ estimated
25/512GB
Gemma 4 26B A4B
Q4_K_M
13.0GB
256k ctx
Runs comfortably
136
tok/s
ⓘ estimated
13
/ 512GB
85
/
88
/
84
Runs comfortably
136 tok/s
ⓘ estimated
13/512GB
Gemma 4 26B A4B
NVFP4
14.0GB
256k ctx
Runs comfortably
132
tok/s
ⓘ estimated
14
/ 512GB
85
/
88
/
84
Runs comfortably
132 tok/s
ⓘ estimated
14/512GB
Runs comfortably
21 tok/s
ⓘ estimated
28/512GB
Runs comfortably
34 tok/s
ⓘ estimated
17/512GB
Runs comfortably
24 tok/s
ⓘ estimated
25/512GB
Runs comfortably
18 tok/s
ⓘ estimated
34/512GB
Runs comfortably
21 tok/s
ⓘ estimated
29/512GB
Runs comfortably
29 tok/s
ⓘ estimated
20/512GB
Runs comfortably
26 tok/s
ⓘ estimated
178/512GB
Runs comfortably
33 tok/s
ⓘ estimated
77/512GB
58.0GB
999k cap
Runs comfortably
78
tok/s
ⓘ estimated
58
/ 512GB
78
/
76
/
74
Runs comfortably
78 tok/s
ⓘ estimated
58/512GB
Nemotron 3.5 Lightning
Q4_K_M
32.0GB
1000k ctx
Runs comfortably
119
tok/s
ⓘ estimated
32
/ 512GB
78
/
76
/
74
Runs comfortably
119 tok/s
ⓘ estimated
32/512GB
60.0GB
995k cap
Runs comfortably
75
tok/s
ⓘ estimated
60
/ 512GB
78
/
76
/
74
Runs comfortably
75 tok/s
ⓘ estimated
60/512GB
Runs comfortably
68 tok/s
ⓘ estimated
8/512GB
Runs comfortably
84 tok/s
ⓘ estimated
6/512GB
Runs comfortably
75 tok/s
ⓘ estimated
7/512GB
Runs comfortably
32 tok/s
ⓘ estimated
18/512GB
Runs comfortably
55 tok/s
ⓘ estimated
10/512GB
Runs comfortably
173 tok/s
ⓘ estimated
16/512GB
Runs comfortably
124 tok/s
ⓘ estimated
31/512GB
Runs comfortably
65 tok/s
ⓘ estimated
9/512GB
Runs comfortably
39 tok/s
ⓘ estimated
15/512GB
Runs comfortably
21 tok/s
ⓘ estimated
29/512GB
Runs comfortably
48 tok/s
ⓘ estimated
62/512GB
Xing4.0-29B-A4B
Q4_K_M
20.1GB
256k ctx
Runs comfortably
85
tok/s
ⓘ estimated
20
/ 512GB
75
/
73
/
72
Runs comfortably
85 tok/s
ⓘ estimated
20/512GB
Llama 3.3 70B Instruct
Q3_K_M
30.0GB
128k ctx
Runs comfortably
18
tok/s
ⓘ estimated
30
/ 512GB
72
/
77
/
80
Runs comfortably
18 tok/s
ⓘ estimated
30/512GB
21.5GB
128k ctx
Runs comfortably
24
tok/s
ⓘ estimated
22
/ 512GB
72
/
77
/
80
Runs comfortably
24 tok/s
ⓘ estimated
22/512GB
Llama 3.3 70B Instruct
Q4_K_M
42.0GB
128k ctx
Runs comfortably
14
tok/s
ⓘ estimated
42
/ 512GB
72
/
77
/
80
Runs comfortably
14 tok/s
ⓘ estimated
42/512GB
74.0GB
128k ctx
Runs comfortably
8
tok/s
ⓘ estimated
74
/ 512GB
72
/
77
/
80
Runs comfortably
8 tok/s
ⓘ estimated
74/512GB
Runs comfortably
59 tok/s
ⓘ estimated
9/512GB
Runs comfortably
38 tok/s
ⓘ estimated
15/512GB
Runs comfortably
44 tok/s
ⓘ estimated
13/512GB
Runs comfortably
72 tok/s
ⓘ estimated
7/512GB
Runs comfortably
21 tok/s
ⓘ estimated
28/512GB
Runs comfortably
33 tok/s
ⓘ estimated
17/512GB
Runs comfortably
62 tok/s
ⓘ estimated
9/512GB
Runs comfortably
90 tok/s
ⓘ estimated
5/512GB
Runs comfortably
71 tok/s
ⓘ estimated
8/512GB
Runs comfortably
43 tok/s
ⓘ estimated
14/512GB
Mixtral 8x7B Instruct
Q3_K_M
19.0GB
32k ctx
Runs comfortably
90
tok/s
ⓘ estimated
19
/ 512GB
62
/
65
/
68
Runs comfortably
90 tok/s
ⓘ estimated
19/512GB
Mixtral 8x7B Instruct
Q4_K_M
26.5GB
32k ctx
Runs comfortably
70
tok/s
ⓘ estimated
27
/ 512GB
62
/
65
/
68
Runs comfortably
70 tok/s
ⓘ estimated
27/512GB
Runs comfortably
4 tok/s
ⓘ estimated
156/512GB
Runs comfortably
44 tok/s
ⓘ estimated
13/512GB
Runs comfortably
73 tok/s
ⓘ estimated
7/512GB
Runs comfortably
175 tok/s
ⓘ estimated
3/512GB
Runs comfortably
197 tok/s
ⓘ estimated
3/512GB
Runs comfortably
133 tok/s
ⓘ estimated
4/512GB
Llama 3.1 8B Instruct
Q4_K_M
4.5GB
128k ctx
Runs comfortably
100
tok/s
ⓘ estimated
5
/ 512GB
52
/
55
/
62
Runs comfortably
100 tok/s
ⓘ estimated
5/512GB
8.0GB
128k ctx
Runs comfortably
65
tok/s
ⓘ estimated
8
/ 512GB
52
/
55
/
62
Runs comfortably
65 tok/s
ⓘ estimated
8/512GB
16.0GB
128k ctx
Runs comfortably
36
tok/s
ⓘ estimated
16
/ 512GB
52
/
55
/
62
Runs comfortably
36 tok/s
ⓘ estimated
16/512GB
Runs comfortably
155 tok/s
ⓘ estimated
3/512GB
Runs comfortably
105 tok/s
ⓘ estimated
5/512GB
3.5GB
128k ctx
Runs comfortably
146
tok/s
ⓘ estimated
4
/ 512GB
35
/
38
/
50
Runs comfortably
146 tok/s
ⓘ estimated
4/512GB
Llama 3.2 3B Instruct
Q4_K_M
2.0GB
128k ctx
Runs comfortably
220
tok/s
ⓘ estimated
2
/ 512GB
35
/
38
/
50
Runs comfortably
220 tok/s
ⓘ estimated
2/512GB
Runs comfortably
394 tok/s
ⓘ estimated
7/512GB
Runs comfortably
125 tok/s
ⓘ estimated
24/512GB
Runs comfortably
10 tok/s
ⓘ estimated
60/512GB
Runs comfortably
18 tok/s
ⓘ estimated
33/512GB
Runs comfortably
32 tok/s
ⓘ estimated
18/512GB
Runs comfortably
26 tok/s
ⓘ estimated
484/512GB
Muse Spark Open 816B-A42B
UD-Q2_K_XL
311.0GB
1024k ctx
Runs comfortably
41
tok/s
ⓘ estimated
311
/ 512GB
Runs comfortably
41 tok/s
ⓘ estimated
311/512GB
Muse Spark Open 816B-A42B
UD-IQ1_S
176.0GB
1024k ctx
Runs comfortably
72
tok/s
ⓘ estimated
176
/ 512GB
Runs comfortably
72 tok/s
ⓘ estimated
176/512GB
Runs comfortably
11 tok/s
ⓘ estimated
61/512GB
Runs comfortably
5 tok/s
ⓘ estimated
141/512GB
Runs comfortably
9 tok/s
ⓘ estimated
75/512GB
Runs comfortably
3 tok/s
ⓘ estimated
257/512GB
Runs comfortably
2 tok/s
ⓘ estimated
265/512GB
Runs comfortably
5 tok/s
ⓘ estimated
128/512GB
Runs comfortably
5 tok/s
ⓘ estimated
143/512GB
Runs comfortably
282 tok/s
ⓘ estimated
24/512GB
Runs comfortably
448 tok/s
ⓘ estimated
14/512GB
Runs tight
Runs tight
24 tok/s
ⓘ estimated
510/512GB
Run GLM-5.3-Flash in the cloud
No hardware? Host it - per-token API or flat subscription
Relace
per-token
$0.08
Darkbloom
per-token
$0.14
Wafer
per-token
$0.16
OpenInference
per-token
$0.18
Tenstorrent
per-token
$0.18
GMICloud
per-token
$0.18
Morph
per-token
$0.18
Novita
per-token
$0.2
StreamLake
per-token
$0.21
Reka
per-token
$0.25
InferenceNet
per-token
$0.26
Makora
per-token
$0.26
SiliconFlow
per-token
$0.26
DigitalOcean
per-token
$0.27
Near AI
per-token
$0.28
CoreWeave
per-token
$0.28
River
per-token
$0.29
DekaLLM
per-token
$0.3
NextBit
per-token
$0.31
Particle AI
per-token
$0.32
Nebius
per-token
$0.36
Mistral
per-token
$0.36
Modal
per-token
Serverless GPU inference platform. Serves open-weight models including reason...
$0.36
Z.AI
per-token
$0.36
Venice
per-token
$0.36
Friendli
per-token
$0.36
Z.ai
per-token
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
pricing may be outdated
$0.36
AtlasCloud
per-token
$0.36
Crusoe
per-token
$0.36
BaseTen
per-token
$0.36
Together
per-token
$0.36
Cohere
per-token
$0.36
DeepInfra
per-token
$0.36
KT
per-token
$0.36
Inceptron
per-token
$0.38
Sail Research
per-token
$0.44
Parasail
per-token
$0.45
Fireworks
per-token
$0.54
Z.ai
Coding Plan Lite
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$10.0
OpenCode Go
Go ($5 first month)
subscription
Low-cost subscription for open coding models. $5 first month, then $10/month....
$10.0
Z.ai
Coding Plan Pro
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$30.0
Z.ai
Coding Plan Max
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$80.0
Coding alternatives
Hosted coding assistants for comparison - per seat
Cursor
Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
GitHub Copilot
Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
GitHub Copilot
Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
Cursor
Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
GitHub Copilot
Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
Cursor
Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.
Sign in with GitHub to save this rig and get weekly model updates
Sign in with GitHubTokenstead community
Not sure this is the right fit?
Post your rig and the shortlist in the community and get a sanity check from people running the same memory and stack.