Model
Fit
Speed
Memory
Scores / Run
Runs comfortably
120.0GB
1000k ctx
Runs comfortably
22
tok/s
ⓘ estimated
120
/ 192GB
93
/
92
/
91
Runs comfortably
22 tok/s
ⓘ estimated
120/192GB
109.0GB
1000k ctx
Runs comfortably
24
tok/s
ⓘ estimated
109
/ 192GB
93
/
92
/
91
Runs comfortably
24 tok/s
ⓘ estimated
109/192GB
93.1GB
1000k ctx
Runs comfortably
29
tok/s
ⓘ estimated
93
/ 192GB
93
/
92
/
91
Runs comfortably
29 tok/s
ⓘ estimated
93/192GB
162.0GB
1000k ctx
Runs comfortably
20
tok/s
ⓘ estimated
162
/ 192GB
93
/
91
/
90
Runs comfortably
20 tok/s
ⓘ estimated
162/192GB
155.0GB
1000k ctx
Runs comfortably
21
tok/s
ⓘ estimated
155
/ 192GB
93
/
91
/
90
Runs comfortably
21 tok/s
ⓘ estimated
155/192GB
72.5GB
207k cap
Runs comfortably
32
tok/s
ⓘ estimated
73
/ 192GB
92
/
92
/
89
Runs comfortably
32 tok/s
ⓘ estimated
73/192GB
Qwen3.8-Flash-Next
EXL3_2BPW
62.7GB
262k ctx
Runs comfortably
39
tok/s
ⓘ estimated
63
/ 192GB
92
/
92
/
89
Runs comfortably
39 tok/s
ⓘ estimated
63/192GB
Qwen3.8-Flash-Next
EXL3_3BPW
85.0GB
262k ctx
Runs comfortably
33
tok/s
ⓘ estimated
85
/ 192GB
92
/
92
/
89
Runs comfortably
33 tok/s
ⓘ estimated
85/192GB
Ornith-1.5-35B-A3B
Q8_0
37.8GB
262k ctx
Runs comfortably
28
tok/s
ⓘ estimated
38
/ 192GB
91
/
89
/
86
Runs comfortably
28 tok/s
ⓘ estimated
38/192GB
Ornith-1.5-35B-A3B
Q4_K_M
21.7GB
262k ctx
Runs comfortably
37
tok/s
ⓘ estimated
22
/ 192GB
91
/
89
/
86
Runs comfortably
37 tok/s
ⓘ estimated
22/192GB
Ornith-1.5-35B-A3B
Q6_K
29.2GB
262k ctx
Runs comfortably
32
tok/s
ⓘ estimated
29
/ 192GB
91
/
89
/
86
Runs comfortably
32 tok/s
ⓘ estimated
29/192GB
Ornith-1.5-35B-A3B
BF16
71.1GB
218k cap
Runs comfortably
18
tok/s
ⓘ estimated
71
/ 192GB
91
/
89
/
86
Runs comfortably
18 tok/s
ⓘ estimated
71/192GB
Ornith-1.5-35B-A3B
Q5_K_M
25.3GB
262k ctx
Runs comfortably
34
tok/s
ⓘ estimated
25
/ 192GB
91
/
89
/
86
Runs comfortably
34 tok/s
ⓘ estimated
25/192GB
Qwen3.6 35B A3B
Q4_K_M
20.0GB
262k ctx
Runs comfortably
38
tok/s
ⓘ estimated
20
/ 192GB
90
/
91
/
87
Runs comfortably
38 tok/s
ⓘ estimated
20/192GB
Runs comfortably
28 tok/s
ⓘ estimated
37/192GB
Runs comfortably
3 tok/s
ⓘ estimated
56/192GB
Runs comfortably
5 tok/s
ⓘ estimated
28/192GB
Runs comfortably
8 tok/s
ⓘ estimated
16/192GB
Runs comfortably
10 tok/s
ⓘ estimated
68/192GB
Qwen3 235B A22B
Q4_K_M
125.0GB
33k cap
Runs comfortably
8
tok/s
ⓘ estimated
125
/ 192GB
88
/
90
/
85
Runs comfortably
8 tok/s
ⓘ estimated
125/192GB
17.6GB
262k ctx
Runs comfortably
8
tok/s
ⓘ estimated
18
/ 192GB
88
/
89
/
85
Runs comfortably
8 tok/s
ⓘ estimated
18/192GB
9.8GB
262k ctx
Runs comfortably
12
tok/s
ⓘ estimated
10
/ 192GB
88
/
89
/
85
Runs comfortably
12 tok/s
ⓘ estimated
10/192GB
6.2GB
262k ctx
Runs comfortably
18
tok/s
ⓘ estimated
6
/ 192GB
88
/
89
/
85
Runs comfortably
18 tok/s
ⓘ estimated
6/192GB
Runs comfortably
7 tok/s
ⓘ estimated
18/192GB
Runs comfortably
7 tok/s
ⓘ estimated
18/192GB
Runs comfortably
4 tok/s
ⓘ estimated
33/192GB
Runs comfortably
2 tok/s
ⓘ estimated
61/192GB
Runs comfortably
14 tok/s
ⓘ estimated
50/192GB
Runs comfortably
23 tok/s
ⓘ estimated
25/192GB
Gemma 4 26B A4B
Q4_K_M
13.0GB
251k cap
Runs comfortably
31
tok/s
ⓘ estimated
13
/ 192GB
85
/
88
/
84
Runs comfortably
31 tok/s
ⓘ estimated
13/192GB
Runs comfortably
8 tok/s
ⓘ estimated
17/192GB
Runs comfortably
5 tok/s
ⓘ estimated
28/192GB
Runs comfortably
4 tok/s
ⓘ estimated
34/192GB
Runs comfortably
5 tok/s
ⓘ estimated
29/192GB
Runs comfortably
5 tok/s
ⓘ estimated
25/192GB
Runs comfortably
7 tok/s
ⓘ estimated
20/192GB
Runs comfortably
7 tok/s
ⓘ estimated
77/192GB
Runs comfortably
19 tok/s
ⓘ estimated
6/192GB
Runs comfortably
17 tok/s
ⓘ estimated
7/192GB
60.0GB
284k cap
Runs comfortably
17
tok/s
ⓘ estimated
60
/ 192GB
78
/
76
/
74
Runs comfortably
17 tok/s
ⓘ estimated
60/192GB
58.0GB
288k cap
Runs comfortably
18
tok/s
ⓘ estimated
58
/ 192GB
78
/
76
/
74
Runs comfortably
18 tok/s
ⓘ estimated
58/192GB
Nemotron 3.5 Lightning
Q4_K_M
32.0GB
350k cap
Runs comfortably
27
tok/s
ⓘ estimated
32
/ 192GB
78
/
76
/
74
Runs comfortably
27 tok/s
ⓘ estimated
32/192GB
Runs comfortably
16 tok/s
ⓘ estimated
8/192GB
Runs comfortably
13 tok/s
ⓘ estimated
10/192GB
Runs comfortably
7 tok/s
ⓘ estimated
18/192GB
Runs comfortably
28 tok/s
ⓘ estimated
31/192GB
Runs comfortably
40 tok/s
ⓘ estimated
16/192GB
Runs comfortably
15 tok/s
ⓘ estimated
9/192GB
Runs comfortably
5 tok/s
ⓘ estimated
29/192GB
Runs comfortably
9 tok/s
ⓘ estimated
15/192GB
Runs comfortably
11 tok/s
ⓘ estimated
62/192GB
Xing4.0-29B-A4B
Q4_K_M
20.1GB
147k cap
Runs comfortably
20
tok/s
ⓘ estimated
20
/ 192GB
75
/
73
/
72
Runs comfortably
20 tok/s
ⓘ estimated
20/192GB
21.5GB
113k cap
Runs comfortably
5
tok/s
ⓘ estimated
22
/ 192GB
72
/
77
/
80
Runs comfortably
5 tok/s
ⓘ estimated
22/192GB
Llama 3.3 70B Instruct
Q3_K_M
30.0GB
108k cap
Runs comfortably
4
tok/s
ⓘ estimated
30
/ 192GB
72
/
77
/
80
Runs comfortably
4 tok/s
ⓘ estimated
30/192GB
Llama 3.3 70B Instruct
Q4_K_M
42.0GB
100k cap
Runs comfortably
3
tok/s
ⓘ estimated
42
/ 192GB
72
/
77
/
80
Runs comfortably
3 tok/s
ⓘ estimated
42/192GB
74.0GB
78k cap
Runs comfortably
2
tok/s
ⓘ estimated
74
/ 192GB
72
/
77
/
80
Runs comfortably
2 tok/s
ⓘ estimated
74/192GB
Runs comfortably
9 tok/s
ⓘ estimated
15/192GB
Runs comfortably
14 tok/s
ⓘ estimated
9/192GB
Runs comfortably
17 tok/s
ⓘ estimated
7/192GB
Runs comfortably
10 tok/s
ⓘ estimated
13/192GB
Runs comfortably
5 tok/s
ⓘ estimated
28/192GB
Runs comfortably
7 tok/s
ⓘ estimated
17/192GB
Runs comfortably
14 tok/s
ⓘ estimated
9/192GB
Runs comfortably
21 tok/s
ⓘ estimated
5/192GB
Mixtral 8x7B Instruct
Q4_K_M
26.5GB
32k ctx
Runs comfortably
16
tok/s
ⓘ estimated
27
/ 192GB
62
/
65
/
68
Runs comfortably
16 tok/s
ⓘ estimated
27/192GB
Mixtral 8x7B Instruct
Q3_K_M
19.0GB
32k ctx
Runs comfortably
21
tok/s
ⓘ estimated
19
/ 192GB
62
/
65
/
68
Runs comfortably
21 tok/s
ⓘ estimated
19/192GB
Runs comfortably
10 tok/s
ⓘ estimated
14/192GB
Runs comfortably
16 tok/s
ⓘ estimated
8/192GB
Runs comfortably
0.96 tok/s
ⓘ estimated
156/192GB
Runs comfortably
10 tok/s
ⓘ estimated
13/192GB
Runs comfortably
17 tok/s
ⓘ estimated
7/192GB
Runs comfortably
40 tok/s
ⓘ estimated
3/192GB
Runs comfortably
45 tok/s
ⓘ estimated
3/192GB
Runs comfortably
31 tok/s
ⓘ estimated
4/192GB
8.0GB
128k ctx
Runs comfortably
15
tok/s
ⓘ estimated
8
/ 192GB
52
/
55
/
62
Runs comfortably
15 tok/s
ⓘ estimated
8/192GB
Llama 3.1 8B Instruct
Q4_K_M
4.5GB
128k ctx
Runs comfortably
23
tok/s
ⓘ estimated
5
/ 192GB
52
/
55
/
62
Runs comfortably
23 tok/s
ⓘ estimated
5/192GB
16.0GB
128k ctx
Runs comfortably
8
tok/s
ⓘ estimated
16
/ 192GB
52
/
55
/
62
Runs comfortably
8 tok/s
ⓘ estimated
16/192GB
Runs comfortably
24 tok/s
ⓘ estimated
5/192GB
Runs comfortably
36 tok/s
ⓘ estimated
3/192GB
3.5GB
128k ctx
Runs comfortably
33
tok/s
ⓘ estimated
4
/ 192GB
35
/
38
/
50
Runs comfortably
33 tok/s
ⓘ estimated
4/192GB
Llama 3.2 3B Instruct
Q4_K_M
2.0GB
128k ctx
Runs comfortably
50
tok/s
ⓘ estimated
2
/ 192GB
35
/
38
/
50
Runs comfortably
50 tok/s
ⓘ estimated
2/192GB
Runs comfortably
90 tok/s
ⓘ estimated
7/192GB
Runs comfortably
29 tok/s
ⓘ estimated
24/192GB
Runs comfortably
2 tok/s
ⓘ estimated
60/192GB
Runs comfortably
4 tok/s
ⓘ estimated
33/192GB
Runs comfortably
7 tok/s
ⓘ estimated
18/192GB
Runs comfortably
2 tok/s
ⓘ estimated
61/192GB
Runs comfortably
1 tok/s
ⓘ estimated
141/192GB
Runs comfortably
2 tok/s
ⓘ estimated
75/192GB
Runs comfortably
1 tok/s
ⓘ estimated
128/192GB
Runs comfortably
1 tok/s
ⓘ estimated
143/192GB
Runs comfortably
65 tok/s
ⓘ estimated
24/192GB
Runs comfortably
103 tok/s
ⓘ estimated
14/192GB
Runs tight
Runs tight
14 tok/s
ⓘ estimated
188/192GB
Runs tight
6 tok/s
ⓘ estimated
178/192GB
Runs tight
17 tok/s
ⓘ estimated
176/192GB
Run GLM-5.3-Flash in the cloud
No hardware? Host it - per-token API or flat subscription
Relace
per-token
$0.08
Darkbloom
per-token
$0.14
PrimeIntellect
per-token
$0.15
Morph
per-token
$0.16
Wafer
per-token
$0.16
OpenInference
per-token
$0.18
Tenstorrent
per-token
$0.18
GMICloud
per-token
$0.18
Novita
per-token
$0.2
StreamLake
per-token
$0.21
Reka
per-token
$0.25
Makora
per-token
$0.26
InferenceNet
per-token
$0.26
DigitalOcean
per-token
$0.27
Near AI
per-token
$0.28
CoreWeave
per-token
$0.28
DekaLLM
per-token
$0.3
NextBit
per-token
$0.31
Particle AI
per-token
$0.32
Modal
per-token
Serverless GPU inference platform. Serves open-weight models including reason...
$0.36
Nebius
per-token
$0.36
Mistral
per-token
$0.36
Z.AI
per-token
$0.36
Venice
per-token
$0.36
Friendli
per-token
$0.36
Fireworks
per-token
$0.36
Z.ai
per-token
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
pricing may be outdated
$0.36
KT
per-token
$0.36
DeepInfra
per-token
$0.36
SiliconFlow
per-token
$0.36
Cohere
per-token
$0.36
Together
per-token
$0.36
BaseTen
per-token
$0.36
Crusoe
per-token
$0.36
AtlasCloud
per-token
$0.36
Inceptron
per-token
$0.39
Sail Research
per-token
$0.44
Parasail
per-token
$0.45
Z.ai
Coding Plan Lite
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$10.0
OpenCode Go
Go ($5 first month)
subscription
Low-cost subscription for open coding models. $5 first month, then $10/month....
$10.0
Z.ai
Coding Plan Pro
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$30.0
Z.ai
Coding Plan Max
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$80.0
Coding alternatives
Hosted coding assistants for comparison - per seat
Cursor
Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
GitHub Copilot
Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
GitHub Copilot
Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
Cursor
Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
GitHub Copilot
Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
Cursor
Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.
Sign in with GitHub to save this rig and get weekly model updates
Sign in with GitHubTokenstead community
Not sure this is the right fit?
Post your rig and the shortlist in the community and get a sanity check from people running the same memory and stack.