Model
Fit
Speed
Memory
Scores / Run
Runs comfortably
120.0GB
1000k ctx
Runs comfortably
22
tok/s
ⓘ estimated
120
/ 192GB
93
/
92
/
91
Runs comfortably
22 tok/s
ⓘ estimated
120/192GB
109.0GB
1000k ctx
Runs comfortably
24
tok/s
ⓘ estimated
109
/ 192GB
93
/
92
/
91
Runs comfortably
24 tok/s
ⓘ estimated
109/192GB
93.1GB
1000k ctx
Runs comfortably
29
tok/s
ⓘ estimated
93
/ 192GB
93
/
92
/
91
Runs comfortably
29 tok/s
ⓘ estimated
93/192GB
162.0GB
1000k ctx
Runs comfortably
20
tok/s
ⓘ estimated
162
/ 192GB
93
/
91
/
90
Runs comfortably
20 tok/s
ⓘ estimated
162/192GB
155.0GB
1000k ctx
Runs comfortably
21
tok/s
ⓘ estimated
155
/ 192GB
93
/
91
/
90
Runs comfortably
21 tok/s
ⓘ estimated
155/192GB
72.5GB
207k cap
Runs comfortably
32
tok/s
ⓘ estimated
73
/ 192GB
92
/
92
/
89
Runs comfortably
32 tok/s
ⓘ estimated
73/192GB
Qwen3.8-Flash-Next
EXL3_3BPW
85.0GB
262k ctx
Runs comfortably
33
tok/s
ⓘ estimated
85
/ 192GB
92
/
92
/
89
Runs comfortably
33 tok/s
ⓘ estimated
85/192GB
Qwen3.8-Flash-Next
EXL3_2BPW
62.7GB
262k ctx
Runs comfortably
39
tok/s
ⓘ estimated
63
/ 192GB
92
/
92
/
89
Runs comfortably
39 tok/s
ⓘ estimated
63/192GB
Ornith-1.5-35B-A3B
Q5_K_M
25.3GB
262k ctx
Runs comfortably
34
tok/s
ⓘ estimated
25
/ 192GB
91
/
89
/
86
Runs comfortably
34 tok/s
ⓘ estimated
25/192GB
Ornith-1.5-35B-A3B
Q6_K
29.2GB
262k ctx
Runs comfortably
32
tok/s
ⓘ estimated
29
/ 192GB
91
/
89
/
86
Runs comfortably
32 tok/s
ⓘ estimated
29/192GB
Ornith-1.5-35B-A3B
Q8_0
37.8GB
262k ctx
Runs comfortably
28
tok/s
ⓘ estimated
38
/ 192GB
91
/
89
/
86
Runs comfortably
28 tok/s
ⓘ estimated
38/192GB
Ornith-1.5-35B-A3B
Q4_K_M
21.7GB
262k ctx
Runs comfortably
37
tok/s
ⓘ estimated
22
/ 192GB
91
/
89
/
86
Runs comfortably
37 tok/s
ⓘ estimated
22/192GB
Ornith-1.5-35B-A3B
BF16
71.1GB
218k cap
Runs comfortably
18
tok/s
ⓘ estimated
71
/ 192GB
91
/
89
/
86
Runs comfortably
18 tok/s
ⓘ estimated
71/192GB
Runs comfortably
28 tok/s
ⓘ estimated
37/192GB
Qwen3.6 35B A3B
Q4_K_M
20.0GB
262k ctx
Runs comfortably
38
tok/s
ⓘ estimated
20
/ 192GB
90
/
91
/
87
Runs comfortably
38 tok/s
ⓘ estimated
20/192GB
Runs comfortably
8 tok/s
ⓘ estimated
16/192GB
Runs comfortably
5 tok/s
ⓘ estimated
28/192GB
Runs comfortably
3 tok/s
ⓘ estimated
56/192GB
Qwen3 235B A22B
Q4_K_M
125.0GB
33k cap
Runs comfortably
8
tok/s
ⓘ estimated
125
/ 192GB
88
/
90
/
85
Runs comfortably
8 tok/s
ⓘ estimated
125/192GB
Runs comfortably
10 tok/s
ⓘ estimated
68/192GB
6.2GB
262k ctx
Runs comfortably
18
tok/s
ⓘ estimated
6
/ 192GB
88
/
89
/
85
Runs comfortably
18 tok/s
ⓘ estimated
6/192GB
9.8GB
262k ctx
Runs comfortably
12
tok/s
ⓘ estimated
10
/ 192GB
88
/
89
/
85
Runs comfortably
12 tok/s
ⓘ estimated
10/192GB
17.6GB
262k ctx
Runs comfortably
8
tok/s
ⓘ estimated
18
/ 192GB
88
/
89
/
85
Runs comfortably
8 tok/s
ⓘ estimated
18/192GB
Runs comfortably
7 tok/s
ⓘ estimated
18/192GB
Runs comfortably
4 tok/s
ⓘ estimated
33/192GB
Runs comfortably
2 tok/s
ⓘ estimated
61/192GB
Runs comfortably
7 tok/s
ⓘ estimated
18/192GB
Runs comfortably
14 tok/s
ⓘ estimated
50/192GB
Runs comfortably
23 tok/s
ⓘ estimated
25/192GB
Gemma 4 26B A4B
Q4_K_M
13.0GB
251k cap
Runs comfortably
31
tok/s
ⓘ estimated
13
/ 192GB
85
/
88
/
84
Runs comfortably
31 tok/s
ⓘ estimated
13/192GB
Runs comfortably
5 tok/s
ⓘ estimated
28/192GB
Runs comfortably
8 tok/s
ⓘ estimated
17/192GB
Runs comfortably
7 tok/s
ⓘ estimated
20/192GB
Runs comfortably
4 tok/s
ⓘ estimated
34/192GB
Runs comfortably
5 tok/s
ⓘ estimated
25/192GB
Runs comfortably
5 tok/s
ⓘ estimated
29/192GB
Runs comfortably
7 tok/s
ⓘ estimated
77/192GB
Nemotron 3.5 Lightning
Q4_K_M
32.0GB
350k cap
Runs comfortably
27
tok/s
ⓘ estimated
32
/ 192GB
78
/
76
/
74
Runs comfortably
27 tok/s
ⓘ estimated
32/192GB
58.0GB
288k cap
Runs comfortably
18
tok/s
ⓘ estimated
58
/ 192GB
78
/
76
/
74
Runs comfortably
18 tok/s
ⓘ estimated
58/192GB
60.0GB
284k cap
Runs comfortably
17
tok/s
ⓘ estimated
60
/ 192GB
78
/
76
/
74
Runs comfortably
17 tok/s
ⓘ estimated
60/192GB
Runs comfortably
7 tok/s
ⓘ estimated
18/192GB
Runs comfortably
19 tok/s
ⓘ estimated
6/192GB
Runs comfortably
17 tok/s
ⓘ estimated
7/192GB
Runs comfortably
16 tok/s
ⓘ estimated
8/192GB
Runs comfortably
13 tok/s
ⓘ estimated
10/192GB
Runs comfortably
40 tok/s
ⓘ estimated
16/192GB
Runs comfortably
28 tok/s
ⓘ estimated
31/192GB
Runs comfortably
15 tok/s
ⓘ estimated
9/192GB
Runs comfortably
9 tok/s
ⓘ estimated
15/192GB
Runs comfortably
5 tok/s
ⓘ estimated
29/192GB
Runs comfortably
11 tok/s
ⓘ estimated
62/192GB
Xing4.0-29B-A4B
Q4_K_M
20.1GB
147k cap
Runs comfortably
20
tok/s
ⓘ estimated
20
/ 192GB
75
/
73
/
72
Runs comfortably
20 tok/s
ⓘ estimated
20/192GB
Llama 3.3 70B Instruct
Q3_K_M
30.0GB
108k cap
Runs comfortably
4
tok/s
ⓘ estimated
30
/ 192GB
72
/
77
/
80
Runs comfortably
4 tok/s
ⓘ estimated
30/192GB
21.5GB
113k cap
Runs comfortably
5
tok/s
ⓘ estimated
22
/ 192GB
72
/
77
/
80
Runs comfortably
5 tok/s
ⓘ estimated
22/192GB
Llama 3.3 70B Instruct
Q4_K_M
42.0GB
100k cap
Runs comfortably
3
tok/s
ⓘ estimated
42
/ 192GB
72
/
77
/
80
Runs comfortably
3 tok/s
ⓘ estimated
42/192GB
74.0GB
78k cap
Runs comfortably
2
tok/s
ⓘ estimated
74
/ 192GB
72
/
77
/
80
Runs comfortably
2 tok/s
ⓘ estimated
74/192GB
Runs comfortably
9 tok/s
ⓘ estimated
15/192GB
Runs comfortably
14 tok/s
ⓘ estimated
9/192GB
Runs comfortably
17 tok/s
ⓘ estimated
7/192GB
Runs comfortably
10 tok/s
ⓘ estimated
13/192GB
Runs comfortably
7 tok/s
ⓘ estimated
17/192GB
Runs comfortably
5 tok/s
ⓘ estimated
28/192GB
Runs comfortably
14 tok/s
ⓘ estimated
9/192GB
Runs comfortably
21 tok/s
ⓘ estimated
5/192GB
Runs comfortably
10 tok/s
ⓘ estimated
14/192GB
Mixtral 8x7B Instruct
Q4_K_M
26.5GB
32k ctx
Runs comfortably
16
tok/s
ⓘ estimated
27
/ 192GB
62
/
65
/
68
Runs comfortably
16 tok/s
ⓘ estimated
27/192GB
Runs comfortably
16 tok/s
ⓘ estimated
8/192GB
Mixtral 8x7B Instruct
Q3_K_M
19.0GB
32k ctx
Runs comfortably
21
tok/s
ⓘ estimated
19
/ 192GB
62
/
65
/
68
Runs comfortably
21 tok/s
ⓘ estimated
19/192GB
Runs comfortably
0.96 tok/s
ⓘ estimated
156/192GB
Runs comfortably
10 tok/s
ⓘ estimated
13/192GB
Runs comfortably
17 tok/s
ⓘ estimated
7/192GB
Runs comfortably
40 tok/s
ⓘ estimated
3/192GB
Runs comfortably
45 tok/s
ⓘ estimated
3/192GB
Runs comfortably
31 tok/s
ⓘ estimated
4/192GB
16.0GB
128k ctx
Runs comfortably
8
tok/s
ⓘ estimated
16
/ 192GB
52
/
55
/
62
Runs comfortably
8 tok/s
ⓘ estimated
16/192GB
8.0GB
128k ctx
Runs comfortably
15
tok/s
ⓘ estimated
8
/ 192GB
52
/
55
/
62
Runs comfortably
15 tok/s
ⓘ estimated
8/192GB
Llama 3.1 8B Instruct
Q4_K_M
4.5GB
128k ctx
Runs comfortably
23
tok/s
ⓘ estimated
5
/ 192GB
52
/
55
/
62
Runs comfortably
23 tok/s
ⓘ estimated
5/192GB
Runs comfortably
24 tok/s
ⓘ estimated
5/192GB
Runs comfortably
36 tok/s
ⓘ estimated
3/192GB
3.5GB
128k ctx
Runs comfortably
33
tok/s
ⓘ estimated
4
/ 192GB
35
/
38
/
50
Runs comfortably
33 tok/s
ⓘ estimated
4/192GB
Llama 3.2 3B Instruct
Q4_K_M
2.0GB
128k ctx
Runs comfortably
50
tok/s
ⓘ estimated
2
/ 192GB
35
/
38
/
50
Runs comfortably
50 tok/s
ⓘ estimated
2/192GB
Runs comfortably
2 tok/s
ⓘ estimated
61/192GB
Runs comfortably
1 tok/s
ⓘ estimated
141/192GB
Runs comfortably
2 tok/s
ⓘ estimated
75/192GB
Runs comfortably
1 tok/s
ⓘ estimated
128/192GB
Runs comfortably
1 tok/s
ⓘ estimated
143/192GB
Runs comfortably
7 tok/s
ⓘ estimated
18/192GB
Runs comfortably
4 tok/s
ⓘ estimated
33/192GB
Runs comfortably
2 tok/s
ⓘ estimated
60/192GB
Runs tight
Runs tight
14 tok/s
ⓘ estimated
188/192GB
Runs tight
6 tok/s
ⓘ estimated
178/192GB
Run GLM-5.3-Flash in the cloud
No hardware? Host it - per-token API or flat subscription
DeepInfra
per-token
$0.18
Wafer
per-token
$0.19
Novita
per-token
$0.2
StreamLake
per-token
$0.21
GMICloud
per-token
$0.22
Decart
per-token
$0.22
Relace
per-token
$0.23
InferenceNet
per-token
$0.25
Near AI
per-token
$0.25
Phala
per-token
$0.27
Sail Research
per-token
$0.27
AtlasCloud
per-token
$0.36
CoreWeave
per-token
$0.36
Friendli
per-token
$0.36
Venice
per-token
$0.36
Z.AI
per-token
$0.36
Crusoe
per-token
$0.36
Modal
per-token
Serverless GPU inference platform. Serves open-weight models including reason...
$0.36
BaseTen
per-token
$0.36
Z.ai
per-token
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
pricing may be outdated
$0.36
Together
per-token
$0.36
DigitalOcean
per-token
$0.36
SiliconFlow
per-token
$0.36
Morph
per-token
$0.38
Parasail
per-token
$0.45
DekaLLM
per-token
$0.48
Inceptron
per-token
$0.49
Fireworks
per-token
$0.54
OpenInference
per-token
$0.62
Reka
per-token
$0.65
Z.ai
Coding Plan Lite
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$10.0
OpenCode Go
Go ($5 first month)
subscription
Low-cost subscription for open coding models. $5 first month, then $10/month....
$10.0
Z.ai
Coding Plan Pro
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$30.0
Z.ai
Coding Plan Max
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$80.0
Coding alternatives
Hosted coding assistants for comparison - per seat
Cursor
Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
GitHub Copilot
Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
GitHub Copilot
Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
Cursor
Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
GitHub Copilot
Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
Cursor
Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.
Sign in with GitHub to save this rig and get weekly model updates
Sign in with GitHub