Model
Fit
Speed
Memory
Scores / Run
Runs comfortably
109.0GB
1000k ctx
Runs comfortably
24
tok/s
ⓘ estimated
109
/ 128GB
93
/
92
/
91
Runs comfortably
24 tok/s
ⓘ estimated
109/128GB
93.1GB
1000k ctx
Runs comfortably
29
tok/s
ⓘ estimated
93
/ 128GB
93
/
92
/
91
Runs comfortably
29 tok/s
ⓘ estimated
93/128GB
Qwen3.8-Flash-Next
EXL3_2BPW
62.7GB
262k ctx
Runs comfortably
72
tok/s
ⓘ estimated
63
/ 128GB
92
/
92
/
89
Runs comfortably
72 tok/s
ⓘ estimated
63/128GB
Qwen3.8-Flash-Next
EXL3_3BPW
85.0GB
262k ctx
Runs comfortably
53
tok/s
ⓘ estimated
85
/ 128GB
92
/
92
/
89
Runs comfortably
53 tok/s
ⓘ estimated
85/128GB
72.5GB
262k ctx
Runs comfortably
62
tok/s
ⓘ estimated
73
/ 128GB
92
/
92
/
89
Runs comfortably
62 tok/s
ⓘ estimated
73/128GB
Ornith-1.5-35B-A3B
Q4_K_M
21.7GB
262k ctx
Runs comfortably
83
tok/s
ⓘ estimated
22
/ 128GB
91
/
89
/
86
Runs comfortably
83 tok/s
ⓘ estimated
22/128GB
Ornith-1.5-35B-A3B
Q5_K_M
25.3GB
262k ctx
Runs comfortably
71
tok/s
ⓘ estimated
25
/ 128GB
91
/
89
/
86
Runs comfortably
71 tok/s
ⓘ estimated
25/128GB
Ornith-1.5-35B-A3B
Q6_K
29.2GB
262k ctx
Runs comfortably
62
tok/s
ⓘ estimated
29
/ 128GB
91
/
89
/
86
Runs comfortably
62 tok/s
ⓘ estimated
29/128GB
Ornith-1.5-35B-A3B
Q8_0
37.8GB
262k ctx
Runs comfortably
48
tok/s
ⓘ estimated
38
/ 128GB
91
/
89
/
86
Runs comfortably
48 tok/s
ⓘ estimated
38/128GB
Ornith-1.5-35B-A3B
BF16
71.1GB
262k ctx
Runs comfortably
25
tok/s
ⓘ estimated
71
/ 128GB
91
/
89
/
86
Runs comfortably
25 tok/s
ⓘ estimated
71/128GB
Runs comfortably
47 tok/s
ⓘ estimated
37/128GB
Qwen3.6 35B A3B
Q4_K_M
20.0GB
262k ctx
Runs comfortably
87
tok/s
ⓘ estimated
20
/ 128GB
90
/
91
/
87
Runs comfortably
87 tok/s
ⓘ estimated
20/128GB
Runs comfortably
3 tok/s
ⓘ estimated
56/128GB
Runs comfortably
5 tok/s
ⓘ estimated
28/128GB
Pokee-Isaac 28B
Q4_K_M
16.0GB
10000k ctx
Runs comfortably
9
tok/s
ⓘ estimated
16
/ 128GB
90
/
88
/
88
Runs comfortably
9 tok/s
ⓘ estimated
16/128GB
Runs comfortably
24 tok/s
ⓘ estimated
68/128GB
17.6GB
262k ctx
Runs comfortably
9
tok/s
ⓘ estimated
18
/ 128GB
88
/
89
/
85
Runs comfortably
9 tok/s
ⓘ estimated
18/128GB
9.8GB
262k ctx
Runs comfortably
15
tok/s
ⓘ estimated
10
/ 128GB
88
/
89
/
85
Runs comfortably
15 tok/s
ⓘ estimated
10/128GB
15.2GB
262k ctx
Runs comfortably
10
tok/s
ⓘ estimated
15
/ 128GB
88
/
89
/
85
Runs comfortably
10 tok/s
ⓘ estimated
15/128GB
6.2GB
262k ctx
Runs comfortably
24
tok/s
ⓘ estimated
6
/ 128GB
88
/
89
/
85
Runs comfortably
24 tok/s
ⓘ estimated
6/128GB
Runs comfortably
8 tok/s
ⓘ estimated
18/128GB
Runs comfortably
5 tok/s
ⓘ estimated
33/128GB
Runs comfortably
2 tok/s
ⓘ estimated
61/128GB
Runs comfortably
9 tok/s
ⓘ estimated
16/128GB
Runs comfortably
8 tok/s
ⓘ estimated
18/128GB
Runs comfortably
71 tok/s
ⓘ estimated
14/128GB
Gemma 4 26B A4B
Q4_K_M
13.0GB
256k ctx
Runs comfortably
76
tok/s
ⓘ estimated
13
/ 128GB
85
/
88
/
84
Runs comfortably
76 tok/s
ⓘ estimated
13/128GB
Runs comfortably
40 tok/s
ⓘ estimated
25/128GB
Runs comfortably
20 tok/s
ⓘ estimated
50/128GB
Runs comfortably
9 tok/s
ⓘ estimated
17/128GB
Runs comfortably
5 tok/s
ⓘ estimated
28/128GB
Runs comfortably
5 tok/s
ⓘ estimated
29/128GB
Runs comfortably
6 tok/s
ⓘ estimated
25/128GB
Runs comfortably
4 tok/s
ⓘ estimated
34/128GB
Runs comfortably
8 tok/s
ⓘ estimated
20/128GB
Runs comfortably
40 tok/s
ⓘ estimated
77/128GB
58.0GB
1000k ctx
Runs comfortably
23
tok/s
ⓘ estimated
58
/ 128GB
78
/
76
/
74
Runs comfortably
23 tok/s
ⓘ estimated
58/128GB
Runs comfortably
8 tok/s
ⓘ estimated
18/128GB
60.0GB
1000k ctx
Runs comfortably
22
tok/s
ⓘ estimated
60
/ 128GB
78
/
76
/
74
Runs comfortably
22 tok/s
ⓘ estimated
60/128GB
Nemotron 3.5 Lightning
Q4_K_M
32.0GB
1000k ctx
Runs comfortably
41
tok/s
ⓘ estimated
32
/ 128GB
78
/
76
/
74
Runs comfortably
41 tok/s
ⓘ estimated
32/128GB
Runs comfortably
15 tok/s
ⓘ estimated
10/128GB
Runs comfortably
20 tok/s
ⓘ estimated
8/128GB
Runs comfortably
23 tok/s
ⓘ estimated
7/128GB
Runs comfortably
26 tok/s
ⓘ estimated
6/128GB
Runs comfortably
98 tok/s
ⓘ estimated
16/128GB
Runs comfortably
49 tok/s
ⓘ estimated
31/128GB
Runs comfortably
10 tok/s
ⓘ estimated
15/128GB
Runs comfortably
18 tok/s
ⓘ estimated
9/128GB
Runs comfortably
5 tok/s
ⓘ estimated
29/128GB
Xing4.0-29B-A4B
Q4_K_M
20.1GB
256k ctx
Runs comfortably
54
tok/s
ⓘ estimated
20
/ 128GB
75
/
73
/
72
Runs comfortably
54 tok/s
ⓘ estimated
20/128GB
Runs comfortably
17 tok/s
ⓘ estimated
62/128GB
74.0GB
128k ctx
Runs comfortably
2
tok/s
ⓘ estimated
74
/ 128GB
72
/
77
/
80
Runs comfortably
2 tok/s
ⓘ estimated
74/128GB
Llama 3.3 70B Instruct
Q4_K_M
42.0GB
128k ctx
Runs comfortably
4
tok/s
ⓘ estimated
42
/ 128GB
72
/
77
/
80
Runs comfortably
4 tok/s
ⓘ estimated
42/128GB
Llama 3.3 70B Instruct
Q3_K_M
30.0GB
128k ctx
Runs comfortably
5
tok/s
ⓘ estimated
30
/ 128GB
72
/
77
/
80
Runs comfortably
5 tok/s
ⓘ estimated
30/128GB
21.5GB
128k ctx
Runs comfortably
7
tok/s
ⓘ estimated
22
/ 128GB
72
/
77
/
80
Runs comfortably
7 tok/s
ⓘ estimated
22/128GB
Runs comfortably
17 tok/s
ⓘ estimated
9/128GB
Runs comfortably
10 tok/s
ⓘ estimated
15/128GB
Runs comfortably
21 tok/s
ⓘ estimated
7/128GB
Runs comfortably
12 tok/s
ⓘ estimated
13/128GB
Runs comfortably
5 tok/s
ⓘ estimated
28/128GB
Runs comfortably
9 tok/s
ⓘ estimated
17/128GB
Runs comfortably
18 tok/s
ⓘ estimated
9/128GB
Runs comfortably
29 tok/s
ⓘ estimated
5/128GB
Runs comfortably
11 tok/s
ⓘ estimated
14/128GB
Runs comfortably
20 tok/s
ⓘ estimated
8/128GB
Mixtral 8x7B Instruct
Q4_K_M
26.5GB
32k ctx
Runs comfortably
21
tok/s
ⓘ estimated
27
/ 128GB
62
/
65
/
68
Runs comfortably
21 tok/s
ⓘ estimated
27/128GB
Mixtral 8x7B Instruct
Q3_K_M
19.0GB
32k ctx
Runs comfortably
29
tok/s
ⓘ estimated
19
/ 128GB
62
/
65
/
68
Runs comfortably
29 tok/s
ⓘ estimated
19/128GB
Runs comfortably
11 tok/s
ⓘ estimated
13/128GB
Runs comfortably
21 tok/s
ⓘ estimated
7/128GB
Runs comfortably
58 tok/s
ⓘ estimated
3/128GB
Runs comfortably
60 tok/s
ⓘ estimated
3/128GB
Runs comfortably
37 tok/s
ⓘ estimated
4/128GB
8.0GB
128k ctx
Runs comfortably
19
tok/s
ⓘ estimated
8
/ 128GB
52
/
55
/
62
Runs comfortably
19 tok/s
ⓘ estimated
8/128GB
16.0GB
128k ctx
Runs comfortably
9
tok/s
ⓘ estimated
16
/ 128GB
52
/
55
/
62
Runs comfortably
9 tok/s
ⓘ estimated
16/128GB
Llama 3.1 8B Instruct
Q4_K_M
4.5GB
128k ctx
Runs comfortably
33
tok/s
ⓘ estimated
5
/ 128GB
52
/
55
/
62
Runs comfortably
33 tok/s
ⓘ estimated
5/128GB
Runs comfortably
30 tok/s
ⓘ estimated
5/128GB
Runs comfortably
50 tok/s
ⓘ estimated
3/128GB
3.5GB
128k ctx
Runs comfortably
43
tok/s
ⓘ estimated
4
/ 128GB
35
/
38
/
50
Runs comfortably
43 tok/s
ⓘ estimated
4/128GB
Llama 3.2 3B Instruct
Q4_K_M
2.0GB
128k ctx
Runs comfortably
75
tok/s
ⓘ estimated
2
/ 128GB
35
/
38
/
50
Runs comfortably
75 tok/s
ⓘ estimated
2/128GB
Runs comfortably
8 tok/s
ⓘ estimated
18/128GB
Runs comfortably
5 tok/s
ⓘ estimated
33/128GB
Runs comfortably
3 tok/s
ⓘ estimated
60/128GB
Runs tight
120.0GB
0k cap
Runs tight
22
tok/s
ⓘ estimated
120
/ 128GB
93
/
92
/
91
Runs tight
22 tok/s
ⓘ estimated
120/128GB
Runs tight
13 tok/s
ⓘ estimated
125/128GB
Run GLM-5.3-Flash in the cloud
No hardware? Host it - per-token API or flat subscription
InferenceNet
per-token
$0.11
OpenInference
per-token
$0.14
DeepInfra
per-token
$0.18
Relace
per-token
$0.21
GMICloud
per-token
$0.22
Sail Research
per-token
$0.27
Novita
per-token
$0.27
AtlasCloud
per-token
$0.28
Inceptron
per-token
$0.31
Phala
per-token
$0.31
StreamLake
per-token
$0.31
Decart
per-token
$0.31
Io Net
per-token
$0.33
Z.ai
per-token
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
pricing may be outdated
$0.36
Modal
per-token
Serverless GPU inference platform. Serves open-weight models including reason...
$0.36
Z.AI
per-token
$0.36
Venice
per-token
$0.36
Friendli
per-token
$0.36
SiliconFlow
per-token
$0.36
DigitalOcean
per-token
$0.36
CoreWeave
per-token
$0.36
Crusoe
per-token
$0.36
Near AI
per-token
$0.36
BaseTen
per-token
$0.36
Parasail
per-token
$0.36
Together
per-token
$0.36
Reka
per-token
$0.36
Morph
per-token
$0.38
NextBit
per-token
$0.4
Fireworks
per-token
$0.54
Cloudflare
per-token
$0.72
Wafer
per-token
$1.08
Z.ai
Coding Plan Lite
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$10.0
OpenCode Go
Go ($5 first month)
subscription
Low-cost subscription for open coding models. $5 first month, then $10/month....
$10.0
Z.ai
Coding Plan Pro
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$30.0
Z.ai
Coding Plan Max
subscription
Official API and platform for Zhipu AI's open-source GLM models. GLM-5.2 avai...
$80.0
Coding alternatives
Hosted coding assistants for comparison - per seat
Cursor
Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
GitHub Copilot
Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
GitHub Copilot
Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
Cursor
Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
GitHub Copilot
Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
Cursor
Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.
Sign in with GitHub to save this rig and get weekly model updates
Sign in with GitHub