Model
Fit
Speed
Memory
Scores / Run
Runs comfortably
72.5GB
32k cap
Runs comfortably
105
tok/s
ⓘ estimated
73
/ 96GB
92
/
92
/
89
Runs comfortably
105 tok/s
ⓘ estimated
73/96GB
Qwen3.8-Flash-Next
EXL3_2BPW
62.7GB
171k cap
Runs comfortably
129
tok/s
ⓘ estimated
63
/ 96GB
92
/
92
/
89
Runs comfortably
129 tok/s
ⓘ estimated
63/96GB
Qwen3.8-Flash-Next
EXL3_3BPW
85.0GB
171k cap
Runs comfortably
108
tok/s
ⓘ estimated
85
/ 96GB
92
/
92
/
89
Runs comfortably
108 tok/s
ⓘ estimated
85/96GB
Runs comfortably
60 tok/s
ⓘ estimated
71/96GB
Ornith-1.5-35B-A3B
Q8_0
37.8GB
105k cap
Runs comfortably
91
tok/s
ⓘ estimated
38
/ 96GB
91
/
89
/
86
Runs comfortably
91 tok/s
ⓘ estimated
38/96GB
Ornith-1.5-35B-A3B
Q4_K_M
21.7GB
134k cap
Runs comfortably
121
tok/s
ⓘ estimated
22
/ 96GB
91
/
89
/
86
Runs comfortably
121 tok/s
ⓘ estimated
22/96GB
Ornith-1.5-35B-A3B
Q6_K
29.2GB
120k cap
Runs comfortably
105
tok/s
ⓘ estimated
29
/ 96GB
91
/
89
/
86
Runs comfortably
105 tok/s
ⓘ estimated
29/96GB
Ornith-1.5-35B-A3B
Q5_K_M
25.3GB
127k cap
Runs comfortably
113
tok/s
ⓘ estimated
25
/ 96GB
91
/
89
/
86
Runs comfortably
113 tok/s
ⓘ estimated
25/96GB
Qwen3.6 35B A3B
Q4_K_M
20.0GB
138k cap
Runs comfortably
124
tok/s
ⓘ estimated
20
/ 96GB
90
/
91
/
87
Runs comfortably
124 tok/s
ⓘ estimated
20/96GB
Runs comfortably
91 tok/s
ⓘ estimated
37/96GB
Runs comfortably
8 tok/s
ⓘ estimated
56/96GB
Runs comfortably
16 tok/s
ⓘ estimated
28/96GB
Runs comfortably
27 tok/s
ⓘ estimated
16/96GB
Runs comfortably
34 tok/s
ⓘ estimated
68/96GB
17.6GB
140k cap
Runs comfortably
25
tok/s
ⓘ estimated
18
/ 96GB
88
/
89
/
85
Runs comfortably
25 tok/s
ⓘ estimated
18/96GB
9.8GB
154k cap
Runs comfortably
41
tok/s
ⓘ estimated
10
/ 96GB
88
/
89
/
85
Runs comfortably
41 tok/s
ⓘ estimated
10/96GB
6.2GB
160k cap
Runs comfortably
58
tok/s
ⓘ estimated
6
/ 96GB
88
/
89
/
85
Runs comfortably
58 tok/s
ⓘ estimated
6/96GB
15.2GB
141k cap
Runs comfortably
28
tok/s
ⓘ estimated
15
/ 96GB
88
/
89
/
85
Runs comfortably
28 tok/s
ⓘ estimated
15/96GB
Runs comfortably
23 tok/s
ⓘ estimated
18/96GB
Runs comfortably
25 tok/s
ⓘ estimated
16/96GB
Runs comfortably
8 tok/s
ⓘ estimated
61/96GB
Runs comfortably
14 tok/s
ⓘ estimated
33/96GB
Runs comfortably
23 tok/s
ⓘ estimated
18/96GB
Gemma 4 26B A4B
Q4_K_M
13.0GB
114k cap
Runs comfortably
102
tok/s
ⓘ estimated
13
/ 96GB
85
/
88
/
84
Runs comfortably
102 tok/s
ⓘ estimated
13/96GB
Runs comfortably
74 tok/s
ⓘ estimated
25/96GB
Runs comfortably
47 tok/s
ⓘ estimated
50/96GB
Runs comfortably
99 tok/s
ⓘ estimated
14/96GB
Runs comfortably
16 tok/s
ⓘ estimated
28/96GB
Runs comfortably
25 tok/s
ⓘ estimated
17/96GB
Runs comfortably
18 tok/s
ⓘ estimated
25/96GB
Runs comfortably
21 tok/s
ⓘ estimated
20/96GB
Runs comfortably
16 tok/s
ⓘ estimated
29/96GB
Runs comfortably
13 tok/s
ⓘ estimated
34/96GB
Runs comfortably
24 tok/s
ⓘ estimated
77/96GB
Nemotron 3.5 Lightning
Q4_K_M
32.0GB
137k cap
Runs comfortably
90
tok/s
ⓘ estimated
32
/ 96GB
78
/
76
/
74
Runs comfortably
90 tok/s
ⓘ estimated
32/96GB
58.0GB
75k cap
Runs comfortably
58
tok/s
ⓘ estimated
58
/ 96GB
78
/
76
/
74
Runs comfortably
58 tok/s
ⓘ estimated
58/96GB
60.0GB
71k cap
Runs comfortably
57
tok/s
ⓘ estimated
60
/ 96GB
78
/
76
/
74
Runs comfortably
57 tok/s
ⓘ estimated
60/96GB
Runs comfortably
57 tok/s
ⓘ estimated
7/96GB
Runs comfortably
63 tok/s
ⓘ estimated
6/96GB
Runs comfortably
51 tok/s
ⓘ estimated
8/96GB
Runs comfortably
42 tok/s
ⓘ estimated
10/96GB
Runs comfortably
24 tok/s
ⓘ estimated
18/96GB
Runs comfortably
130 tok/s
ⓘ estimated
16/96GB
Runs comfortably
93 tok/s
ⓘ estimated
31/96GB
Runs comfortably
48 tok/s
ⓘ estimated
9/96GB
Runs comfortably
30 tok/s
ⓘ estimated
15/96GB
Runs comfortably
16 tok/s
ⓘ estimated
29/96GB
Runs comfortably
36 tok/s
ⓘ estimated
62/96GB
Runs comfortably
64 tok/s
ⓘ estimated
20/96GB
Llama 3.3 70B Instruct
Q3_K_M
30.0GB
44k cap
Runs comfortably
14
tok/s
ⓘ estimated
30
/ 96GB
72
/
77
/
80
Runs comfortably
14 tok/s
ⓘ estimated
30/96GB
21.5GB
49k cap
Runs comfortably
18
tok/s
ⓘ estimated
22
/ 96GB
72
/
77
/
80
Runs comfortably
18 tok/s
ⓘ estimated
22/96GB
Llama 3.3 70B Instruct
Q4_K_M
42.0GB
36k cap
Runs comfortably
10
tok/s
ⓘ estimated
42
/ 96GB
72
/
77
/
80
Runs comfortably
10 tok/s
ⓘ estimated
42/96GB
74.0GB
14k cap
Runs comfortably
6
tok/s
ⓘ estimated
74
/ 96GB
72
/
77
/
80
Runs comfortably
6 tok/s
ⓘ estimated
74/96GB
Runs comfortably
29 tok/s
ⓘ estimated
15/96GB
Runs comfortably
44 tok/s
ⓘ estimated
9/96GB
Runs comfortably
54 tok/s
ⓘ estimated
7/96GB
Runs comfortably
33 tok/s
ⓘ estimated
13/96GB
Runs comfortably
16 tok/s
ⓘ estimated
28/96GB
Runs comfortably
24 tok/s
ⓘ estimated
17/96GB
Runs comfortably
47 tok/s
ⓘ estimated
9/96GB
Runs comfortably
68 tok/s
ⓘ estimated
5/96GB
Runs comfortably
53 tok/s
ⓘ estimated
8/96GB
Runs comfortably
32 tok/s
ⓘ estimated
14/96GB
Mixtral 8x7B Instruct
Q3_K_M
19.0GB
32k ctx
Runs comfortably
67
tok/s
ⓘ estimated
19
/ 96GB
62
/
65
/
68
Runs comfortably
67 tok/s
ⓘ estimated
19/96GB
Mixtral 8x7B Instruct
Q4_K_M
26.5GB
32k ctx
Runs comfortably
52
tok/s
ⓘ estimated
27
/ 96GB
62
/
65
/
68
Runs comfortably
52 tok/s
ⓘ estimated
27/96GB
Runs comfortably
55 tok/s
ⓘ estimated
7/96GB
Runs comfortably
33 tok/s
ⓘ estimated
13/96GB
Runs comfortably
131 tok/s
ⓘ estimated
3/96GB
Runs comfortably
148 tok/s
ⓘ estimated
3/96GB
Runs comfortably
100 tok/s
ⓘ estimated
4/96GB
Llama 3.1 8B Instruct
Q4_K_M
4.5GB
128k ctx
Runs comfortably
75
tok/s
ⓘ estimated
5
/ 96GB
52
/
55
/
62
Runs comfortably
75 tok/s
ⓘ estimated
5/96GB
8.0GB
128k ctx
Runs comfortably
49
tok/s
ⓘ estimated
8
/ 96GB
52
/
55
/
62
Runs comfortably
49 tok/s
ⓘ estimated
8/96GB
16.0GB
128k ctx
Runs comfortably
27
tok/s
ⓘ estimated
16
/ 96GB
52
/
55
/
62
Runs comfortably
27 tok/s
ⓘ estimated
16/96GB
Runs comfortably
116 tok/s
ⓘ estimated
3/96GB
Runs comfortably
79 tok/s
ⓘ estimated
5/96GB
3.5GB
128k ctx
Runs comfortably
110
tok/s
ⓘ estimated
4
/ 96GB
35
/
38
/
50
Runs comfortably
110 tok/s
ⓘ estimated
4/96GB
Llama 3.2 3B Instruct
Q4_K_M
2.0GB
128k ctx
Runs comfortably
165
tok/s
ⓘ estimated
2
/ 96GB
35
/
38
/
50
Runs comfortably
165 tok/s
ⓘ estimated
2/96GB
Runs comfortably
295 tok/s
ⓘ estimated
7/96GB
Runs comfortably
94 tok/s
ⓘ estimated
24/96GB
Runs comfortably
14 tok/s
ⓘ estimated
33/96GB
Runs comfortably
24 tok/s
ⓘ estimated
18/96GB
Runs comfortably
8 tok/s
ⓘ estimated
61/96GB
Runs comfortably
6 tok/s
ⓘ estimated
75/96GB
Runs comfortably
212 tok/s
ⓘ estimated
24/96GB
Runs comfortably
336 tok/s
ⓘ estimated
14/96GB
Runs tight
Runs tight
8 tok/s
ⓘ estimated
60/96GB
Coding alternatives
Hosted coding assistants for comparison - per seat
Cursor
Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
GitHub Copilot
Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
GitHub Copilot
Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
Cursor
Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
GitHub Copilot
Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
Cursor
Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.
Sign in with GitHub to save this rig and get weekly model updates
Sign in with GitHubTokenstead community
Not sure this is the right fit?
Post your rig and the shortlist in the community and get a sanity check from people running the same memory and stack.