Model
Fit
Speed
Memory
Scores / Run
Runs comfortably
Runs comfortably
26 tok/s
ⓘ estimated
29/32GB
Ornith-1.5-35B-A3B
Q5_K_M
25.3GB
10k cap
Runs comfortably
28
tok/s
ⓘ estimated
25
/ 32GB
91
/
89
/
86
Runs comfortably
28 tok/s
ⓘ estimated
25/32GB
Ornith-1.5-35B-A3B
Q4_K_M
21.7GB
18k cap
Runs comfortably
30
tok/s
ⓘ estimated
22
/ 32GB
91
/
89
/
86
Runs comfortably
30 tok/s
ⓘ estimated
22/32GB
Runs comfortably
30 tok/s
ⓘ estimated
20/32GB
Runs comfortably
7 tok/s
ⓘ estimated
16/32GB
Runs comfortably
4 tok/s
ⓘ estimated
28/32GB
15.2GB
25k cap
Runs comfortably
7
tok/s
ⓘ estimated
15
/ 32GB
88
/
89
/
85
Runs comfortably
7 tok/s
ⓘ estimated
15/32GB
6.2GB
43k cap
Runs comfortably
14
tok/s
ⓘ estimated
6
/ 32GB
88
/
89
/
85
Runs comfortably
14 tok/s
ⓘ estimated
6/32GB
9.8GB
38k cap
Runs comfortably
10
tok/s
ⓘ estimated
10
/ 32GB
88
/
89
/
85
Runs comfortably
10 tok/s
ⓘ estimated
10/32GB
17.6GB
23k cap
Runs comfortably
6
tok/s
ⓘ estimated
18
/ 32GB
88
/
89
/
85
Runs comfortably
6 tok/s
ⓘ estimated
18/32GB
Runs comfortably
6 tok/s
ⓘ estimated
18/32GB
Runs comfortably
6 tok/s
ⓘ estimated
18/32GB
Runs comfortably
6 tok/s
ⓘ estimated
16/32GB
Runs comfortably
25 tok/s
ⓘ estimated
13/32GB
Runs comfortably
18 tok/s
ⓘ estimated
25/32GB
Runs comfortably
24 tok/s
ⓘ estimated
14/32GB
Runs comfortably
4 tok/s
ⓘ estimated
28/32GB
Runs comfortably
6 tok/s
ⓘ estimated
17/32GB
Runs comfortably
4 tok/s
ⓘ estimated
25/32GB
Runs comfortably
4 tok/s
ⓘ estimated
29/32GB
Runs comfortably
5 tok/s
ⓘ estimated
20/32GB
Runs comfortably
12 tok/s
ⓘ estimated
8/32GB
Runs comfortably
10 tok/s
ⓘ estimated
10/32GB
Runs comfortably
6 tok/s
ⓘ estimated
18/32GB
Runs comfortably
15 tok/s
ⓘ estimated
6/32GB
Runs comfortably
14 tok/s
ⓘ estimated
7/32GB
Runs comfortably
32 tok/s
ⓘ estimated
16/32GB
Runs comfortably
12 tok/s
ⓘ estimated
9/32GB
Runs comfortably
4 tok/s
ⓘ estimated
29/32GB
Runs comfortably
7 tok/s
ⓘ estimated
15/32GB
Runs comfortably
16 tok/s
ⓘ estimated
20/32GB
21.5GB
7k cap
Runs comfortably
4
tok/s
ⓘ estimated
22
/ 32GB
72
/
77
/
80
Runs comfortably
4 tok/s
ⓘ estimated
22/32GB
Runs comfortably
7 tok/s
ⓘ estimated
15/32GB
Runs comfortably
11 tok/s
ⓘ estimated
9/32GB
Runs comfortably
8 tok/s
ⓘ estimated
13/32GB
Runs comfortably
13 tok/s
ⓘ estimated
7/32GB
Runs comfortably
4 tok/s
ⓘ estimated
28/32GB
Runs comfortably
6 tok/s
ⓘ estimated
17/32GB
Runs comfortably
11 tok/s
ⓘ estimated
9/32GB
Runs comfortably
17 tok/s
ⓘ estimated
5/32GB
Mixtral 8x7B Instruct
Q4_K_M
26.5GB
11k cap
Runs comfortably
13
tok/s
ⓘ estimated
27
/ 32GB
62
/
65
/
68
Runs comfortably
13 tok/s
ⓘ estimated
27/32GB
Runs comfortably
13 tok/s
ⓘ estimated
8/32GB
Runs comfortably
8 tok/s
ⓘ estimated
14/32GB
Mixtral 8x7B Instruct
Q3_K_M
19.0GB
26k cap
Runs comfortably
16
tok/s
ⓘ estimated
19
/ 32GB
62
/
65
/
68
Runs comfortably
16 tok/s
ⓘ estimated
19/32GB
Runs comfortably
13 tok/s
ⓘ estimated
7/32GB
Runs comfortably
8 tok/s
ⓘ estimated
13/32GB
Runs comfortably
32 tok/s
ⓘ estimated
3/32GB
Runs comfortably
36 tok/s
ⓘ estimated
3/32GB
Runs comfortably
24 tok/s
ⓘ estimated
4/32GB
Llama 3.1 8B Instruct
Q4_K_M
4.5GB
55k cap
Runs comfortably
18
tok/s
ⓘ estimated
5
/ 32GB
52
/
55
/
62
Runs comfortably
18 tok/s
ⓘ estimated
5/32GB
8.0GB
48k cap
Runs comfortably
12
tok/s
ⓘ estimated
8
/ 32GB
52
/
55
/
62
Runs comfortably
12 tok/s
ⓘ estimated
8/32GB
16.0GB
32k cap
Runs comfortably
7
tok/s
ⓘ estimated
16
/ 32GB
52
/
55
/
62
Runs comfortably
7 tok/s
ⓘ estimated
16/32GB
Runs comfortably
19 tok/s
ⓘ estimated
5/32GB
Runs comfortably
28 tok/s
ⓘ estimated
3/32GB
3.5GB
118k cap
Runs comfortably
27
tok/s
ⓘ estimated
4
/ 32GB
35
/
38
/
50
Runs comfortably
27 tok/s
ⓘ estimated
4/32GB
Llama 3.2 3B Instruct
Q4_K_M
2.0GB
124k cap
Runs comfortably
40
tok/s
ⓘ estimated
2
/ 32GB
35
/
38
/
50
Runs comfortably
40 tok/s
ⓘ estimated
2/32GB
Runs comfortably
72 tok/s
ⓘ estimated
7/32GB
Runs comfortably
23 tok/s
ⓘ estimated
24/32GB
Runs comfortably
52 tok/s
ⓘ estimated
24/32GB
Runs comfortably
82 tok/s
ⓘ estimated
14/32GB
Runs tight
Runs tight
23 tok/s
ⓘ estimated
31/32GB
Runs tight
3 tok/s
ⓘ estimated
30/32GB
Runs tight
6 tok/s
ⓘ estimated
18/32GB
Coding alternatives
Hosted coding assistants for comparison - per seat
Cursor
Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
GitHub Copilot
Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
GitHub Copilot
Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
Cursor
Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
GitHub Copilot
Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
Cursor
Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.
Sign in with GitHub to save this rig and get weekly model updates
Sign in with GitHubTokenstead community
Not sure this is the right fit?
Post your rig and the shortlist in the community and get a sanity check from people running the same memory and stack.