Model
Fit
Speed
Memory
Scores / Run
Runs comfortably
Runs comfortably
51 tok/s
ⓘ estimated
29/32GB
Ornith-1.5-35B-A3B
Q5_K_M
25.3GB
10k cap
Runs comfortably
55
tok/s
ⓘ estimated
25
/ 32GB
91
/
89
/
86
Runs comfortably
55 tok/s
ⓘ estimated
25/32GB
Ornith-1.5-35B-A3B
Q4_K_M
21.7GB
18k cap
Runs comfortably
59
tok/s
ⓘ estimated
22
/ 32GB
91
/
89
/
86
Runs comfortably
59 tok/s
ⓘ estimated
22/32GB
Runs comfortably
61 tok/s
ⓘ estimated
20/32GB
Runs comfortably
13 tok/s
ⓘ estimated
16/32GB
Runs comfortably
8 tok/s
ⓘ estimated
28/32GB
15.2GB
25k cap
Runs comfortably
14
tok/s
ⓘ estimated
15
/ 32GB
88
/
89
/
85
Runs comfortably
14 tok/s
ⓘ estimated
15/32GB
6.2GB
43k cap
Runs comfortably
28
tok/s
ⓘ estimated
6
/ 32GB
88
/
89
/
85
Runs comfortably
28 tok/s
ⓘ estimated
6/32GB
9.8GB
38k cap
Runs comfortably
20
tok/s
ⓘ estimated
10
/ 32GB
88
/
89
/
85
Runs comfortably
20 tok/s
ⓘ estimated
10/32GB
17.6GB
23k cap
Runs comfortably
12
tok/s
ⓘ estimated
18
/ 32GB
88
/
89
/
85
Runs comfortably
12 tok/s
ⓘ estimated
18/32GB
Runs comfortably
11 tok/s
ⓘ estimated
18/32GB
Runs comfortably
11 tok/s
ⓘ estimated
18/32GB
Runs comfortably
12 tok/s
ⓘ estimated
16/32GB
Runs comfortably
50 tok/s
ⓘ estimated
13/32GB
Runs comfortably
36 tok/s
ⓘ estimated
25/32GB
Runs comfortably
48 tok/s
ⓘ estimated
14/32GB
Runs comfortably
8 tok/s
ⓘ estimated
28/32GB
Runs comfortably
12 tok/s
ⓘ estimated
17/32GB
Runs comfortably
9 tok/s
ⓘ estimated
25/32GB
Runs comfortably
8 tok/s
ⓘ estimated
29/32GB
Runs comfortably
11 tok/s
ⓘ estimated
20/32GB
Runs comfortably
25 tok/s
ⓘ estimated
8/32GB
Runs comfortably
20 tok/s
ⓘ estimated
10/32GB
Runs comfortably
12 tok/s
ⓘ estimated
18/32GB
Runs comfortably
31 tok/s
ⓘ estimated
6/32GB
Runs comfortably
28 tok/s
ⓘ estimated
7/32GB
Runs comfortably
64 tok/s
ⓘ estimated
16/32GB
Runs comfortably
24 tok/s
ⓘ estimated
9/32GB
Runs comfortably
8 tok/s
ⓘ estimated
29/32GB
Runs comfortably
14 tok/s
ⓘ estimated
15/32GB
Runs comfortably
31 tok/s
ⓘ estimated
20/32GB
21.5GB
7k cap
Runs comfortably
9
tok/s
ⓘ estimated
22
/ 32GB
72
/
77
/
80
Runs comfortably
9 tok/s
ⓘ estimated
22/32GB
Runs comfortably
14 tok/s
ⓘ estimated
15/32GB
Runs comfortably
22 tok/s
ⓘ estimated
9/32GB
Runs comfortably
16 tok/s
ⓘ estimated
13/32GB
Runs comfortably
27 tok/s
ⓘ estimated
7/32GB
Runs comfortably
8 tok/s
ⓘ estimated
28/32GB
Runs comfortably
12 tok/s
ⓘ estimated
17/32GB
Runs comfortably
23 tok/s
ⓘ estimated
9/32GB
Runs comfortably
33 tok/s
ⓘ estimated
5/32GB
Mixtral 8x7B Instruct
Q4_K_M
26.5GB
11k cap
Runs comfortably
26
tok/s
ⓘ estimated
27
/ 32GB
62
/
65
/
68
Runs comfortably
26 tok/s
ⓘ estimated
27/32GB
Runs comfortably
26 tok/s
ⓘ estimated
8/32GB
Runs comfortably
16 tok/s
ⓘ estimated
14/32GB
Mixtral 8x7B Instruct
Q3_K_M
19.0GB
26k cap
Runs comfortably
33
tok/s
ⓘ estimated
19
/ 32GB
62
/
65
/
68
Runs comfortably
33 tok/s
ⓘ estimated
19/32GB
Runs comfortably
27 tok/s
ⓘ estimated
7/32GB
Runs comfortably
16 tok/s
ⓘ estimated
13/32GB
Runs comfortably
64 tok/s
ⓘ estimated
3/32GB
Runs comfortably
72 tok/s
ⓘ estimated
3/32GB
Runs comfortably
49 tok/s
ⓘ estimated
4/32GB
Llama 3.1 8B Instruct
Q4_K_M
4.5GB
55k cap
Runs comfortably
37
tok/s
ⓘ estimated
5
/ 32GB
52
/
55
/
62
Runs comfortably
37 tok/s
ⓘ estimated
5/32GB
8.0GB
48k cap
Runs comfortably
24
tok/s
ⓘ estimated
8
/ 32GB
52
/
55
/
62
Runs comfortably
24 tok/s
ⓘ estimated
8/32GB
16.0GB
32k cap
Runs comfortably
13
tok/s
ⓘ estimated
16
/ 32GB
52
/
55
/
62
Runs comfortably
13 tok/s
ⓘ estimated
16/32GB
Runs comfortably
39 tok/s
ⓘ estimated
5/32GB
Runs comfortably
57 tok/s
ⓘ estimated
3/32GB
3.5GB
118k cap
Runs comfortably
54
tok/s
ⓘ estimated
4
/ 32GB
35
/
38
/
50
Runs comfortably
54 tok/s
ⓘ estimated
4/32GB
Llama 3.2 3B Instruct
Q4_K_M
2.0GB
124k cap
Runs comfortably
80
tok/s
ⓘ estimated
2
/ 32GB
35
/
38
/
50
Runs comfortably
80 tok/s
ⓘ estimated
2/32GB
Runs comfortably
144 tok/s
ⓘ estimated
7/32GB
Runs comfortably
46 tok/s
ⓘ estimated
24/32GB
Runs comfortably
103 tok/s
ⓘ estimated
24/32GB
Runs comfortably
164 tok/s
ⓘ estimated
14/32GB
Runs tight
Runs tight
45 tok/s
ⓘ estimated
31/32GB
Runs tight
7 tok/s
ⓘ estimated
30/32GB
Runs tight
12 tok/s
ⓘ estimated
18/32GB
Coding alternatives
Hosted coding assistants for comparison - per seat
Cursor
Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
GitHub Copilot
Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
GitHub Copilot
Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
Cursor
Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
GitHub Copilot
Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
Cursor
Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.
Sign in with GitHub to save this rig and get weekly model updates
Sign in with GitHubTokenstead community
Not sure this is the right fit?
Post your rig and the shortlist in the community and get a sanity check from people running the same memory and stack.