Model
Fit
Speed
Memory
Scores / Run
Runs comfortably
Ornith-1.5-35B-A3B
Q4_K_M
21.7GB
262k ctx
Runs comfortably
90
tok/s
ⓘ estimated
22
/ 24GB
91
/
89
/
86
Runs comfortably
90 tok/s
ⓘ estimated
22/24GB
Runs comfortably
95 tok/s
ⓘ estimated
20/24GB
Pokee-Isaac 28B
Q4_K_M
16.0GB
10000k ctx
Runs comfortably
10
tok/s
ⓘ estimated
16
/ 24GB
90
/
88
/
88
Runs comfortably
10 tok/s
ⓘ estimated
16/24GB
6.2GB
262k ctx
Runs comfortably
26
tok/s
ⓘ estimated
6
/ 24GB
88
/
89
/
85
Runs comfortably
26 tok/s
ⓘ estimated
6/24GB
15.2GB
262k ctx
Runs comfortably
11
tok/s
ⓘ estimated
15
/ 24GB
88
/
89
/
85
Runs comfortably
11 tok/s
ⓘ estimated
15/24GB
9.8GB
262k ctx
Runs comfortably
17
tok/s
ⓘ estimated
10
/ 24GB
88
/
89
/
85
Runs comfortably
17 tok/s
ⓘ estimated
10/24GB
17.6GB
262k ctx
Runs comfortably
9
tok/s
ⓘ estimated
18
/ 24GB
88
/
89
/
85
Runs comfortably
9 tok/s
ⓘ estimated
18/24GB
Runs comfortably
10 tok/s
ⓘ estimated
16/24GB
Runs comfortably
9 tok/s
ⓘ estimated
18/24GB
Runs comfortably
9 tok/s
ⓘ estimated
18/24GB
Runs comfortably
83 tok/s
ⓘ estimated
13/24GB
Runs comfortably
77 tok/s
ⓘ estimated
14/24GB
Runs comfortably
10 tok/s
ⓘ estimated
17/24GB
Runs comfortably
8 tok/s
ⓘ estimated
20/24GB
Runs comfortably
25 tok/s
ⓘ estimated
7/24GB
Runs comfortably
28 tok/s
ⓘ estimated
6/24GB
Runs comfortably
22 tok/s
ⓘ estimated
8/24GB
Runs comfortably
17 tok/s
ⓘ estimated
10/24GB
Runs comfortably
9 tok/s
ⓘ estimated
18/24GB
Runs comfortably
107 tok/s
ⓘ estimated
16/24GB
Runs comfortably
11 tok/s
ⓘ estimated
15/24GB
Runs comfortably
19 tok/s
ⓘ estimated
9/24GB
Runs comfortably
59 tok/s
ⓘ estimated
20/24GB
Runs comfortably
18 tok/s
ⓘ estimated
9/24GB
Runs comfortably
11 tok/s
ⓘ estimated
15/24GB
Runs comfortably
23 tok/s
ⓘ estimated
7/24GB
Runs comfortably
13 tok/s
ⓘ estimated
13/24GB
Runs comfortably
10 tok/s
ⓘ estimated
17/24GB
Runs comfortably
31 tok/s
ⓘ estimated
5/24GB
Runs comfortably
19 tok/s
ⓘ estimated
9/24GB
Mixtral 8x7B Instruct
Q3_K_M
19.0GB
32k ctx
Runs comfortably
31
tok/s
ⓘ estimated
19
/ 24GB
62
/
65
/
68
Runs comfortably
31 tok/s
ⓘ estimated
19/24GB
Runs comfortably
22 tok/s
ⓘ estimated
8/24GB
Runs comfortably
12 tok/s
ⓘ estimated
14/24GB
Runs comfortably
12 tok/s
ⓘ estimated
13/24GB
Runs comfortably
22 tok/s
ⓘ estimated
7/24GB
Runs comfortably
63 tok/s
ⓘ estimated
3/24GB
Runs comfortably
40 tok/s
ⓘ estimated
4/24GB
Runs comfortably
66 tok/s
ⓘ estimated
3/24GB
16.0GB
128k ctx
Runs comfortably
10
tok/s
ⓘ estimated
16
/ 24GB
52
/
55
/
62
Runs comfortably
10 tok/s
ⓘ estimated
16/24GB
8.0GB
128k ctx
Runs comfortably
20
tok/s
ⓘ estimated
8
/ 24GB
52
/
55
/
62
Runs comfortably
20 tok/s
ⓘ estimated
8/24GB
Llama 3.1 8B Instruct
Q4_K_M
4.5GB
128k ctx
Runs comfortably
36
tok/s
ⓘ estimated
5
/ 24GB
52
/
55
/
62
Runs comfortably
36 tok/s
ⓘ estimated
5/24GB
Runs comfortably
55 tok/s
ⓘ estimated
3/24GB
Runs comfortably
33 tok/s
ⓘ estimated
5/24GB
3.5GB
128k ctx
Runs comfortably
47
tok/s
ⓘ estimated
4
/ 24GB
35
/
38
/
50
Runs comfortably
47 tok/s
ⓘ estimated
4/24GB
Llama 3.2 3B Instruct
Q4_K_M
2.0GB
128k ctx
Runs comfortably
82
tok/s
ⓘ estimated
2
/ 24GB
35
/
38
/
50
Runs comfortably
82 tok/s
ⓘ estimated
2/24GB
Runs tight
Runs tight
8 tok/s
ⓘ estimated
22/24GB
Runs tight
9 tok/s
ⓘ estimated
18/24GB
Coding alternatives
Hosted coding assistants for comparison - per seat
Cursor
Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
GitHub Copilot
Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
GitHub Copilot
Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
Cursor
Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
GitHub Copilot
Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
Cursor
Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.
Sign in with GitHub to save this rig and get weekly model updates
Sign in with GitHub