Tokenstead - Find the right AI model for your hardware

RTX 5090 32GB

73 models / sorted by best_quality

Quality Fastest Least mem Newest

Model Fit Speed Memory Scores / Run

Runs comfortably

Ornith-1.5-35B-A3B Q6_K

29.2GB 3k cap

Runs comfortably

210 tok/s

ⓘ estimated

29 / 32GB

91 / 89 / 86

FIT Runs comfortably

SPEED 210 tok/s

ⓘ estimated

MEMORY 29/32GB

Ornith-1.5-35B-A3B Q5_K_M

25.3GB 10k cap

Runs comfortably

226 tok/s

ⓘ estimated

25 / 32GB

91 / 89 / 86

FIT Runs comfortably

SPEED 226 tok/s

ⓘ estimated

MEMORY 25/32GB

Ornith-1.5-35B-A3B Q4_K_M

21.7GB 18k cap

Runs comfortably

243 tok/s

ⓘ estimated

22 / 32GB

91 / 89 / 86

FIT Runs comfortably

SPEED 243 tok/s

ⓘ estimated

MEMORY 22/32GB

Qwen3.6 35B A3B Q4_K_M

20.0GB 21k cap

Runs comfortably

248 tok/s

ⓘ estimated

20 / 32GB

90 / 91 / 87

FIT Runs comfortably

SPEED 248 tok/s

ⓘ estimated

MEMORY 20/32GB

Pokee-Isaac 28B Q4_K_M

16.0GB 23k cap

Runs comfortably

53 tok/s

ⓘ estimated

16 / 32GB

90 / 88 / 88

FIT Runs comfortably

SPEED 53 tok/s

ⓘ estimated

MEMORY 16/32GB

Pokee-Isaac 28B Q8_0

28.0GB 3k cap

Runs comfortably

32 tok/s

ⓘ estimated

28 / 32GB

90 / 88 / 88

FIT Runs comfortably

SPEED 32 tok/s

ⓘ estimated

MEMORY 28/32GB

Qwen3.8-27B NVFP4 Unsloth

15.2GB 25k cap

Runs comfortably

56 tok/s

ⓘ estimated

15 / 32GB

88 / 89 / 85

FIT Runs comfortably

SPEED 56 tok/s

ⓘ estimated

MEMORY 15/32GB

Qwen3.8-27B UD-IQ1_S Unsloth

6.2GB 43k cap

Runs comfortably

117 tok/s

ⓘ estimated

6 / 32GB

88 / 89 / 85

FIT Runs comfortably

SPEED 117 tok/s

ⓘ estimated

MEMORY 6/32GB

Qwen3.8-27B UD-Q2_K_XL Unsloth

9.8GB 38k cap

Runs comfortably

82 tok/s

ⓘ estimated

10 / 32GB

88 / 89 / 85

FIT Runs comfortably

SPEED 82 tok/s

ⓘ estimated

MEMORY 10/32GB

Qwen3.8-27B UD-Q4_K_XL Unsloth

17.6GB 23k cap

Runs comfortably

50 tok/s

ⓘ estimated

18 / 32GB

88 / 89 / 85

FIT Runs comfortably

SPEED 50 tok/s

ⓘ estimated

MEMORY 18/32GB

Gemma 4 31B QAT

18.0GB 16k cap

Runs comfortably

46 tok/s

ⓘ estimated

18 / 32GB

86 / 89 / 85

FIT Runs comfortably

SPEED 46 tok/s

ⓘ estimated

MEMORY 18/32GB

Gemma 4 31B Q4_K_M

18.3GB 15k cap

Runs comfortably

46 tok/s

ⓘ estimated

18 / 32GB

86 / 89 / 85

FIT Runs comfortably

SPEED 46 tok/s

ⓘ estimated

MEMORY 18/32GB

Gemma 4 31B NVFP4

16.0GB 15k cap

Runs comfortably

51 tok/s

ⓘ estimated

16 / 32GB

86 / 89 / 85

FIT Runs comfortably

SPEED 51 tok/s

ⓘ estimated

MEMORY 16/32GB

Gemma 4 26B A4B Q4_K_M

13.0GB 22k cap

Runs comfortably

204 tok/s

ⓘ estimated

13 / 32GB

85 / 88 / 84

FIT Runs comfortably

SPEED 204 tok/s

ⓘ estimated

MEMORY 13/32GB

Gemma 4 26B A4B Q8_0

25.0GB 7k cap

Runs comfortably

148 tok/s

ⓘ estimated

25 / 32GB

85 / 88 / 84

FIT Runs comfortably

SPEED 148 tok/s

ⓘ estimated

MEMORY 25/32GB

Gemma 4 26B A4B NVFP4

14.0GB 24k cap

Runs comfortably

198 tok/s

ⓘ estimated

14 / 32GB

85 / 88 / 84

FIT Runs comfortably

SPEED 198 tok/s

ⓘ estimated

MEMORY 14/32GB

Qwen3.6 27B Q8_0

28.0GB 5k cap

Runs comfortably

32 tok/s

ⓘ estimated

28 / 32GB

85 / 87 / 82

FIT Runs comfortably

SPEED 32 tok/s

ⓘ estimated

MEMORY 28/32GB

Qwen3.6 27B Q4_K_M

16.5GB 22k cap

Runs comfortably

51 tok/s

ⓘ estimated

17 / 32GB

85 / 87 / 82

FIT Runs comfortably

SPEED 51 tok/s

ⓘ estimated

MEMORY 17/32GB

Qwen3 32B Q5_K_M

24.5GB 10k cap

Runs comfortably

36 tok/s

ⓘ estimated

25 / 32GB

80 / 82 / 78

FIT Runs comfortably

SPEED 36 tok/s

ⓘ estimated

MEMORY 25/32GB

Qwen3 32B Q6_K

28.5GB 4k cap

Runs comfortably

31 tok/s

ⓘ estimated

29 / 32GB

80 / 82 / 78

FIT Runs comfortably

SPEED 31 tok/s

ⓘ estimated

MEMORY 29/32GB

Qwen3 32B Q4_K_M

20.0GB 17k cap

Runs comfortably

43 tok/s

ⓘ estimated

20 / 32GB

80 / 82 / 78

FIT Runs comfortably

SPEED 43 tok/s

ⓘ estimated

MEMORY 20/32GB

Ornith-1.5-9B Q6_K

7.6GB 48k cap

Runs comfortably

103 tok/s

ⓘ estimated

8 / 32GB

78 / 76 / 74

FIT Runs comfortably

SPEED 103 tok/s

ⓘ estimated

MEMORY 8/32GB

Ornith-1.5-9B Q8_0

9.8GB 44k cap

Runs comfortably

83 tok/s

ⓘ estimated

10 / 32GB

78 / 76 / 74

FIT Runs comfortably

SPEED 83 tok/s

ⓘ estimated

MEMORY 10/32GB

Ornith-1.5-9B BF16

18.4GB 26k cap

Runs comfortably

48 tok/s

ⓘ estimated

18 / 32GB

78 / 76 / 74

FIT Runs comfortably

SPEED 48 tok/s

ⓘ estimated

MEMORY 18/32GB

Ornith-1.5-9B Q4_K_M

5.8GB 52k cap

Runs comfortably

126 tok/s

ⓘ estimated

6 / 32GB

78 / 76 / 74

FIT Runs comfortably

SPEED 126 tok/s

ⓘ estimated

MEMORY 6/32GB

Ornith-1.5-9B Q5_K_M

6.6GB 50k cap

Runs comfortably

113 tok/s

ⓘ estimated

7 / 32GB

78 / 76 / 74

FIT Runs comfortably

SPEED 113 tok/s

ⓘ estimated

MEMORY 7/32GB

Qwen3 30B A3B Q4_K_M

15.5GB 30k cap

Runs comfortably

261 tok/s

ⓘ estimated

16 / 32GB

75 / 78 / 72

FIT Runs comfortably

SPEED 261 tok/s

ⓘ estimated

MEMORY 16/32GB

Phi-4 14B Q4_K_M

8.5GB 16k ctx

Runs comfortably

97 tok/s

ⓘ estimated

9 / 32GB

75 / 78 / 70

FIT Runs comfortably

SPEED 97 tok/s

ⓘ estimated

MEMORY 9/32GB

Phi-4 14B FP16

29.0GB 7k cap

Runs comfortably

32 tok/s

ⓘ estimated

29 / 32GB

75 / 78 / 70

FIT Runs comfortably

SPEED 32 tok/s

ⓘ estimated

MEMORY 29/32GB

Phi-4 14B Q8_0

15.0GB 16k ctx

Runs comfortably

59 tok/s

ⓘ estimated

15 / 32GB

75 / 78 / 70

FIT Runs comfortably

SPEED 59 tok/s

ⓘ estimated

MEMORY 15/32GB

Xing4.0-29B-A4B Q4_K_M

20.1GB 14k cap

Runs comfortably

128 tok/s

ⓘ estimated

20 / 32GB

75 / 73 / 72

FIT Runs comfortably

SPEED 128 tok/s

ⓘ estimated

MEMORY 20/32GB

Llama 3.3 70B Instruct Q2_K

21.5GB 7k cap

Runs comfortably

36 tok/s

ⓘ estimated

22 / 32GB

72 / 77 / 80

FIT Runs comfortably

SPEED 36 tok/s

ⓘ estimated

MEMORY 22/32GB

Qwen3 14B Q8_0

15.0GB 34k cap

Runs comfortably

58 tok/s

ⓘ estimated

15 / 32GB

72 / 75 / 70

FIT Runs comfortably

SPEED 58 tok/s

ⓘ estimated

MEMORY 15/32GB

Qwen3 14B Q4_K_M

9.0GB 46k cap

Runs comfortably

89 tok/s

ⓘ estimated

9 / 32GB

72 / 75 / 70

FIT Runs comfortably

SPEED 89 tok/s

ⓘ estimated

MEMORY 9/32GB

Gemma 4 12B Q8_0

13.0GB 42k cap

Runs comfortably

66 tok/s

ⓘ estimated

13 / 32GB

70 / 74 / 72

FIT Runs comfortably

SPEED 66 tok/s

ⓘ estimated

MEMORY 13/32GB

Gemma 4 12B Q4_K_M

7.2GB 55k cap

Runs comfortably

109 tok/s

ⓘ estimated

7 / 32GB

70 / 74 / 72

FIT Runs comfortably

SPEED 109 tok/s

ⓘ estimated

MEMORY 7/32GB

Gemma 3 27B Q8_0

28.0GB 5k cap

Runs comfortably

32 tok/s

ⓘ estimated

28 / 32GB

68 / 71 / 72

FIT Runs comfortably

SPEED 32 tok/s

ⓘ estimated

MEMORY 28/32GB

Gemma 3 27B Q4_K_M

17.0GB 20k cap

Runs comfortably

49 tok/s

ⓘ estimated

17 / 32GB

68 / 71 / 72

FIT Runs comfortably

SPEED 49 tok/s

ⓘ estimated

MEMORY 17/32GB

Qwen3 8B Q8_0

8.5GB 47k cap

Runs comfortably

93 tok/s

ⓘ estimated

9 / 32GB

67 / 70 / 65

FIT Runs comfortably

SPEED 93 tok/s

ⓘ estimated

MEMORY 9/32GB

Qwen3 8B Q4_K_M

5.2GB 53k cap

Runs comfortably

136 tok/s

ⓘ estimated

5 / 32GB

67 / 70 / 65

FIT Runs comfortably

SPEED 136 tok/s

ⓘ estimated

MEMORY 5/32GB

Mixtral 8x7B Instruct Q4_K_M

26.5GB 11k cap

Runs comfortably

105 tok/s

ⓘ estimated

27 / 32GB

62 / 65 / 68

FIT Runs comfortably

SPEED 105 tok/s

ⓘ estimated

MEMORY 27/32GB

Gemma 3 12B Q4_K_M

7.5GB 58k cap

Runs comfortably

107 tok/s

ⓘ estimated

8 / 32GB

62 / 65 / 68

FIT Runs comfortably

SPEED 107 tok/s

ⓘ estimated

MEMORY 8/32GB

Gemma 3 12B Q8_0

13.5GB 44k cap

Runs comfortably

65 tok/s

ⓘ estimated

14 / 32GB

62 / 65 / 68

FIT Runs comfortably

SPEED 65 tok/s

ⓘ estimated

MEMORY 14/32GB

Mixtral 8x7B Instruct Q3_K_M

19.0GB 26k cap

Runs comfortably

135 tok/s

ⓘ estimated

19 / 32GB

62 / 65 / 68

FIT Runs comfortably

SPEED 135 tok/s

ⓘ estimated

MEMORY 19/32GB

Mistral Nemo 12B Q4_K_M

7.3GB 61k cap

Runs comfortably

110 tok/s

ⓘ estimated

7 / 32GB

58 / 60 / 62

FIT Runs comfortably

SPEED 110 tok/s

ⓘ estimated

MEMORY 7/32GB

Mistral Nemo 12B Q8_0

13.2GB 46k cap

Runs comfortably

66 tok/s

ⓘ estimated

13 / 32GB

58 / 60 / 62

FIT Runs comfortably

SPEED 66 tok/s

ⓘ estimated

MEMORY 13/32GB

Qwen3 4B Q4_K_M

2.6GB 32k ctx

Runs comfortably

263 tok/s

ⓘ estimated

3 / 32GB

58 / 60 / 56

FIT Runs comfortably

SPEED 263 tok/s

ⓘ estimated

MEMORY 3/32GB

Phi-4 Mini Q4_K_M

2.5GB 128k ctx

Runs comfortably

297 tok/s

ⓘ estimated

3 / 32GB

55 / 58 / 52

FIT Runs comfortably

SPEED 297 tok/s

ⓘ estimated

MEMORY 3/32GB

Phi-4 Mini Q8_0

4.1GB 128k ctx

Runs comfortably

200 tok/s

ⓘ estimated

4 / 32GB

55 / 58 / 52

FIT Runs comfortably

SPEED 200 tok/s

ⓘ estimated

MEMORY 4/32GB

Llama 3.1 8B Instruct Q4_K_M

4.5GB 55k cap

Runs comfortably

151 tok/s

ⓘ estimated

5 / 32GB

52 / 55 / 62

FIT Runs comfortably

SPEED 151 tok/s

ⓘ estimated

MEMORY 5/32GB

Llama 3.1 8B Instruct Q8_0

8.0GB 48k cap

Runs comfortably

98 tok/s

ⓘ estimated

8 / 32GB

52 / 55 / 62

FIT Runs comfortably

SPEED 98 tok/s

ⓘ estimated

MEMORY 8/32GB

Llama 3.1 8B Instruct FP16

16.0GB 32k cap

Runs comfortably

55 tok/s

ⓘ estimated

16 / 32GB

52 / 55 / 62

FIT Runs comfortably

SPEED 55 tok/s

ⓘ estimated

MEMORY 16/32GB

Gemma 3 4B Q8_0

5.0GB 90k cap

Runs comfortably

158 tok/s

ⓘ estimated

5 / 32GB

42 / 45 / 55

FIT Runs comfortably

SPEED 158 tok/s

ⓘ estimated

MEMORY 5/32GB

Gemma 3 4B Q4_K_M

3.0GB 96k cap

Runs comfortably

233 tok/s

ⓘ estimated

3 / 32GB

42 / 45 / 55

FIT Runs comfortably

SPEED 233 tok/s

ⓘ estimated

MEMORY 3/32GB

Llama 3.2 3B Instruct Q8_0

3.5GB 118k cap

Runs comfortably

220 tok/s

ⓘ estimated

4 / 32GB

35 / 38 / 50

FIT Runs comfortably

SPEED 220 tok/s

ⓘ estimated

MEMORY 4/32GB

Llama 3.2 3B Instruct Q4_K_M

2.0GB 124k cap

Runs comfortably

330 tok/s

ⓘ estimated

2 / 32GB

35 / 38 / 50

FIT Runs comfortably

SPEED 330 tok/s

ⓘ estimated

MEMORY 2/32GB

Mellum2.1 12B Thinking Q4_K_M

7.0GB 131k ctx

Runs comfortably

592 tok/s

ⓘ estimated

7 / 32GB

FIT Runs comfortably

SPEED 592 tok/s

ⓘ estimated

MEMORY 7/32GB

Mellum2.1 12B Thinking FP16

24.3GB 109k cap

Runs comfortably

189 tok/s

ⓘ estimated

24 / 32GB

FIT Runs comfortably

SPEED 189 tok/s

ⓘ estimated

MEMORY 24/32GB

LFM2.5-24B-A2B FP8

24.0GB 76k cap

Runs comfortably

424 tok/s

ⓘ estimated

24 / 32GB

FIT Runs comfortably

SPEED 424 tok/s

ⓘ estimated

MEMORY 24/32GB

LFM2.5-24B-A2B Q4_K_M

13.7GB 131k ctx

Runs comfortably

674 tok/s

ⓘ estimated

14 / 32GB

FIT Runs comfortably

SPEED 674 tok/s

ⓘ estimated

MEMORY 14/32GB

Runs tight

Qwen3 30B A3B Q8_0

31.0GB 1k cap

Runs tight

186 tok/s

ⓘ estimated

31 / 32GB

75 / 78 / 72

FIT Runs tight

SPEED 186 tok/s

ⓘ estimated

MEMORY 31/32GB

Llama 3.3 70B Instruct Q3_K_M

30.0GB 1k cap

Runs tight

27 tok/s

ⓘ estimated

30 / 32GB

72 / 77 / 80

FIT Runs tight

SPEED 27 tok/s

ⓘ estimated

MEMORY 30/32GB

Muse Glimmer 30B Q4_K_M

18.0GB 13k cap

Runs tight

48 tok/s

ⓘ estimated

18 / 32GB

FIT Runs tight

SPEED 48 tok/s

ⓘ estimated

MEMORY 18/32GB

Runs with CPU offload

Qwen3.8-Flash-Next EXL3_3BPW

85.0GB 19k cap

Runs with CPU offload

0.5 tok/s

ⓘ estimated

85 / 32GB

92 / 92 / 89

FIT Runs with CPU offload

SPEED 0.5 tok/s

ⓘ estimated

MEMORY 85/32GB

Qwen3.8-Flash-Next EXL3_2BPW

62.7GB 19k cap

Runs with CPU offload

0.5 tok/s

ⓘ estimated

63 / 32GB

92 / 92 / 89

FIT Runs with CPU offload

SPEED 0.5 tok/s

ⓘ estimated

MEMORY 63/32GB

Ornith-1.5-35B-A3B Q8_0

37.8GB ctx spills to ram

Runs with CPU offload

2 tok/s

ⓘ estimated

38 / 32GB

91 / 89 / 86

FIT Runs with CPU offload

SPEED 2 tok/s

ⓘ estimated

MEMORY 38/32GB

Qwen3.6 35B A3B Q8_0

37.0GB ctx spills to ram

Runs with CPU offload

2 tok/s

ⓘ estimated

37 / 32GB

90 / 91 / 87

FIT Runs with CPU offload

SPEED 2 tok/s

ⓘ estimated

MEMORY 37/32GB

Gemma 4 31B Q8_0

32.6GB ctx spills to ram

Runs with CPU offload

15 tok/s

ⓘ estimated

33 / 32GB

86 / 89 / 85

FIT Runs with CPU offload

SPEED 15 tok/s

ⓘ estimated

MEMORY 33/32GB

Gemma 4 26B A4B BF16

50.0GB ctx spills to ram

Runs with CPU offload

1 tok/s

ⓘ estimated

50 / 32GB

85 / 88 / 84

FIT Runs with CPU offload

SPEED 1 tok/s

ⓘ estimated

MEMORY 50/32GB

Qwen3 32B Q8_0

34.0GB ctx spills to ram

Runs with CPU offload

15 tok/s

ⓘ estimated

34 / 32GB

80 / 82 / 78

FIT Runs with CPU offload

SPEED 15 tok/s

ⓘ estimated

MEMORY 34/32GB

Nemotron 3.5 Lightning Q4_K_M

32.0GB ctx spills to ram

Runs with CPU offload

4 tok/s

ⓘ estimated

32 / 32GB

78 / 76 / 74

FIT Runs with CPU offload

SPEED 4 tok/s

ⓘ estimated

MEMORY 32/32GB

Llama 3.3 70B Instruct Q4_K_M

42.0GB ctx spills to ram

Runs with CPU offload

7 tok/s

ⓘ estimated

42 / 32GB

72 / 77 / 80

FIT Runs with CPU offload

SPEED 7 tok/s

ⓘ estimated

MEMORY 42/32GB

Muse Glimmer 30B Q8_0

33.0GB ctx spills to ram

Runs with CPU offload

11 tok/s

ⓘ estimated

33 / 32GB

FIT Runs with CPU offload

SPEED 11 tok/s

ⓘ estimated

MEMORY 33/32GB

Coding alternatives

Hosted coding assistants for comparison - per seat

Cursor Hobby

AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...

$0.0

/MONTH

GitHub Copilot Individual

AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...

$10.0

/MONTH

GitHub Copilot Business

AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...

$19.0

/MONTH

Cursor Pro

AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...

$20.0

/MONTH

GitHub Copilot Enterprise

AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...

$39.0

/MONTH

Cursor Business

AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...

$40.0

/MONTH

Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.

On a monthly budget? Compare owning hardware vs renting cloud →

Tokenstead community

Not sure this is the right fit?

Post your rig and the shortlist in the community and get a sanity check from people running the same memory and stack.

Join the community Share your rig