Skip to content

Orin NX 16 16GB

32 models / sorted by best_quality

Quality Fastest Least mem Newest
Runs comfortably
Qwen3.8-27B UD-IQ1_S Unsloth
6.2GB 14k cap
FIT Runs comfortably
SPEED 7 tok/s
ⓘ estimated
MEMORY 6/16GB
Qwen3.8-27B UD-Q2_K_XL Unsloth
9.8GB 9k cap
FIT Runs comfortably
SPEED 5 tok/s
ⓘ estimated
MEMORY 10/16GB
Ornith-1.5-9B Q8_0
9.8GB 12k cap
FIT Runs comfortably
SPEED 5 tok/s
ⓘ estimated
MEMORY 10/16GB
Ornith-1.5-9B Q6_K
7.6GB 16k cap
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 8/16GB
Ornith-1.5-9B Q5_K_M
6.6GB 18k cap
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 7/16GB
Ornith-1.5-9B Q4_K_M
5.8GB 20k cap
FIT Runs comfortably
SPEED 7 tok/s
ⓘ estimated
MEMORY 6/16GB
Phi-4 14B Q4_K_M
8.5GB 16k ctx
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 9/16GB
Qwen3 14B Q4_K_M
9.0GB 14k cap
FIT Runs comfortably
SPEED 5 tok/s
ⓘ estimated
MEMORY 9/16GB
Gemma 4 12B Q4_K_M
7.2GB 19k cap
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 7/16GB
Gemma 4 12B Q8_0
13.0GB 6k cap
FIT Runs comfortably
SPEED 4 tok/s
ⓘ estimated
MEMORY 13/16GB
Qwen3 8B Q8_0
8.5GB 15k cap
FIT Runs comfortably
SPEED 5 tok/s
ⓘ estimated
MEMORY 9/16GB
Qwen3 8B Q4_K_M
5.2GB 21k cap
FIT Runs comfortably
SPEED 8 tok/s
ⓘ estimated
MEMORY 5/16GB
Gemma 3 12B Q4_K_M
7.5GB 20k cap
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 8/16GB
Gemma 3 12B Q8_0
13.5GB 5k cap
FIT Runs comfortably
SPEED 4 tok/s
ⓘ estimated
MEMORY 14/16GB
Mistral Nemo 12B Q8_0
13.2GB 6k cap
FIT Runs comfortably
SPEED 4 tok/s
ⓘ estimated
MEMORY 13/16GB
Mistral Nemo 12B Q4_K_M
7.3GB 21k cap
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 7/16GB
Qwen3 4B Q4_K_M
2.6GB 32k ctx
FIT Runs comfortably
SPEED 15 tok/s
ⓘ estimated
MEMORY 3/16GB
Phi-4 Mini Q8_0
4.1GB 59k cap
FIT Runs comfortably
SPEED 11 tok/s
ⓘ estimated
MEMORY 4/16GB
Phi-4 Mini Q4_K_M
2.5GB 67k cap
FIT Runs comfortably
SPEED 17 tok/s
ⓘ estimated
MEMORY 3/16GB
Llama 3.1 8B Instruct Q8_0
8.0GB 16k cap
FIT Runs comfortably
SPEED 6 tok/s
ⓘ estimated
MEMORY 8/16GB
Llama 3.1 8B Instruct Q4_K_M
4.5GB 23k cap
FIT Runs comfortably
SPEED 9 tok/s
ⓘ estimated
MEMORY 5/16GB
Gemma 3 4B Q8_0
5.0GB 36k cap
FIT Runs comfortably
SPEED 9 tok/s
ⓘ estimated
MEMORY 5/16GB
Gemma 3 4B Q4_K_M
3.0GB 43k cap
FIT Runs comfortably
SPEED 13 tok/s
ⓘ estimated
MEMORY 3/16GB
Llama 3.2 3B Instruct Q8_0
3.5GB 52k cap
FIT Runs comfortably
SPEED 13 tok/s
ⓘ estimated
MEMORY 4/16GB
Llama 3.2 3B Instruct Q4_K_M
2.0GB 58k cap
FIT Runs comfortably
SPEED 19 tok/s
ⓘ estimated
MEMORY 2/16GB
Mellum2.1 12B Thinking Q4_K_M
7.0GB 109k cap
FIT Runs comfortably
SPEED 34 tok/s
ⓘ estimated
MEMORY 7/16GB
Runs tight
Gemma 4 26B A4B Q4_K_M
13.0GB ctx headroom ~0
FIT Runs tight
SPEED 12 tok/s
ⓘ estimated
MEMORY 13/16GB
Qwen3 30B A3B Q4_K_M
15.5GB ctx headroom ~0
FIT Runs tight
SPEED 15 tok/s
ⓘ estimated
MEMORY 16/16GB
Phi-4 14B Q8_0
15.0GB 2k cap
FIT Runs tight
SPEED 3 tok/s
ⓘ estimated
MEMORY 15/16GB
Qwen3 14B Q8_0
15.0GB 2k cap
FIT Runs tight
SPEED 3 tok/s
ⓘ estimated
MEMORY 15/16GB
Llama 3.1 8B Instruct FP16
16.0GB ctx headroom ~0
FIT Runs tight
SPEED 3 tok/s
ⓘ estimated
MEMORY 16/16GB
LFM2.5-24B-A2B Q4_K_M
13.7GB ctx headroom ~0
FIT Runs tight
SPEED 38 tok/s
ⓘ estimated
MEMORY 14/16GB

Coding alternatives

Hosted coding assistants for comparison - per seat

Cursor Hobby
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$0.0
/MONTH
GitHub Copilot Individual
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$10.0
/MONTH
GitHub Copilot Business
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$19.0
/MONTH
Cursor Pro
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$20.0
/MONTH
GitHub Copilot Enterprise
AI coding assistant by GitHub. GPT-4o and Claude-based completions. $19/seat ...
$39.0
/MONTH
Cursor Business
AI-first code editor. Uses frontier models (GPT-4, Claude). $20/user Business...
$40.0
/MONTH

Per-token monthly figures are estimates at typical usage. Prices verified periodically - always confirm current pricing on the provider's website.

On a monthly budget? Compare owning hardware vs renting cloud →

Sign in with GitHub to save this rig and get weekly model updates

Sign in with GitHub

Tokenstead community

Not sure this is the right fit?

Post your rig and the shortlist in the community and get a sanity check from people running the same memory and stack.

Join the community Share your rig