Models / Llama 3.2 1B Instruct

Llama 3.2 1B Instruct

edge
HuggingFace → HuggingBay → Meta → Find for my hardware

AI-generated content marks

The provider reports that this model does not add embedded watermarks or provenance metadata to generated output.

Provider transparency docs →

chat general
Parameters
1.2B
Context
128k
License
llama 3
Developer
Meta
Origin
🇺🇸 USA
Released
Sep 2024

Scores

Coding
20
Reasoning
25
General
35

Score per dollar

1296 pts per $/M input

general_score (35) divided by cheapest input price ($0.03/M). Higher is better value. See live pricing.

Related models

Llama 3.3 70B Instruct
70.6B enthusiast 22GB min RAM $0.10/M in Dec 6, 2024
Llama 3.2 3B Instruct
3.2B edge 2GB min RAM $0.05/M in Sep 25, 2024
Llama 3.1 405B
405.0B premier no local build Jul 23, 2024
Llama 3.1 8B Instruct
8.0B consumer 5GB min RAM $0.02/M in Jul 23, 2024

Save your hardware and every model page answers the real question: will it run on your machine, and how fast?

Join free - save your rig →

Run it locally

Per-quant memory needs and a static "can you run it?" reference - no rig entry required

Q4_K_M
1.1GB 1.1GB min 2.0GB rec
Balanced - the usual local sweet spot
Q8_0
1.4GB 1.5GB min 2.3GB rec
Near-lossless

The reference hardware

Schematic of the 4x H100 80GB (320GB) reference rig - 320GB VRAM, 13400 GB/s aggregate bandwidth
Schematic of the NVIDIA DGX Station 748GB reference rig - 748GB unified memory, 8000 GB/s aggregate bandwidth
Schematic of the 8x RTX 3090 rack (192GB) reference rig - 192GB VRAM, 7489 GB/s aggregate bandwidth
Schematic of the 4x RTX 5090 (128GB) reference rig - 128GB VRAM, 7168 GB/s aggregate bandwidth
Schematic of the AMD Instinct MI300X (192GB) reference rig - 192GB VRAM, 5324 GB/s aggregate bandwidth
Schematic of the 4x RTX 4090 (96GB) reference rig - 96GB VRAM, 4032 GB/s aggregate bandwidth
Schematic of the 2x RTX 5090 (64GB) reference rig - 64GB VRAM, 3584 GB/s aggregate bandwidth
Schematic of the 2x RTX 3090 (48GB) reference rig - 48GB VRAM, 1872 GB/s aggregate bandwidth
Schematic of the Single RTX 5090 (32GB) reference rig - 32GB VRAM, 1792 GB/s aggregate bandwidth
Schematic of the RTX PRO 6000 Blackwell (96GB) reference rig - 96GB VRAM, 1792 GB/s aggregate bandwidth
Schematic of the Mac Studio M4 Ultra 192GB reference rig - 192GB unified memory, 1092 GB/s aggregate bandwidth
Schematic of the Mac Studio M4 Ultra 512GB reference rig - 512GB unified memory, 1092 GB/s aggregate bandwidth
Schematic of the Single RTX 4090 (24GB) reference rig - 24GB VRAM, 1008 GB/s aggregate bandwidth
Schematic of the MacBook Pro M5 Max 128GB reference rig - 128GB unified memory, 614 GB/s aggregate bandwidth
Schematic of the Single GTX 1080 Ti (11GB) reference rig - 11GB VRAM, 484 GB/s aggregate bandwidth
Schematic of the Dual EPYC 9004 + 768GB DDR5-4800 reference rig - 768GB unified memory, 460 GB/s aggregate bandwidth
Schematic of the DGX Spark 128GB unified reference rig - 128GB unified memory, 273 GB/s aggregate bandwidth
Schematic of the Ryzen AI Max+ 395 128GB reference rig - 128GB unified memory, 256 GB/s aggregate bandwidth
Schematic of the Jetson AGX Orin 64GB reference rig - 64GB unified memory, 204 GB/s aggregate bandwidth
Schematic of the Epyc + 512GB DDR4-3200 + 2x RTX 3090 reference rig - 560GB unified memory, 204 GB/s aggregate bandwidth
Schematic of the Epyc + 512GB DDR4-2400 + 2x RTX 3090 reference rig - 560GB unified memory, 153 GB/s aggregate bandwidth
Schematic of the NVIDIA Jetson Orin NX 16GB reference rig - 16GB unified memory, 102 GB/s aggregate bandwidth

22 reference configs, drawn in-house. Scroll for more.

Can you run it? - reference rigs

Rig Q4_K_M Q8_0
4x H100 80GB (320GB) fast 5161.1t/s fast 4265.1t/s
NVIDIA DGX Station 748GB fast 3081.2t/s fast 2546.3t/s
8x RTX 3090 rack (192GB) fast 2884.7t/s fast 2383.8t/s
4x RTX 5090 (128GB) fast 2760.8t/s fast 2281.5t/s
AMD Instinct MI300X (192GB) fast 2050.9t/s fast 1694.8t/s
4x RTX 4090 (96GB) fast 1552.9t/s fast 1283.3t/s
2x RTX 5090 (64GB) fast 1380.4t/s fast 1140.7t/s
2x RTX 3090 (48GB) fast 721.2t/s fast 596.0t/s
Single RTX 5090 (32GB) fast 690.2t/s fast 570.4t/s
RTX PRO 6000 Blackwell (96GB) fast 690.2t/s fast 570.4t/s
Mac Studio M4 Ultra 192GB fast 458.8t/s fast 379.2t/s
Mac Studio M4 Ultra 512GB fast 458.8t/s fast 379.2t/s
Single RTX 4090 (24GB) fast 388.2t/s fast 320.8t/s
MacBook Pro M5 Max 128GB fast 258.0t/s fast 213.2t/s
Single GTX 1080 Ti (11GB) fast 186.4t/s fast 154.1t/s
Dual EPYC 9004 + 768GB DDR5-4800 fast 177.5t/s fast 146.7t/s
DGX Spark 128GB unified fast 105.2t/s fast 86.9t/s
Ryzen AI Max+ 395 128GB fast 98.6t/s fast 81.5t/s
Jetson AGX Orin 64GB fast 78.9t/s fast 65.2t/s
Epyc + 512GB DDR4-3200 + 2x RTX 3090 fast 78.9t/s fast 65.2t/s
Epyc + 512GB DDR4-2400 + 2x RTX 3090 fast 59.2t/s fast 48.9t/s
NVIDIA Jetson Orin NX 16GB fast 39.4t/s fast 32.6t/s

Fit tiers use the same will-it-run logic as the rig finder. For comfortable fits, the badge reflects decode speed: fast >=20 t/s, ok 8-20 t/s, slow <8 t/s. t/s is a bandwidth estimate, not a measured benchmark.

Download options

Q4_K_M official -6% vs fp16
1.1GB dl 1.1GB min 2.0GB rec
REC RAM vs largest quant
Q8_0 official -1% vs fp16
1.4GB dl 1.5GB min 2.3GB rec
REC RAM vs largest quant

Or run it in the cloud

Live per-provider pricing, throughput and uptime - refreshed about 1 hour ago via OpenRouter. Click a column to sort.

Provider Type Input $/M Output $/M Cache $/M Tok/s Latency Uptime Value
Cloudflare
API 0.03 0.20 - - - 100.00% best uptime

Default order: throughput among 95%+ uptime providers, then latency; subscriptions last. Sort by any column. Subscription rows show $/mo in the Value column - per-token columns are "-". Affiliate links are marked sponsored / nofollow. Confirm current pricing on the provider's site before committing.

Detailed API pricing page + JSON endpoint →

See who runs Meta in production →

PRICE HISTORY

Inference cost over time

Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.

Loading price history...