Models / Llama 3.2 1B Instruct

Llama 3.2 1B Instruct

edge
HuggingFace → HuggingBay → Meta → Find for my hardware

AI-generated content marks

The provider reports that this model does not add embedded watermarks or provenance metadata to generated output.

Provider transparency docs →

chat general
Parameters
1.2B
Context
128k
License
llama 3
Developer
Meta
Origin
🇺🇸 USA
Released
Sep 2024

Scores

Coding
20
Reasoning
25
General
35

Score per dollar

1296 pts per $/M input

general_score (35) divided by cheapest input price ($0.03/M). Higher is better value. See live pricing.

Related models

Llama 3.3 70B Instruct
70.6B enthusiast 22GB min RAM $0.10/M in Dec 6, 2024
Llama 3.2 3B Instruct
3.2B edge 2GB min RAM $0.05/M in Sep 25, 2024
Llama 3.1 405B
405.0B premier no local build Jul 23, 2024
Llama 3.1 8B Instruct
8.0B consumer 5GB min RAM $0.02/M in Jul 23, 2024

Save your hardware and every model page answers the real question: will it run on your machine, and how fast?

Join free - save your rig →

Run it locally

Per-quant memory needs and a static "can you run it?" reference - no rig entry required

Q4_K_M
1.1GB 1.1GB min 1.5GB rec
Balanced - the usual local sweet spot
Q8_0
1.4GB 1.5GB min 2.0GB rec
Near-lossless

The reference hardware

Schematic of the 4x H100 80GB (320GB) reference rig - 320GB VRAM, 13400 GB/s aggregate bandwidth
Schematic of the NVIDIA DGX Station 748GB reference rig - 748GB unified memory, 8000 GB/s aggregate bandwidth
Schematic of the 8x RTX 3090 rack (192GB) reference rig - 192GB VRAM, 7489 GB/s aggregate bandwidth
Schematic of the 4x RTX 5090 (128GB) reference rig - 128GB VRAM, 7168 GB/s aggregate bandwidth
Schematic of the AMD Instinct MI300X (192GB) reference rig - 192GB VRAM, 5324 GB/s aggregate bandwidth
Schematic of the 4x RTX 4090 (96GB) reference rig - 96GB VRAM, 4032 GB/s aggregate bandwidth
Schematic of the 2x RTX 5090 (64GB) reference rig - 64GB VRAM, 3584 GB/s aggregate bandwidth
Schematic of the 2x RTX 3090 (48GB) reference rig - 48GB VRAM, 1872 GB/s aggregate bandwidth
Schematic of the Single RTX 5090 (32GB) reference rig - 32GB VRAM, 1792 GB/s aggregate bandwidth
Schematic of the RTX PRO 6000 Blackwell (96GB) reference rig - 96GB VRAM, 1792 GB/s aggregate bandwidth
Schematic of the Mac Studio M4 Ultra 192GB reference rig - 192GB unified memory, 1092 GB/s aggregate bandwidth
Schematic of the Mac Studio M4 Ultra 512GB reference rig - 512GB unified memory, 1092 GB/s aggregate bandwidth
Schematic of the Single RTX 4090 (24GB) reference rig - 24GB VRAM, 1008 GB/s aggregate bandwidth
Schematic of the MacBook Pro M5 Max 128GB reference rig - 128GB unified memory, 614 GB/s aggregate bandwidth
Schematic of the Single GTX 1080 Ti (11GB) reference rig - 11GB VRAM, 484 GB/s aggregate bandwidth
Schematic of the Dual EPYC 9004 + 768GB DDR5-4800 reference rig - 768GB unified memory, 460 GB/s aggregate bandwidth
Schematic of the DGX Spark 128GB unified reference rig - 128GB unified memory, 273 GB/s aggregate bandwidth
Schematic of the Ryzen AI Max+ 395 128GB reference rig - 128GB unified memory, 256 GB/s aggregate bandwidth
Schematic of the Jetson AGX Orin 64GB reference rig - 64GB unified memory, 204 GB/s aggregate bandwidth
Schematic of the Epyc + 512GB DDR4-3200 + 2x RTX 3090 reference rig - 560GB unified memory, 204 GB/s aggregate bandwidth
Schematic of the Epyc + 512GB DDR4-2400 + 2x RTX 3090 reference rig - 560GB unified memory, 153 GB/s aggregate bandwidth
Schematic of the NVIDIA Jetson Orin NX 16GB reference rig - 16GB unified memory, 102 GB/s aggregate bandwidth

22 reference configs, drawn in-house. Scroll for more.

Can you run it? - reference rigs

Rig Q4_K_M Q8_0
4x H100 80GB (320GB) fast 6698.1t/s fast 5263.1t/s
NVIDIA DGX Station 748GB fast 3998.8t/s fast 3142.1t/s
8x RTX 3090 rack (192GB) fast 3743.7t/s fast 2941.7t/s
4x RTX 5090 (128GB) fast 3583.0t/s fast 2815.4t/s
AMD Instinct MI300X (192GB) fast 2661.6t/s fast 2091.4t/s
4x RTX 4090 (96GB) fast 2015.4t/s fast 1583.6t/s
2x RTX 5090 (64GB) fast 1791.5t/s fast 1407.7t/s
2x RTX 3090 (48GB) fast 935.9t/s fast 735.4t/s
Single RTX 5090 (32GB) fast 895.7t/s fast 703.8t/s
RTX PRO 6000 Blackwell (96GB) fast 895.7t/s fast 703.8t/s
Mac Studio M4 Ultra 192GB fast 595.5t/s fast 467.9t/s
Mac Studio M4 Ultra 512GB fast 595.5t/s fast 467.9t/s
Single RTX 4090 (24GB) fast 503.9t/s fast 395.9t/s
MacBook Pro M5 Max 128GB fast 334.8t/s fast 263.1t/s
Single GTX 1080 Ti (11GB) fast 241.9t/s fast 190.1t/s
Dual EPYC 9004 + 768GB DDR5-4800 fast 230.3t/s fast 181.0t/s
DGX Spark 128GB unified fast 136.5t/s fast 107.2t/s
Ryzen AI Max+ 395 128GB fast 128.0t/s fast 100.6t/s
Jetson AGX Orin 64GB fast 102.4t/s fast 80.4t/s
Epyc + 512GB DDR4-3200 + 2x RTX 3090 fast 102.4t/s fast 80.4t/s
Epyc + 512GB DDR4-2400 + 2x RTX 3090 fast 76.8t/s fast 60.3t/s
NVIDIA Jetson Orin NX 16GB fast 51.2t/s fast 40.2t/s

Fit tiers use the same will-it-run logic as the rig finder. For comfortable fits, the badge reflects decode speed: fast >=20 t/s, ok 8-20 t/s, slow <8 t/s. t/s is a bandwidth estimate, not a measured benchmark.

Download options

Q4_K_M official -6% vs fp16
1.1GB dl 1.1GB min 1.5GB rec
REC RAM vs largest quant
Q8_0 official -1% vs fp16
1.4GB dl 1.5GB min 2.0GB rec
REC RAM vs largest quant

Or run it in the cloud

Live per-provider pricing, throughput and uptime - refreshed about 19 hours ago via OpenRouter. Click a column to sort.

Provider Type Input $/M Output $/M Cache $/M Tok/s Latency Uptime Value
Cloudflare
API 0.03 0.20 - - - 100.00% best uptime

Default order: throughput among 95%+ uptime providers, then latency; subscriptions last. Sort by any column. Subscription rows show $/mo in the Value column - per-token columns are "-". Affiliate links are marked sponsored / nofollow. Confirm current pricing on the provider's site before committing.

Detailed API pricing page + JSON endpoint →

See who runs Meta in production →

PRICE HISTORY

Inference cost over time

Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.

Loading price history...