Gemma 4 26B A4B
MoE
enthusiast
25.2B total, 3.8B active per token (MoE: 128 experts, top-8 + 1 shared). Multimodal (text + image). The small-MoE sweet spot - near-4B decode speed with 25B-class quality. NVFP4 (~14GB) needs NVIDIA Blackwell (vLLM) or Apple Silicon (MLX); Q4_K_M (~13GB weights, ~18GB runtime) for Ollama/llama.cpp.
AI-generated content marks
The provider reports that this model does not add embedded watermarks or provenance metadata to generated output.
Provider transparency docs β
coding
reasoning
chat
general
vision
- Parameters
-
25.2B
- Context
- 256k
- License
- other
- Origin
-
πΊπΈ
USA
- Released
- Apr 2026
Run it locally
Per-quant memory needs and a static "can you run it?" reference - no rig entry required
NVFP4
14.0GB
15.0GB min
18.0GB rec
NVIDIA FP4 - Blackwell or Apple MLX, near-lossless
Q4_K_M
13.0GB
16.0GB min
18.0GB rec
Balanced - the usual local sweet spot
Q8_0
25.0GB
27.0GB min
30.0GB rec
Near-lossless
BF16
50.0GB
52.0GB min
56.0GB rec
Full quality, largest
The reference hardware
22 reference configs, drawn in-house. Scroll for more.
Can you run it? - reference rigs
| Rig |
NVFP4 |
Q4_K_M |
Q8_0 |
BF16 |
| NVIDIA Jetson Orin NX 16GB |
no -> cloud
|
tight
|
no -> cloud
|
no -> cloud
|
| Single GTX 1080 Ti (11GB) |
no -> cloud
|
offload
|
no -> cloud
|
no -> cloud
|
| 4x H100 80GB (320GB) |
no -> cloud
|
fast 3754.2t/s
|
fast 1953.5t/s
|
fast 977.1t/s
|
| NVIDIA DGX Station 748GB |
no -> cloud
|
fast 2241.3t/s
|
fast 1166.3t/s
|
fast 583.4t/s
|
| 8x RTX 3090 rack (192GB) |
no -> cloud
|
fast 2098.3t/s
|
fast 1091.9t/s
|
fast 546.1t/s
|
| 4x RTX 5090 (128GB) |
fast 1865.0t/s
|
fast 2008.2t/s
|
fast 1045.0t/s
|
fast 522.7t/s
|
| AMD Instinct MI300X (192GB) |
no -> cloud
|
fast 1491.8t/s
|
fast 776.3t/s
|
fast 388.3t/s
|
| 4x RTX 4090 (96GB) |
no -> cloud
|
fast 1129.6t/s
|
fast 587.8t/s
|
fast 294.0t/s
|
| 2x RTX 5090 (64GB) |
fast 932.5t/s
|
fast 1004.1t/s
|
fast 522.5t/s
|
fast 261.4t/s
|
| 2x RTX 3090 (48GB) |
no -> cloud
|
fast 524.6t/s
|
fast 273.0t/s
|
offload
|
| Single RTX 5090 (32GB) |
fast 466.2t/s
|
fast 502.1t/s
|
fast 261.3t/s
|
offload
|
| RTX PRO 6000 Blackwell (96GB) |
fast 466.2t/s
|
fast 502.1t/s
|
fast 261.3t/s
|
fast 130.7t/s
|
| Mac Studio M4 Ultra 192GB |
fast 310.0t/s
|
fast 333.8t/s
|
fast 173.7t/s
|
fast 86.9t/s
|
| Mac Studio M4 Ultra 512GB |
fast 310.0t/s
|
fast 333.8t/s
|
fast 173.7t/s
|
fast 86.9t/s
|
| Single RTX 4090 (24GB) |
no -> cloud
|
fast 282.4t/s
|
offload
|
no -> cloud
|
| MacBook Pro M5 Max 128GB |
fast 174.3t/s
|
fast 187.7t/s
|
fast 97.7t/s
|
fast 48.8t/s
|
| Dual EPYC 9004 + 768GB DDR5-4800 |
no -> cloud
|
fast 129.1t/s
|
fast 67.2t/s
|
fast 33.6t/s
|
| DGX Spark 128GB unified |
fast 71.0t/s
|
fast 76.5t/s
|
fast 39.8t/s
|
ok 19.9t/s
|
| Ryzen AI Max+ 395 128GB |
no -> cloud
|
fast 71.7t/s
|
fast 37.3t/s
|
ok 18.7t/s
|
| Jetson AGX Orin 64GB |
no -> cloud
|
fast 57.4t/s
|
fast 29.9t/s
|
ok 14.9t/s
|
| Epyc + 512GB DDR4-3200 + 2x RTX 3090 |
no -> cloud
|
fast 57.4t/s
|
fast 29.9t/s
|
ok 14.9t/s
|
| Epyc + 512GB DDR4-2400 + 2x RTX 3090 |
no -> cloud
|
fast 43.0t/s
|
fast 22.4t/s
|
ok 11.2t/s
|
Fit tiers use the same will-it-run logic as the rig finder. For comfortable fits, the badge reflects decode speed: fast >=20 t/s, ok 8-20 t/s, slow <8 t/s. t/s is a bandwidth estimate, not a measured benchmark.
Or run it in the cloud
Live per-provider pricing, throughput and uptime - refreshed about 19 hours ago via OpenRouter. Click a column to sort.
|
Provider
|
Type
|
Input $/M
|
Output $/M
|
Cache $/M
|
Tok/s
|
Latency
|
Uptime
|
Value
|
|
Darkbloom
|
API
|
0.04 |
0.22 |
0.021 |
- |
- |
100.00% |
best uptime
|
|
DekaLLM
|
API
|
0.06 |
0.33 |
0.040 |
- |
- |
100.00% |
|
|
NextBit
|
API
|
0.07 |
0.22 |
0.038 |
- |
- |
100.00% |
|
|
DeepInfra
|
API
|
0.07 |
0.34 |
0.038 |
- |
- |
100.00% |
|
|
Makora
|
API
|
0.07 |
0.24 |
0.046 |
- |
- |
100.00% |
|
|
Io Net
|
API
|
0.09 |
0.31 |
0.041 |
- |
- |
100.00% |
|
|
Cloudflare
|
API
|
0.10 |
0.30 |
0.050 |
- |
- |
100.00% |
|
|
CoreWeave
|
API
|
0.10 |
0.30 |
0.050 |
- |
- |
100.00% |
|
|
Novita
|
API
|
0.13 |
0.40 |
0.038 |
- |
- |
100.00% |
|
|
Parasail
|
API
|
0.13 |
0.40 |
0.050 |
- |
- |
100.00% |
|
|
Venice
|
API
|
0.13 |
0.40 |
0.050 |
- |
- |
100.00% |
|
|
SiliconFlow
|
API
|
0.14 |
0.40 |
0.050 |
- |
- |
100.00% |
|
|
Google
|
API
|
0.15 |
0.60 |
0.038 |
- |
- |
100.00% |
|
Default order: throughput among 95%+ uptime providers, then latency; subscriptions last. Sort by any column. Subscription rows show $/mo in the Value column - per-token columns are "-". Affiliate links are marked sponsored / nofollow. Confirm current pricing on the provider's site before committing.
PRICE HISTORY
Inference cost over time
Data accumulates from the first daily sync - longer ranges populate over time. Prices come from OpenRouter snapshots, not a historical API.
Loading price history...