Compare
Loading community benchmarks…
Loading community benchmarks…
Put two chips, runtimes, or runtime versions side by side. Everything else is held fixed or called out, so a ratio is worth exactly what the matched runs say.
Ratios read side A relative to side B. Geometric mean over 2 like-for-like pairs.
Everything else matches: model, quantisation, backend, protocol, and workload are the same on both sides.
Each row is a configuration present on both sides. Values are per-cell medians; ratios read Apple M1 Max relative to Apple M3 Ultra.
| Configuration | Decode A | Decode B | Ratio | Prefill A | Prefill B | Ratio | Runs A / B |
|---|---|---|---|---|---|---|---|
gemma-4-E2B-it BaseRTQ4 | 119.5 | 140.1 | 0.85× | 4,522 | 8,803 | 0.51× | 2 / 2 |
gemma-4-E2B-it BaseRTQ8 | 90.3 | 119.5 | 0.76× | 4,414 | 8,540 | 0.52× | 2 / 2 |
Top 4 of 4 runs by decode throughput.
| Model / format | Chip / backend | Decode | Prefill | Contributor | Date | Report |
|---|---|---|---|---|---|---|
gemma-4-E2B-it-Q4 BaseRT 0.2.6Q4 | Apple M1 Max Metal | 120.8 TG128 @ 1 ctx | 4,521 PP512 | basecompute | View Benchmark | |
gemma-4-E2B-it-Q4 BaseRT 0.3.0Q4 | Apple M1 Max Metal | 118.2 TG128 @ 1 ctx | 4,523 PP512 | basecompute | View Benchmark | |
gemma-4-E2B-it-Q8 BaseRT 0.2.6Q8 | Apple M1 Max Metal | 91.1 TG128 @ 1 ctx | 4,442 PP512 | basecompute | View Benchmark | |
gemma-4-E2B-it-Q8 BaseRT 0.3.0Q8 | Apple M1 Max Metal | 89.6 TG128 @ 1 ctx | 4,386 PP512 | basecompute | View Benchmark |
Top 4 of 4 runs by decode throughput.
| Model / format | Chip / backend | Decode | Prefill | Contributor | Date | Report |
|---|---|---|---|---|---|---|
gemma-4-E2B-it-Q4 BaseRT 0.3.0Q4 | Apple M3 Ultra Metal | 142.7 TG128 @ 1 ctx | 8,609 PP512 | basecompute | View Benchmark | |
gemma-4-E2B-it-Q4 BaseRT 0.2.6Q4 | Apple M3 Ultra Metal | 137.4 TG128 @ 1 ctx | 8,996 PP512 | basecompute | View Benchmark | |
gemma-4-E2B-it-Q8 BaseRT 0.3.0Q8 | Apple M3 Ultra Metal | 122.4 TG128 @ 1 ctx | 8,469 PP512 | basecompute | View Benchmark | |
gemma-4-E2B-it-Q8 BaseRT 0.2.6Q8 | Apple M3 Ultra Metal | 116.6 TG128 @ 1 ctx | 8,610 PP512 | basecompute | View Benchmark |