Compare
Loading community benchmarks…
Loading community benchmarks…
Put two chips, runtimes, or runtime versions side by side. Everything else is held fixed or called out, so a ratio is worth exactly what the matched runs say.
Ratios read side A relative to side B. Geometric mean over 3 like-for-like pairs.
Everything else matches: model, quantisation, backend, protocol, and workload are the same on both sides.
Each row is a configuration present on both sides. Values are per-cell medians; ratios read Apple M1 Max relative to Apple M4 Pro.
| Configuration | Decode A | Decode B | Ratio | Prefill A | Prefill B | Ratio | Runs A / B |
|---|---|---|---|---|---|---|---|
gpt-oss-20b BaseRTQ4 | 81.8 | 78.9 | 1.04× | 882 | 732 | 1.21× | 2 / 2 |
gpt-oss-20b BaseRTQ8 | 75.7 | 73.4 | 1.03× | 874 | 730 | 1.20× | 2 / 2 |
gpt-oss-20b BaseRTmxfp4 | 76.2 | 72.5 | 1.05× | 890 | 736 | 1.21× | 2 / 2 |
Top 6 of 6 runs by decode throughput.
| Model / format | Chip / backend | Decode | Prefill | Contributor | Date | Report |
|---|---|---|---|---|---|---|
gpt-oss-20b-Q4 BaseRT 0.2.6Q4 | Apple M1 Max Metal | 82.3 TG128 @ 1 ctx | 881 PP512 | basecompute | View Benchmark | |
gpt-oss-20b-Q4 BaseRT 0.3.0Q4 | Apple M1 Max Metal | 81.3 TG128 @ 1 ctx | 884 PP512 | basecompute | View Benchmark | |
gpt-oss-20b-Q8 BaseRT 0.2.6Q8 | Apple M1 Max Metal | 76.7 TG128 @ 1 ctx | 880 PP512 | basecompute | View Benchmark | |
gpt-oss-20b-MXFP4 BaseRT 0.2.6mxfp4 | Apple M1 Max Metal | 76.6 TG128 @ 1 ctx | 890 PP512 | basecompute | View Benchmark | |
gpt-oss-20b-MXFP4 BaseRT 0.3.0mxfp4 | Apple M1 Max Metal | 75.9 TG128 @ 1 ctx | 891 PP512 | basecompute | View Benchmark | |
gpt-oss-20b-Q8 BaseRT 0.3.0Q8 | Apple M1 Max Metal | 74.8 TG128 @ 1 ctx | 867 PP512 | basecompute | View Benchmark |
Top 6 of 6 runs by decode throughput.
| Model / format | Chip / backend | Decode | Prefill | Contributor | Date | Report |
|---|---|---|---|---|---|---|
gpt-oss-20b-Q4 BaseRT 0.2.6Q4 | Apple M4 Pro Metal | 79.3 TG128 @ 1 ctx | 732 PP512 | basecompute | View Benchmark | |
gpt-oss-20b-Q4 BaseRT 0.3.0Q4 | Apple M4 Pro Metal | 78.6 TG128 @ 1 ctx | 731 PP512 | basecompute | View Benchmark | |
gpt-oss-20b-Q8 BaseRT 0.2.6Q8 | Apple M4 Pro Metal | 73.7 TG128 @ 1 ctx | 731 PP512 | basecompute | View Benchmark | |
gpt-oss-20b-Q8 BaseRT 0.3.0Q8 | Apple M4 Pro Metal | 73.2 TG128 @ 1 ctx | 729 PP512 | basecompute | View Benchmark | |
gpt-oss-20b-MXFP4 BaseRT 0.2.6mxfp4 | Apple M4 Pro Metal | 72.7 TG128 @ 1 ctx | 734 PP512 | basecompute | View Benchmark | |
gpt-oss-20b-MXFP4 BaseRT 0.3.0mxfp4 | Apple M4 Pro Metal | 72.3 TG128 @ 1 ctx | 737 PP512 | basecompute | View Benchmark |