Compare
Loading community benchmarks…
Loading community benchmarks…
Put two chips, runtimes, or runtime versions side by side. Everything else is held fixed or called out, so a ratio is worth exactly what the matched runs say.
Ratios read side A relative to side B. Geometric mean over 2 like-for-like pairs.
Everything else matches: model, quantisation, backend, protocol, and workload are the same on both sides.
Each row is a configuration present on both sides. Values are per-cell medians; ratios read Apple M1 Max relative to Apple M3 Ultra.
| Configuration | Decode A | Decode B | Ratio | Prefill A | Prefill B | Ratio | Runs A / B |
|---|---|---|---|---|---|---|---|
Qwen3.5-35B-A3B-Q8 BaseRTQ8 | 71.9 | 110.5 | 0.65× | 561 | 1,624 | 0.35× | 4 / 4 |
Qwen3.5-35B-A3B BaseRTQ4 | 93.2 | 134.5 | 0.69× | 580 | 1,629 | 0.36× | 2 / 2 |
Top 6 of 6 runs by decode throughput.
| Model / format | Chip / backend | Decode | Prefill | Contributor | Date | Report |
|---|---|---|---|---|---|---|
Qwen3.5-35B-A3B-Q4 BaseRT 0.2.6Q4 | Apple M1 Max Metal | 93.7 TG128 @ 1 ctx | 280 PP512 | basecompute | View Benchmark | |
Qwen3.5-35B-A3B-Q4 BaseRT 0.3.0Q4 | Apple M1 Max Metal | 92.6 TG128 @ 1 ctx | 880 PP512 | basecompute | View Benchmark | |
Qwen3.5-35B-A3B-Q8 BaseRT 0.2.6Q8 | Apple M1 Max Metal | 72.2 TG128 @ 1 ctx | 251 PP512 | basecompute | View Benchmark | |
Qwen3.5-35B-A3B-Q8 BaseRT 0.2.6Q8 | Apple M1 Max Metal | 72.0 TG128 @ 1 ctx | 250 PP512 | basecompute | View Benchmark | |
Qwen3.5-35B-A3B-Q8 BaseRT 0.3.0Q8 | Apple M1 Max Metal | 71.8 TG128 @ 1 ctx | 871 PP512 | basecompute | View Benchmark | |
Qwen3.5-35B-A3B-Q8 BaseRT 0.3.0Q8 | Apple M1 Max Metal | 71.7 TG128 @ 1 ctx | 877 PP512 | basecompute | View Benchmark |
Top 6 of 6 runs by decode throughput.
| Model / format | Chip / backend | Decode | Prefill | Contributor | Date | Report |
|---|---|---|---|---|---|---|
Qwen3.5-35B-A3B-Q4 BaseRT 0.3.0Q4 | Apple M3 Ultra Metal | 136.1 TG128 @ 1 ctx | 2,311 PP512 | basecompute | View Benchmark | |
Qwen3.5-35B-A3B-Q4 BaseRT 0.2.6Q4 | Apple M3 Ultra Metal | 133.0 TG128 @ 1 ctx | 947 PP512 | basecompute | View Benchmark | |
Qwen3.5-35B-A3B-Q8 BaseRT 0.3.0Q8 | Apple M3 Ultra Metal | 113.4 TG128 @ 1 ctx | 2,312 PP512 | basecompute | View Benchmark | |
Qwen3.5-35B-A3B-Q8 BaseRT 0.3.0Q8 | Apple M3 Ultra Metal | 111.4 TG128 @ 1 ctx | 2,310 PP512 | basecompute | View Benchmark | |
Qwen3.5-35B-A3B-Q8 BaseRT 0.2.6Q8 | Apple M3 Ultra Metal | 109.6 TG128 @ 1 ctx | 927 PP512 | basecompute | View Benchmark | |
Qwen3.5-35B-A3B-Q8 BaseRT 0.2.6Q8 | Apple M3 Ultra Metal | 109.1 TG128 @ 1 ctx | 939 PP512 | basecompute | View Benchmark |