Models

Loading community benchmarks…

← All models

Community benchmarks

Llama 3.2 1B Instruct

Submitted benchmarks for Llama 3.2 1B Instruct. Browse individual runs and their measurement settings, or open the report JSON for full benchmark details.

Compare chips Compare runtimes Add your benchmark

Submitted runs: 27
Chips tested: 7
Contributors: 2

Model identity

Grouped as meta-llama/Llama-3.2-1B-Instruct. The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution. · Nothing in this report ties it to a published model file. Reports from CLI 0.1.0 record only a model name and a file hash, so the run is grouped by the name it reported until it is reconciled.. Artifact verification confirms published model bytes, not that a community-submitted benchmark was honestly executed. Hover or tap a label for what it means.

This model group collects runs reported as basecompute/Llama-3.2-1B-Instruct, Llama-3.2-1B-Instruct-cuda-q4mix, Llama-3.2-1B-Instruct-cuda-q8, Llama-3.2-1B-Instruct-Q4, Llama-3.2-1B-Instruct-Q8. Individual results keep the package name and format they were submitted with.

View on Hugging Face ↗

Published files benchmarked

basecompute/Llama-3.2-1B-Instruct/Llama-3.2-1B-Instruct-Q4.base (opens in a new tab)BaseRTQ4· 12 runs
basecompute/Llama-3.2-1B-Instruct/Llama-3.2-1B-Instruct-Q8.base (opens in a new tab)BaseRTQ4· 11 runs

Benchmark results

Peak throughput is the highest reported value and may come from different runs. Compare model, quantisation, backend, and token counts before drawing conclusions. Model verification identifies published artifact bytes; community benchmark execution is not remotely attested.

Individual runs for Llama 3.2 1B Instruct. Throughput is in tokens per second; dates use your browser timezone. Hover a date for the exact local time.
Model / runtime / format	Chip / backend	Decode	Prefill	Peak process memory	Contributor

Llama-3.2-1B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M3 Ultra Metal	415.1 tok/s TG128 @ 1 ctx	8,900 tok/s PP512	1,090.8 MiB	basecompute	19 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M3 Ultra Metal	356.8 tok/s TG128 @ 1 ctx	9,006 tok/s PP512	1,675.7 MiB	basecompute	19 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Pro Metal	176.8 tok/s TG128 @ 1 ctx	2,691 tok/s PP512	1,687.4 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M1 Max Metal	232.7 tok/s TG128 @ 1 ctx	3,357 tok/s PP512	1,687.9 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Pro Metal	199.0 tok/s TG128 @ 1 ctx	2,679 tok/s PP512	1,102.4 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	unknown CUDA	168.2 tok/s TG128 @ 1 ctx	37,392 tok/s PP512	1,746.1 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Max Metal	319.8 tok/s TG128 @ 1 ctx	6,014 tok/s PP512	1,682.2 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M1 Max Metal	238.3 tok/s TG128 @ 1 ctx	3,348 tok/s PP512	1,103.0 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-cuda-q8 BaseRTQ4 Nothing in this report ties it to a published model file. Reports from CLI 0.1.0 record only a model name and a file hash, so the run is grouped by the name it reported until it is reconciled.	NVIDIA GB10 CUDA	169.5 tok/s TG128 @ 1 ctx	36,737 tok/s PP512	1,746.4 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Max Metal	371.4 tok/s TG128 @ 1 ctx	6,067 tok/s PP512	1,097.0 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	unknown CUDA	191.9 tok/s TG128 @ 1 ctx	34,471 tok/s PP512	1,553.7 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-cuda-q4mix BaseRTQ4 Nothing in this report ties it to a published model file. Reports from CLI 0.1.0 record only a model name and a file hash, so the run is grouped by the name it reported until it is reconciled.	unknown CUDA	254.6 tok/s TG128 @ 1 ctx	37,864 tok/s PP512	1,256.4 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.2-1B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Pro Metal	204.6 tok/s TG128 @ 1 ctx	2,685 tok/s PP512	1,090.2 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.2-1B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Pro Metal	179.3 tok/s TG128 @ 1 ctx	2,692 tok/s PP512	1,675.1 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.2-1B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M3 Ultra Metal	410.1 tok/s TG128 @ 1 ctx	9,066 tok/s PP512	1,085.4 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.2-1B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M3 Ultra Metal	345.2 tok/s TG128 @ 1 ctx	9,055 tok/s PP512	1,670.5 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.2-1B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M1 Max Metal	242.1 tok/s TG128 @ 1 ctx	3,333 tok/s PP512	1,091.3 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.2-1B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M1 Max Metal	229.4 tok/s TG128 @ 1 ctx	3,372 tok/s PP512	1,676.2 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.2-1B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Max Metal	320.5 tok/s TG128 @ 1 ctx	6,058 tok/s PP512	1,673.3 MiB	basecompute	19 Sep 2026	View Benchmark
Llama-3.2-1B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Max Metal	371.7 tok/s TG128 @ 1 ctx	5,963 tok/s PP512	1,089.1 MiB	basecompute	19 Sep 2026	View Benchmark
Llama-3.2-1B-Instruct-cuda-q8 BaseRTQ4 Nothing in this report ties it to a published model file. Reports from CLI 0.1.0 record only a model name and a file hash, so the run is grouped by the name it reported until it is reconciled.	NVIDIA GB10 CUDA	173.7 tok/s TG128 @ 1 ctx	34,296 tok/s PP512	1,742.4 MiB	basecompute	19 Sep 2026	View Benchmark
Llama-3.2-1B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	NVIDIA GB10 CUDA	172.8 tok/s TG128 @ 1 ctx	35,941 tok/s PP512	1,742.3 MiB	basecompute	19 Sep 2026	View Benchmark
Llama-3.2-1B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	NVIDIA GB10 CUDA	195.3 tok/s TG128 @ 1 ctx	33,397 tok/s PP512	1,549.9 MiB	basecompute	19 Sep 2026	View Benchmark
Llama-3.2-1B-Instruct-cuda-q4mix BaseRTQ4 Nothing in this report ties it to a published model file. Reports from CLI 0.1.0 record only a model name and a file hash, so the run is grouped by the name it reported until it is reconciled.	NVIDIA GB10 CUDA	261.3 tok/s TG128 @ 1 ctx	36,647 tok/s PP512	1,252.3 MiB	basecompute	19 Sep 2026	View Benchmark
basecompute/Llama-3.2-1B-Instruct BaseRTQ4· default-q4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M5 Pro Metal	206.3 tok/s TG128	10,528 tok/s PP512	1,087.7 MiB	arki05	11 Sep 2026	View Benchmark