Models

Loading community benchmarks…

← All models

Community benchmarks

Llama 3.1 8B Instruct

Submitted benchmarks for Llama 3.1 8B Instruct. Browse individual runs and their measurement settings, or open the report JSON for full benchmark details.

Compare chips Compare runtimes Add your benchmark

Submitted runs: 40
Chips tested: 9
Contributors: 2

Model identity

Grouped as meta-llama/Llama-3.1-8B-Instruct. The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.. Artifact verification confirms published model bytes, not that a community-submitted benchmark was honestly executed. Hover or tap a label for what it means.

This model group collects runs reported as basecompute/Llama-3.1-8B-Instruct, Llama-3.1-8B-Instruct, Llama-3.1-8B-Instruct-Q4, Llama-3.1-8B-Instruct-Q8, Meta Llama 3.1 8B Instruct. Individual results keep the package name and format they were submitted with.

View on Hugging Face ↗

Published files benchmarked

basecompute/Llama-3.1-8B-Instruct/Llama-3.1-8B-Instruct-Q4.base (opens in a new tab)BaseRTQ4· 12 runs
basecompute/Llama-3.1-8B-Instruct/Llama-3.1-8B-Instruct-Q8.base (opens in a new tab)BaseRTQ4· 12 runs
unsloth/Llama-3.1-8B-Instruct-GGUF/Llama-3.1-8B-Instruct-Q4_0.gguf (opens in a new tab)llama.cppQ4_0· 3 runs

Benchmark results

Peak throughput is the highest reported value and may come from different runs. Compare model, quantisation, backend, and token counts before drawing conclusions. Model verification identifies published artifact bytes; community benchmark execution is not remotely attested.

Individual runs for Llama 3.1 8B Instruct. Throughput is in tokens per second; dates use your browser timezone. Hover a date for the exact local time.
Model / runtime / format	Chip / backend	Decode	Prefill	Peak process memory	Contributor

Llama-3.1-8B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M3 Ultra Metal	125.7 tok/s TG128 @ 1 ctx	1,430 tok/s PP512	6,178.8 MiB	basecompute	19 Oct 2026	View Benchmark
Llama-3.1-8B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M3 Ultra Metal	78.1 tok/s TG128 @ 1 ctx	1,423 tok/s PP512	10,322.4 MiB	basecompute	19 Oct 2026	View Benchmark
Llama-3.1-8B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Max Metal	60.3 tok/s TG128 @ 1 ctx	948 tok/s PP512	10,328.8 MiB	basecompute	17 Oct 2026	View Benchmark
Llama-3.1-8B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Max Metal	106.5 tok/s TG128 @ 1 ctx	954 tok/s PP512	6,185.2 MiB	basecompute	17 Oct 2026	View Benchmark
Llama-3.1-8B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Pro Metal	31.9 tok/s TG128 @ 1 ctx	392 tok/s PP512	10,334.5 MiB	basecompute	11 Oct 2026	View Benchmark
Llama-3.1-8B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M1 Max Metal	38.7 tok/s TG128 @ 1 ctx	508 tok/s PP512	10,333.7 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.1-8B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M1 Max Metal	63.5 tok/s TG128 @ 1 ctx	511 tok/s PP512	6,191.5 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.1-8B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Pro Metal	55.7 tok/s TG128 @ 1 ctx	394 tok/s PP512	6,190.6 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.1-8B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	NVIDIA GB10 CUDA	25.5 tok/s TG128 @ 1 ctx	7,170 tok/s PP512	8,428.8 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.1-8B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	NVIDIA GB10 CUDA	51.6 tok/s TG128 @ 1 ctx	7,333 tok/s PP512	5,688.0 MiB	basecompute	9 Oct 2026	View Benchmark
Llama-3.1-8B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M3 Ultra Metal	124.4 tok/s TG128 @ 1 ctx	1,438 tok/s PP512	6,174.1 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M3 Ultra Metal	75.3 tok/s TG128 @ 1 ctx	1,392 tok/s PP512	10,318.1 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M1 Max Metal	63.7 tok/s TG128 @ 1 ctx	509 tok/s PP512	6,179.6 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M1 Max Metal	38.6 tok/s TG128 @ 1 ctx	509 tok/s PP512	10,323.0 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Pro Metal	56.1 tok/s TG128 @ 1 ctx	394 tok/s PP512	6,178.0 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Pro Metal	32.1 tok/s TG128 @ 1 ctx	392 tok/s PP512	10,321.6 MiB	basecompute	20 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Max Metal	60.8 tok/s TG128 @ 1 ctx	947 tok/s PP512	10,321.6 MiB	basecompute	19 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Apple M4 Max Metal	105.5 tok/s TG128 @ 1 ctx	946 tok/s PP512	6,176.5 MiB	basecompute	19 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct-Q8 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	NVIDIA GB10 CUDA	25.4 tok/s TG128 @ 1 ctx	7,299 tok/s PP512	8,425.1 MiB	basecompute	19 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct-Q4 BaseRTQ4 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	NVIDIA GB10 CUDA	53.1 tok/s TG128 @ 1 ctx	7,567 tok/s PP512	5,491.8 MiB	basecompute	19 Sep 2026	View Benchmark
Meta Llama 3.1 8B Instruct llama.cppQ4_K_M The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	Tesla T10/Tesla T10/Tesla T10/Tesla T10 CUDA	136.1 tok/s TG128	3,390 tok/s PP512	10.9 MiB	arki05	17 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct llama.cppQ8_0 The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	AMD Radeon RX 7900 XT (RADV NAVI31) Vulkan	68.6 tok/s TG128	2,286 tok/s PP512	10,218.0 MiB	arki05	11 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct llama.cppQ6_K The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	AMD Radeon RX 7900 XT (RADV NAVI31) Vulkan	97.7 tok/s TG128	2,512 tok/s PP512	6,422.7 MiB	arki05	11 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct llama.cppQ4_K_M The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	AMD Radeon RX 7900 XT (RADV NAVI31) Vulkan	119.8 tok/s TG128	2,756 tok/s PP512	4,895.2 MiB	arki05	11 Sep 2026	View Benchmark
Llama-3.1-8B-Instruct llama.cppQ4_K_M The report's model SHA-256 matches a file published on Hugging Face, so the exact model bytes are known. This does not attest benchmark execution.	AMD Radeon RX 7900 XT (RADV NAVI31) Vulkan	122.7 tok/s TG128	2,743 tok/s PP512	4,825.0 MiB	arki05	11 Sep 2026	View Benchmark