privacy policy

last updated: 2026-07-28

what we collect

The standard normiebench command submits a completed result automatically. Use local-only mode by setting NORMIEBENCH_NO_SUBMIT=1. When a result is submitted, the following data is collected and published publicly on the leaderboard:

CPU model name
GPU model name and approximate VRAM
System RAM (GB)
Operating system and architecture
Benchmark scores, variance, raw timing samples, and phase timings
CPU core counts and maximum reported clock, GPU memory and driver, RAM, OS version, and active power plan when available
Optional start, maximum, and end hardware temperatures when a supported sensor is available
Benchmark profile, llama.cpp build, model checksum, and effective benchmark settings
Inference backend used (CUDA, Vulkan, Metal, CPU)

The script also sends a random private machine ID generated by normiebench so a later run can replace the earlier result. It is not a vendor hardware identifier. The server converts it to a public ID with a keyed one-way HMAC and never publishes the private value.

what we do not collect

IP addresses — not stored at any point
Serial numbers, device IDs, or other hardware identifiers
Location data
Any data beyond what is listed above

how data is used

Submitted data is published publicly on the normiebench leaderboard at normiebench.com. The purpose is to compare real-world LLM inference performance across different hardware configurations. Anyone can view it.

If you run the benchmark again on the same machine, your previous entry is replaced with your latest result.

consent

Submission is voluntary but enabled by the standard one-command run. Set NORMIEBENCH_NO_SUBMIT=1 before running to keep the result local. A network or submission failure never deletes the local result. The source code is publicly available at gitlab.com/brando69/normiebench so you can inspect exactly what is sent.

data removal

To remove an entry, open a confidential issue in the GitLab project and include the private machine ID stored beside last-result.json in the NormieBench user cache. Do not post that private ID in a public issue.

third parties

Results are submitted to a Cloudflare Worker and stored in Cloudflare D1. Cloudflare may process standard request metadata (such as IP addresses) under its own privacy policy. normiebench does not store IP addresses in its result database; an optional Cloudflare rate limiter may use the connecting address transiently.

The leaderboard is hosted on GitLab Pages. See GitLab's privacy statement.

contact

Questions? Open an issue at gitlab.com/brando69/normiebench/-/issues.