Bench Labs

Building open source benchmarks, datasets, experiments, research, and AI.

Everything here is designed to be explored, reproduced, improved, and shared by the community. Bench Labs works in the open — research, engineering, and community, all in one place.

Visit on Hugging Face

Growing in the open

Bench Labs started small — a first cohort of a couple hundred people. As the work landed and Simplicity adopted the lab, adoption compounded quickly: past a thousand, then into the thousands, reaching roughly four thousand in about two months.

01.1k2.2k3.3k4.4k200Wk 11.2kWk 32.6kWk 64.0kWk 8

User growth over the first two months (illustrative)

What we build

Discord bot

A community bot that brings Bench Labs' tools and experiments into the conversation.

PixelModel

An open model effort exploring efficient, reproducible generation.

Benchmarks

Open, reproducible benchmarks and datasets for evaluating models honestly.

About Bench Labs

Bench Labs is part of the Simplicity family — an open-research lab focused on the things that make AI trustworthy: honest benchmarks, reproducible datasets, and experiments anyone can rerun. Simplicity adopted the lab to give that open work a home, resources, and reach, while keeping it community-first. Releases have included efforts like bench-AGI and LRD (Latent Reasoning Directions).

The philosophy is simple: research is only real when others can check it. So everything is built to be explored, reproduced, improved, and shared.

See the Simplicity family →