Frontier models are crushing benchmark after benchmark...so I built a quiz to ask this simple yet humbling question: can a human still beat them?
Humans vs. HLE is a web-based quiz that pits you against frontier AI models on
How it's built
The entire (see what I did there) app runs on Cloudflare Workers. Here are a few decisions I want to call out.
Questions baked in at build time
Rather than fetch questions at runtime, they're curated offline from the gated cais/hle Hugging Face dataset into src/questions.json and then imported directly by src/questions.ts so the bank ships inside the Worker bundle. This means no database or external fetch, and that the deployed Worker never calls Hugging Face or agi.safe.ai at request time. This means the app is fast to serve and that nothing sensitive travels over the wire.
Keeping the answers un-cheatable
The interesting engineering challenge in a quiz app is: how do you stop people from just reading the answers in the network tab?
The approach keeps correct answers server-side the entire quiz lifecycle. GET /api/quiz/new shuffles each question's choices, strips the answers, and hands back an AES-GCM–encrypted answer-key token that's opaque to the browser. POST /api/quiz/answer decrypts it server-side to grade one question at a time. POST /api/quiz/submit returns an HMAC-signed result token — so a score forged in the client simply won't verify. The client gets what it needs to render a question, but never the answer key, and scoring happens where it can't be tampered with.
Durable Objects for the leaderboard
The leaderboard and result signing use Cloudflare Durable Objects, which are my go-to dev tool for consistent, stateful coordination (ie. a persistent leaderboard).
Built with Entire
The entire development process (again, see what I did there) was tracked with (with an AS_OF date in models.ts). So it's you-on-a-sample versus them-on-the-whole-thing — close enough to sting, honest enough to admit.
Try it out yourself!
Think you can beat the models? Give it a shot, and let me know your score in the comments (as well as the leaderboard.)
SOCIAL SHARE CARD GENERATOR