Nonobench

io.github.mauricekleine/nonobench

An open-source benchmark of how well LLMs solve nonogram puzzles, from 5x5 to 20x20.

Yes, your AI can use this right now.Answered a live MCP handshake in 227 ms with no sign-in needed and exposes 11 tools.

Connect it

Settings → Connectors → Add custom connector
URL: https://www.nonobench.com/mcp

11 tools, verified live

Pulled straight from the server with tools/list on 2026-10-17.
get_leaderboardread-only

Models ranked by accuracy; defaults to all effort levels for compatibility.

list_providersread-only

Provider ids, names, families and variant counts.

list_familiesread-only

Model families, available efforts and best variants.

compare_modelsread-only

Side-by-side core overall and per-size accuracy, cost, latency and token results for model or family names.

get_model_resultsread-only

Accuracy, cost, latency and token use for one model, broken down by grid size.

list_puzzlesread-only

The benchmark puzzles with their ids and row/column clues.

get_puzzleread-only

One puzzle, including the clue text models were prompted with. The reference solution is only included on request; some puzzles have several valid solutions.

check_solutionread-only

Check a grid against a puzzle's clues, using the same rule as the benchmark grader. Reports which rows and columns do not match.

get_puzzle_resultsread-only

Per-model outcomes for one puzzle. Answers are omitted unless requested.

get_model_puzzlesread-only

Which puzzles one model solved, missed, timed out on, or has not run.

list_runsread-only

Individual benchmark runs (one model on one puzzle), optionally with the raw prompt and model output.

Alternatives in Developer Tools

Compare →
Try “Notion”, “Stripe”, “create invoice”, “browser”