Add OpenRouter screenshot judge tool #1

Merged
zwitschi merged 1 commits from judge-screenshot into main 2026-11-07 15:58:28 +01:00
Owner

Adds Tools/judge_screenshot.py, a small optional pre-check that uses OpenRouter multimodal image understanding (docs: https://openrouter.ai/docs/guides/overview/multimodal/image-understanding) to judge whether a screenshot shows the expected scene.

  • --image <png> --expect "<scene>" evaluates one shot; --shots runs every review shot in Screenshots/README.md.
  • Reads OPENROUTER_API_KEY from the ignored .env (never committed).
  • Returns {verdict, confidence, reason, missing}.

Documented in AGENTS.md (Visual review pre-check step), Tools/README.md, and MEMORY.md. It is a helper only — a human still approves.

Live run on main's older pre-warm-skin review-01-character.png correctly flagged it as missing the expected human figure (verdict "no", confidence 0.9) — a regression this is meant to catch.

Adds `Tools/judge_screenshot.py`, a small optional pre-check that uses OpenRouter multimodal image understanding (docs: https://openrouter.ai/docs/guides/overview/multimodal/image-understanding) to judge whether a screenshot shows the expected scene. - `--image <png> --expect "<scene>"` evaluates one shot; `--shots` runs every review shot in `Screenshots/README.md`. - Reads `OPENROUTER_API_KEY` from the ignored `.env` (never committed). - Returns `{verdict, confidence, reason, missing}`. Documented in `AGENTS.md` (Visual review pre-check step), `Tools/README.md`, and `MEMORY.md`. It is a helper only — a human still approves. Live run on `main`'s older pre-warm-skin `review-01-character.png` correctly flagged it as missing the expected human figure (verdict "no", confidence 0.9) — a regression this is meant to catch.
zwitschi added 1 commit 2026-11-07 15:58:15 +01:00
- Tools/judge_screenshot.py: judges a screenshot against an expected-scene
  description via OpenRouter multimodal image understanding, reading
  OPENROUTER_API_KEY from the ignored .env. --image+--expect for one shot,
  --shots to run every review shot in Screenshots/README.md. Returns a
  {verdict, confidence, reason, missing} JSON.
- Documented in AGENTS.md (Visual review pre-check step) and Tools/README.md;
  recorded the OpenRouter payload format gotcha in MEMORY.md.
zwitschi merged commit a181de991c into main 2026-11-07 15:58:28 +01:00
Sign in to join this conversation.
No Reviewers
No labels
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: zwitschi/gig-line#1