Add better target-debug overlays and candidate inspection #22

Closed
opened 2026-05-01 17:11:56 +02:00 by luna · 0 comments
Collaborator

Problem

When Clickthrough guesses wrong, it is hard to see exactly what it thought the target was. Debugging misclicks takes more manual screenshot comparison than it should.

Desired capability

Add better debug/inspection output for targeting decisions, such as:

  • optional overlay image showing chosen target/bounds
  • OCR candidate visualization
  • click preview / intended hit point rendering
  • clearer metadata for why a candidate was chosen

Why

This would make both development and live-agent debugging much faster.

## Problem When Clickthrough guesses wrong, it is hard to see exactly what it thought the target was. Debugging misclicks takes more manual screenshot comparison than it should. ## Desired capability Add better debug/inspection output for targeting decisions, such as: - optional overlay image showing chosen target/bounds - OCR candidate visualization - click preview / intended hit point rendering - clearer metadata for why a candidate was chosen ## Why This would make both development and live-agent debugging much faster.
luna closed this issue 2026-05-01 17:14:50 +02:00
This repo is archived. You cannot comment on issues.
No Label
1 Participants
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: space/clickthrough#22