Skip to content

MM-011 resolve boundsless semantic selectors - #4

Draft
himattm wants to merge 1 commit into
agent/mm-002-no-device-errorfrom
agent/mm-011-resolve-semantic-selector
Draft

MM-011 resolve boundsless semantic selectors#4
himattm wants to merge 1 commit into
agent/mm-002-no-device-errorfrom
agent/mm-011-resolve-semantic-selector

Conversation

@himattm

@himattm himattm commented Jul 17, 2026

Copy link
Copy Markdown
Owner

What changed

Resolve accessibility selectors through related actionable nodes when the matching semantics node has no geometry. The resolver now considers actionable ancestors and descendants, shared identity with flat-layout proximity, overlapping geometry, multiple Android bounds encodings, and bounded diagnostics.

Why

Real Compose output can place a stable content-desc on a boundsless semantics record while the adjacent clickable record owns the tap center. Minimap stopped at the label node and returned matched node has no tap bounds.

Impact

Stable accessibility labels can drive taps without falling back to brittle coordinates, while truly unresolved selectors still return diagnostics naming the related nodes considered.

Validation

  • Exact GetGoing Debug tools flat-layout regression
  • Shared-key, ancestor, overlap, and diagnostic unit tests
  • Verified semantic selector is recorded without a point fallback
  • Full workspace tests, Clippy, formatting, and binary build

Stack

Depends on #3; base branch: agent/mm-002-no-device-error.

Reproduction: content-desc=Debug tools matched a boundsless Compose semantics record while the adjacent clickable record at 815,240 had valid geometry, so Minimap returned action_failed.

Rank related actionable nodes by ancestry, shared identity and flat-list proximity, or overlapping geometry; preserve semantic selectors in recorded edges and include bounded node diagnostics only when no tappable relation exists.

Verified with the captured Debug tools CLI contract, shared-key, ancestor, overlap, and diagnostic unit tests, cargo test --workspace, cargo clippy --all-targets -- -D warnings, cargo fmt --check, and the minimap-cli binary build.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant