Skip to content

Harness: add browser-level dashboard validation #300

@mashenjun

Description

@mashenjun

Context

Dashboard has useful Vitest and Testing Library coverage plus a pnpm verify script, but there is no browser automation harness. The OpenAI harness best practice is to make the application UI directly legible to agents through DOM, screenshots, navigation, console errors, and runtime state.

The dashboard also includes visual and canvas-heavy surfaces, especially Pixel Farm, where unit tests alone cannot prove the page renders correctly.

Scope

  1. Add Playwright or equivalent browser smoke tests under dashboard/app.
  2. Cover /your-memory connect flow, memory list/detail, analysis panel, and Pixel Farm route.
  3. Fail on unexpected console errors and failed network requests where appropriate.
  4. Capture screenshots as artifacts for local debugging.
  5. Add a Pixel Farm canvas nonblank check.
  6. Expose a single command, for example pnpm browser:smoke or make verify-dashboard-browser.

Acceptance Criteria

  1. Browser smoke test starts the dashboard and completes key routes.
  2. Tests fail on major render errors or console exceptions.
  3. Pixel Farm canvas is verified as nonblank.
  4. Screenshots are saved on failure.
  5. The command is documented in dashboard/app/AGENTS.md.

Effort

~200-500 LoC net.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions