Skip to content

fix(ci): require QA live evidence artifacts - #95952

Merged
vincentkoc merged 1 commit into
mainfrom
ops/qa-live-artifact-evidence
Jun 23, 2026
Merged

vincentkoc merged 1 commit into
mainfrom
ops/qa-live-artifact-evidence

Conversation

@vincentkoc

@vincentkoc vincentkoc commented Jun 23, 2026

Copy link
Copy Markdown
Member

What Problem This Solves

QA live transport workflows are evidence-producing gates, but their artifact uploads used if-no-files-found: warn. That means a lane could report success without durable QA evidence if the expected output directory was empty or not written.

Why This Change Was Made

  • require artifact presence for parity, runtime token-efficiency, Matrix, Telegram, Discord, WhatsApp, and Slack QA live uploads
  • add a workflow guard so every QA live evidence upload keeps if-no-files-found: error

User Impact

Nightly and manual QA live runs fail loudly when their evidence bundle is missing instead of producing a green run with no useful artifacts.

Evidence

  • inspected .github/workflows/qa-live-transports-convex.yml: all QA live upload steps ran with if: always() but accepted missing files with warn
  • go run github.com/rhysd/actionlint/cmd/actionlint@v1.7.11 .github/workflows/qa-live-transports-convex.yml
  • git diff --check
  • node scripts/crabbox-wrapper.mjs job run testbox-changed for 473986a0d959df3ef8dcb82c23b9df2ac977ba70 (tbx_01kvs9wtzg1zv4arkfytc3a8cr; wrapper command exited 0; https://github.com/openclaw/openclaw/actions/runs/28001043651)
  • codex review --base origin/main: no actionable regressions after the guard job-id fix

Known proof gap

  • node scripts/run-vitest.mjs test/scripts/package-acceptance-workflow.test.ts could not run locally because this sparse Codex worktree has no node_modules; the Testbox changed gate covered the touched test lane remotely.

@vincentkoc vincentkoc self-assigned this Jun 23, 2026
@openclaw-barnacle openclaw-barnacle Bot added size: XS maintainer Maintainer-authored PR labels Jun 23, 2026
@vincentkoc
vincentkoc force-pushed the ops/qa-live-artifact-evidence branch from 3fb0e05 to 473986a Compare June 23, 2026 03:55
@vincentkoc
vincentkoc marked this pull request as ready for review June 23, 2026 03:58
@vincentkoc

Copy link
Copy Markdown
Member Author

Land-ready proof for 473986a0d959df3ef8dcb82c23b9df2ac977ba70:

  • local workflow lint: go run github.com/rhysd/actionlint/cmd/actionlint@v1.7.11 .github/workflows/qa-live-transports-convex.yml
  • diff hygiene: git diff --check
  • changed gate: node scripts/crabbox-wrapper.mjs job run testbox-changed (tbx_01kvs9wtzg1zv4arkfytc3a8cr; wrapper command exited 0; https://github.com/openclaw/openclaw/actions/runs/28001043651)
  • autoreview: codex review --base origin/main reported no actionable regressions after the guard job-id fix
  • PR checks: ghx pr checks 95952 --watch=false reported 60 successful, 17 skipped, 0 failing, 0 pending
  • latest-main apply sanity: git merge-tree --write-tree HEAD origin/main completed cleanly after origin/main moved to 68a1e00b73b

Known local gap: node scripts/run-vitest.mjs test/scripts/package-acceptance-workflow.test.ts could not run locally because this sparse Codex worktree has no node_modules; the Testbox changed gate covered the touched test lane remotely.

@vincentkoc
vincentkoc merged commit cfff6b2 into main Jun 23, 2026
110 of 112 checks passed
@vincentkoc
vincentkoc deleted the ops/qa-live-artifact-evidence branch June 23, 2026 04:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

maintainer Maintainer-authored PR size: XS

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant