Skip to content

docs: update maturity scorecard - #95933

Merged
RomneyDa merged 2 commits into
mainfrom
codex/maturity-scorecard-27997059990
Jun 23, 2026
Merged

RomneyDa merged 2 commits into
mainfrom
codex/maturity-scorecard-27997059990

Conversation

@RomneyDa

@RomneyDa RomneyDa commented Jun 23, 2026

Copy link
Copy Markdown
Member

I manually ran "all" qa profile action and used that evidence to generate this locally using the maturity scorecard renderer locally. Run 28000996256.

What Problem This Solves

OpenClaw has a current maturity taxonomy and QA profile evidence artifact, but the public scorecard needed to be regenerated from full taxonomy evidence instead of the older release-profile evidence subset.

Why This Change Was Made

  • Regenerates qa/maturity-scores.yaml from the current active taxonomy using the newer committed source shape for Quality, Completeness, and LTS review state.
  • Renders docs/maturity/scorecard.md and docs/maturity/taxonomy.md from the QA Profile Evidence all artifact from run 28000996256.
  • Updates the maturity renderer to prefer all scorecard evidence for Coverage while retaining release fallback for non-workflow/manual use.
  • Changes the generated maturity scorecard workflow default from release to all, with guard coverage so future generated scorecard PRs use full taxonomy evidence.
  • Adjusts the maturity taxonomy renderer so generated family index headings do not duplicate the later detail headings under markdownlint.

User Impact

Readers get initial public maturity scorecard and taxonomy pages backed by the latest score source and full taxonomy QA evidence summary. The scorecard no longer shows Unscored for overall Coverage just because release profile membership omits many categories; it now shows the low but complete full-taxonomy coverage state from the all profile artifact.

Evidence

  • Downloaded artifact from QA Profile Evidence run: https://github.com/openclaw/openclaw/actions/runs/28000996256
  • Artifact manifest: qaProfile=all, targetSha=4460fa78c32093d170625775ba2b73880b454721, qaPassed=false, qaExitCode=1, scorecard present with 281 category reports.
  • Root aggregate evidence summary: 96 checks, 88 passed, 6 failed, 2 blocked; 281 category reports; 20 of 1675 features fulfilled.
  • pnpm maturity:render -- --output-dir docs --scores qa/maturity-scores.yaml --evidence-dir .artifacts/maturity-evidence-all-28000996256 --strict-inputs
  • pnpm maturity:render -- --check --output-dir docs --scores qa/maturity-scores.yaml --evidence-dir .artifacts/maturity-evidence-all-28000996256 --strict-inputs
  • node --import tsx --input-type=module schema validation for taxonomy.yaml, qa/scenarios/index.yaml, and qa/maturity-scores.yaml
  • node scripts/run-vitest.mjs test/scripts/ci-workflow-guards.test.ts
  • pnpm check:docs
  • git diff --check
  • .agents/skills/autoreview/scripts/autoreview --mode local clean: no accepted/actionable findings

@openclaw-barnacle openclaw-barnacle Bot added docs Improvements or additions to documentation scripts Repository scripts size: XL maintainer Maintainer-authored PR labels Jun 23, 2026
@RomneyDa
RomneyDa force-pushed the codex/maturity-scorecard-27997059990 branch from 27df6f6 to 3b1fb3c Compare June 23, 2026 04:27
@RomneyDa
RomneyDa merged commit d3dc7aa into main Jun 23, 2026
91 checks passed
@RomneyDa
RomneyDa deleted the codex/maturity-scorecard-27997059990 branch June 23, 2026 04:37
LucienShui pushed a commit to LucienShui/openclaw that referenced this pull request Jun 23, 2026
* docs: update maturity scorecard

* docs: rerender maturity scorecard from all evidence
github-actions Bot pushed a commit to Desicool/openclaw that referenced this pull request Jun 23, 2026
* docs: update maturity scorecard

* docs: rerender maturity scorecard from all evidence
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs Improvements or additions to documentation maintainer Maintainer-authored PR scripts Repository scripts size: XL

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant