Skip to content

Regenerate Probo skill pack with multi-stack guidelines + adversarial reviewer#1139

Draft
aureliensibiril wants to merge 9 commits into
mainfrom
aureliensibiril/potion-skills
Draft

Regenerate Probo skill pack with multi-stack guidelines + adversarial reviewer#1139
aureliensibiril wants to merge 9 commits into
mainfrom
aureliensibiril/potion-skills

Conversation

@aureliensibiril
Copy link
Copy Markdown
Collaborator

@aureliensibiril aureliensibiril commented May 1, 2026

Summary

Re-runs potion-skill-generator against the full monorepo to produce an up-to-date, tailored Claude Code skill pack at .claude/. Replaces the prior generation (skills already prefixed potion-, but agents and module notes were stale).

Inputs digested: 61 modules explored, 80 human PR review comments mined, 28 contrib/claude/*.md docs absorbed.

What changed

Skills (.claude/skills/): /potion-ask, /potion-plan, /potion-implement, /potion-review, /potion-learn (new — mines getprobo/probo PR reviews, detects drift between contrib/claude/ and code, stages guideline updates).

Agents (.claude/agents/): All renamed to potion- prefix.

  • Generalists: potion-explorer, potion-planner, potion-implementer, potion-reviewer
  • Stack-specific implementers: potion-go-backend-implementer, potion-typescript-frontend-implementer (each loads only its stack's guidelines for focused context)
  • Specialized reviewers (.claude/agents/reviewers/): architecture, pattern, security, style, test, duplication, plus opt-in adversarial reviewer wired to OpenAI Codex via the local Codex MCP server

Guidelines (.claude/guidelines/): 3,921 lines, 35 files in a multi-stack tree.

  • shared.md — cross-cutting: four-surface API rule (GraphQL ↔ MCP ↔ CLI ↔ n8n), GIDs, ISC headers, git workflow, security baseline, 19 PR-review-enforced standards distilled from human reviewer comments
  • go-backend/ — patterns, conventions, testing, pitfalls + 19 module notes (one per package group)
  • typescript-frontend/ — same shape + 10 module notes

AGENTS.md gains a top-of-file section pointing to the skill pack while keeping contrib/claude/ as the authoritative source-of-truth.

.gitignore now excludes the local .skill-gen-workspace/ and .claude_context caches.

Why

The four-surface API rule (GraphQL ↔ MCP ↔ CLI ↔ n8n) is the rule most likely to be silently dropped by an AI assistant lacking Probo context. The potion-implement skill enforces it before delegating; the with/without evaluation showed a vanilla agent literally said "MCP/CLI/n8n not on critical path" while the skill-loaded agent generated concrete diffs across all four surfaces.

Other measurable wins from the with/without comparison:

  • potion-plan turns prior-art discovery into a AskUserQuestion decision (Route A reuse vs Route B new entity) per skill methodology
  • potion-review enforces severity categorization + cites guideline section numbers + caught the license year-range rule that vanilla missed
  • potion-ask followed the lazy-loading order exactly and structured failure modes by category

Test plan

  • git diff --stat origin/main shows only .claude/, AGENTS.md, and .gitignore changes
  • /potion-ask "where is tenant isolation enforced" loads shared.md then go-backend/index.md then drills into module-notes/coredata.md
  • /potion-plan "add an AuditTrail entity" surfaces the existing AuditLogEntry as Route A
  • /potion-implement "add a pendingActionsCount field" routes to potion-go-backend-implementer and produces concrete diffs across all four surfaces
  • /potion-review "review pkg/agent/tools/search/web_search.go" flags bare http.Client{} as a security blocker citing shared.md §12
  • /potion-review "second opinion on this PR" triggers the adversarial reviewer (requires Codex CLI + ChatGPT login or OPENAI_API_KEY)
  • AGENTS.md renders correctly on GitHub

Summary by cubic

Regenerated the Probo skill pack under .claude/ with multi-stack guidelines and potion-‑prefixed skills/agents, plus an opt-in adversarial reviewer via Codex MCP. Planning, implementation, and reviews are now stack‑aware and enforce the four‑surface API rule across GraphQL ↔ MCP ↔ CLI ↔ n8n.

  • New Features

    • Skills: /potion-ask, /potion-plan, /potion-implement, /potion-review, /potion-learn (mines PR reviews, detects guideline drift).
    • Agents: generalists (potion-explorer, potion-planner, potion-implementer, potion-reviewer), stack implementers (potion-go-backend-implementer, potion-typescript-frontend-implementer), and reviewers (architecture, pattern, security, style, test, duplication, potion-adversarial-reviewer via Codex MCP); all potion-‑prefixed.
    • Guidelines: .claude/guidelines/shared.md plus go-backend/ and typescript-frontend/ trees with module notes; reference contrib/claude/.
  • Migration

    • No product code changes; only .claude/, AGENTS.md (points to the pack), and .gitignore (ignores .skill-gen-workspace/ and .claude_context).
    • Adversarial reviewer requires the Codex CLI and either codex login or OPENAI_API_KEY.

Written for commit 9755b29. Summary will update on new commits.

@aureliensibiril aureliensibiril force-pushed the aureliensibiril/potion-skills branch 3 times, most recently from e47b0fc to d4b5e63 Compare May 8, 2026 07:36
Signed-off-by: Aurélien Sibiril <81782+aureliensibiril@users.noreply.github.com>
Signed-off-by: Aurélien Sibiril <81782+aureliensibiril@users.noreply.github.com>
Signed-off-by: Aurélien Sibiril <81782+aureliensibiril@users.noreply.github.com>
Signed-off-by: Aurélien Sibiril <81782+aureliensibiril@users.noreply.github.com>
Signed-off-by: Aurélien Sibiril <81782+aureliensibiril@users.noreply.github.com>
Signed-off-by: Aurélien Sibiril <81782+aureliensibiril@users.noreply.github.com>
Signed-off-by: Aurélien Sibiril <81782+aureliensibiril@users.noreply.github.com>
Signed-off-by: Aurélien Sibiril <81782+aureliensibiril@users.noreply.github.com>
…iewer

Re-run potion-skill-generator on the full monorepo (61 explored
modules + 80 PR review comments + 28 contrib/claude/* docs) to produce
a tailored skill pack:

- Skills: /potion-ask, /potion-plan, /potion-implement, /potion-review,
  /potion-learn (mines getprobo/probo PR reviews + drift detection)
- Generalist agents: explorer, planner, implementer, reviewer
- Stack-specific implementers: go-backend, typescript-frontend (each
  loads only its stack's guidelines for focused context)
- Specialized reviewers (now potion- prefixed): architecture, pattern,
  security, style, test, duplication, plus opt-in adversarial reviewer
  wired to OpenAI Codex via the local Codex MCP server
- Multi-stack guidelines tree: .claude/guidelines/shared.md +
  go-backend/ + typescript-frontend/ (3,921 lines, 35 files,
  including 19 + 10 module-notes)

The shared guidelines codify the four-surface API rule (GraphQL
<-> MCP <-> CLI <-> n8n) and the 19 review-enforced standards mined
from human PR comments. Stack guidelines reference shared.md instead
of duplicating cross-cutting rules. The implementer skill enforces
the four-surface rule before delegating.

AGENTS.md now points to the skill pack as a top-of-file section while
keeping contrib/claude/ as the authoritative source-of-truth for
subsystem rules.

Also: gitignore the local .skill-gen-workspace/ and .claude_context.

Signed-off-by: Aurélien Sibiril <81782+aureliensibiril@users.noreply.github.com>
@aureliensibiril aureliensibiril force-pushed the aureliensibiril/potion-skills branch from d4b5e63 to 9755b29 Compare May 8, 2026 11:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant