fix(wix-manage): quote bundle-and-save flow description to fix YAML parse error - #829
fix(wix-manage): quote bundle-and-save flow description to fix YAML parse error#829itayhewix wants to merge 1 commit into
Conversation
…arse error The description contained an unquoted "[Goal: Drive Cross-Sells]" — a colon+space inside a plain YAML scalar is parsed as a nested mapping key, breaking frontmatter parsing with "mapping values are not allowed in this context". Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
✅ EvalForge YAML Gate: Eval ComparisonVerdict:
ecommerce/pricing-promotions/run-a-sale-drive-cross-sellspairwise judge: prod wins (high confidence) | Response B is substantially better because it successfully completed the core task (10/10 LLM judge score vs 0/10) by properly loading recipes and persisting recommendations via BatchCreate. While Response A was more efficient in terms of cost and tokens, the complete task failure means efficiency gains are irrelevant. Task completion and tool accuracy are critical for this ecommerce task. | dimensions - task completion: without, tool accuracy: without, error handling: without, efficiency: with | LLM judge fails in PR, passes in prod | LLM judge: 0/10 PR vs 10/10 prod | efficiency (PR vs prod) - cost: $0.6048 vs $2.1720, tokens: 296,915 vs 1,059,604, time: 48.8s vs 212.3s Assertions (PR):
Assertions (prod):
Compare result: Response B is substantially better because it successfully completed the core task (10/10 LLM judge score vs 0/10) by properly loading recipes and persisting recommendations via BatchCreate. While Response A was more efficient in terms of cost and tokens, the complete task failure means efficiency gains are irrelevant. Task completion and tool accuracy are critical for this ecommerce task. |
Summary
descriptioninecommerce/pricing-promotions/ecom-pricing-flow-bundle-and-save.mdcontained an unquoted[Goal: Drive Cross-Sells]— a colon+space inside a plain YAML scalar is parsed as a nested mapping key.Error in user YAML: (<unknown>): mapping values are not allowed in this context.ecom-load-context.md).Test plan
yaml.safe_load🤖 Generated with Claude Code