Skip to content

Conform forward top-k loss with verl v0.8 - #60

Merged
DaoyuanLi2816 merged 3 commits into
mainfrom
v0.8.0-verl-loss-conformance
Aug 12, 2026
Merged

Conform forward top-k loss with verl v0.8#60
DaoyuanLi2816 merged 3 commits into
mainfrom
v0.8.0-verl-loss-conformance

Conversation

@DaoyuanLi2816

Copy link
Copy Markdown
Owner

Summary

  • add a distinct forward_kl_topk objective and verl-compatible token-mean reduction
  • compare values, masses, overlap diagnostics, scalar reduction, and gradients against official verl v0.8.0 at 7aed6b2
  • bind cached targets to prompt row, exact actor response tokens, policy version, teacher/tokenizer identity, and score implementation

Validation

  • ruff check . and ruff format --check .
  • mypy src/miniverl scripts
  • actionlint
  • 2159 passed, 6 skipped in full CPU suite; 85.76% coverage (one packaging regression found and fixed, focused rerun green)
  • 8 GPU tests and 15 network tests passed
  • official verl conformance: 2 passed
  • strict MkDocs build, package build, and twine checks passed
  • frozen calculator JSON remains 53fc1d4d5b7adee09618d77ad62d4086ba56b78569832d6fc7c3bcd5c2695bbc

@DaoyuanLi2816
DaoyuanLi2816 merged commit 7699d53 into main Aug 12, 2026
16 checks passed
@DaoyuanLi2816
DaoyuanLi2816 deleted the v0.8.0-verl-loss-conformance branch August 12, 2026 07:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant