Build the one-GPU Alignment Lab - #33
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Result
The common Qwen3-0.6B SFT checkpoint scored 100% alignment and 100% retained tool utility for every seed. No continuation method improved it. Completed regressions remain in the headline result: continued SFT seed 20260801 failed 8 safe-error-recovery tasks, standard OPD seed 20260801 failed 2, and verifier-gated OPD seed 20260727 failed 3.
Verifier gating reduced the selected-position query ratio from 100% to 46.8% and mean continuation GPU time from 76.7 s to 66.0 s, without a quality gain. The pilot returns insufficient_evidence and recommends no online teacher-query spend for this saturated recipe. Missing free-running teacher competence, distribution-level top-k overlap, independent gate precision, and population uncertainty are recorded as null, not zero.
Result SHA-256: 584752dccb91654109c357b8ebb12681a12a9c1476a9ba539dd35e4d860a22ef
Task rows SHA-256: 8d7fc723436d7377d196fc44046d960e3cb7f0aa81e03d49ef05b627eb84630f
State x Supervision SHA-256: 9e08129ba4cd9e460c189b94b4e421d881ba69e3938f02eac95d251f50c88788
PDF SHA-256: adbffa967f6b9a25d2cdb0cc4464a93c13db4615a1e91499585fb199285d980b
Validation
The immutable calculator artifact remains 53fc1d4d5b7adee09618d77ad62d4086ba56b78569832d6fc7c3bcd5c2695bbc. Existing tags and public adapter revisions are unchanged.