* normalize loss scale by tokens * . * updata doc * fix * . * . * . * PullRequest: 2 Add CLI options such that users can control loss scale window and initial loss scale. Merge branch fw/loss-scale of git@code.alipay.com:inclusionAI/AReaL.git into main https://code.alipay.com/inclusionAI/AReaL/pull_requests/2 Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com> * . * fix: dataloader shuffle different seeds for every epoch & every rank * PullRequest: 4 Fix the dataloader shuffle and random seed issue. Merge branch fw/fix-dataloading-not-shuffle of git@code.alipay.com:inclusionAI/AReaL.git into main https://code.alipay.com/inclusionAI/AReaL/pull_requests/4 Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com> * fw/fix-dataloading-not-shuffle * . * . * . * PullRequest: 7 Support the key-value allocation when using decoupled vLLM generation. Merge branch fw/vllm-key-value-alloc of git@code.alipay.com:inclusionAI/AReaL.git into main https://code.alipay.com/inclusionAI/AReaL/pull_requests/7?tab=commit Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com> * . * remove pring * PullRequest: 5 修改微批次分割逻辑 Merge branch fw/balanced-datapck of git@code.alipay.com:inclusionAI/AReaL.git into main https://code.alipay.com/inclusionAI/AReaL/pull_requests/5 Signed-off-by: 温差 <xushusheng.xss@antgroup.com> * . * fw/fix-dataloading-not-shuffle * . * . * . * . * . * PullRequest: 8 debug: math verifier timeout Merge branch math_verifier_timeout of git@code.alipay.com:inclusionAI/AReaL.git into main https://code.alipay.com/inclusionAI/AReaL/pull_requests/8 Signed-off-by: 博惟 <bowei.fw@antgroup.com> * debug: math verifier timeout * debug: math verifier timeout * timeout in math_verify_utils * format * PullRequest: 10 Fix the dataset indexing bug after filtering during recover. Merge branch fw/fix-recover-filter of git@code.alipay.com:inclusionAI/AReaL.git into main https://code.alipay.com/inclusionAI/AReaL/pull_requests/10 Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com> * . * cleanup * cleanup * PullRequest: 12 Update tutorials Merge branch update-tutorial of git@code.alipay.com:inclusionAI/AReaL.git into main https://code.alipay.com/inclusionAI/AReaL/pull_requests/12?tab=comment Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com> * support setup env and start train * update tutorial * update training script * PullRequest: 14 format and update requirements.txt Merge branch fw/update-requirements of git@code.alipay.com:inclusionAI/AReaL.git into main https://code.alipay.com/inclusionAI/AReaL/pull_requests/14 Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com> * format and update requirements.txt * cleanup * PullRequest: 13 update 7B-zero figures Merge branch 0304-7b-zero-readme of git@code.alipay.com:inclusionAI/AReaL.git into main https://code.alipay.com/inclusionAI/AReaL/pull_requests/13 Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com> * update 7B zero figures * update readme * update amc * update readme * Delete Data Comparison * typo * update figures * fix typo --------- Signed-off-by: 博惟 <bowei.fw@antgroup.com> Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com> Co-authored-by: bowei.fw <bowei.fw@antgroup.com> Co-authored-by: wanghuaijie.whj <wanghuaijie.whj@antgroup.com> Co-authored-by: 温差 <xushusheng.xss@antgroup.com> Co-authored-by: 郭唯 <kira.gw@antgroup.com>

Breadcrumbs

User selector

Commit history

Commits on Mar 4, 2025

Update release v0.1.1 (#4)

Commits on Feb 24, 2025

Initial commit.