Skip to content

[veomni, vllm] feat: Allow gptoss ep with veomni - #7397

Merged
Luosuu merged 5 commits into
verl-project:mainfrom
wyettzeng:gpt_oss_ep_sync
Sep 2, 2026
Merged

Luosuu merged 5 commits into
verl-project:mainfrom
wyettzeng:gpt_oss_ep_sync

Conversation

@wyettzeng

@wyettzeng wyettzeng commented Aug 13, 2026 •

Copy link
Copy Markdown
Contributor

What does this PR do?

Enable gpt-oss RL training with veomni EP for gpt-oss family model. In conjuncture with this vllm PR:
vllm-project/vllm#52209

Checklist Before Starting

  • Search for similar PRs. Paste at least one query link here: previously found bug: [veomni] fix: preserve GPT-OSS weights without expert parallelism #7243
  • Format the PR title as [{modules}] {type}: {description} (This will be checked by the CI)
    • {modules} include fsdp, megatron, veomni, sglang, vllm, rollout, trainer, ci, training_utils, recipe, hardware, deployment, ray, worker, single_controller, misc, perf, model, algo, env, tool, ckpt, doc, data, cfg, reward, fully_async, one_step_off
    • If this PR involves multiple modules, separate them with , like [megatron, fsdp, doc]
    • {type} is in feat, fix, refactor, chore, test
    • If this PR breaks any API (CLI arguments, config, function signature, etc.), add [BREAKING] to the beginning of the title.
    • Example: [BREAKING][fsdp, megatron] feat: dynamic batching

Test

Performed e2e testing with veomni (ep = 8) + vllm (ep = 8):
image
image

API and Usage Example

Demonstrate how the API changes if any, and provide usage example(s) if possible.

# Add code snippet or script demonstrating how to use this

Design & Code Changes

Demonstrate the high-level design if this PR is complex, and list the specific changes.

Checklist Before Submitting

Important

Please check all the following items before requesting a review, otherwise the reviewer might deprioritize this PR for review.

@Luosuu
Luosuu merged commit 896a9bb into verl-project:main Sep 2, 2026
98 of 112 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants