Search results

AsyncGRPOTrainer: the environment_factory reset() observation is dropped — the policy trains on the bare dataset prompt

Status: Open.

#6067 In huggingface/trl;

· adithya-s-k opened on Jun 15, 2026

CI fails for distributed smoke tests: RuntimeError: aten.mm.default got mixed torch.Tensor and DTensor

Status: Open.

#6064 In huggingface/trl;

· albertvillanova opened on Jun 15, 2026

Add GMPO as an experimental trainer

Status: Open.

#6056 In huggingface/trl;

· raghulchandramouli opened on Jun 14, 2026

SFTTrainer silently breaks datasets that use Dataset.with_transform

Status: Open.

#6039 In huggingface/trl;

· proshian opened on Jun 13, 2026

AsyncGRPOTrainer: vision-language (*ForConditionalGeneration) checkpoints can't be trained (weight-sync key mismatch)

Status: Open.

#6028 In huggingface/trl;

· adithya-s-k opened on Jun 12, 2026

AsyncGRPOTrainer: environment_factory rewards are never passed to reward_funcs

Status: Open.

#6027 In huggingface/trl;

· adithya-s-k opened on Jun 12, 2026

Support training on Harbor agentic task suites via environment_factory

Status: Open.

#6017 In huggingface/trl;

· adithya-s-k opened on Jun 11, 2026

Add adapter-only vLLM LoRA sync for GRPO and AsyncGRPO

Status: Open.

#5975 In huggingface/trl;

· rycerzes opened on Jun 8, 2026

RFC: Rollout sources — a unified seam for environment & agent RL

Status: Open.

#5974 In huggingface/trl;

· adithya-s-k opened on Jun 8, 2026

RFC: Environment-owned reward

Status: Open.

#5912 In huggingface/trl;

· qgallouedec opened on Jun 2, 2026

RFC: Agent RL training with environment: environment-owned dataset, if any

Status: Open.

#5903 In huggingface/trl;

· qgallouedec opened on Jun 1, 2026

bug(rloo): KL penalty uses first-order log ratio instead of Schulman approximation (inconsistent with GRPOTrainer)

Status: Open.

#5889 In huggingface/trl;

· Sumu004 opened on May 30, 2026