Search results

CI fails for distributed smoke tests: TypeError: output tensor must have the same type as input tensor

Status: Open.

#6089 In huggingface/trl;

· albertvillanova opened on Jun 17, 2026

chunked_nll under FSDP2 triggers per-chunk all-gathers of lm_head.weight during backward

Status: Open.

#6076 In huggingface/trl;

· albertvillanova opened on Jun 16, 2026

AsyncGRPOTrainer: the environment_factory reset() observation is dropped — the policy trains on the bare dataset prompt

Status: Open.

#6067 In huggingface/trl;

· adithya-s-k opened on Jun 15, 2026

Add GMPO as an experimental trainer

Status: Open.

#6056 In huggingface/trl;

· raghulchandramouli opened on Jun 14, 2026

AsyncGRPOTrainer: vision-language (*ForConditionalGeneration) checkpoints can't be trained (weight-sync key mismatch)

Status: Open.

#6028 In huggingface/trl;

· adithya-s-k opened on Jun 12, 2026

AsyncGRPOTrainer: environment_factory rewards are never passed to reward_funcs

Status: Open.

#6027 In huggingface/trl;

· adithya-s-k opened on Jun 12, 2026

Add adapter-only vLLM LoRA sync for GRPO and AsyncGRPO

Status: Open.

#5975 In huggingface/trl;

· rycerzes opened on Jun 8, 2026

RFC: Rollout sources — a unified seam for environment & agent RL

Status: Open.

#5974 In huggingface/trl;

· adithya-s-k opened on Jun 8, 2026

RFC: Environment-owned reward

Status: Open.

#5912 In huggingface/trl;

· qgallouedec opened on Jun 2, 2026

RFC: Agent RL training with environment: environment-owned dataset, if any

Status: Open.

#5903 In huggingface/trl;

· qgallouedec opened on Jun 1, 2026

RDPO support in GRPOTRainer

Status: Open.

#5886 In huggingface/trl;

· JishnuKR opened on May 29, 2026

AsyncGRPO: make NCCL weight sync robust on PCIe-only GPUs (auto fallback from P2P/SHM)

Status: Open.

#5865 In huggingface/trl;

· rycerzes opened on May 27, 2026