Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
fenglui
/
trl
Public
forked from
huggingface/trl
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
All time
Commit history
Commits on May 24, 2025
Fix mis-aligned prompts and completions in colocate mode (#3491)
Show description for 9ac614f
toslali-ibm
and
qgallouedec
authored
9ac614f
View commit details
Copy full SHA for 9ac614f
Browse repository at this point
[Doc][SFT] Update sft_trainer.md. link prompt-completion dataset example (#3486)
Show description for 29401e7
HERIUN
and
kashif
authored
29401e7
View commit details
Copy full SHA for 29401e7
Browse repository at this point
Fix typo (#3489)
nikolai-kummer
authored
31bf3f9
View commit details
Copy full SHA for 31bf3f9
Browse repository at this point
Commits on May 23, 2025
[CI] fix sampler api to make the CI green (#3488)
kashif
authored
7f32792
View commit details
Copy full SHA for 7f32792
Browse repository at this point
[SFT] update minimal liger version (#3483)
kashif
authored
3d87279
View commit details
Copy full SHA for 3d87279
Browse repository at this point
Commits on May 22, 2025
Update .pre-commit-config.yaml (#3479)
kashif
authored
65245f6
View commit details
Copy full SHA for 65245f6
Browse repository at this point
Commits on May 20, 2025
[NashMD] fix the edge case where the model is a peft model (#3473)
Show description for a528b9c
kashif
and
lewtun
authored
a528b9c
View commit details
Copy full SHA for a528b9c
Browse repository at this point
🙅 PPO value_model can't be None, so it shouldn't be Optional (#3300)
AMindToThink
authored
e0dd525
View commit details
Copy full SHA for e0dd525
Browse repository at this point
Commits on May 19, 2025
enable activation offloading on XPU (#3444)
Show description for 64aa064
yao-matrix
and
kashif
authored
64aa064
View commit details
Copy full SHA for 64aa064
Browse repository at this point
enable vllm c-s tests on XPU (#3445)
Show description for be93a0c
yao-matrix
and
kashif
authored
be93a0c
View commit details
Copy full SHA for be93a0c
Browse repository at this point
[CI] fix CI failure of transformer dev (#3457)
kashif
authored
f9fbd91
View commit details
Copy full SHA for f9fbd91
Browse repository at this point
Commits on May 16, 2025
🎁 Reward submodule (#3430)
qgallouedec
authored
54d4f6b
View commit details
Copy full SHA for 54d4f6b
Browse repository at this point
Commits on May 13, 2025
feat: Implement Two-Sided Clipping for GRPO Trainer (#3434)
Show description for 05bc43e
3 people
authored
05bc43e
View commit details
Copy full SHA for 05bc43e
Browse repository at this point
use device agnostic empty_cache in ppo & rloo (#3439)
Show description for d3dc8ff
yao-matrix
and
kashif
authored
d3dc8ff
View commit details
Copy full SHA for d3dc8ff
Browse repository at this point
enable `trl env` on xpu (#3438)
Show description for 21738c3
yao-matrix
and
kashif
authored
21738c3
View commit details
Copy full SHA for 21738c3
Browse repository at this point
Commits on May 9, 2025
🏹 Support kv_cache_dtype to quantize kv-cache in vllm (#3422)
Show description for eab175d
winglian
and
qgallouedec
authored
eab175d
View commit details
Copy full SHA for eab175d
Browse repository at this point
Commits on May 8, 2025
Update README.md
qgallouedec
authored
4da4dc9
View commit details
Copy full SHA for 4da4dc9
Browse repository at this point
Update README.md (#3420)
qgallouedec
authored
6b3a023
View commit details
Copy full SHA for 6b3a023
Browse repository at this point
🧪 Testing support for Qwen3 tiny (#3415)
shirinyamani
authored
abbbb93
View commit details
Copy full SHA for abbbb93
Browse repository at this point
Commits on May 7, 2025
[Models] Activation checkpointing from TorchTune (#2954)
Show description for cafa663
11 people
authored
cafa663
View commit details
Copy full SHA for cafa663
Browse repository at this point
🐍 Support Python 3.13 (#2593)
qgallouedec
authored
fd04a54
View commit details
Copy full SHA for fd04a54
Browse repository at this point
Commits on May 6, 2025
🎁 Reward takes completion ids (#3272)
Show description for 56e5766
3 people
authored
56e5766
View commit details
Copy full SHA for 56e5766
Browse repository at this point
📝 vLLM-integration documentation (#3376)
Show description for 89d44ca
shirinyamani
and
qgallouedec
authored
89d44ca
View commit details
Copy full SHA for 89d44ca
Browse repository at this point
🎲 [GRPO] Shuffle mini batches (#3391)
Show description for adfa7fd
3 people
authored
adfa7fd
View commit details
Copy full SHA for adfa7fd
Browse repository at this point
💔 [GRPO] Decouple gradient accumulation from the number of minibatches generated (#3388)
Show description for cf5183d
edbeeching
and
qgallouedec
authored
cf5183d
View commit details
Copy full SHA for cf5183d
Browse repository at this point
🤝 Compatibility of the TRL CLI with accelerate arguments (#3409)
Show description for 1954c02
qgallouedec
and
lewtun
authored
1954c02
View commit details
Copy full SHA for 1954c02
Browse repository at this point
✌️ Add support for FSDP2 (#3317)
Show description for 45f4c58
lewtun
and
qgallouedec
authored
45f4c58
View commit details
Copy full SHA for 45f4c58
Browse repository at this point
Commits on May 2, 2025
🕊️ Un-restrict diffusers (#3407)
qgallouedec
authored
cc044e3
View commit details
Copy full SHA for cc044e3
Browse repository at this point
🕺 Migrate setup configuration from `setup.py` to `setup.cfg` and make `rich` an optional dep (#3403)
Show description for 999acd5
qgallouedec
and
lewtun
authored
999acd5
View commit details
Copy full SHA for 999acd5
Browse repository at this point
🪪 Remove license classifier (#3402)
qgallouedec
authored
8606b1a
View commit details
Copy full SHA for 8606b1a
Browse repository at this point
👉 [DPO] Model forward pass padding side fix (#3307)
Show description for a673da5
LeonEricsson
and
qgallouedec
authored
a673da5
View commit details
Copy full SHA for a673da5
Browse repository at this point
🦁 Fix liger initialization (#3401)
Show description for 00b8e31
shivam15s
and
qgallouedec
authored
00b8e31
View commit details
Copy full SHA for 00b8e31
Browse repository at this point
Commits on May 1, 2025
💔 [SFT] Raise error when `formatting_func` is used with `completion_only_loss` (#3385)
Show description for c163cf5
LeonEricsson
and
qgallouedec
authored
c163cf5
View commit details
Copy full SHA for c163cf5
Browse repository at this point
✨ [IterativeSFT] Small refresher (#3378)
LeonEricsson
authored
bc9c019
View commit details
Copy full SHA for bc9c019
Browse repository at this point
🧑🤝🧑 Co-Locating vLLM w/ training to for higher throughput and GPU utilization (#3394)
Show description for 18596cf
toslali-ibm
and
qgallouedec
authored
18596cf
View commit details
Copy full SHA for 18596cf
Browse repository at this point
Previous
Next
You can’t perform that action at this time.