Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
qlycool
/
trl
Public
forked from
huggingface/trl
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Breadcrumbs
History for
trl
examples
on
main
User selector
All users
All time
Commit history
Commits on Sep 15, 2025
🗑️ Remove deprecated `AlignPropTrainer`, `DDPOTrainer` and `IterativeSFTTrainer` (#4068)
qgallouedec
authored
78f1a92
View commit details
Copy full SHA for 78f1a92
View code at this point
Browse repository at this point
Commits on Sep 14, 2025
🐳 Docker update + Simplify Jobs doc (#3931)
Show description for 9955ee7
3 people
authored
9955ee7
View commit details
Copy full SHA for 9955ee7
View code at this point
Browse repository at this point
Commits on Sep 11, 2025
Remove redundant 'None' from docstrings (#4058)
albertvillanova
authored
e8b8499
View commit details
Copy full SHA for e8b8499
View code at this point
Browse repository at this point
Commits on Sep 9, 2025
🗜 Hotfix: avoid passing `quantization_config=None` (#4019)
qgallouedec
authored
a647e5a
View commit details
Copy full SHA for a647e5a
View code at this point
Browse repository at this point
⚖️ Remove `average_tokens_across_devices` default replacement (#4039)
qgallouedec
authored
af82b38
View commit details
Copy full SHA for af82b38
View code at this point
Browse repository at this point
🥓 [docs] add CP docs (#3994)
Show description for 1b799a2
4 people
authored
1b799a2
View commit details
Copy full SHA for 1b799a2
View code at this point
Browse repository at this point
Commits on Sep 7, 2025
Align docstring parameters with function definitions (#4017)
albertvillanova
authored
c9484b1
View commit details
Copy full SHA for c9484b1
View code at this point
Browse repository at this point
Commits on Sep 5, 2025
⚖️ Add vLLM server mode and VLM support to OnlineDPOTrainer (#3783)
Show description for d1bf560
4 people
authored
d1bf560
View commit details
Copy full SHA for d1bf560
View code at this point
Browse repository at this point
Commits on Sep 4, 2025
👷 Added Kernels on the Hub x TRL guide (#3969)
Show description for 0c69fd2
4 people
authored
0c69fd2
View commit details
Copy full SHA for 0c69fd2
View code at this point
Browse repository at this point
Commits on Sep 3, 2025
📏 `torch_dype` to `dtype` everywhere (#4000)
Show description for 208e9f7
sergiopaniego
and
qgallouedec
authored
208e9f7
View commit details
Copy full SHA for 208e9f7
View code at this point
Browse repository at this point
Commits on Aug 29, 2025
ℹ️ Validate examples on xpu (#3897)
Show description for 8aa0eed
yao-matrix
authored
8aa0eed
View commit details
Copy full SHA for 8aa0eed
View code at this point
Browse repository at this point
🔥 [Refactor] RLOOTrainer (#3801)
Show description for e7b37d4
3 people
authored
e7b37d4
View commit details
Copy full SHA for e7b37d4
View code at this point
Browse repository at this point
Commits on Aug 27, 2025
🧭 HF jobs x TRL guide (#3890)
Show description for 0c91515
3 people
authored
0c91515
View commit details
Copy full SHA for 0c91515
View code at this point
Browse repository at this point
Commits on Aug 21, 2025
📦 Wrapping the main execution code to avoid multi-processing issues from vLLM (#3932)
Show description for 251c048
kaixuanliu
authored
251c048
View commit details
Copy full SHA for 251c048
View code at this point
Browse repository at this point
Commits on Aug 20, 2025
🗑️ Deprecate `setup_chat_format` (#3929)
qgallouedec
authored
48d7ecc
View commit details
Copy full SHA for 48d7ecc
View code at this point
Browse repository at this point
🧾 Use `logger.warning` instead of `warnings.warn` (#3923)
Show description for 8793a46
qgallouedec
and
kashif
authored
8793a46
View commit details
Copy full SHA for 8793a46
View code at this point
Browse repository at this point
Commits on Aug 18, 2025
🌓 SFTTrainer for VLM: Support for prompt-completion data (#3907)
qgallouedec
authored
0227d68
View commit details
Copy full SHA for 0227d68
View code at this point
Browse repository at this point
Commits on Aug 13, 2025
🔮 Native VLM support for `SFTTrainer` (#3862)
Show description for 44e6c15
3 people
authored
44e6c15
View commit details
Copy full SHA for 44e6c15
View code at this point
Browse repository at this point
Commits on Aug 7, 2025
👋 Remove `--bf16` value in scripts (#3869)
sergiopaniego
authored
cb95323
View commit details
Copy full SHA for cb95323
View code at this point
Browse repository at this point
👁️ From `AutoModelForVision2Seq` to `AutoModelForImageTextToText` (#3836)
qgallouedec
authored
2fb7090
View commit details
Copy full SHA for 2fb7090
View code at this point
Browse repository at this point
Commits on Aug 5, 2025
🌺 OpenAI GPT OSS & Harmony support (#3848)
Show description for 17393b8
3 people
authored
17393b8
View commit details
Copy full SHA for 17393b8
View code at this point
Browse repository at this point
Commits on Jul 31, 2025
Add GSPO script examples (VLM/LLM) (#3810)
sergiopaniego
authored
3ae60cd
View commit details
Copy full SHA for 3ae60cd
View code at this point
Browse repository at this point
Commits on Jul 30, 2025
🐙 Add MPO VLM example script (#3799)
sergiopaniego
authored
25ce0f3
View commit details
Copy full SHA for 25ce0f3
View code at this point
Browse repository at this point
Commits on Jul 28, 2025
🌋 [GRPO] add support for `pixel_attention_mask` (SmolVLM2) and `image_sizes` (LLaVa-Next) (#3760)
Show description for fcd3e0f
5 people
authored
fcd3e0f
View commit details
Copy full SHA for fcd3e0f
View code at this point
Browse repository at this point
Commits on Jul 26, 2025
📐 Fix CI and `GeometricMixtureWrapper` (#3779)
qgallouedec
authored
2f4cb38
View commit details
Copy full SHA for 2f4cb38
View code at this point
Browse repository at this point
Commits on Jul 25, 2025
Add uv scripts headers (#3767)
lhoestq
authored
a043fd7
View commit details
Copy full SHA for a043fd7
View code at this point
Browse repository at this point
Commits on Jul 23, 2025
👁️ [GRPO] Add VLM training capabilities to the trainer (#3072)
CompN3rd
authored
56f4201
View commit details
Copy full SHA for 56f4201
View code at this point
Browse repository at this point
Commits on Jul 12, 2025
👋 Remove `--bf16` flag from training scripts (#3724)
Show description for dffd1ac
qgallouedec
and
shirinyamani
authored
dffd1ac
View commit details
Copy full SHA for dffd1ac
View code at this point
Browse repository at this point
Commits on Jul 11, 2025
Remove deprecated `processor.tokenizer` (#3720)
Tavish9
authored
43e6b24
View commit details
Copy full SHA for 43e6b24
View code at this point
Browse repository at this point
Commits on Jun 24, 2025
Update dpo_vlm.py (#3629)
Show description for ab331bf
Clement25
and
shirinyamani
authored
ab331bf
View commit details
Copy full SHA for ab331bf
View code at this point
Browse repository at this point
fixing num_processes (#3637)
shirinyamani
authored
b40c959
View commit details
Copy full SHA for b40c959
View code at this point
Browse repository at this point
Commits on Jun 18, 2025
🗳️ Remove `logging_steps` parameter from for simpler setup (#3612)
qgallouedec
authored
ed9b78a
View commit details
Copy full SHA for ed9b78a
View code at this point
Browse repository at this point
Commits on Jun 15, 2025
Fix Typo in Documentation and Notebook; Improve Library Installation Comment (#3593)
zeevick10
authored
8a235a9
View commit details
Copy full SHA for 8a235a9
View code at this point
Browse repository at this point
Commits on Jun 12, 2025
Add support for `IterableDataset` in DPO Trainer (#3559)
Show description for 3d077fd
h-tonywu
and
kashif
authored
3d077fd
View commit details
Copy full SHA for 3d077fd
View code at this point
Browse repository at this point
Commits on Jun 10, 2025
ℹ️ Unify autocast behavior to `torch.autocast` and make it cover XPU (#3541)
Show description for 1314aac
3 people
authored
1314aac
View commit details
Copy full SHA for 1314aac
View code at this point
Browse repository at this point
Previous
Next
You can’t perform that action at this time.