Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
j-cb
/
trl
Public
forked from
huggingface/trl
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
All time
Commit history
Commits on Feb 2, 2024
Fix AttributeError in dpo_trainer for reference_free case in dpo_loss function (#1313)
Show description for f12a1da
maliozer
authored
f12a1da
View commit details
Copy full SHA for f12a1da
Browse repository at this point
Fix typos in docs for Multi Adapter RL (MARL). (#1312)
Show description for ae87b3a
elhusseiniali
authored
ae87b3a
View commit details
Copy full SHA for ae87b3a
Browse repository at this point
Commits on Feb 1, 2024
ENH: Run CI only if relevant files are modified (#1309)
Show description for 3f7cee7
younesbelkada
authored
3f7cee7
View commit details
Copy full SHA for 3f7cee7
Browse repository at this point
Codemod Unittest assertions to bare asserts (#1301)
Show description for ae8431b
akx
authored
ae8431b
View commit details
Copy full SHA for ae8431b
Browse repository at this point
Update sft_trainer.mdx to add note on launching DDP training (#1308)
Show description for 66a976c
johnowhitaker
authored
66a976c
View commit details
Copy full SHA for 66a976c
Browse repository at this point
Add num_proc arg to the eval_dataset processing (#1307)
esceptico
authored
8149303
View commit details
Copy full SHA for 8149303
Browse repository at this point
Commits on Jan 31, 2024
Types: Fix PEP 484 implicit-optional compliance (#1297)
Show description for 88685f2
akx
authored
88685f2
View commit details
Copy full SHA for 88685f2
Browse repository at this point
Fix `DPOTrainer` docstrings (#1298)
Show description for 6f40f20
alvarobartt
authored
6f40f20
View commit details
Copy full SHA for 6f40f20
Browse repository at this point
Fix sft trainer when args is None (#1295)
Show description for 036213b
younesbelkada
authored
036213b
View commit details
Copy full SHA for 036213b
Browse repository at this point
Commits on Jan 30, 2024
Fix DPO slow tests (#1292)
Show description for 6042596
younesbelkada
authored
6042596
View commit details
Copy full SHA for 6042596
Browse repository at this point
load data only on main process + fix dpo example test (#1291)
younesbelkada
authored
070c75e
View commit details
Copy full SHA for 070c75e
Browse repository at this point
fix DPO trainer + mistral + FA2 (#1290)
younesbelkada
authored
b415224
View commit details
Copy full SHA for b415224
Browse repository at this point
fix padding in dpo trainer (#1284)
pacman100
authored
9186710
View commit details
Copy full SHA for 9186710
Browse repository at this point
raise value error if one passes a ref_model and a peft_config (#1289)
younesbelkada
authored
aa35fec
View commit details
Copy full SHA for aa35fec
Browse repository at this point
Add multiprocessing in the DPO trainer. (#1286)
Show description for 737d771
3 people
authored
737d771
View commit details
Copy full SHA for 737d771
Browse repository at this point
Commits on Jan 27, 2024
Update dpo_trainer.mdx (#1280)
ouhenio
authored
ef441ea
View commit details
Copy full SHA for ef441ea
Browse repository at this point
Commits on Jan 26, 2024
Fix sft ci (#1279)
vwxyzjn
authored
af623ae
View commit details
Copy full SHA for af623ae
Browse repository at this point
Fix SFT tuner (#1278)
vwxyzjn
authored
3843cfc
View commit details
Copy full SHA for 3843cfc
Browse repository at this point
Remove tyro (#1176)
Show description for 9a71e67
3 people
authored
9a71e67
View commit details
Copy full SHA for 9a71e67
Browse repository at this point
FIx SFTTrainer bugs on TRL main (#1276)
Show description for 09ca565
younesbelkada
authored
09ca565
View commit details
Copy full SHA for 09ca565
Browse repository at this point
Only load data on main process (#1255)
Show description for 4edc688
JohnGiorgi
and
younesbelkada
authored
4edc688
View commit details
Copy full SHA for 4edc688
Browse repository at this point
Commits on Jan 24, 2024
[DPO] average_log_prob when loss is IPO (#1265)
Show description for 29d439a
kashif
authored
29d439a
View commit details
Copy full SHA for 29d439a
Browse repository at this point
Commits on Jan 23, 2024
Fix typo in extra_columns variable name (#1269)
Show description for 5760e5d
otlaitil
authored
5760e5d
View commit details
Copy full SHA for 5760e5d
Browse repository at this point
Commits on Jan 22, 2024
Update utils.py (#1256)
philschmid
authored
a3c5b71
View commit details
Copy full SHA for a3c5b71
Browse repository at this point
Commits on Jan 19, 2024
set dev version (#1254)
younesbelkada
authored
222d275
View commit details
Copy full SHA for 222d275
Browse repository at this point
Release: v0.7.10 (#1253)
younesbelkada
authored
09ca760
View commit details
Copy full SHA for 09ca760
Browse repository at this point
Commits on Jan 18, 2024
fix: fix loss_type and some args desc (#1247)
zspo
authored
1e68753
View commit details
Copy full SHA for 1e68753
Browse repository at this point
Fix chatml template (#1248)
Show description for 1f59eeb
philschmid
and
younesbelkada
authored
1f59eeb
View commit details
Copy full SHA for 1f59eeb
Browse repository at this point
Add `setup_chat_format` for adding new special tokens to model for training chat models (#1242)
Show description for 928d144
philschmid
and
younesbelkada
authored
928d144
View commit details
Copy full SHA for 928d144
Browse repository at this point
Fix weird doc bug (#1244)
Show description for 3319993
younesbelkada
authored
3319993
View commit details
Copy full SHA for 3319993
Browse repository at this point
Commits on Jan 17, 2024
Update sft_trainer.py (#1241)
younesbelkada
authored
4fb3d0c
View commit details
Copy full SHA for 4fb3d0c
Browse repository at this point
[`core` / SFTTrainer] Fix breaking change (#1229)
Show description for bcccdeb
younesbelkada
authored
bcccdeb
View commit details
Copy full SHA for bcccdeb
Browse repository at this point
[`core` / tests ] v1 slow tests (#1218)
Show description for ef209e3
younesbelkada
authored
ef209e3
View commit details
Copy full SHA for ef209e3
Browse repository at this point
fix: improve error message when `pad_token_id` is not configured (#1152)
Show description for 341f6a6
yumemio
authored
341f6a6
View commit details
Copy full SHA for 341f6a6
Browse repository at this point
Commits on Jan 15, 2024
Update dpo_trainer.py (#1160)
Show description for 97b9fa2
AjayP13
authored
97b9fa2
View commit details
Copy full SHA for 97b9fa2
Browse repository at this point
Previous
Next
You can’t perform that action at this time.