Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
brentyi
/
trl
Public
forked from
huggingface/trl
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
All time
Commit history
Commits on Oct 30, 2023
updating PPOTrainer docstring (#897)
Show description for 051d5a1
3 people
authored
051d5a1
View commit details
Copy full SHA for 051d5a1
Browse repository at this point
Generalize NEFTune for FSDP, DDP, ... (#924)
Show description for 2068fdc
younesbelkada
authored
2068fdc
View commit details
Copy full SHA for 2068fdc
Browse repository at this point
Commits on Oct 25, 2023
fix stackllama2 sft gradient checkpointing (#906)
Show description for 02f5c1d
nrailg
authored
02f5c1d
View commit details
Copy full SHA for 02f5c1d
Browse repository at this point
Commits on Oct 24, 2023
deactivate MacOS CI (#913)
lvwerra
authored
7de7db6
View commit details
Copy full SHA for 7de7db6
Browse repository at this point
[Update reward_trainer.py] append PeftSavingCallback if callbacks is not None (#910)
zuoxingdong
authored
4e7d5b5
View commit details
Copy full SHA for 4e7d5b5
Browse repository at this point
Fix broken link/markdown (#903)
Show description for a90e133
osanseviero
and
vwxyzjn
authored
a90e133
View commit details
Copy full SHA for a90e133
Browse repository at this point
[`NEFTune`] Make use of forward hooks instead (#889)
Show description for 5b2aeca
younesbelkada
authored
5b2aeca
View commit details
Copy full SHA for 5b2aeca
Browse repository at this point
Commits on Oct 23, 2023
Add whiten ops before compute advatanges (#887)
Show description for 1f3314f
SingL3
and
Lin Junpeng
authored
1f3314f
View commit details
Copy full SHA for 1f3314f
Browse repository at this point
Fix couple broken links on lib homepage (#908)
paulbricman
authored
304ee70
View commit details
Copy full SHA for 304ee70
Browse repository at this point
Commits on Oct 19, 2023
[reward_modeling] Cleaning example script (#882)
Show description for 0a5aee7
gaetanlop
authored
0a5aee7
View commit details
Copy full SHA for 0a5aee7
Browse repository at this point
fix: remove useless token (#896)
rtrompier
authored
db592a2
View commit details
Copy full SHA for db592a2
Browse repository at this point
Commits on Oct 18, 2023
fix peft_config type (#883)
Show description for 122edc8
u2takey
and
wanglei.w
authored
122edc8
View commit details
Copy full SHA for 122edc8
Browse repository at this point
remove duplicate key in `reward_modeling.py` (#890)
vwxyzjn
authored
f91fb2b
View commit details
Copy full SHA for f91fb2b
Browse repository at this point
Commits on Oct 17, 2023
fix syntax error
graniet
committed
01e4ad0
View commit details
Copy full SHA for 01e4ad0
Browse repository at this point
Fix security breach
rtrompier
authored
1e56ff0
View commit details
Copy full SHA for 1e56ff0
Browse repository at this point
[`SFTTrainer`] Adds NEFTune into `SFTTrainer` (#871)
Show description for c4ed327
younesbelkada
and
lewtun
authored
c4ed327
View commit details
Copy full SHA for c4ed327
Browse repository at this point
Commits on Oct 16, 2023
[DPO] add SLiC hinge loss to DPOTrainer (#866)
Show description for 14b6bc6
kashif
and
lvwerra
authored
14b6bc6
View commit details
Copy full SHA for 14b6bc6
Browse repository at this point
Commits on Oct 12, 2023
set dev version (#864)
younesbelkada
authored
eb4d2f3
View commit details
Copy full SHA for eb4d2f3
Browse repository at this point
Release: 0.7.2 (#863)
younesbelkada
authored
78e08bd
View commit details
Copy full SHA for 78e08bd
Browse repository at this point
Support both old and new diffusers import path (#843)
Show description for 96d4854
osanseviero
and
younesbelkada
authored
96d4854
View commit details
Copy full SHA for 96d4854
Browse repository at this point
Commits on Oct 11, 2023
[`core`] Fix import issues (#859)
Show description for 3ef21a2
younesbelkada
authored
3ef21a2
View commit details
Copy full SHA for 3ef21a2
Browse repository at this point
dont use get_peft_model if model is already peft (#857)
abhishekkrthakur
authored
f7707fd
View commit details
Copy full SHA for f7707fd
Browse repository at this point
Fix version check in import_utils.py (#853)
adampauls
authored
dd9b8f4
View commit details
Copy full SHA for dd9b8f4
Browse repository at this point
Standardise example scripts (#842)
Show description for ddd3188
lewtun
and
vwxyzjn
authored
ddd3188
View commit details
Copy full SHA for ddd3188
Browse repository at this point
Update benchmark.yml (#856)
lvwerra
authored
8aa12d3
View commit details
Copy full SHA for 8aa12d3
Browse repository at this point
Commits on Oct 9, 2023
Use uniform config (#817)
Show description for 95aea7c
vwxyzjn
authored
95aea7c
View commit details
Copy full SHA for 95aea7c
Browse repository at this point
Raise error in `create_reference_model()` when ZeRO-3 is enabled (#840)
Show description for eda1f36
lewtun
authored
eda1f36
View commit details
Copy full SHA for eda1f36
Browse repository at this point
Commits on Oct 6, 2023
add DDPO to index (#826)
Show description for ac0d5b7
lvwerra
authored
ac0d5b7
View commit details
Copy full SHA for ac0d5b7
Browse repository at this point
Clarify docstrings, help messages, assert messages in merge_peft_adapter.py (#838)
Show description for 6826d59
larekrow
authored
6826d59
View commit details
Copy full SHA for 6826d59
Browse repository at this point
Commits on Oct 5, 2023
[MINOR:TYPOS] Update README.md (#829)
cakiki
authored
c058ee6
View commit details
Copy full SHA for c058ee6
Browse repository at this point
Commits on Oct 4, 2023
Set trust remote code to false by default (#833)
lewtun
authored
fbeb146
View commit details
Copy full SHA for fbeb146
Browse repository at this point
Commits on Oct 3, 2023
Fix DeepSpeed ZeRO-{1,2} for DPOTrainer (#825)
lewtun
authored
98845b9
View commit details
Copy full SHA for 98845b9
Browse repository at this point
Commits on Oct 2, 2023
Unify sentiment documentation (#803)
Show description for 9f6326e
3 people
authored
9f6326e
View commit details
Copy full SHA for 9f6326e
Browse repository at this point
Small fixes to the PPO trainer doc. (#811)
Show description for 7dcc71b
namin
authored
7dcc71b
View commit details
Copy full SHA for 7dcc71b
Browse repository at this point
Commits on Sep 29, 2023
add option for compute_metrics in DPOTrainer (#822)
kashif
authored
6b73adc
View commit details
Copy full SHA for 6b73adc
Browse repository at this point
Previous
Next
You can’t perform that action at this time.