Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
aicodex
/
trl
Public
forked from
huggingface/trl
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
All time
Commit history
Commits on Dec 22, 2024
📦 Packing documentation (#2503)
qgallouedec
authored
aed5da5
View commit details
Copy full SHA for aed5da5
Browse repository at this point
👬 Rename collator `PreferenceCollator` to ` DataCollatorForPreference` (#2510)
qgallouedec
authored
99451b4
View commit details
Copy full SHA for 99451b4
Browse repository at this point
💧 Generalize `disable_dropout` (#2511)
qgallouedec
authored
5239b94
View commit details
Copy full SHA for 5239b94
Browse repository at this point
👨🍳 Clarify DPO data preparation (#2512)
qgallouedec
authored
8fb267f
View commit details
Copy full SHA for 8fb267f
Browse repository at this point
❎ Remove RLOO example test (#2513)
qgallouedec
authored
2e1adbb
View commit details
Copy full SHA for 2e1adbb
Browse repository at this point
Commits on Dec 20, 2024
Update community_tutorials.md (#2509)
Show description for b668048
qgallouedec
authored
b668048
View commit details
Copy full SHA for b668048
Browse repository at this point
Commits on Dec 19, 2024
🏚 Remove unused components (#2480)
qgallouedec
authored
8c49ea3
View commit details
Copy full SHA for 8c49ea3
Browse repository at this point
fix orpo chosen-nll loss (#2502)
kashif
authored
88ad1a0
View commit details
Copy full SHA for 88ad1a0
Browse repository at this point
Commits on Dec 18, 2024
🗂️ Reorganize documentation (#2483)
Show description for 9908dda
qgallouedec
authored
9908dda
View commit details
Copy full SHA for 9908dda
Browse repository at this point
🏞️ Proper dataset for documentation images (#2499)
Show description for 5e204e1
qgallouedec
authored
5e204e1
View commit details
Copy full SHA for 5e204e1
Browse repository at this point
Commits on Dec 17, 2024
🤩 Add SmolVLM tutorials to Community Tutorials page (#2498)
sergiopaniego
authored
82cfeb8
View commit details
Copy full SHA for 82cfeb8
Browse repository at this point
Commits on Dec 16, 2024
🗣️ Improve prose for smol course (#2487)
burtenshaw
authored
0fe73a8
View commit details
Copy full SHA for 0fe73a8
Browse repository at this point
Commits on Dec 15, 2024
⚰️ Remove deprecated (#2485)
qgallouedec
authored
33fb9ef
View commit details
Copy full SHA for 33fb9ef
Browse repository at this point
Bump version
qgallouedec
committed
f68d11f
View commit details
Copy full SHA for f68d11f
Browse repository at this point
👨🏫 smol course links and badges (#2484)
Show description for aeca637
qgallouedec
authored
aeca637
View commit details
Copy full SHA for aeca637
Browse repository at this point
📥 Fix missing `BitsAndBytesConfig` import in doc (#2478)
August-murr
authored
117c6d4
View commit details
Copy full SHA for 117c6d4
Browse repository at this point
Commits on Dec 13, 2024
☄️ Add support for Comet experiment management SDK integration (#2462)
Show description for 6d4ed07
yaricom
and
qgallouedec
authored
6d4ed07
View commit details
Copy full SHA for 6d4ed07
Browse repository at this point
👀 Add "PaliGemma 🤝 Direct Preference Optimization" in community tutorials (#2475)
qgallouedec
authored
cd7156f
View commit details
Copy full SHA for cd7156f
Browse repository at this point
🕹️ CLI refactor (#2380)
Show description for ca850be
qgallouedec
authored
ca850be
View commit details
Copy full SHA for ca850be
Browse repository at this point
🐾 Process-supervised RM Trainer (#2127)
Show description for 179ba53
4 people
authored
179ba53
View commit details
Copy full SHA for 179ba53
Browse repository at this point
Commits on Dec 12, 2024
🔨 Support for tools for data utils (#2455)
Show description for e3e171a
August-murr
and
qgallouedec
authored
e3e171a
View commit details
Copy full SHA for e3e171a
Browse repository at this point
🎞️ Add "Fine-tuning open AI models using Hugging Face TRL" YouTube video to community tutorials (#2467)
qgallouedec
authored
b3aff44
View commit details
Copy full SHA for b3aff44
Browse repository at this point
🛠️ Update tests and fix PPO (#2463)
Show description for efc687d
3 people
authored
efc687d
View commit details
Copy full SHA for efc687d
Browse repository at this point
Commits on Dec 11, 2024
⚖️ Add `tests_latest.yml` workflow file (#2457)
Show description for f2e3626
qgallouedec
authored
f2e3626
View commit details
Copy full SHA for f2e3626
Browse repository at this point
[bugfix] Fix DataCollatorForChatML unexpected generation prompt (#2450)
Show description for c9c4f18
NIL-zhuang
and
kashif
authored
c9c4f18
View commit details
Copy full SHA for c9c4f18
Browse repository at this point
Commits on Dec 10, 2024
👯 Standardize `model_args` (#2442)
Show description for 460e780
qgallouedec
authored
460e780
View commit details
Copy full SHA for 460e780
Browse repository at this point
🏎 Fix deepspeed preparation of `ref_model` in `OnlineDPOTrainer` (#2417)
Show description for 7ba118a
qgallouedec
authored
7ba118a
View commit details
Copy full SHA for 7ba118a
Browse repository at this point
🆔 Add `datast_config` to `ScriptArguments` (#2440)
Show description for 6a05fef
qgallouedec
authored
6a05fef
View commit details
Copy full SHA for 6a05fef
Browse repository at this point
💬 Fix chat for windows (#2443)
Show description for 2f72f47
qgallouedec
authored
2f72f47
View commit details
Copy full SHA for 2f72f47
Browse repository at this point
©️ Copyrights update (#2454)
Show description for 9410874
qgallouedec
authored
9410874
View commit details
Copy full SHA for 9410874
Browse repository at this point
Commits on Dec 6, 2024
🔗 Add "Open in Colab" badges in community tutorials page (#2441)
qgallouedec
authored
9c5388b
View commit details
Copy full SHA for 9c5388b
Browse repository at this point
Commits on Dec 4, 2024
🗂️ Harmonize run and example batch sizes in RLOO docs (#2439)
Show description for b02189a
asparius
authored
b02189a
View commit details
Copy full SHA for b02189a
Browse repository at this point
Commits on Dec 3, 2024
🧮 Fix `max_steps` calculation in `RLOOTrainer` (#2433)
qgallouedec
authored
52201d3
View commit details
Copy full SHA for 52201d3
Browse repository at this point
🔮 Fix unused precomputed ref log probs in DPO (#2431)
dakru012
authored
9ff79a6
View commit details
Copy full SHA for 9ff79a6
Browse repository at this point
Commits on Dec 2, 2024
📑 Refactor `TrlParser` (#2412)
Show description for 9001a86
qgallouedec
authored
9001a86
View commit details
Copy full SHA for 9001a86
Browse repository at this point
Previous
Next
You can’t perform that action at this time.