Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
frelam
/
verl
Public
forked from
verl-project/verl
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
All time
Commit history
Commits on Jul 10, 2026
feat(online_dpo): support AGENT_RUNNER selection and mixed datasets
Show description for 7c7ade3
lvhaoyu
and
claude
committed
7c7ade3
View commit details
Copy full SHA for 7c7ade3
Browse repository at this point
refactor(online_dpo): remove reward/ directory, use uni_agent.reward.llm_judge directly
Show description for f401b5f
lvhaoyu
and
claude
committed
f401b5f
View commit details
Copy full SHA for f401b5f
Browse repository at this point
refactor(online_dpo): simplify to sandbox runners + pluggable scoring
Show description for 6ee5953
lvhaoyu
and
claude
committed
6ee5953
View commit details
Copy full SHA for 6ee5953
Browse repository at this point
fix: use urlparse for repo URL validation to prevent SSRF bypass
Show description for a7f4f07
lvhaoyu
and
claude
committed
a7f4f07
View commit details
Copy full SHA for a7f4f07
Browse repository at this point
feat: add Claude-Code-style agent runner for online DPO
Show description for 4b02e13
lvhaoyu
and
claude
committed
4b02e13
View commit details
Copy full SHA for 4b02e13
Browse repository at this point
feat: add dataset-specific batch LLM judge for online DPO
Show description for 1e012cc
lvhaoyu
and
claude
committed
1e012cc
View commit details
Copy full SHA for 1e012cc
Browse repository at this point
fix: repair online DPO + uni-agent gateway integration and remove redundant code
Show description for a632bed
lvhaoyu
and
claude
committed
a632bed
View commit details
Copy full SHA for a632bed
Browse repository at this point
update doc for online dpo
lvhaoyu
committed
a2341fc
View commit details
Copy full SHA for a2341fc
Browse repository at this point
support uniagent for dpo
lvhaoyu
committed
f7cdc12
View commit details
Copy full SHA for f7cdc12
Browse repository at this point
Commits on Jul 9, 2026
fix: sanitize workspace paths, avoid shell injection in scripts
Show description for 86842fb
lvhaoyu
and
claude
committed
86842fb
View commit details
Copy full SHA for 86842fb
Browse repository at this point
feat: add sandbox tools for online DPO with multi-backend support
Show description for 1dc98e5
lvhaoyu
and
claude
committed
1dc98e5
View commit details
Copy full SHA for 1dc98e5
Browse repository at this point
Commits on Jul 8, 2026
update batch dpo with model judge
lvhaoyu
committed
d12964d
View commit details
Copy full SHA for d12964d
Browse repository at this point
update
lvhaoyu
committed
e36e338
View commit details
Copy full SHA for e36e338
Browse repository at this point
update
lvhaoyu
committed
384daf9
View commit details
Copy full SHA for 384daf9
Browse repository at this point
add agent online dpo
lvhaoyu
committed
f47a653
View commit details
Copy full SHA for f47a653
Browse repository at this point
new
lvhaoyu
committed
c5ad556
View commit details
Copy full SHA for c5ad556
Browse repository at this point
Clarify DPO reward calculation requirements
frelam
authored and
lvhaoyu
committed
03b2ff2
View commit details
Copy full SHA for 03b2ff2
Browse repository at this point
Expand agent abilities with new insights on DPO and SFT
Show description for b5c7e6e
frelam
authored and
lvhaoyu
committed
b5c7e6e
View commit details
Copy full SHA for b5c7e6e
Browse repository at this point
Add honesty and humility as an ability
frelam
authored and
lvhaoyu
committed
29bc16c
View commit details
Copy full SHA for 29bc16c
Browse repository at this point
add agent reject sampling
lvhaoyu
committed
ad4c644
View commit details
Copy full SHA for ad4c644
Browse repository at this point
add agent sft
lvhaoyu
committed
a8cda8d
View commit details
Copy full SHA for a8cda8d
Browse repository at this point
update
lvhaoyu
committed
b1f5cc9
View commit details
Copy full SHA for b1f5cc9
Browse repository at this point
add optimizer reset per iter feature
lvhaoyu
committed
d57fcea
View commit details
Copy full SHA for d57fcea
Browse repository at this point
Update agent abilities with clearer descriptions
Show description for 3f7812c
frelam
authored and
lvhaoyu
committed
3f7812c
View commit details
Copy full SHA for 3f7812c
Browse repository at this point
Add new abilities for agent in agent_ability.md
frelam
authored and
lvhaoyu
committed
870aaad
View commit details
Copy full SHA for 870aaad
Browse repository at this point
Create agent_ability.md
frelam
authored and
lvhaoyu
committed
feca7ed
View commit details
Copy full SHA for feca7ed
Browse repository at this point
Refactor math solution extraction to use new method
frelam
authored and
lvhaoyu
committed
405d8f7
View commit details
Copy full SHA for 405d8f7
Browse repository at this point
Refactor math_reward.py for clarity and efficiency
Show description for edbd3d5
frelam
authored and
lvhaoyu
committed
edbd3d5
View commit details
Copy full SHA for edbd3d5
Browse repository at this point
Add reward calculation functions in reward.py
frelam
authored and
lvhaoyu
committed
e30fcdf
View commit details
Copy full SHA for e30fcdf
Browse repository at this point
Add max effort handling in mixed reasoning dataset
frelam
authored and
lvhaoyu
committed
5c310f4
View commit details
Copy full SHA for 5c310f4
Browse repository at this point
Update max_occurrences and add data_source parameter
frelam
authored and
lvhaoyu
committed
f5850a4
View commit details
Copy full SHA for f5850a4
Browse repository at this point
Update thinking format pattern in check_thinking_format
frelam
authored and
lvhaoyu
committed
37033fd
View commit details
Copy full SHA for 37033fd
Browse repository at this point
Add mixed reasoning dataset generation script
frelam
authored and
lvhaoyu
committed
736b934
View commit details
Copy full SHA for 736b934
Browse repository at this point
Update length bonus logic for max-effort data source
Show description for 1d188d0
frelam
authored and
lvhaoyu
committed
1d188d0
View commit details
Copy full SHA for 1d188d0
Browse repository at this point
Add mix_sharegpt_agentinstruct_sft.py for dataset mixing
Show description for 0d35c3e
frelam
authored and
lvhaoyu
committed
0d35c3e
View commit details
Copy full SHA for 0d35c3e
Browse repository at this point
Previous
Next
You can’t perform that action at this time.