Skip to content
Navigation Menu
Sign in
Products
Platform
GitHub
Repository hosting, code review, and collaboration
Copilot
AI coding agent for tasks, projects, and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Developer articles
Changelog
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
GitHub Universe
The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
AspadaX
minimalRL-rs
Repository navigation
Code
Issues
1
(1)
Pull requests
1
(1)
Actions
Projects
Security and quality
Insights
More
items
Commits
Branch selector
main
User selector
All users
Datepicker
All time
Commit history
Commits on Sep 11, 2025
Merge pull request #6 from AspadaX/sac
Show description for 0476665
AspadaX
authored
0476665
View commit details
Copy full SHA for 0476665
Browse repository at this point
Remove hardcoded AC algorithm execution and add user input prompt
AspadaX
committed
b8f9ff4
View commit details
Copy full SHA for b8f9ff4
Browse repository at this point
Commits on Sep 10, 2025
remove unused imports
xinyubao
committed
054e1d2
View commit details
Copy full SHA for 054e1d2
Browse repository at this point
Remove Python implementation and refactor Rust actor-critic
Show description for 45edb40
xinyubao
committed
45edb40
View commit details
Copy full SHA for 45edb40
Browse repository at this point
Commits on Sep 9, 2025
updating Actor-Critic algorithm
AspadaX
committed
d2d0410
View commit details
Copy full SHA for d2d0410
Browse repository at this point
Commits on Sep 8, 2025
updated the ac, but it will need a rewrite
xinyubao
committed
d3d0d8b
View commit details
Copy full SHA for d3d0d8b
Browse repository at this point
Commits on Sep 6, 2025
Add replay buffer with max capacity and fix DQN training loop
Show description for 48b8aeb
xinyubao
committed
48b8aeb
View commit details
Copy full SHA for 48b8aeb
Browse repository at this point
Refactor PPO data handling and fix DQN memory usage
Show description for cfea396
xinyubao
committed
cfea396
View commit details
Copy full SHA for cfea396
Browse repository at this point
Commits on Sep 2, 2025
Refactor to share common data structures and replay buffer
xinyubao
committed
db20c74
View commit details
Copy full SHA for db20c74
Browse repository at this point
Rename `action_prob` to `action_probability` and add `from_step_result` constructor
AspadaX
committed
f39e537
View commit details
Copy full SHA for f39e537
Browse repository at this point
Refactor module structure and add SAC skeleton
Show description for 1fa5b05
AspadaX
committed
1fa5b05
View commit details
Copy full SHA for 1fa5b05
Browse repository at this point
Commits on Sep 1, 2025
Update main.rs
AspadaX
authored
85226e0
View commit details
Copy full SHA for 85226e0
Browse repository at this point
Rename a2c module to ac and update references
AspadaX
committed
a22dc92
View commit details
Copy full SHA for a22dc92
Browse repository at this point
Update README.md
AspadaX
authored
c40cfde
View commit details
Copy full SHA for c40cfde
Browse repository at this point
Merge pull request #5 from AspadaX/a2c
Show description for 4a2929c
AspadaX
authored
4a2929c
View commit details
Copy full SHA for 4a2929c
Browse repository at this point
Add A2C implementation and refactor shared Relu layers
Show description for 728bb0b
AspadaX
committed
728bb0b
View commit details
Copy full SHA for 728bb0b
Browse repository at this point
Commits on Aug 30, 2025
Refactor A2C implementation and fix TD target calculation
Show description for 179ad74
xinyubao
committed
179ad74
View commit details
Copy full SHA for 179ad74
Browse repository at this point
Commits on Aug 29, 2025
added a2c to main
AspadaX
committed
d342490
View commit details
Copy full SHA for d342490
Browse repository at this point
finished training loop of a2c
AspadaX
committed
28c9954
View commit details
Copy full SHA for 28c9954
Browse repository at this point
Commits on Aug 28, 2025
Implement TD target computation for A2C training loop
xinyubao
committed
9152959
View commit details
Copy full SHA for 9152959
Browse repository at this point
Add gym-rs dependency and update environment interaction logic
xinyubao
committed
b4c06a3
View commit details
Copy full SHA for b4c06a3
Browse repository at this point
updates
AspadaX
committed
b31ff8a
View commit details
Copy full SHA for b31ff8a
Browse repository at this point
Commits on Aug 27, 2025
updated readme
AspadaX
committed
c75b9c9
View commit details
Copy full SHA for c75b9c9
Browse repository at this point
Refactor action sampling into shared utility and add A2C training loop
AspadaX
committed
8050f22
View commit details
Copy full SHA for 8050f22
Browse repository at this point
Commits on Aug 26, 2025
Remove unused dependencies and add A2C module
AspadaX
committed
4915298
View commit details
Copy full SHA for 4915298
Browse repository at this point
Commits on Aug 25, 2025
Add usage instructions to README
AspadaX
committed
48e0b72
View commit details
Copy full SHA for 48e0b72
Browse repository at this point
Merge pull request #4 from AspadaX/dqn
Show description for e2965e5
AspadaX
authored
e2965e5
View commit details
Copy full SHA for e2965e5
Browse repository at this point
Update README with DQN completion and project progress
AspadaX
committed
b59cfda
View commit details
Copy full SHA for b59cfda
Browse repository at this point
Remove hardcoded DQN session and add algorithm selection prompt
AspadaX
committed
36cf7b8
View commit details
Copy full SHA for 36cf7b8
Browse repository at this point
Commits on Aug 24, 2025
Fix argmax dimension and target network output calculation in DQN
xinyubao
committed
8c1ddd6
View commit details
Copy full SHA for 8c1ddd6
Browse repository at this point
added a simple cli to activate different algorithm
xinyubao
committed
190494a
View commit details
Copy full SHA for 190494a
Browse repository at this point
Commits on Aug 22, 2025
Refactor DQN training loop and implement Huber loss
Show description for 2717c8e
AspadaX
committed
2717c8e
View commit details
Copy full SHA for 2717c8e
Browse repository at this point
Commits on Aug 21, 2025
Add DQN training loop and improve documentation
Show description for 2901b3d
AspadaX
committed
2901b3d
View commit details
Copy full SHA for 2901b3d
Browse repository at this point
Implement DQN forward pass and action sampling, make PPO methods immutable
AspadaX
committed
229be46
View commit details
Copy full SHA for 229be46
Browse repository at this point
Implement replay buffer and Q-network for DQN agent
AspadaX
committed
1127588
View commit details
Copy full SHA for 1127588
Browse repository at this point
Previous
Next
You can’t perform that action at this time.