Commits

Branch selector

 sac

User selector

All users

All time

Commit History

Commits on Oct 19, 2025

• Fix SAC training loop by computing Q-values and loss

  Show description for 3c9690e
  

  xinyubao

  committed
  3c9690e

  Copy full SHA for 3c9690e

Commits on Oct 12, 2025

• Refactor SAC training to use DataBatch and update both Q-networks

  Show description for 164e12b
  

  xinyubao

  committed
  164e12b

  Copy full SHA for 164e12b

Commits on Oct 9, 2025

• Refactor SAC implementation with backend-agnostic QNet

  Show description for 15ca9cd
  

  xinyubao

  committed
  15ca9cd

  Copy full SHA for 15ca9cd

Commits on Oct 7, 2025

• working on computing the temporal difference target

  

  xinyubao

  committed
  172a180

  Copy full SHA for 172a180

Commits on Oct 6, 2025

• Refactor state conversion into shared utility function

  

  xinyubao

  committed
  4f4efa8

  Copy full SHA for 4f4efa8

Commits on Oct 4, 2025

• Refactor Huber loss creation into shared utility function

  

  xinyubao

  committed
  b477f19

  Copy full SHA for b477f19

Commits on Sep 23, 2025

• Remove commented Python SAC implementation from forward method

  

  xinyubao

  committed
  77b7a9f

  Copy full SHA for 77b7a9f

Commits on Sep 19, 2025

• Refactor policy network forward pass and add logprob utility

  Show description for 4e5f36b
  

  xinyubao

  committed
  4e5f36b

  Copy full SHA for 4e5f36b

Commits on Sep 16, 2025

• Replace hardcoded beta with constant 1.0 and convert standard_deviation to scalar in Normal distribution

  

  xinyubao

  committed
  6ba1bfc

  Copy full SHA for 6ba1bfc

• working on forward method of the policy net

  AspadaX

  committed
  39451e1

  Copy full SHA for 39451e1

Commits on Sep 15, 2025

• working on the policy network's forward function

  

  xinyubao

  committed
  aba51da

  Copy full SHA for aba51da

• Implement PolicyNet for SAC with Adam optimizer helper

  AspadaX

  committed
  ea0b7ed

  Copy full SHA for ea0b7ed

Commits on Sep 11, 2025

• Remove hardcoded AC algorithm execution and add user input prompt

  AspadaX

  committed
  b8f9ff4

  Copy full SHA for b8f9ff4

Commits on Sep 10, 2025

• remove unused imports

  

  xinyubao

  committed
  054e1d2

  Copy full SHA for 054e1d2

• Remove Python implementation and refactor Rust actor-critic

  Show description for 45edb40
  

  xinyubao

  committed
  45edb40

  Copy full SHA for 45edb40

Commits on Sep 9, 2025

• updating Actor-Critic algorithm

  AspadaX

  committed
  d2d0410

  Copy full SHA for d2d0410

Commits on Sep 8, 2025

• updated the ac, but it will need a rewrite

  

  xinyubao

  committed
  d3d0d8b

  Copy full SHA for d3d0d8b

Commits on Sep 6, 2025

• Add replay buffer with max capacity and fix DQN training loop

  Show description for 48b8aeb
  

  xinyubao

  committed
  48b8aeb

  Copy full SHA for 48b8aeb

• Refactor PPO data handling and fix DQN memory usage

  Show description for cfea396
  

  xinyubao

  committed
  cfea396

  Copy full SHA for cfea396

Commits on Sep 2, 2025

• Refactor to share common data structures and replay buffer

  

  xinyubao

  committed
  db20c74

  Copy full SHA for db20c74

• Rename `action_prob` to `action_probability` and add `from_step_result` constructor

  AspadaX

  committed
  f39e537

  Copy full SHA for f39e537

• Refactor module structure and add SAC skeleton

  Show description for 1fa5b05
  AspadaX

  committed
  1fa5b05

  Copy full SHA for 1fa5b05

Commits on Sep 1, 2025

• Update main.rs

  AspadaX

  authored
  85226e0

  Copy full SHA for 85226e0

• Rename a2c module to ac and update references

  AspadaX

  committed
  a22dc92

  Copy full SHA for a22dc92

• Update README.md

  AspadaX

  authored
  c40cfde

  Copy full SHA for c40cfde

• Merge pull request #5 from AspadaX/a2c

  Show description for 4a2929c
  AspadaX

  authored
  4a2929c

  Copy full SHA for 4a2929c

• Add A2C implementation and refactor shared Relu layers

  Show description for 728bb0b
  AspadaX

  committed
  728bb0b

  Copy full SHA for 728bb0b

Commits on Aug 30, 2025

• Refactor A2C implementation and fix TD target calculation

  Show description for 179ad74
  

  xinyubao

  committed
  179ad74

  Copy full SHA for 179ad74

Commits on Aug 29, 2025

• added a2c to main

  AspadaX

  committed
  d342490

  Copy full SHA for d342490

• finished training loop of a2c

  AspadaX

  committed
  28c9954

  Copy full SHA for 28c9954

Commits on Aug 28, 2025

• Implement TD target computation for A2C training loop

  

  xinyubao

  committed
  9152959

  Copy full SHA for 9152959

• Add gym-rs dependency and update environment interaction logic

  

  xinyubao

  committed
  b4c06a3

  Copy full SHA for b4c06a3

• updates

  AspadaX

  committed
  b31ff8a

  Copy full SHA for b31ff8a

Commits on Aug 27, 2025

• updated readme

  AspadaX

  committed
  c75b9c9

  Copy full SHA for c75b9c9

• Refactor action sampling into shared utility and add A2C training loop

  AspadaX

  committed
  8050f22

  Copy full SHA for 8050f22