This repo contains code written by Koray Ulusan.

Full implementation of UlusanTD3 can be found in src/agents/ulusan_td3.py.

src/scripts contain scripts to run the code. For example:

python -m src.scripts.train-curriculum

We use a python venv

# note that I'm usnig fish shell

python3.11 -m venv venv
source venv/bin/activate.fish
pip install -r requirements.txt

99% win rate. StableBaselines3 TD3 agent is on the left. BasicAgent(strong_version=True) is on the right. A batch of 4 games is shown.

When TD3 starts with the ball it scores immediately:

When TD3 starts without the ball it defends and scores when its capable: