Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MACE-RL: Meta-Adaptive Curiosity-Driven Exploration with Episodic Memory

MACE-RL is a novel reinforcement learning framework that learns to dynamically regulate its own exploration strategy. It integrates:

  • A curiosity module informed by episodic memory
  • A meta-learning network that adaptively regulates the curiosity bonus

This enables agents to balance exploration and exploitation dynamically.

Installation

pip install -r requirements.txt

Usage

Quick Test

python experiment_runner.py --quick-test

Run Experiments

python experiment_runner.py --run-experiments

Publication Mode

python experiment_runner.py --publication-mode

Visualize Agent

python visualize_agent.py --model-path path/to/model.pth --env CartPole-v1

Project Structure

mace_rl/
├── agents/         # RL agents (PPO)
├── modules/        # Core MACE-RL components
│   ├── curiosity.py        # Curiosity module
│   ├── episodic_memory.py  # Episodic memory
│   └── meta_adaptation.py  # Meta-learning network
├── envs/           # Environment wrappers
└── utils/          # Utilities and helpers

Results

Algorithm Acrobot-v1 CartPole-v1 HopperBulletEnv-v0
PPO (Baseline) 186 / 617 140 / 660 865 / 1841
MACE-RL (Fixed β) 201 / 595 120 / 620 782 / 1801
MACE-RL (Full) 249 / 586 104 / 634 495 / 1799

Metrics: Sample Efficiency / Convergence Steps (lower is better)

About

MACE-RL is a novel framework that learns to dynamically regulate its own exploration strategy. It integrates a curiosity module, informed by episodic memory of past experiences, with a meta-learning network that monitors the agent's performance and adaptively regulates the influence of the intrinsic curiosity bonus.

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages