Simple Pendulum Simulation

Math Major | Posse Scholar | AB/MA Candidate

Comparison of RL algorithms (Bandit, Q-Learning etc.) to similar algorithms that use inference. Psi-Auto as an algorithm that automatically tunes the inverse temperature.

A generic implementation of dynamic programming algorithm and value iteration algorithm. To cite this Original Software Publication: https://www.sciencedirect.com/science/article/pii/S2352711022000152

MPC for Powered Descent Guidance and Control of a Lander

Setup scripts for the PSOPT package @ https://github.com/flavio-santes/psopt

optimal control for eCAV's

Code for: "A graph-informed regret metric for optimal distributed control"

An implementation of the numerical algorithm for the bound constraints optimal control problems in linear elasticity

A universal wrapper for reinforecement learning agents with guarantees

An Intelligent room temperature Control and Monitoring System

Practicums from System Analysis

Learning efficient goal-conditioned policies by imitating optimal trajectories

My most recent personal coding projects!

Assignment for optimal control (MAE 546): Moon Lander Problem

Fast and embedded solvers for nonlinear optimal control

We use optimal control and Pontryagin’s Maximum Principle to maximize resource collection by a swarm of agents in a given time constraint.

A toolbox for the fuel-optimization of space trajectories