- Johannesburg, South Africa
- https://williamjshipman.wordpress.com
- https://orcid.org/0000-0002-5971-6957
Stars
Tutorials for reinforcement learning in PyTorch and Gym by implementing a few of the popular algorithms. [IN PROGRESS]
Python implementation of DDQN multi-UAV data harvesting
Reinforcement learning tutorials
Deep Q-Learning (DQN) implementation for Atari pong.
PyTorch implementations of MADDPG, MAPPO (coming)
PyTorch implementations of popular off-policy multi-agent reinforcement learning algorithms, including QMix, VDN, MADDPG, and MATD3.
OpenUI5 lets you build enterprise-ready web applications, responsive to all devices, running on almost any browser of your choice.
A single CLAUDE.md file to improve Claude Code behavior, derived from Andrej Karpathy's observations on LLM coding pitfalls.
OpenViking is an open-source context database designed specifically for AI Agents(such as openclaw). OpenViking unifies the management of context (memory, resources, and skills) that Agents need th…
Zotero MCP: Connects your Zotero research library with Claude and other AI assistants via the Model Context Protocol to discuss papers, get summaries, analyze citations, and more.
Context7 Platform -- Up-to-date code documentation for LLMs and AI code editors
🔥 Datasets and env wrappers for offline safe reinforcement learning
Prioritized Experience Replay (PER) implementation in PyTorch
Lua/Torch implementation of DQN (Nature, 2015)
[ICRA 2023] Adaptive and Explainable Deployment of Navigation Skills via Hierarchical Deep Reinforcement Learning
A research-validated stethoscope whose plans are available Freely and openly. The cost of the entire stethoscope is between $2.5 to $5 to produce
Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.
📚 Freely available programming books
A rewrite of the old legacy software "depends.exe" in C# for Windows devs to troubleshoot dll load dependencies issues.
ASP.NET Core is a cross-platform .NET framework for building modern cloud-based web applications on Windows, Mac, or Linux.
Aspire is the tool for code-first, extensible, observable dev and deploy.
The OpenTelemetry .NET Client
Develop Desktop, Embedded, Mobile and WebAssembly apps with C# and XAML. The future of .NET UI
Simple A3C implementation with pytorch + multiprocessing
Use Codex from Claude Code to review code or delegate tasks.
An OpenaAIGym-based framework allowing to test hybrid approaches (RL + path planning) for multi-UAV systems that are supposed to provide smart services.