Stars
Run the full 2.78-trillion-parameter Kimi K3 model beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.
Awesome list for AI agent harness engineering: tools, patterns, evals, memory, MCP, permissions, observability, and orchestration.
OGO (OpenShell Gateway Operator): Deploy and manage NVIDIA OpenShell Gateway instances on OpenShift
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
Skills for Real Engineers. Straight from my .agents directory.
An agentic skills framework & software development methodology that works.
Efficient, lightweight and reliable distributed computation engine
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Create stunning demos for free. Open-source, no subscriptions, no watermarks, and free for commercial use. An alternative to Screen Studio.
🔧 pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fas…
macOS menu bar app that tells you, in plain English, what each USB-C cable plugged into your Mac can actually do
A harness optimized to smaller LLMs
Inspektor Gadget is a set of tools and framework for data collection and system inspection on Kubernetes clusters and Linux hosts using eBPF
AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI
🙌 OpenHands: AI-Driven Development
An enhanced web terminal for OpenShift