Lists (3)
Stars
AgentENV (AENV) is a distributed platform for running agent environments at scale.
From-scratch, heavily-annotated CUDA inference runtime for Qwen2.5-Coder-7B on H100 (sm_90). Custom INT4 packer, fused GEMV, paged KV, split-KV attention, CUDA graph decode — every hot path comment…
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
An Open Component Model Based AI Model Server
Declaratively deploy your Kubernetes manifests, Kustomize configs, and Charts as Helm releases. Generate all-in-one manifests for use with ArgoCD.
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthr…
SGLang is a high-performance serving framework for large language models and multimodal models.
Talos Linux is a modern Linux distribution built for Kubernetes.
All parts of Claude Code's system prompt, 27 builtin tool descriptions, sub agent prompts (Plan/Explore/Task), utility prompts (CLAUDE.md, compact, statusline, magic docs, WebFetch, Bash cmd, secur…
Backstage is an open framework for building developer portals
A lightweight alternative to OpenClaw that runs in containers for security. Connects to WhatsApp, Telegram, Slack, Discord, Gmail and other messaging apps,, has memory, scheduled jobs, and runs dir…
An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare…
Beads - A memory upgrade for your coding agent
Gateway API Inference Extension
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
CloudBot - The simple, fast, expandable, open-source Python IRC Bot!
Optimized primitives for collective multi-GPU communication
Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling
NVSentinel is a cross-platform fault remediation service designed to rapidly remediate runtime node-level issues in GPU-accelerated computing environments
NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.