Stars
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…
Development repository for the Triton language and compiler
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
Voice activity detector (VAD) for the browser with a simple API
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
AI agents running research on single-GPU nanochat training automatically
Ghostty-based macOS terminal with vertical tabs and notifications for AI coding agents
The missing DevTools for Claude Code — inspect session logs, tool calls, token usage, subagents, and context window in a visual UI. Free, open source.
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
ClickHouse® is a real-time analytics database management system
A tool for exploring each layer in a docker image
The hub for EleutherAI's work on interpretability and learning dynamics
Nvim Treesitter configurations and abstraction layer
open-source framework for creating and managing simulations populated with AI-powered agents. It provides an intuitive platform for designing complex, interactive environments where agents can act,…
Simple, unified interface to multiple Generative AI providers
A modern commutative diagram editor for the web.
Distribute and run LLMs with a single file.
Build forms in React, without the tears 😭
Simple reimplementation of the diamond types sequence CRDT in simple, pure, unoptimized typescript.
Bare metal to production ready in mins; your own fly server on your VPS.