AI
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.
The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
A Python package that makes it easy for developers to create AI apps powered by various AI providers.
Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Run PyTorch LLMs locally on servers, desktop and mobile
High-performance In-browser LLM Inference Engine
GenAI Agent Framework, the Pydantic way
ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.
The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai
Delivery infrastructure for agents. Arch is a models-native proxy and data plane for agents that handles plumbing work in AI - like agent routing and orchestration, guardrails, zero-code logs and t…
The SOTA Open-Source Browser Agent for autonomously performing complex tasks on the web
open-source framework for creating and managing simulations populated with AI-powered agents. It provides an intuitive platform for designing complex, interactive environments where agents can act,…
Composio equips your AI agents & LLMs with 100+ high-quality integrations via function calling
The Open Source Memory Layer For Autonomous Agents
A lightweight framework for building LLM-based agents
Easiest and laziest way for building multi-agent LLMs applications.
Building a Software Dev Team. Experimental Project to orchestrate a team of agents to solve programming tasks.
The fastest way to build robust AI agents
RAG that intelligently adapts to your use case, data, and queries
⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)