Stars
Agent 始终无法命中缓存巨浪费Token? 来看 PromptXRay! PromptXRay 是一个代理工具，只需要接入到AI API 调用中间, 就可以分析 OpenAI 兼容API的 Prompt 缓存行为
TokenHub gives enterprises a private gateway to unify AI model access and governance, making every request controllable, traceable, and attributable.
An open-source database of AI models.
🐢 Open-Source Evaluation & Testing library for LLM Agents
Instant, Concurrent, Secure & Lightweight Sandbox for AI Agents.
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
A framework for few-shot evaluation of language models.
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
Next Generation Agentic Proxy for AI Agents and MCP servers
Local-first observability your agent reads back. TMA1 records every LLM call, then routes what it sees into the agent's next turn via hooks and MCP.
Langfuse on GreptimeDB. Self-hosted LLM observability.
ARCHIVE — historical fork metadata for CCSwitchMulti. Active standalone repository: https://github.com/BigStrongSun/ccswitchmulti
📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
🔬 A curated collection of 23,000+ agent skills for empirical research across 8 social science disciplines. | 精选 23,000+ AI Agent 技能库，覆盖8大社会科学学科的实证研究。CoPaper.AI 20分钟完成一篇可复现的规范实证论文，并支持用户上传 Skills。-- …
1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.
NVR with realtime local object detection for IP cameras
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Sub2API 一站式开源中转服务，让 Claude、Openai 、Gemini、Grok订阅统一接入，支持拼车共享，更高效分摊成本，原生工具无缝使用。
Python Computer Vision & Video Analytics Framework With Batteries Included
An agent-managed museum exhibit, built in Rust with Gajae-Code / LazyCodex — developed and maintained with no human intervention.
Sample codes for my CUDA programming book
Several simple examples for popular neural network toolkits calling custom CUDA operators.
LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM API management & k…
A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for p…