LLM
Universal LLM Deployment Engine with ML Compilation
🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…
A framework to enable multimodal models to operate a computer.
A collection of GPT system prompts and various prompt injection/leaking knowledge.
Distribute and run LLMs with a single file.
AI agent using GPT-4V(ision) capable of using a mouse/keyboard to interact with web UI
High-speed Large Language Model Serving for Local Deployment
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports Open…
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
A benchmark to evaluate language models on questions I've previously asked them to solve.
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
Open-source search and retrieval database for AI applications.
Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
Open source AI coding agent. Designed for large projects and real world tasks.
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous …
《动手学大模型Dive into LLMs》系列编程实践教程