Lists (1)
Stars
Hack OpenAI LLMs' System Prompts By Reverse Prompt Engineering
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
LangGPT: Empowering everyone to become a prompt expert! 🚀 📌 结构化提示词（Structured Prompt）提出者 📌 元提示词（Meta-Prompt）发起者 📌 最流行的提示词落地范式 | Language of GPT The pioneering framework for structured & meta-prompt…
Awesome LLM compression research papers and tools.
Chatbot Ollama is an open source chat UI for Ollama.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
EMNLP'23 survey: a curation of awesome papers and resources on refreshing large language models (LLMs) without expensive retraining.
State-of-the-Art Text Embeddings
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
[COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild
Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc.…
Open Source AI Platform - AI Chat with advanced features that works with every LLM
LangChain 的中文入门教程
Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and…
✨✨Latest Advances on Multimodal Large Language Models
[EMNLP 2023] Lion: Adversarial Distillation of Proprietary Large Language Models
Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration
A PyTorch-based knowledge distillation toolkit for natural language processing
Example models using DeepSpeed
LLM Zoo collects information of various open- and close-sourced LLMs