[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Stable Diffusion web UI

A Gradio web UI for Large Language Models with support for multiple inference backends.

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSeek / Qwen), Knowledge Base (file upload / knowledge managemen…

Inference Llama 2 in one file of pure C

Linear algebra package for rust-ndarray using LAPACK binding

Explain complex systems using visuals and simple terms. Help you prepare for system design interviews.

Python bindings for llama.cpp

Stable diffusion for real-time music generation (web app)

The first real AI developer

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Python Library for Robust Decision Making and Exploratory Modelling

Structured Text Generation

Fast and memory-efficient exact attention

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid search in less than 2kb.

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

A Bulletproof Way to Generate Structured JSON from Language Models

A guidance language for controlling large language models.

🦜🔗 Build context-aware reasoning applications

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activelo…

egui: an easy-to-use immediate mode GUI in Rust that runs on both web and native

ChatGPT interface with better UI

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

🔊 Text-prompted Generative Audio Model - With the ability to clone voices

AI tool to build charts based on text input

Data validation using Python type hints