Stars
real time face swap and one-click video deepfake with only a single image
A Datacenter Scale Distributed Inference Serving Framework
A retargetable MLIR-based machine learning compiler and runtime toolkit.
Tools for easier OpenVINO development/debugging
Sky-T1: Train your own O1 preview model within $450
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filli…
State-of-the-Art Text Embeddings
Build resilient language agents as graphs.
Fast Matrix Multiplications for Lookup Table-Quantized LLMs
[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"
Vane is an AI-powered answering engine.
The open source repository for Electricity Maps data parsers that powers the world's most comprehensive electricity data platform
first base model for full-duplex conversational audio
o1-engineer is a command-line tool designed to assist developers in managing and interacting with their projects efficiently. Leveraging the power of OpenAI's API, this tool provides functionalitie…
GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
Fast and memory-efficient exact attention
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for…
AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
RayLLM - LLMs on Ray (Archived). Read README for more info.
Convmelspec: Convertible Melspectrograms via 1D Convolutions