Starred repositories
1066
results
for source starred repositories
Clear filter
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
Supercharge Your LLM with the Fastest KV Cache Layer
TurboDiffusion: 100–200× Acceleration for Video Diffusion Models
Perplexity open source garden for inference technology
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Official inference repo for FLUX.1 models
An early research stage expert-parallel load balancer for MoE models based on linear programming.
A guidance language for controlling large language models.
Disaggregated serving system for Large Language Models (LLMs).
High performance Transformer implementation in C++.
DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit
MSCCL++: A GPU-driven communication stack for scalable AI applications
A throughput-oriented high-performance serving framework for LLMs
Venus Collective Communication Library, supported by SII and Infrawaves.
一个深挖 Linux 内核的新功能特性，以 io_uring, cgroup, ebpf, llvm 为代表，包含开源项目，代码案例，文章，视频，架构脑图等
Seamless operability between C++11 and Python
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
注释的nano_vllm仓库，并且完成了MiniCPM4的适配以及注册新模型的功能
Qlib is an AI-oriented Quant investment platform that aims to use AI tech to empower Quant Research, from exploring ideas to implementing productions. Qlib supports diverse ML modeling paradigms, i…
ArcticInference: vLLM plugin for high-throughput, low-latency inference
Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels