Algorithm powering the For You feed on X

A high-throughput and memory-efficient inference and serving engine for LLMs

Fast and memory-efficient exact attention

DeepEP: an efficient expert-parallel communication library

Efficient Triton Kernels for LLM Training

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer

XAttention: Block Sparse Attention with Antidiagonal Scoring

SpargeAttention: A training-free sparse attention that can accelerate any model inference.

SGLang is a fast serving framework for large language models and vision language models.

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge ba…

A Benchmark Tool for VectorDB

🦜🔗 Build context-aware reasoning applications

AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

DSPy: The framework for programming—not prompting—language models

TuGraph is a high performance graph database.

The Memory layer for your AI apps

Mirror of the official PostgreSQL GIT repository. Note that this is just a *mirror* - we don't work with pull requests on github. To contribute, please see https://wiki.postgresql.org/wiki/Submitti…

System for AI Education Resource.

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

LLM inference in C/C++

LlamaIndex is a data framework for your LLM applications

统计照片的拍摄焦距