🦜🔗 The platform for reliable agents.

A high-throughput and memory-efficient inference and serving engine for LLMs

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga…

Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Qlib is an AI-oriented Quant investment platform that aims to use AI tech to empower Quant Research, from exploring ideas to implementing productions. Qlib supports diverse ML modeling paradigms, i…

Build resilient language agents as graphs.

Fast and memory-efficient exact attention

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Mamba SSM architecture

Ongoing research training transformer models at scale

"DeepCode: Open Agentic Coding (Paper2Code & Text2Web & Text2Backend)"

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

Large Language Model Text Generation Inference

Perform data science on data that remains in someone else's server

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & TIS & vLLM & Ray & Async RL)

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Flower: A Friendly Federated AI Framework

A unified, comprehensive and efficient recommendation library

Set of tools to assess and improve LLM security.

PyTorch implementation of "Supervised Contrastive Learning" (and SimCLR incidentally)

A unified framework for privacy-preserving data analysis and machine learning

A curated list of community detection research papers with implementations.

Karate Club: An API Oriented Open-source Python Framework for Unsupervised Learning on Graphs (CIKM 2020)

Master Federated Learning in 2 Hours—Run It on Your PC!

Comprehensive and timely academic information on federated learning (papers, frameworks, datasets, tutorials, workshops)

Efficient Retrieval Augmentation and Generation Framework

Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).