Ongoing research training transformer models at scale

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

Optimized primitives for collective multi-GPU communication

A high-throughput and memory-efficient inference and serving engine for LLMs

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Tokamax: A GPU and TPU kernel library.

CUDA Python: Performance meets Productivity

Datasets, Transforms and Models specific to Computer Vision

High-performance system-wide BPF-based workload tracer with Perfetto-backed trace visualization.

Lightweight coding agent that runs in your terminal

视觉小说翻译器 / Visual Novel Translator

Git Source Code Mirror - This is a publish-only repository but pull requests can be turned into patches to the mailing list via GitGitGadget (https://gitgitgadget.github.io/). Please follow Documen…

Repository hosting code for "Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations" (https://arxiv.org/abs/2402.17152).

CUDA GDB

Development repository for the Triton language and compiler

Tool to work with Signal Backup files.

A PyTorch native platform for training generative AI models

Fast and memory-efficient exact attention

DeepEP: an efficient expert-parallel communication library

NeMo: a toolkit for conversational AI

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.

This is now the official location of the Kaldi project.

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.

Moved to https://github.com/k2-fsa/icefall

FSA/FST algorithms, differentiable, with PyTorch compatibility.

Seamless operability between C++11 and Python