A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a fast serving framework for large language models and vision language models.

Nano vLLM

C++ extensions in PyTorch. Attempt to port to ROCm

Open-Sora: Democratizing Efficient Video Production for All

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

$HOME sweet $HOME

Fast and memory-efficient exact attention

Models and examples built with TensorFlow

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Implementation of Hinton's forward-forward (FF) algorithm - an alternative to back-propagation. Moreh fork

VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech. Moreh fork

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows". Moreh fork

PyTorch implementation of convolutional neural networks-based text-to-speech synthesis models. Moreh fork

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377. Moreh fork

Official DeiT repository. Moreh fork

Release for Improved Denoising Diffusion Probabilistic Models. Moreh fork

Implementation of Denoising Diffusion Probabilistic Model in Pytorch. Moreh fork

This is an official implementation for "SimMIM: A Simple Framework for Masked Image Modeling". Moreh fork

A latent text-to-image diffusion model. Moreh fork