Hypercorn is an ASGI and WSGI Server based on Hyper libraries and inspired by Gunicorn.

NO LONGER MAINTAINED - A Flask extension for creating simple ReSTful JSON APIs from SQLAlchemy models.

Ring attention implementation with flash attention

PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.

Various information query via command line.

A Quirky Assortment of CuTe Kernels

Implementation of MagViT2 Tokenizer in Pytorch

XVERSE-13B: A multilingual large language model developed by XVERSE Technology Inc.

Simple way to handle fat files without committing them to git, supports synchronization using rsync

[ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters

A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training

Extreme Learning Machine implementation in Python

Unofficial Python SDK for OpenAI's ChatGPT

GLake: optimizing GPU memory management and IO transmission.

Linux CLI tool providing real-time system resource monitoring

A library to analyze PyTorch traces.

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

Neural network toolkit for Python

OSLO: Open Source framework for Large-scale model Optimization

A Python Library for Simple Models and Containers Persisted in Redis

A declarative drawing API in Python

Implementation of a Transformer, but completely in Triton

Colors aren't that scary!

A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind.

Customizable Naming Convention Checker - uses Clang, developed with C++ in mind

Pool for asyncio with multiprocessing, threading and gevent -like interface

Creates Wheel based archives to allow portable offline installation of Python packages and their dependencies

A library that modifies python source code to conform to pep8.

Stochastic gradient routines for Theano