A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Streamline your web application's authentication with Polis, an SSO service supporting SAML and OpenID Connect protocols. Beyond enterprise-grade Single Sign-On, it also supports Directory Sync via…

PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.

Speed up model training by fixing data loading.

Placeholder for the opensource Grid AI components

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Stockfish NNUE (Chess evaluation) trainer in Pytorch

A Pluggable Terraform Linter

Your PyTorch AI Factory - Flash enables you to easily configure and run complex AI recipes for over 15 tasks across 7 data domains

Machine learning metrics for distributed, scalable PyTorch applications.

Accelerated pose estimation and tracking using semi-supervised learning

Generalization Over Taxonomies

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Prometheus Operator creates/configures/manages Prometheus clusters atop Kubernetes

Statistical Natural Language Processing with Annotated Suffix Trees

Factorization machines in python

Unofficial Python SVN auto-updating mirror

Topic Modelling for Humans

Generates sequences for satsolvers

Abstract Suffix Tree C++ library for Python