Tensors and Dynamic neural networks in Python with strong GPU acceleration

AI agents running research on single-GPU nanochat training automatically

Open-Source Frontier Voice AI

Official inference framework for 1-bit LLMs

All the open source AI Agents hosted on the oTTomator Live Agent Studio platform!

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization