A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.