PyTorch native quantization for training and inference

🤗 Optimum ExecuTorch

Example apps and demos using PyTorch's ExecuTorch framework

C++ implementations for various tokenizers (sentencepiece, tiktoken etc).

Run PyTorch LLMs locally on servers, desktop and mobile

On-device AI across mobile, embedded and edge for PyTorch