LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.