A light, transparent, and modular inference & quantization engine for studying LLMs.
-
Updated
Jun 4, 2026 - Cuda
A light, transparent, and modular inference & quantization engine for studying LLMs.
Add a description, image, and links to the awq topic page so that developers can more easily learn about it.
To associate your repository with the awq topic, visit your repo's landing page and select "manage topics."