Hi @sorasoras, I appreciate the excitement over the new llama.cpp K-bit quants that are slowly rolling in. At the current stage of AutoAWQ, I cannot take on these large things on my own. Although I wish I had the time (and compute+$), I do not. So the priority is to make AutoAWQ smooth to work with and to provide quantization of newer models as they come out.

Closing this for now as it's not a planned update. However, I am open for all PRs that can use importance matrices to improve AWQ!