Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

This repo contains the source code in my personal column (https://zhuanlan.zhihu.com/zhaoyeyu), implemented using Python 3.6. Including Natural Language Processing and Computer Vision projects, suc…

End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow