Skip to content
View thekoushik's full-sized avatar
👋
I may be slow to respond.
👋
I may be slow to respond.
7 followers · 6 following

Achievements

Achievement: Pull Sharkx4Achievement: QuickdrawAchievement: YOLOAchievement: Arctic Code Vault Contributor

Achievements

Achievement: Pull Sharkx4Achievement: QuickdrawAchievement: YOLOAchievement: Arctic Code Vault Contributor

Block or report thekoushik

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Stars

1 star written in Python
Clear filter

microsoft / LLMLingua

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Python 6,031 361 Updated Apr 8, 2026