This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

[ACL25] FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementation

[ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring

Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718

📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

[NeurIPS'24 Spotlight] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 whil…

Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

SGLang is a fast serving framework for large language models and vision language models. See hip12-offload-add-offload-cache

Automatic differentiation for Triton Kernels

LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding

Official repository for EXAONE 3.5 built by LG AI Research

LOFT: A 1 Million+ Token Long-Context Benchmark

Development repository for the Triton language and compiler

InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)

Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.

AcadHomepage: A Modern and Responsive Academic Personal Homepage

A framework for few-shot evaluation of language models.