Stars
Official code and resources for the paper "EXIT: Context-Aware Extractive Compression for Enhancing Retrieval-Augmented Generation."
Squeeze verbose LLM agent tool output down to only the relevant lines
Learn rule-based models from examples using LLM-powered synthesis. Replace expensive LLM calls with fast, deterministic, inspectable regex, code, or spaCy rules.
Unified Schema-Based Information Extraction
Lightweight coding agent that runs in your terminal
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.5, GPT-OSS, Llama, and more!
Superlinked is a Python framework for AI Engineers building high-performance search & recommendation applications that combine structured and unstructured data.
UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection
Hallucination-prevention RAG system with verbatim span extraction. Ensures all generated content is grounded in source documents with exact citations.
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
High-performance retrieval engine for unstructured data
Python tool for converting files and office documents to Markdown.
MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension and question answering
Natural Questions (NQ) contains real user questions issued to Google search, and answers found from Wikipedia by annotators. NQ is designed for the training and evaluation of automatic question ans…
Lightweight hallucination detection framework for RAG applications
RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
A collection of modern/faster/saner alternatives to common unix commands.
Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
AirLLM 70B inference with single 4GB GPU
The Startup CTO's Handbook, a book covering leadership, management and technical topics for leaders of software engineering teams
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Reverse Instructions to generate instruction tuning data with corpus examples
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.