Apache Lucene.NET

MTEB: Massive Text Embedding Benchmark

Study guides for MIT's 15.003 Data Science Tools

📑 PageIndex: Document Index for Reasoning-based RAG

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

User Profile-Based Long-Term Memory for AI Chatbot Applications.

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

A realtime serving engine for Data-Intensive Generative AI Applications

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

Data for the MTEB leaderboard

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

Superlinked is a Python framework for AI Engineers building high-performance search & recommendation applications that combine structured and unstructured data.

Deep Recommenders

My personal note about local and global descriptor

Use late-interaction multi-modal models such as ColPali in just a few lines of code.

Rust library for generating vector embeddings, reranking. Re-write of qdrant/fastembed.

[Pytorch] Generative retrieval model using semantic IDs from "Recommender Systems with Generative Retrieval"

Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy