Apache Lucene.NET

MTEB: Massive Text Embedding Benchmark

Study guides for MIT's 15.003 Data Science Tools

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

📄🧠 PageIndex: Document Index for Reasoning-based RAG

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

Profile-Based Long-Term Memory for AI Applications. Memobase handles user profiles, memory events, and evolving context — perfect for chatbots, companions, tutors, customer service bots, and all chat-based agents.

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

A realtime serving engine for Data-Intensive Generative AI Applications

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

Deep Recommenders

Superlinked is a Python framework for AI Engineers building high-performance search & recommendation applications that combine structured and unstructured data.

My personal note about local and global descriptor

Use late-interaction multi-modal models such as ColPali in just a few lines of code.

Rust library for generating vector embeddings, reranking. Re-write of qdrant/fastembed.

Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy

Use ArXiv ChatGuru to talk to research papers. This app uses LangChain, OpenAI, Streamlit, and Redis as a vector database/semantic cache.

Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.