Stars
Introduction to Machine Learning Systems
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, etc.)
Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.
Expose your FastAPI endpoints as Model Context Protocol (MCP) tools, with Auth!
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
A client for the Overmind API providing easy access to AI endpoints with policy enforcement and obvervability.
A high-throughput and memory-efficient inference and serving engine for LLMs
Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
A comprehensive collection of AI development patterns for building software with AI assistance, organized by implementation maturity and development lifecycle phases. Includes Foundation, Developme…
Additional packages (components, document stores and the likes) to extend the capabilities of Haystack
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Structured data extraction and instruction calling with ML, LLM and Vision LLM
Powerful expense tracker that lives in your terminal.
Private & local AI personal knowledge management app for high entropy people.
Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.
AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data…
Self-hosted AI accounting app. LLM analyzer for receipts, invoices, transactions with custom prompts and categories
The official Python SDK for Model Context Protocol servers and clients
Introducing DataKitsune, an open-source Telegram bot designed to enhance the way you manage and retrieve links shared within your personal or group chats. By automatically indexing the content of t…
🌐 Make websites accessible for AI agents. Automate tasks online with ease.