GPU Engineering for AI Systems

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

A framework for few-shot evaluation of language models.

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Achieve state of the art inference performance with modern accelerators on Kubernetes

A beautiful, Windows 11-style Clipboard History Manager for Linux 💅

Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

Learn LLM internals step by step - from tokenization to attention to inference optimization.

A high-throughput and memory-efficient inference and serving engine for LLMs

🚀 Efficient implementations for emerging model architectures

A game theoretic approach to explain the output of any machine learning model.

An intelligent tuner for vLLM that automatically monitors GPU metrics, uses Bayesian optimization to tune parameters

Provide with pre-build flash-attention 2 and 3 package wheels on Linux and Windows using GitHub Actions

Full toolkit for running an AI agent service built with LangGraph, FastAPI and Streamlit

A developer-friendly API for converting many document formats into PDF files, and more!

PruneMate - Docker image & resource cleanup helper, on a schedule!

An interactive tool that transforms static system design diagrams into explorable, interactive visualizations using AI.

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

"RAG-Anything: All-in-One RAG Framework"

Comprehensive resources on Generative AI, including a detailed roadmap, projects, use cases, interview preparation, and coding preparation.

A flexible universal ASIO driver that uses the PortAudio sound I/O library. Supports WASAPI (shared and exclusive), KS, DirectSound and MME.

The API to search, scrape, and interact with the web at scale. 🔥

Open Data Platform for analysts, quants and AI agents.

Python GUI builder. GUI builder for Tkinter, CustomTkinter, Kivy(upcoming) and PySide

This repository contains the Hugging Face Agents Course.

BillionMail gives you open-source MailServer, NewsLetter, Email Marketing — fully self-hosted, dev-friendly, and free from monthly fees. Join the discord: https://discord.gg/asfXzBUhZr

CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning

🌐 Make websites accessible for AI agents. Automate tasks online with ease.