cuTile is a programming model for writing parallel kernels for NVIDIA GPUs

Mimir - Fully open and customizable memory bank with semantic vector search capabilities for locally indexed files (Code Intelligence) and stored memories that are shared across sessions and chat c…

Course Materials for Interpretability of Large Language Models (0368.4264) at Tel Aviv University

An open-source authorization as a service inspired by Google Zanzibar, designed to build and manage fine-grained and scalable authorization systems for any application.

Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.

Visual Studio Code

Optimize prompts, code, and more with AI-powered Reflective Text Evolution

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of …

A collection of lightweight interpretability scripts to understand how LLMs think

Curated list of datasets and tools for post-training.

Deepnote is a drop-in replacement for Jupyter with an AI-first design, sleek UI, new blocks, and native data integrations. Use Python, R, and SQL locally in your favorite IDE, then scale to Deepnot…

An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models

This tool will help manage tedious tasks in qBittorrent and automate them. Tag, categorize, remove Orphaned data, remove unregistered torrents and much much more.

Kernels & AI inference engine for phones

🎒 Token-Oriented Object Notation – JSON for LLMs at half the token cost

[CVPR 2025] A Comprehensive Benchmark for Document Parsing and Evaluation

Framework agnostic sliced/tiled inference + interactive ui + error analysis plots

A pytorch quantization backend for optimum

⚡ Lingo.dev - open-source, AI-powered i18n toolkit for instant localization with LLMs. Bring your own LLM or use Lingo.dev Translation Engine. Join discord: