Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase

The fastest way to create an HTML app

Mobile Shell

LLM inference in C/C++

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

build-once run-anywhere c library

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr…

Structured Outputs

structured outputs for llms

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

Wheels for llama-cpp-python compiled with cuBLAS support

AI chat for any model.

A new bootable USB solution.

LLM plugin for running models using llama.cpp

Access large language models from the command-line

Get up and running with Kimi-K2.5, GLM-4.7, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Chat language model that can use tools and interpret the results

A guidance compatibility layer for llama-cpp-python

A utility to stream (and record) from a Remarkable2 without hack or third party dependencies

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous …

A truly Open Source MongoDB alternative

LLM-based code completion engine

nanobind: tiny and efficient C++/Python bindings

Let's make sand talk

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

QLoRA: Efficient Finetuning of Quantized LLMs

A guidance language for controlling large language models.

Python bindings for the Transformer models implemented in C/C++ using GGML library.