Community maintained hardware plugin for vLLM on Apple Silicon

Tensors and Dynamic neural networks in Python with strong GPU acceleration

A high-throughput and memory-efficient inference and serving engine for LLMs

Docker Model Runner

Ubuntu Bootc experiment with composefs-native backend

LLM inference in C/C++

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

A small self-contained alternative to readline and libedit

a simple wrapper around curl to easily download files

https://docs.openwebui.com

Boot and upgrade via container images

Go library and CLIs for working with container registries

Launch configurable virtual machines with libkrun

An app that brings language models directly to your phone.

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.

A dynamic library providing Virtualization-based process isolation capabilities