with a nice GUi

buzzword search with "and" option within distance. Its like an embedder only with plain txt search

Pre-built wheels for llama-cpp-python across platforms and CUDA versions

Python bindings for llama.cpp

Joy Caption is a ComfyUI node using the LLaVA model to generate stylized image captions, supporting batch processing and GGUF models.

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.

The definitive Web UI for local AI, with powerful features and easy setup.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.