Private AI meeting notes. Free and open source.

llama.cpp provider for DeepSeek Harness

Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.

A multi-framework neural network compiler lowering PyTorch, JAX, Flax, and Keras models to portable, high-performance GGML execution

DeepSeek Harness: Everything is a Plugin.

A nice agent harness that runs within Neovim

ggml speech-to-text inference for 16+ model families

Standalone C++/GGML runtime for ThinkSound text->sound-effect generation

Port of Nvidia LocateAnything-3B on ggml

Vim-fork focused on extensibility and usability

github action to speedup building using ccache

Visualizer for neural network, deep learning and machine learning models

Fast state-of-the-art image and video segmentation in portable C/C++

Mount Hugging Face Buckets and repos as local filesystems. No download, no copy, no waiting.

Portable C++17 implementation of ACE-Step 1.5 AI Music Generator using GGML. Text + lyrics in, stereo 48kHz MP3 or WAV out. Runs on CPU, CUDA, ROCm, Metal, Vulkan.

A C++17 single-file header-only wrapper for llama.cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

A free, open source, and extensible speech-to-text application that works completely offline.

A cosy home for your LLMs.

Audio playback and capture library written in C, in a single source file.

Local LLM-assisted text completion for Qt Creator.

Simple GUI around whisper.cpp for voice-to-text on Linux

Local LLM-assisted code / text completion for Qt Creator.

MLPerf Client is a benchmark for Windows, Linux and macOS, focusing on client form factors in ML inference scenarios.

Emacs package for LLM-assisted code/text completion

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

The application performs real-time inference on audio from an ALSA capture device

TTS support with GGML