LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

🔍 A Hex Editor for Reverse Engineers, Programmers and people who value their retinas when working at 3 AM.

Port of OpenAI's Whisper model in C/C++

A library for efficient similarity search and clustering of dense vectors.

Self-hosted game stream host for Moonlight.

Cross-platform, customizable ML solutions for live and streaming media.

Carbon Language's main repository: documents, design, implementation, and related tools. (NOTE: Carbon Language is experimental; see README)

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

MLX: An array framework for Apple silicon

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Valdi is a cross-platform UI framework that delivers native performance without sacrificing developer velocity.

mold: A Modern Linker 🦠

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

Tensor library for machine learning

Tiny cross-platform webview library for C/C++. Uses WebKit (GTK/Cocoa) and Edge WebView2 (Windows).

Google's Operations Research tools:

FlashMLA: Efficient Multi-head Latent Attention Kernels

The Z3 Theorem Prover

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

ZeroMQ core engine in C++, implements ZMTP/3.1

A fast, local neural text to speech system

A suite of WiFi/Bluetooth offensive and defensive tools for the ESP32

cuDF - GPU DataFrame Library

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Multipass orchestrates virtual Ubuntu instances

ESP8266 WiFi Connection manager with web captive portal

Facebook AI Research's Automatic Speech Recognition Toolkit

Bloaty: a size profiler for binaries