LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

A library for efficient similarity search and clustering of dense vectors.

DuckDB is an analytical in-process SQL database management system

Caffe: a fast open framework for deep learning.

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

A modern, C++-native, test framework for unit-tests, TDD and BDD - using C++14, C++17 and later (C++11 support is in v2.x branch, and C++03 on the Catch1.x branch)

Simple, secure & standards compliant web server for the most demanding of applications

Seamless operability between C++11 and Python

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

Code. Music. Live.

Unsupervised text tokenizer for Neural Network-based text generation.

A fast, local neural text to speech system

FUSE-based file system backed by Amazon S3

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activelo…

Facebook AI Research's Automatic Speech Recognition Toolkit

header only, dependency-free deep learning framework in C++14

A C++ standalone library for machine learning

[ARCHIVED] The C++ parallel algorithms library. See https://github.com/NVIDIA/cccl

CLI11 is a command line parser for C++11 and beyond that provides a rich feature set with a simple and intuitive interface.

A Very Low-Bitrate Codec for Speech Compression

KenLM: Faster and Smaller Language Model Queries

🐸STT - The deep learning toolkit for Speech-to-Text. Training and deploying STT models has never been so easy.

C++ Implementation of PyTorch Tutorials for Everyone

library to read/write .npy and .npz files in C/C++

A high-quality speech analysis, manipulation and synthesis system

C library for generating audio fingerprints used by AcoustID

Real-time audio streaming over the network.

Digital Audio Workstation with Python; VST instruments/effects, parameter automation, FAUST, JAX, Warp Markers, and JUCE processors