An Open Source Machine Learning Framework for Everyone

LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Tesseract Open Source OCR Engine (main repository)

Port of OpenAI's Whisper model in C/C++

A library for efficient similarity search and clustering of dense vectors.

Distribute and run LLMs with a single file.

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

A flexible, high-performance serving system for machine learning models

an efficient feature complete C++ bittorrent implementation

😎🏖️🐬 Your new, 𝙧𝙞𝙙𝙤𝙣𝙠𝙪𝙡𝙞𝙘𝙞𝙤𝙪𝙨𝙡𝙮 smart clipboard manager

Fast inference engine for Transformer models

Self-hosted crypto trading bot (automated high frequency market making) written in C++

AdaptixC2 is a highly modular advanced redteam toolkit

Deep Learning API and Server in C++14 support for PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

RISC Zero is a zero-knowledge verifiable general computing platform based on zk-STARKs and the RISC-V microarchitecture.

C++ library for zkSNARKs

SCUDA is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

A minimalistic and high-performance SAT solver

A lightweight header-only library for using Keras (TensorFlow) models in C++.

Odin 2 Synthesizer Plugin

A hardware acceleration library for compute intensive cryptography 🧊

Neural Network TensorFlow C API

An implementation of Wave Function Collapse with a focus on performance.

A stand-alone implementation of several NumPy dtype extensions used in machine learning.

Zero-Knowledge Proof Systems Circuit Compiler

A slimline C++ class for parsing command-line arguments, with an interface similar to python's class of the same name

Python bindings for llama.cpp

WebGPU LLM inference tuned by hand