LLM inference in C/C++

Tesseract Open Source OCR Engine (main repository)

C++那些事

A library for efficient similarity search and clustering of dense vectors.

A modern replacement for Redis and Memcached

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning …

Watches files and records, or triggers actions, when they change.

Google's Operations Research tools:

A Multithreaded Fork of Redis

Unsupervised text tokenizer for Neural Network-based text generation.

A microbenchmark support library

RE2 is a fast, safe, thread-friendly alternative to backtracking regular expression engines like those used in PCRE, Perl, and Python. It is a C++ library.

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

High performance server-side application framework

High-speed Large Language Model Serving for Local Deployment

A collection of C++ HTTP libraries including an easy to use HTTP server.

lightweight, standalone C++ inference engine for Google's Gemma models.

oneAPI Threading Building Blocks (oneTBB)

Performance-portable, length-agnostic SIMD with runtime dispatch

Zcash - Internet Money

A large scale non-linear optimization library

An industrial-grade C++ implementation of RAFT consensus algorithm based on brpc, widely used inside Baidu to build highly-available distributed systems.

Modern C++ Cheatsheet

Mcrouter is a memcached protocol router for scaling memcached deployments.

Intel® Performance Counter Monitor (Intel® PCM)

A dbg(…) macro for C++

Tendis is a high-performance distributed storage system fully compatible with the Redis protocol.

Intel® Implicit SPMD Program Compiler

A cross platform C99 library to get cpu features at runtime.