LLM inference in C/C++

LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

An open-source C++ library developed and used at Facebook.

C++ Insights - See your source code with the eyes of a compiler

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

Probably the fastest coroutine lib in the world!

现代C++模板教程

any lite - A C++17-like any, a type-safe container for single values of any type for C++98, C++11 and later in a single-file header-only library

用C++实现一个简单的Transformer模型。 Attention Is All You Need。