LLM inference in C/C++

ClickHouse® is a real-time analytics database management system

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

The Z3 Theorem Prover

Unsupervised text tokenizer for Neural Network-based text generation.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Andr…

ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM

Fit interpretable models. Explain blackbox machine learning.

Facebook AI Research's Automatic Speech Recognition Toolkit

Transformer related optimization, including BERT, GPT

A C++ standalone library for machine learning

PlaidML is a framework for making deep learning work everywhere.

LightSeq: A High Performance Library for Sequence Processing and Generation

CMake Cookbook recipes.

KenLM: Faster and Smaller Language Model Queries

🐸STT - The deep learning toolkit for Speech-to-Text. Training and deploying STT models has never been so easy.

10x faster matrix and vector operations

YOLO ROS: Real-Time Object Detection for ROS

Real-time dense visual SLAM system

Large-scale LLM inference engine

Monocular Visual-Inertial State Estimator on Mobile Phones

CubeSLAM: Monocular 3D Object Detection and SLAM

This is a code repository for pytorch c++ (or libtorch) tutorial.

Codecademy | Learn C++

Speech-to-text server framework with next-gen Kaldi

A lightweight, accurate and robust monocular visual inertial odometry based on Multi-State Constraint Kalman Filter.

a lightweight LLM model inference framework

AI Research Platform for Reinforcement Learning from Real Panoramic Images.