LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Protocol Buffers - Google's data interchange format

Port of OpenAI's Whisper model in C/C++

Cross-platform, customizable ML solutions for live and streaming media.

PlayStation 4 emulator for Windows, Linux and macOS written in C++

Official source code of FreeCAD, a free and opensource multiplatform 3D parametric modeler.

MLX: An array framework for Apple silicon

ncnn is a high-performance neural network inference framework optimized for the mobile platform

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Audio Editor

A machine learning-based video super resolution and frame interpolation framework. Est. Hack the Valley II, 2018.

Bullet Physics SDK: real-time collision detection and multi-physics simulation for VR, games, visual effects, robotics, machine learning etc.

PCSX2 - The Playstation 2 Emulator

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/READ…

FlashMLA: Efficient Multi-head Latent Attention Kernels

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

🎤⌨️ Acoustic keyboard eavesdropping

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Andr…

High-speed Large Language Model Serving for Local Deployment

JUCE is an open-source cross-platform C++ application framework for desktop and mobile applications, including VST, VST3, AU, AUv3, LV2 and AAX audio plug-ins.

🚀 The best real-time interactive AI avatar(digital human) with on-premise deployment and <1.5 s latency.

lightweight, standalone C++ inference engine for Google's Gemma models.

Facebook AI Research's Automatic Speech Recognition Toolkit

🎛 🔊 A Python library for audio.

Adds AMD FSR 3 Frame Generation to games by replacing Nvidia DLSS Frame Generation (nvngx_dlssg).

Diffusion model(SD,Flux,Wan,Qwen Image,...) inference in pure C/C++

高性能并行编程与优化 - 课件

A Very Low-Bitrate Codec for Speech Compression

A lightweight library for portable low-level GPU computation using WebGPU.