LLM inference in C/C++

Port of OpenAI's Whisper model in C/C++

Cross-platform, customizable ML solutions for live and streaming media.

Fast C++ logging library.

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Haptic input knob with software-defined endstops and virtual detents

❤️中国科学技术大学课程资源

Tensor library for machine learning

A toolkit for making real world machine learning and data analysis applications in C++

FlashMLA: Efficient Multi-head Latent Attention Kernels

Turi Create simplifies the development of custom machine learning models.

RenderDoc is a stand-alone graphics debugging tool.

High-speed Large Language Model Serving for Local Deployment

机器人视觉 移动机器人 VS-SLAM ORB-SLAM2 深度学习目标检测 yolov3 行为检测 opencv PCL 机器学习 无人驾驶

Easy to use device for connecting "old" measuring units (water, power, gas, ...) to the digital world

Qt编写的一些开源的demo，预计会有100多个，一直持续更新完善，代码简洁易懂注释详细，每个都是独立项目，非常适合初学者，代码随意传播使用，拒绝打赏和捐赠，欢迎留言评论！公众号：Qt实战/Qt入门和进阶/Qt教程

Open-source telemetry dashboard. Supports UART, BLE, MQTT, Modbus, CAN Bus and more.

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

An open source quadruped robot pet framework for developing Boston Dynamics-style four-legged robots that are perfect for STEM, coding & robotics education, IoT robotics applications, AI-enhanced r…

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its…

C++ Design Patterns

Tengine is a lite, high performance, modular inference engine for embedded device

🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉

Simplify your onnx model

Webots Robot Simulator

Motion, a software motion detector. Home page: https://motion-project.github.io/

Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU

C++ library for audio and music analysis, description and synthesis, including Python bindings

Tools for synching and streaming files from Windows to Linux