Silero VAD: pre-trained enterprise-grade Voice Activity Detector

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

YoloDotNet - A C# .NET 8.0 project for Classification, Object Detection, OBB Detection, Segmentation and Pose Estimation in both images and live video streams.

🚀 A high performance real-time object detection solution using YOLO11 ⚡️ powered by ONNX-Runtime

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

Full face stack that runs entirely in the browser. Detection, 576-point 3D mesh, recognition, anti-spoof, smile — all WebAssembly, zero server. Apache 2.0.

Edge Inference in Browser with Transformer NLP model

Build apps powered by on-device AI

Face recognition and analytics library based on deep neural networks and ONNX runtime

The Triton backend for the ONNX Runtime.

The Next-Gen Database for AI—an infrastructure designed for data and AI. As the MySQL of the AI era.

Distribute and run transformer encoders with a single file.

On-device speech SDK for Android — ASR, TTS, VAD, and noise cancellation powered by ONNX Runtime with Qualcomm NNAPI acceleration

Speaker diarization in Rust. 312–912x realtime on Apple Silicon, 50–121x on CUDA. Matches pyannote accuracy.

A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.

C++ implementations of YOLOv8/YOLO26, RT-DETR-V2(RTDETR), MobileSAM, and NanoSAM on TensorRT, ONNX Runtime, and RKNN.

基于Real-ESRGAN的图片AI超分辨率安卓APP

Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.