Run LLM inference in an Android app with llama.cpp, ExecuTorch, LiteRT, ONNX, and more.
-
Updated
Nov 12, 2025 - Kotlin
#
onnx-runtime
Here are 70 public repositories matching this topic...
An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
plugin computer-vision mac-osx image-segmentation obs obs-studio video-segmentation onnx obs-studio-plugin obs-plugin background-segmentation onnxruntime onnx-runtime obsproject libobs onnxruntime-gpu
-
Updated
Nov 11, 2025 - C++
Real-time SAM2 segmentation on edge devices - 40x faster C++ inference with ONNX Runtime for iOS/Android deployment
computer-vision tensorrt embedded-ai edge-ai edge-deployment onnx-runtime cpp-inference zero-shot-segmentation ios-deployment sam2 arm-optimization lightweight-ai on-device-inference edgetam real-time-segmentation npu-acceleration mobile-segmentation picosam android-edge prompt-segmentation
-
Updated
Nov 10, 2025 - C++
Silero VAD: pre-trained enterprise-grade Voice Activity Detector
voice-commands speech pytorch voice-recognition vad voice-control speech-processing voice-detection voice-activity-detection onnx onnxruntime onnx-runtime
-
Updated
Nov 10, 2025 - Python
The Triton backend for the ONNX Runtime.
-
Updated
Nov 9, 2025 - C++
A Rust runtime for YOLOv8 and YOLOv10 object detection using ONNX Runtime
-
Updated
Nov 9, 2025 - Rust
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
python rust machine-learning information-retrieval server high-performance production inference indexing rust-lang ingestion hybrid embedding-models rag vector-search onnxruntime vector-database onnx-runtime large-language-models vision-language-model
-
Updated
Nov 8, 2025 - Rust
YoloDotNet - A C# .NET 8.0 project for Classification, Object Detection, OBB Detection, Segmentation and Pose Estimation in both images and live video streams.
video computer-vision detection cuda video-processing yolo image-classification segmentation object-detection obb tensorrt onnx onnx-runtime yolov8 yoloe yolo-world yolov9 yolov10 yolov11 yolov12
-
Updated
Nov 1, 2025 - C#
Offline STT & VAD Service (Rust, Tonic) (Q1:2025)
audio rust grpc speech-to-text tonic transcribe voice-activity-detection transcriber vosk onnx-runtime silero
-
Updated
Nov 1, 2025 - Rust
The Next-Gen Database for AI—an infrastructure designed for data and AI. As the MySQL of the AI era.
mysql multi-model htap rag embedding-vectors onnx-runtime ai-native vectorized-execution-engine ml-embeded in-memory-column-storage open-source-mysql-heatwave
-
Updated
Nov 13, 2025 - C++
🚀 A high performance real-time object detection solution using YOLO11 ⚡️ powered by ONNX-Runtime
csharp dotnet yolo image-classification object-detection pose-estimation obb instance-segmentation imagesharp oriented-object-detection onnx-runtime ultralytics yolov8 yolov10 yolo11 yolov12
-
Updated
Nov 10, 2025 - C#
Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.
pytorch image-classification image-segmentation vgg16 unet resnet-50 tensorrt pytorch-cnn deeplab-v3-plus tensorrt-conversion onnx-runtime tensorrt-inference tensorrt-engine
-
Updated
Oct 21, 2025 - Python
Developed for Temasek Polytechnic, an AI-Driven Telegram Bot that automates Image Processing Tasks for Scavenger Hunts
opencv aws machine-learning csharp python3 asp-net-core telegrambot openai-api onnx-runtime large-language-models
-
Updated
Oct 21, 2025 - C#
Enterprise-unique blazing-fast & precise C# .NET 9.0 library for background removal in C# using ONNX Runtime with DirectML. FP32 and FP16 versions! Always open for PRs.
csharp dotnet image-processing image-editing onnx background-removal remove-background onnxruntime remove-background-image onnx-runtime background-remover rmbg
-
Updated
Oct 4, 2025 - C#
Face recognition and analytics library based on deep neural networks and ONNX runtime
deep-neural-networks cpu recognition dotnet gpu detection estimation embeddings face classification face-recognition face-detection landmarks onnx antispoofing onnx-runtime face-analytics-library face-onnx faceonnx
-
Updated
Sep 28, 2025 - C#
My personal website.
-
Updated
Sep 20, 2025 - CSS
Run large language models like Qwen and LLaMA locally on Android for offline, private, real-time question answering and chat - powered by ONNX Runtime.
android chatbot android-app on-device-ai mobile-ai onnx-runtime huggingface-tokenizers local-llm qwen llama3 local-llm-integration offline-inference
-
Updated
Sep 9, 2025 - Kotlin
Real-time computer vision for embedded Rust with OpenCV and YOLOv8 built with resource-constrained devices such as the Raspberry Pi Zero 2W in mind.
rust opencv embedded computer-vision robotics inference pathfinding neural-networks ffi-bindings onnx onnx-runtime opencv-rust raspberry-pi-zero-2-w yolov8
-
Updated
Sep 3, 2025 - Makefile
High-performance C++17 engine for real-time, stateful log anomaly detection. Uses a multi-tiered system combining heuristics, statistical Z-scores, and ONNX machine learning to find threats. Features flexible alerting (JSON, Syslog, HTTP) and live configuration reloading for operational maturity.
security machine-learning cmake log-analysis cpp makefile cybersecurity vcpkg ids cpp17 intrusion-detection-system onnx onnx-runtime anomay-detection security-moni
-
Updated
Sep 2, 2025 - C++
Inspired by checkout line assignments, this project simulates advanced load balancing in cloud systems, using reinforcement learning to assign jobs with uncertain workloads across servers.
docker reinforcement-learning load-balancer cloud-computing gym-environment onnx onnx-runtime stable-baselines3
-
Updated
Sep 1, 2025 - Python
Improve this page
Add a description, image, and links to the onnx-runtime topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the onnx-runtime topic, visit your repo's landing page and select "manage topics."