[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
-
Updated
Aug 30, 2024 - C++
#
on-device-ai
Here are 11 public repositories matching this topic...
Declarative way to run AI models in React Native on device, powered by ExecuTorch.
ocr computer-vision object-detection speech-to-text on-device-ai llm-inference react-native-ai executorch
-
Updated
Feb 5, 2026 - C++
TinyChatEngine: On-Device LLM Inference Library
c arm deep-learning cpp x86-64 quantization edge-computing cuda-programming on-device-ai large-language-models
-
Updated
Jul 4, 2024 - C++
On-device Neural Engine
-
Updated
Feb 5, 2026 - C++
Simplified AI runtime integration for mobile app development
android ios mobile cplusplus cross-platform neural-network gpu inference coreml tflite qnn npu on-device-ai
-
Updated
Nov 29, 2024 - C++
A curated collection of LLM-powered Flutter apps built using RAG, AI Agents, Multi-Agent Systems, MCP, and Voice Agents.
embeddings chat-application mobile-development front-end-development tensorflow-lite flutter-examples vector-search on-device-ml on-device-ai retrieval-augmented-generation ai-agents-framework llm-agents llm-application gemini-ai rag-application mcp-server mcp-client gemma3n
-
Updated
Dec 1, 2025 - C++
Free AI-powered malware scanner for Linux. Detects evasive threats without signatures. Scans offline, open-source CLI with optional cloud intelligence.
linux security machine-learning ai cybersecurity antivirus threat-hunting security-automation zero-day devsecops threat-intelligence malware-detection malware-scanner endpoint-security on-device-ai clamav-alternative
-
Updated
Dec 9, 2025 - C++
BLOCKSET: Efficient out of core tree ensemble inference
machine-learning aws-lambda random-forest memory-efficient out-of-core tree-ensemble gradient-boosting efficient-inference on-device-ai
-
Updated
Feb 13, 2023 - C++
High-performance On-Device MoA (Mixture of Agents) Engine in C++. Optimized for CPU inference with RadixCache & PagedAttention. (Tiny-MoA Native)
c cpp moa on-device-ai llm llamacpp llama-cpp ggml paged-attention cpu-optimization mixture-of-agents radix-attention
-
Updated
Jan 25, 2026 - C++
DrishtiAI is a cutting-edge Android application that brings multimodal vision-language AI capabilities directly to your mobile device. Built with privacy-first design, it enables on-device processing of text, images, and videos using advanced vision-language models (VLMs) without requiring internet connectivity.
-
Updated
Feb 5, 2026 - C++
Improve this page
Add a description, image, and links to the on-device-ai topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the on-device-ai topic, visit your repo's landing page and select "manage topics."