model-inference

Here are 12 public repositories matching this topic...

bentoml / OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving llm-inference open-source-llm llama2 openllm llm-ops llama3-1 llama3-2 llama3-2-vision

Updated Dec 15, 2025
Python

EmbeddedLLM / embeddedllm

Star

EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

windows cpu llama gemma mistral directx-12 openvino npu openvino-inference-engine aipc directml llm model-inference llm-serving llm-inference open-source-llm phi-3 ipexllm

Updated Oct 6, 2024
Python

DAVIDNYARKO123 / edge-tpu-silva

Star

Streamlining the process for seamless execution of PyCoral in running TensorFlow Lite models on an Edge TPU USB.

raspberry-pi machine-learning fps object-detection edge-computing raspberry-pi-4 coral-tpu pycoral model-inference

Updated Apr 12, 2024
Python

debajitadhikary / EmoVision

Star

😊📸 Real-Time Facial Emotion Recognition using Deep Learning 🤖🧠

git opencv machine-learning real-time ai computer-vision deep-learning tensorflow cnn nvidia neural-networks gpu-computing cudnn facial-expression-recognition emotion-detection emotion-recognition haarcascade model-inference

Updated Apr 22, 2025
Python

itancio / churn

Star

machine-learning python3 streamlit model-inference

Updated Oct 30, 2024
Python

kwame-mintah / gcp-cloud-run-function-model-inference

Star

A cloud run function to invoke a prediction against a machine learning model that has been trained outside of a cloud provider.

gcp google-cloud-platform cloud-functions fastapi model-inference

Updated Jan 19, 2025
Python

RapidVision is a real-time object detection tool powered by the PP-YOLOE deep learning model and the COCO object class dataset. It supports switching between multiple video sources and is built for responsive, flexible object recognition.

opencv real-time computer-vision deep-learning python3 pytorch video-processing neural-networks object-detection pyqt ppyoloe pp-yoloe model-inference

Updated Sep 29, 2025
Python

sharma93manvi / Edit-Generation-Model

Star

EGM is a deep learning tool that learns your image editing style from raw/edited pairs and applies it to new images. It uses a Pix2Pix (conditional GAN) architecture.

machine-learning computer-vision deep-learning pytorch image-editing gan style-transfer neural-networks image-generation photo-editing pix2pix image-to-image conditional-gan ml-model gpu-training model-inference dataset-processing

Updated Nov 21, 2025
Python

Keval10github / Vehicle-Detection

Star

This vehicle identification project utilizes the YOLOv5 deep learning model for detecting and classifying vehicles from images, videos, and live streams. It supports real-time inference, saving outputs with bounding boxes, confidence scores, and class labels, making it ideal for traffic monitoring and smart surveillance systems.