#

llama-cpp

Here are 9 public repositories matching this topic...

mdrokz / rust-llama.cpp

LLama.cpp rust bindings

rust machine-learning cpp model ffi crates-io llama api-bindings llama-cpp

Updated Jun 27, 2024
Rust

lucasjinreal / Crane

A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.

rust mllm llama-cpp qwen2-vl spark-tts qwen3

Updated Nov 8, 2025
Rust

dirmacs / ares

A production-grade agentic chatbot server built in Rust with multi-provider LLM support, tool calling, RAG, MCP integration, and advanced research capabilities

rust ai server mcp chatbot openai agents rag llm llamacpp llama-cpp ggml agentic ollama gguf agentic-workflow tool-calling deep-research

Updated Dec 15, 2025
Rust

slb350 / octoroute

Smart HTTP router for local LLMs (Ollama, LM Studio, llama.cpp). Rule-based + LLM-powered routing, health checks, load balancing, Prometheus metrics. Rust-native, zero-overhead.

rust ai prometheus artificial-intelligence homelab llm llama-cpp local-llm ollama lm-studio

Updated Nov 27, 2025
Rust

dirmacs / lancor

A Rust client library for llama.cpp's OpenAI-compatible API server

api rust http client library ai rest-api http-client openai llama restful-api openai-api llm llamacpp llama-cpp ggml gguf

Updated Nov 18, 2025
Rust

vitali2y / docha

Chat with your PDF/Markdown document

rust llama-cpp lancedb

Updated Aug 23, 2025
Rust

nikvoid / cliplm

Ask LLaMa about image in your clipboard

computer-vision llama command-line-tool llava llama-cpp

Updated Mar 9, 2024
Rust

n-engine / devit

Let LLMs code on your repos without breaking stuff — sandboxed execution, atomic patches & full audit trail

git testing rust cli sandbox wasm developer-tools code-generation ai-agents unified-diff ai-agent llama-cpp ollama lm-studio patch-only approval-policy

Updated Oct 25, 2025
Rust

mmogr / gglib

Download, manage, and chat with LLMs, completely private and local.

ai inference self-hosted openai llm llms llama-cpp gguf openweb-ui

Updated Dec 18, 2025
Rust

Improve this page

Add a description, image, and links to the llama-cpp topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llama-cpp topic, visit your repo's landing page and select "manage topics."