Stars
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
TheTom / llama-cpp-turboquant
Forked from ggml-org/llama.cppLLM inference in C/C++
AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI
LLM Wiki is a cross-platform desktop application that turns your documents into an organized, interlinked knowledge base — automatically. Instead of traditional RAG (retrieve-and-answer from scratc…
The definitive list that answers "I want to do X in Python, which tool should I use?"
Gemma open-weight LLM library, from Google DeepMind