Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Attempt to summarize text from `stdin`, using a large language model (locally and offline), to `stdout`

Your friendly local LLM terminal companion

A high-level Rust interface for language models powered by the Candle ML framework. It provides ergonomic and efficient APIs for intuitive language model interactions.

Experiments running offline LLMs in Python and Rust locally using Ollama and llama.cpp

ChatLogger is a Python package written in RUST for managing chat conversations with support for branching dialogue, user management, and integration with language models.

A terminal shell built with AI at the core