Generation of software test scenarios using a RAG system with a local LLM (llama.cpp)

Qwen2.5-Coder: Family of LLMs excels in code, debugging, etc

Simple Streamlit App to view Exported Conversations from llama.cpp

A website for chatting with AI characters locally or with chat-gpt easily.

Another attempt at an LLM driven voice assitant, but with better transcription and better TTS

CICD Answering-Question Chatbot for RAG (Retrieval-Augmented Generation) using Streamlit

This project hosts the LLaMA 3.1 CPP model on RunPod's serverless platform using Docker. It features a Python 3.11 environment with CUDA 12.2, enabling scalable AI request processing through configurable payload options and GPU support.

Stay focus with ai-warden

For people who would like to involve a script in something that can be done with a command

Run AI models in container

Automatically apply optimal settings to your LLM requests

Hashtags recommendation based on item titles using LLaMA

Examples of how to call the REST api endpoint of the C++ port of LLaMA by ggerganov. Adjust the JSON to your needs

llm-chat - Interactive Chat with LLM

Look Awry is an Text to SQL application with local Ai, ensuring privacy.

A build.zig for llama.cpp

Collection of helpful scripts for working with GGML models

Prebuilt llama-cli binary for Raspberry Pi Zero 2 W

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.