This custom_node for ComfyUI adds one-click "Virtual VRAM" for any UNet and CLIP loader as well MultiGPU integration in WanVideoWrapper, managing the offload/Block Swap of layers to DRAM *or* VRAM to maximize the latent space of your card. Also includes nodes for directly loading entire components (UNet, CLIP, VAE) onto the device you choose

A quant trading system platform based on FinGPT, demonstrating new applications of large pre-trained Language Models in quantitative finance.

Discover the Best AI Models for Your PC

Inspect LLM's logprobs and perplexity over a piece of text, or compare two LLMs (like a git diff)

Experimental interface environment for open source LLM, designed to democratize the use of AI. Powered by llama-cpp, llama-cpp-python and Gradio.

Obrew Server: A self-hostable machine learning engine. Build agents and schedule workflows private to you.

On-device AI chat for iOS. Private, offline-first. Runs open-weight LLMs via llama.rn with semantic memory - no cloud, no API keys

Run Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1, and other state-of-the-art language models locally with scorching-fast performance. Inferno provides an intuitive CLI and an OpenAI/Ollama-compatible API, putting the inferno of AI innovation directly in your hands.

Your terminal's AI co-pilot. Describe your intent and get the command.

Create out symbolic links for the GGUF Models in Ollama Blobs. for use in other applications such as Llama.cpp/Jan/LMStudio etc. / 将 Ollama GGUF 模型文件软链接出，以便其他应用使用。

Simple Python Script that converts the Weight of a GGUF Model to a PyTorch Tensor

Convert and quantize llm models

Web UI for orchestrating distributed llama.cpp RPC GPU clusters with auto node discovery, telemetry, and one-click deployment.

RA Local AI – Run GGUF models on your Android phone and chat fully offline.

The fastest, most efficient library for running GGUF models with maximum throughput and zero-config hardware optimization.

Auto GGUF Converter for HuggingFace Hub Models with Multiple Quantizations (GGUF Format)

Zig library and CLI for interacting with the HuggingFace Hub API, with a focus on GGUF model discovery, searching, viewing, and downloading.

A complete, menu-driven AI model interface for Windows that simplifies running local GGUF language models with llama.cpp. This tool automatically manages dependencies, provides multiple interaction modes, and prioritizes user privacy through fully offline operation.

llama.cpp java wrapper using panama ffm

i use llama cpp for build this app enjoy