#

nf4

Here are 5 public repositories matching this topic...

EricRollei / Comfy_HunyuanImage3

Nodes to run Hunyuan Image 3 locally with BF16 and NF4 quantized options in Comfyui

Updated Apr 25, 2026
Python

rubi-du / ComfyUI-Flux-Inpainting

This repository wraps the flux fill model as ComfyUI nodes. Compared to the flux fill dev model, these nodes can use the flux fill model to perform inpainting and outpainting work under lower VRM conditions

flux inpainting inpaint outpaint outpainting nf4 flux-dev flux-fill

Updated May 14, 2025
Python

edcalderin / huggingface-ragflow

This project implements a classic Retrieval-Augmented Generation (RAG) system using HuggingFace models with quantization techniques. The system processes PDF documents, extracts their content, and enables interactive question-answering through a Streamlit web application.

python cuda text-generation quantization ruff rag huggingface streamlit qdrant large-language-models llm langchain bitsandbytes retrieval-augmented-generation nf4 huggingface-embeddings langchain-community

Updated Jul 18, 2025
Python

davidibarzabal / neuralzip

AI model compression benchmarks — NF4 beats INT8 in every metric

nlp machine-learning transformers pytorch quantization model-compression llm llm-inference bitsandbytes nf4

Updated Feb 21, 2026
Python

skyoo2003 / bit-axon

Hybrid sLLM Engine for Linear, Sparse, and Quantized Architectures.

python macos lora slm quantization language-model mlx mixture-of-experts on-device-ai apple-silicon llm qlora nf4

Updated Apr 20, 2026
Python

Improve this page

Add a description, image, and links to the nf4 topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the nf4 topic, visit your repo's landing page and select "manage topics."