This repository wraps the flux fill model as ComfyUI nodes. Use NF4 flux fill model, support for inpainting and outpainting image. Compared to the flux fill dev model, these nodes can use the flux fill model to perform inpainting and outpainting work under lower VRM conditions
- Dec 26, 2024: Add
FluxGuffInpaintingnode to support loading gguf models - Dec 11, 2024: Add
FluxSimpleInpainting,FluxTransformerInpainting,FluxVAELoadernodes can be used to split pipelines and comfyui clip and vae loader can be used instead
- Navigate to the node directory,
ComfyUI/custom_nodes/ git clone https://github.com/rubi-du/ComfyUI-Flux-Inpainting.gitcd ComfyUI-Flux-Inpaintingpip install -r requirements.txt- Restart ComfyUI
Directly download the node source code package, unzip it into the custom_nodes directory, and then restart ComfyUI.
Install via ComfyUI-Manager by searching for "ComfyUI-Flux-Inpainting".
- Example workflows are placed in
ComfyUI-Flux-Inpainting/workflow. FluxInpaintingnode workflow: Workflow AddressFluxSimpleInpaintingnode workflow: Workflow AddressFluxTransformerInpaintingnode workflow: Workflow AddressFluxGuffInpaintingnode workflow: Workflow Address
- FluxInpainting
- FluxSimpleInpainting
- FluxTransformerInpainting
- FluxVAELoader
- FluxGuffInpainting
The FluxGuffInpainting node only need to load the guff model and put them into the ComfyUI/models/unet folder and don't need load other submodels from FLUX.1-Fil-dev
vae model download links: https://hf-mirror.com/YarvixPA/FLUX.1-Fill-dev-gguf/tree/main
The FluxTransformerInpainting node only need to load the transformer submodel from the FLUX.1-Fil-dev-nf4 model and don't need load other submodels from FLUX.1-Fil-dev
The FluxVAELoader node need to load the flux fill vae model from the ComfyUI/models/vae directory, so you need to download the model and place it in the ComfyUI/models/vae directory
vae model download links: https://huggingface.co/black-forest-labs/FLUX.1-Fill-dev/tree/main/vae
The node needs to load the transformer and text_decoder_2 submodels from the FLUX.1-Fil-dev-nf4 model and load other submodels from FLUX.1-Fil-dev, so these two models need to be placed in the models folder
Model download links:
FLUX.1-Fil-dev: https://huggingface.co/black-forest-labs/FLUX.1-Fill-dev
FLUX.1-Fil-dev-nf4: https://huggingface.co/sayakpaul/FLUX.1-Fill-dev-nf4
FLUX.1-Fill-dev-gguf: https://hf-mirror.com/YarvixPA/FLUX.1-Fill-dev-gguf/tree/main
The directory structure is as follows:
ComfyUI/models/
└── FLUX.1-Fill-dev
├── vae
└── scheduler
└── text_encoder
└── ...
└── FLUX.1-Fill-dev-nf4
├── transformer
└── text_decoder_2
Usage of inpainting workflow
Workflow Address
Usage of outpainting workflow
Workflow Address
Usage of FluxSimpleInpainting workflow
Workflow Address
Usage of FluxTransformerInpainting workflow
Workflow Address
Usage of FluxGuffInpainting workflow
Workflow Address