Skip to content

zmwv823/ComfyUI_Anytext

Repository files navigation

Look at the node tooltip for instruction.

Unofficial custom_node for repos.

1、AnyText:

For better result, use official demo instead.

Warning: v2.0 edit seems not work well in my repo, need more work.

Option 1: any sd1.5 checkpoint with AnyText control model.

Huggingface:

v1.1:

v2.0

Workflow in example_workflows dir:

Option 2: full AnyText checkpoint.

Huggingface:

v1.1:

v2.0:

  • fp32:

Modelscope: fp32

Fonts:ComfyUI\models\fonts

Base font: select Auto_Download from huggingface or manual download from huggingface or modelscope or use any other fonts in ComfyUI\models\fonts. Either v1.1 and v2.0 all need a base font, official base font: Arial_Unicode.ttf.

Github:

Huggingface:

Modelscope:

Zh to En Translators:

T5: Auto_Download from huggingface or manual download or git clone from huggingface into ComfyUI\models\prompt_generator\models--utrobinmv--t5_translate_en_ru_zh_small_200.

nlp_csanmt_translation_zh2en: Auto_Download from modelscope or manual download or git clone from modelscope into ComfyUI\models\prompt_generator\modelscope--damo--nlp_csanmt_translation_zh2en.

2、Glyph-ByT5: Unofficial custom_node for Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Rendering--TEST FAILED ON MY PC

Limitations: background result worse than original SDXL checkpoint, image resolution locked at 1024x1024, input mask and image aspect ratio must be 1:1.

Place Glyph-ByT5 checkpoints in ComfyUI\custom_nodes\ComfyUI_Anytext\Image_Generation\Glyph_SDXL\checkpoints

Place google/byt5-small text_encoder into ComfyUI\models\text_encoders or select Auto_Download from huggingface.

Workflow in example_workflows dir:

It's a typical canny controlnet implementation by diffusers library.

Comfy Ksampler workflow recommended, sd1.5、sd2.1、sdxl canny works.

For JoyType controlnet, download from https://huggingface.co/jdh-algo/JoyType-v1-1M into ComfyUI\models\controlnet. It's a diffusers format canny controlnet, compitable with comfy sampler.

Workflow in example_workflows dir:

About

Unofficial custom_node for AnyText v1.1: https://github.com/tyxsspa/AnyText and AnyText v2.0: https://github.com/tyxsspa/AnyText2 and Glyph-ByT5: https://github.com/AIGText/Glyph-ByT5 (Test failed on latest version transformers) and JoyType: https://github.com/jdh-algo/JoyType

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Contributors 3

  •  
  •  
  •  

Languages