Skip to content
 
 

Latest commit

 

History

29 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion

Forked from here

Project Page arXiv

Notes for myself

The model is gated, see here

ComfyUI workflow here

Things I want to do:

To set this up on Colab

One-time pasting version
git clone https://github.com/ManHinnn0509/DyPE.git
cd DyPE && mkdir -p ~/miniconda3
wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh -O ~/miniconda3/miniconda.sh
bash ~/miniconda3/miniconda.sh -b -u -p ~/miniconda3
rm ~/miniconda3/miniconda.sh && source ~/miniconda3/bin/activate
conda create -n dype python=3.10
conda activate dype
pip install -r requirements.txt

# missing in requirements.txt
pip install sqlalchemy
pip install protobuf

# for the interface
pip install gradio
  1. Open the terminal

  2. Install miniconda

mkdir -p ~/miniconda3
wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh -O ~/miniconda3/miniconda.sh
bash ~/miniconda3/miniconda.sh -b -u -p ~/miniconda3
rm ~/miniconda3/miniconda.sh
  1. Clone the repo
git clone https://github.com/ManHinnn0509/DyPE.git
cd DyPE
  1. Init conda, create venv and install dependencies
source ~/miniconda3/bin/activate
conda create -n dype python=3.10
conda activate dype
pip install -r requirements.txt

# missing in requirements.txt
pip install sqlalchemy
pip install protobuf

# for the interface
pip install gradio
  1. Run the script (if you want)
python run_dype.py --prompt "Your text prompt here"

TL;DR

DyPE (Dynamic Position Extrapolation) enables pre-trained diffusion transformers to generate ultra-high-resolution images far beyond their training scale. It dynamically adjusts positional encodings during denoising to match evolving frequency content—achieving faithful 4K × 4K results without retraining or extra sampling cost.

DyPE Results

Installation

Create a conda environment and install dependencies:

conda create -n dype python=3.10
conda activate dype
pip install -r requirements.txt

Usage

Generate ultra-high resolution images with DyPE using the run_dype.py script:

python run_dype.py --prompt "Your text prompt here"

Key Arguments:

Argument Default Description
--prompt Dark fantasy scene Text prompt for image generation
--height 4096 Image height in pixels
--width 4096 Image width in pixels
--steps 28 Number of inference steps
--seed 42 Random seed for reproducibility
--method yarn Position encoding method: yarn, ntk, or base
--no_dype False Disable DyPE (enabled by default)

Examples:

# Generate 4K image with default settings (YARN + DyPE)
python run_dype.py --prompt "A serene mountain landscape at sunset"

# Use NTK method without DyPE
python run_dype.py --method ntk --no_dype --prompt "A futuristic city skyline"

# Baseline comparison (no position encoding modifications)
python run_dype.py --method base

Generated images will be saved to the outputs/ folder (created automatically).

License and Commercial Use

This work is patent pending. For commercial use or licensing inquiries, please contact the authors.

Citation

If you find this useful for your research, please cite the following:

@misc{issachar2025dypedynamicpositionextrapolation,
      title={DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion}, 
      author={Noam Issachar and Guy Yariv and Sagie Benaim and Yossi Adi and Dani Lischinski and Raanan Fattal},
      year={2025},
      eprint={2510.20766},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2510.20766}, 
}

About

Official implementation for "DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion".

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages