Can't install the xformers for torch 1.11.0+cu113 #22

Your code is built on pytorch=1.11.0 - cudatoolkit=11.3. However, the xformer needs pytorch=2.3.0. How to install xformer for pytorch=1.11.0 with cudatoolkit=11.3?