Skip to content

0.0.52

  • 0.0.52
  • 8771d2d

  • Verified

    This commit was created on GitHub.com and signed with GitHub’s verified signature.
    GPG key ID: B5690EEEBB952194
    Verified
    Learn about vigilant mode

  • Choose a tag to compare

    View all tags
0.0.52: Add flash_attn support (#306) (#313)
  • 0.0.52
  • 8771d2d

  • Choose a tag to compare

    View all tags

  • Verified

    This commit was created on GitHub.com and signed with GitHub’s verified signature.
    GPG key ID: B5690EEEBB952194
    Verified
    Learn about vigilant mode
@michaelfeil michaelfeil tagged this 21 Jul 21:56 
* Add flash_attn support  (#306)

* add dockerfile for flash_attn setup

* remove test.py

* parametrize model name and engine

* Update Dockerfile

---------

Co-authored-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>

* Delete libs/infinity_emb/Dockerfile.flash

---------

Co-authored-by: Göktürk <87906890+gokturkDev@users.noreply.github.com>
Assets 2
Loading