Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
winglian
ring-flash-attention
Repository navigation
Code
Pull requests
Actions
Projects
Security and quality
Insights
More
items
Commits
Branch selector
main
User selector
All users
Datepicker
All time
Commit history
Commits on Jul 3, 2025
bump version
zhuzilin
committed
78718f0
View commit details
Copy full SHA for 78718f0
Browse repository at this point
add new signature for updated hf transformers (#76)
winglian
authored
e7a03f6
View commit details
Copy full SHA for e7a03f6
Browse repository at this point
Commits on Jun 12, 2025
Clarify use of `substitute_hf_flash_attn` (#74)
Show description for 23adae0
qgallouedec
authored
23adae0
View commit details
Copy full SHA for 23adae0
Browse repository at this point
Commits on May 21, 2025
bump to 0.1.5
zhuzilin
authored
acd4610
View commit details
Copy full SHA for acd4610
Browse repository at this point
Commits on May 20, 2025
Add target_dtype conversion (#73)
djsaunde
authored
123f924
View commit details
Copy full SHA for 123f924
Browse repository at this point
Commits on Apr 8, 2025
Fix zigzag varlen when torch compile with capturing scalar outputs (#71)
Show description for ce9fd39
HollowMan6
authored
ce9fd39
View commit details
Copy full SHA for ce9fd39
Browse repository at this point
Merge pull request #70 from HollowMan6/torch_compile_tests
Show description for cf53c2f
HollowMan6
authored
cf53c2f
View commit details
Copy full SHA for cf53c2f
Browse repository at this point
Merge pull request #69 from HollowMan6/ds_store
Show description for 5579f4d
zhuzilin
authored
5579f4d
View commit details
Copy full SHA for 5579f4d
Browse repository at this point
Merge pull request #68 from HollowMan6/torch_compile
Show description for ca63b3c
zhuzilin
authored
ca63b3c
View commit details
Copy full SHA for ca63b3c
Browse repository at this point
Commits on Apr 3, 2025
Add .DS_Store to .gitignore and clean up
Show description for fbbe581
HollowMan6
committed
fbbe581
View commit details
Copy full SHA for fbbe581
Browse repository at this point
Fix llama3 when torch compile with capturing scalar outputs
Show description for b95ddb0
HollowMan6
committed
b95ddb0
View commit details
Copy full SHA for b95ddb0
Browse repository at this point
Commits on Feb 24, 2025
bump to v0.1.4
zhuzilin
committed
c587a0d
View commit details
Copy full SHA for c587a0d
Browse repository at this point
Merge pull request #65 from zhuzilin/feature/update_hf_adapter
Show description for ecec688
zhuzilin
authored
ecec688
View commit details
Copy full SHA for ecec688
Browse repository at this point
update hf adapter to align the _flash_attention_forward signature
zhuzilin
committed
ef2d579
View commit details
Copy full SHA for ef2d579
Browse repository at this point
Merge pull request #64 from zhuzilin/revert-62-feature/update_hf_adapter
Show description for 6186f52
zhuzilin
authored
6186f52
View commit details
Copy full SHA for 6186f52
Browse repository at this point
Revert "Update hf adapter to align the _flash_attention_forward signature"
zhuzilin
authored
0e20b98
View commit details
Copy full SHA for 0e20b98
Browse repository at this point
Merge pull request #62 from zhuzilin/feature/update_hf_adapter
Show description for 1850481
zhuzilin
authored
1850481
View commit details
Copy full SHA for 1850481
Browse repository at this point
Commits on Feb 21, 2025
update hf adapter to align the _flash_attention_forward signature
zhuzilin
committed
97f9c11
View commit details
Copy full SHA for 97f9c11
Browse repository at this point
Commits on Dec 19, 2024
add send_recv_kv to make code simpler
zhuzilin
committed
be3b01f
View commit details
Copy full SHA for be3b01f
Browse repository at this point
nfc
zhuzilin
committed
c84bf81
View commit details
Copy full SHA for c84bf81
Browse repository at this point
Commits on Dec 10, 2024
update version
zhuzilin
committed
faeb369
View commit details
Copy full SHA for faeb369
Browse repository at this point
Merge pull request #58 from zhuzilin/feature/fix_window_size_update
Show description for b54d6b7
zhuzilin
authored
b54d6b7
View commit details
Copy full SHA for b54d6b7
Browse repository at this point
fix flash_attn api breaking in 2.7.0.post2
zhuzilin
committed
bef9333
View commit details
Copy full SHA for bef9333
Browse repository at this point
Commits on Nov 8, 2024
update readme
zhuzilin
committed
6f1c6f7
View commit details
Copy full SHA for 6f1c6f7
Browse repository at this point
Commits on Oct 30, 2024
update readme
zhuzilin
committed
01c8baf
View commit details
Copy full SHA for 01c8baf
Browse repository at this point
bump to v0.1.1
zhuzilin
committed
8404070
View commit details
Copy full SHA for 8404070
Browse repository at this point
add comment for llama3_flash_attn_prepare_cu_seqlens
zhuzilin
committed
5e52d25
View commit details
Copy full SHA for 5e52d25
Browse repository at this point
add benchmark result of llama3_flash_attn_varlen_func
zhuzilin
committed
1342b84
View commit details
Copy full SHA for 1342b84
Browse repository at this point
Update benchmark
zhuzilin
committed
556ddaa
View commit details
Copy full SHA for 556ddaa
Browse repository at this point
move Comm to util
zhuzilin
committed
55ed8fe
View commit details
Copy full SHA for 55ed8fe
Browse repository at this point
rename AsyncHandles to Comm for simplicity
zhuzilin
committed
d005c31
View commit details
Copy full SHA for d005c31
Browse repository at this point
Commits on Oct 8, 2024
udpate readme
zhuzilin
committed
b00d24d
View commit details
Copy full SHA for b00d24d
Browse repository at this point
Commits on Sep 20, 2024
add license and pyproject.toml and upload to pypi
zhuzilin
committed
9e2a7e5
View commit details
Copy full SHA for 9e2a7e5
Browse repository at this point
Commits on Sep 16, 2024
update hf_adapter
zhuzilin
committed
d0262b4
View commit details
Copy full SHA for d0262b4
Browse repository at this point
Commits on Sep 13, 2024
add experimental hf_adapter
zhuzilin
committed
9d16bc9
View commit details
Copy full SHA for 9d16bc9
Browse repository at this point
Previous
Next
You can’t perform that action at this time.