Login

Kye Gomez/FlashAttention20

Get down and dirty with FlashAttention2.0 in pytorch, plug in and play no complex CUDA kernels

Issues looking for funding

About the Disappearing of Inverse Diagonal of exp_row_max_diff in the Inner Loop

#3 opened in kyegomez/FlashAttention20

Fund
Throughput comparison
Fund

#2 opened in kyegomez/FlashAttention20

Fund
kyegomez/FlashAttention20
Creatorkyegomez
Stars90
LicenseMIT License
RepositoryGitHub