Adding Lightning Attention 2 Support
🚀 Feature Request
Using newly proposed model architecture Lightning Attention 2 to increase context size and inference speed.
Motivation
Looks promising and easy to implement, only requires Triton and NVIDIA GPU.
kyegomez / Andromeda
An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
137
Contributors get 40% of received funds after fees
How does funding with Polar work?
1
Pay now to fund the work behind this issue.
2
Get updates on progress being made.
3
Maintainer is rewarded once the issue is completed.
FAQ
Backer
You're funding impactful open source efforts
Contributor
You want to contribute to this effort
Maintainer
You want to get funding like this too