Login

Kye Gomez

@kyegomez

Founder of Swarms https://github.com/kyegomez/swarms Leader of Agora, open source AI Research lab: https://discord.gg/RVCz3yxr

Issues looking for funding

use in pretrained model？
Fund

#1 opened in kyegomez/Blockwise-Parallel-Transformer

Fund
[BUG] cant compile the cuda
bug

#60 opened in kyegomez/BitNet

Fund
500 server error with new google search api
Fund

#1 opened in kyegomez/Athena-for-Search

Fund
Is there a test showing effectiveness of softmax1 removing outliers?

#4 opened in kyegomez/AttentionIsOFFByOne

Fund
Compare with GPT-4 Advanced Data Analysis (integrating with Python)

#6 opened in kyegomez/Algorithm-Of-Thoughts

1
Fund
Attention.__init__() got an unexpected keyword argument 'kv_heads'

#1 opened in kyegomez/AlphaDev

Fund
More of a question/Request

#1 opened in kyegomez/AthenaOS

Fund
Adding Lightning Attention 2 Support
enhancement

#13 opened in kyegomez/Andromeda

Fund
Discuss: softmax_one and zero_vector in QuietAttention conflicts?

#1 opened in kyegomez/AttentionIsOFFByOne

1
Fund
how to solve the issue of overflow

#2 opened in kyegomez/AttentionIsOFFByOne

Fund
Please stop sending your spam to my email address

#4 opened in kyegomez/APACAI

1
👍1
Fund
Notification

#1 opened in kyegomez/1000xDevoloperSchedule

Fund
If you wanna make it fast, just use nn.softmax() and concatenate a zero.

#3 opened in kyegomez/AttentionIsOFFByOne

1
Fund
Expected BitLinear weight to be 1 or -1

#52 opened in kyegomez/BitNet

3
Fund
Explanation on the residual connection part?
Fund

#2 opened in kyegomez/Blockwise-Parallel-Transformer

Fund
Financials Section with monthly profit and losses

#1 opened in kyegomez/APACAI

Fund
Is that possible make it work with codellama34b?

#2 opened in kyegomez/Algorithm-Of-Thoughts

Fund
IMPORTANT：The definition of the softmax one is wrong

#5 opened in kyegomez/AttentionIsOFFByOne

4
👍3
Fund
Is there any evidence that softmax one can takes advantages over normal softmax?

#6 opened in kyegomez/AttentionIsOFFByOne

👍2
Fund
When will all the codes be released?

#1 opened in kyegomez/Aurora

4
Fund
1
2
3
4
5
…
9
© Polar Software Inc. 2024

Platform

Create an AccountIssue FundingProducts & SubscriptionsDonationsNewsletters

Company

CareersBlogBrand AssetsTerms of ServicePrivacy Policy

Community

Join our DiscordGitHubX / Twitter

Support

DocsFAQContact