Kye Gomez

Kye Gomez

@kyegomez

Founder of Swarms https://github.com/kyegomez/swarms Leader of Agora, open source AI Research lab: https://discord.gg/RVCz3yxr

Issues looking for funding

use in pretrained model？
Fund

#1 opened in kyegomez/Blockwise-Parallel-Transformer

Fund
500 server error with new google search api
Fund

#1 opened in kyegomez/Athena-for-Search

Fund
Is there a test showing effectiveness of softmax1 removing outliers?

#4 opened in kyegomez/AttentionIsOFFByOne

Fund
Compare with GPT-4 Advanced Data Analysis (integrating with Python)

#6 opened in kyegomez/Algorithm-Of-Thoughts

1
Fund
Attention.__init__() got an unexpected keyword argument 'kv_heads'

#1 opened in kyegomez/AlphaDev

Fund
[BUG] Is activation actually quantized? (I think it's still in f16 or f32)
bug

#75 opened in kyegomez/BitNet

Fund
Broken discord invitation link in README.md

#11 opened in kyegomez/awesome-multi-agent-papers

Fund
More of a question/Request

#1 opened in kyegomez/AthenaOS

Fund
Adding Lightning Attention 2 Support
enhancement

#13 opened in kyegomez/Andromeda

Fund
Discuss: softmax_one and zero_vector in QuietAttention conflicts?

#1 opened in kyegomez/AttentionIsOFFByOne

1
Fund
how to solve the issue of overflow

#2 opened in kyegomez/AttentionIsOFFByOne

Fund
Please stop sending your spam to my email address

#4 opened in kyegomez/APACAI

1
👍1
Fund
Notification

#1 opened in kyegomez/1000xDevoloperSchedule

Fund
If you wanna make it fast, just use nn.softmax() and concatenate a zero.

#3 opened in kyegomez/AttentionIsOFFByOne

1
Fund
Explanation on the residual connection part?
Fund

#2 opened in kyegomez/Blockwise-Parallel-Transformer

Fund
Financials Section with monthly profit and losses

#1 opened in kyegomez/APACAI

Fund
Is that possible make it work with codellama34b?

#2 opened in kyegomez/Algorithm-Of-Thoughts

Fund
IMPORTANT：The definition of the softmax one is wrong

#5 opened in kyegomez/AttentionIsOFFByOne

4
👍3
Fund
Bitnet RWKV-7

#73 opened in kyegomez/BitNet

Fund
Is there any evidence that softmax one can takes advantages over normal softmax?

#6 opened in kyegomez/AttentionIsOFFByOne

👍2
Fund
1
2
3
4
5
…
7
© Polar Software Inc. 2025

Platform

Create an AccountProducts & SubscriptionsCheckoutsCustomer Portal

Company

CareersBrand AssetsTerms of ServicePrivacy Policy

Community

Join our DiscordGitHubX / Twitter

Support

DocsContact