Kye Gomez

Kye Gomez

@kyegomez

Founder of Swarms https://github.com/kyegomez/swarms Leader of Agora, open source AI Research lab: https://discord.gg/RVCz3yxr

Issues looking for funding

use in pretrained model？
Fund

#1 opened in kyegomez/Blockwise-Parallel-Transformer

Fund
500 server error with new google search api
Fund

#1 opened in kyegomez/Athena-for-Search

Fund
Generate an image

#16 opened in kyegomez/CM3Leon

Fund
IMPORTANT! Security Vulnerability Detected in your Repository

#34 opened in kyegomez/BRAVE-ViT-Swarm

Fund
Is there a test showing effectiveness of softmax1 removing outliers?

#4 opened in kyegomez/AttentionIsOFFByOne

Fund
Compare with GPT-4 Advanced Data Analysis (integrating with Python)

#6 opened in kyegomez/Algorithm-Of-Thoughts

1
Fund
Attention.__init__() got an unexpected keyword argument 'kv_heads'

#1 opened in kyegomez/AlphaDev

Fund
More of a question/Request

#1 opened in kyegomez/AthenaOS

Fund
Adding Lightning Attention 2 Support
enhancement

#13 opened in kyegomez/Andromeda

Fund
Discuss: softmax_one and zero_vector in QuietAttention conflicts?

#1 opened in kyegomez/AttentionIsOFFByOne

1
Fund
how to solve the issue of overflow

#2 opened in kyegomez/AttentionIsOFFByOne

Fund
Please stop sending your spam to my email address

#4 opened in kyegomez/APACAI

1
👍1
Fund
Notification

#1 opened in kyegomez/1000xDevoloperSchedule

Fund
If you wanna make it fast, just use nn.softmax() and concatenate a zero.

#3 opened in kyegomez/AttentionIsOFFByOne

1
Fund
I wonder what hardware conditions (GPU) the code uses, and why the loss value has been above 5.2 after running the train.py file, and the validation generated unreadable incomprehensible content.
bug

#68 opened in kyegomez/BitNet

Fund
Explanation on the residual connection part?
Fund

#2 opened in kyegomez/Blockwise-Parallel-Transformer

Fund
Financials Section with monthly profit and losses

#1 opened in kyegomez/APACAI

Fund
Is that possible make it work with codellama34b?

#2 opened in kyegomez/Algorithm-Of-Thoughts

Fund
IMPORTANT：The definition of the softmax one is wrong

#5 opened in kyegomez/AttentionIsOFFByOne

4
👍3
Fund
Is there any evidence that softmax one can takes advantages over normal softmax?

#6 opened in kyegomez/AttentionIsOFFByOne

👍2
Fund
1
2
3
4
5
…
9
© Polar Software Inc. 2024

Platform

Create an AccountProducts & SubscriptionsDonationsIssue Funding

Company

CareersBlogBrand AssetsTerms of ServicePrivacy Policy

Community

Join our DiscordGitHubX / Twitter

Support

DocsFAQContact