Kye Gomez

Kye Gomez

@kyegomez

Founder of Swarms https://github.com/kyegomez/swarms Leader of Agora, open source AI Research lab: https://discord.gg/RVCz3yxr

Issues looking for funding

500 server error with new google search api
Fund

#1 opened in kyegomez/Athena-for-Search

Fund
CUDA Optimization

#67 opened in kyegomez/BitNet

Fund
Is there a test showing effectiveness of softmax1 removing outliers?

#4 opened in kyegomez/AttentionIsOFFByOne

Fund
Compare with GPT-4 Advanced Data Analysis (integrating with Python)

#6 opened in kyegomez/Algorithm-Of-Thoughts

1
Fund
Attention.__init__() got an unexpected keyword argument 'kv_heads'

#1 opened in kyegomez/AlphaDev

Fund
Can it be used in Huggingface models such as stable diffusion and text to image or LLM models

#66 opened in kyegomez/BitNet

Fund
More of a question/Request

#1 opened in kyegomez/AthenaOS

Fund
Adding Lightning Attention 2 Support
enhancement

#13 opened in kyegomez/Andromeda

Fund
Discuss: softmax_one and zero_vector in QuietAttention conflicts?

#1 opened in kyegomez/AttentionIsOFFByOne

1
Fund
how to solve the issue of overflow

#2 opened in kyegomez/AttentionIsOFFByOne

Fund
Please stop sending your spam to my email address

#4 opened in kyegomez/APACAI

1
👍1
Fund
Notification

#1 opened in kyegomez/1000xDevoloperSchedule

Fund
If you wanna make it fast, just use nn.softmax() and concatenate a zero.

#3 opened in kyegomez/AttentionIsOFFByOne

1
Fund
I wonder what hardware conditions (GPU) the code uses, and why the loss value has been above 5.2 after running the train.py file, and the validation generated unreadable incomprehensible content.
bug

#68 opened in kyegomez/BitNet

Fund
Question: embeddings 3bits?
no-issue-activity

#63 opened in kyegomez/BitNet

1
Fund
Explanation on the residual connection part?
Fund

#2 opened in kyegomez/Blockwise-Parallel-Transformer

Fund
Financials Section with monthly profit and losses

#1 opened in kyegomez/APACAI

Fund
Is that possible make it work with codellama34b?

#2 opened in kyegomez/Algorithm-Of-Thoughts

Fund
IMPORTANT：The definition of the softmax one is wrong

#5 opened in kyegomez/AttentionIsOFFByOne

4
👍3
Fund
Is there any evidence that softmax one can takes advantages over normal softmax?

#6 opened in kyegomez/AttentionIsOFFByOne

👍2
Fund
1
2
3
4
5
…
9
© Polar Software Inc. 2024

Platform

Create an AccountProducts & SubscriptionsDonationsIssue Funding

Company

CareersBlogBrand AssetsTerms of ServicePrivacy Policy

Community

Join our DiscordGitHubX / Twitter

Support

DocsFAQContact