Login

Kye Gomez/Sophia

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

Issues looking for funding

Using Megatron Train GPT3

#21 opened in kyegomez/Sophia

3
Fund
Categorical sample

#6 opened in kyegomez/Sophia

1
Fund
Mismatch between code and paper.
Fund

#19 opened in kyegomez/Sophia

1
👍2
Fund
Gradient shape unexpected

#3 opened in kyegomez/Sophia

7
Fund
Can i use Sophia with qlora ?

#22 opened in kyegomez/Sophia

1
👍1
Fund
Issue on grad

#7 opened in kyegomez/Sophia

3
👍4
Fund
tensorflow2.x version

#4 opened in kyegomez/Sophia

3
Fund
Pass over full dataset

#5 opened in kyegomez/Sophia

1
Fund
Considering incorporate into huggingface

#12 opened in kyegomez/Sophia

👍1
Fund
Pip install error

#20 opened in kyegomez/Sophia

6
Fund
[Feature Request]Add default value for input data and model

#18 opened in kyegomez/Sophia

2
Fund
Error

#25 opened in kyegomez/Sophia

Fund
kyegomez/Sophia
Creatorkyegomez
Stars374
LicenseApache License 2.0
RepositoryGitHub
Websitediscord.gg