Kye Gomez/AlphaDev

Attention.init() got an unexpected keyword argument 'kv_heads'

8 months ago

👍

Hi,
Cloning cloned AlphaDev or pip-instally, and then running example.py returns the following error:
"TypeError: Attention.init() got an unexpected keyword argument 'kv_heads'"
I suspect the parameter attn_kv_heads in AlphaDev.init should be renamed attn_one_kv_head.
Is that correct?
Thanks for your amazing work!

kyegomez / AlphaDev

Implementation of the model from "Faster sorting algorithms discovered using deep reinforcement learning" that discovered an all-new ultra fast sorting algorithm.

Contributors get 40% of received funds after fees

How does funding with Polar work?

Pay now to fund the work behind this issue.

Get updates on progress being made.

Maintainer is rewarded once the issue is completed.

FAQ

Backer

You're funding impactful open source efforts

Contributor

You want to contribute to this effort

Maintainer

You want to get funding like this too

Kye Gomez/AlphaDev

Attention.__init__() got an unexpected keyword argument 'kv_heads'

How does funding with Polar work?

Backer

Why does "Fund on completion" require GitHub login?

When is the invoice due for "Fund on completion"?

What happens if the issue is never completed?

Do I get any extra benefits by funding?

Do I get progress updates?

Contributor

Do I get a reward?

Is rewards guaranteed?

Maintainer

How can I get funding like this for my open source initiatives?

Attention.init() got an unexpected keyword argument 'kv_heads'