gemma.cpp icon indicating copy to clipboard operation
gemma.cpp copied to clipboard

RecurrentGemma 9b support

Open fizzAI opened this issue 1 year ago • 1 comments

Hi! Are there currently any plans to support the 9b version of RecurrentGemma that recently released?

fizzAI avatar Jun 17 '24 02:06 fizzAI

Hi! We do have plans to support RecurrentGemma 9b. There is some internal work to be done - I think it's likely that we'll be able to release it around the end of June. If contributors want to help, we could definitely use help with:

  • Adding a recurrent 9b configuration to convert_weights.py (and configs.h)
  • Testing that the configuration works with the output of convert_weights.py
  • Letting us know if it does not work.

This would save us some time in launching it! Thanks for raising this issue.

pculliton avatar Jun 17 '24 19:06 pculliton

Hi @fizzAI,

Could you please confirm if this issue is resolved for you with the above comment ? Please feel free to close the issue if it is resolved ?

Thank you.

Gopi-Uppari avatar Nov 05 '24 08:11 Gopi-Uppari

Hi @fizzAI,

Closing this issue due to lack of recent activity, Please feel free reopen if this is still a valid request. Thank you!

Thank you.

Gopi-Uppari avatar Nov 19 '24 04:11 Gopi-Uppari