LWM icon indicating copy to clipboard operation
LWM copied to clipboard
verified publisher icon LargeWorldModel

Weight conversion scripts

Open fmmoret opened this issue 1 year ago • 1 comments

Would anyone be able to point me to pytorch -> jax llama weights conversion and jax -> pytorch llama weights conversion scripts?

fmmoret avatar Mar 29 '24 18:03 fmmoret

@lhao499 & do you have any compatible w num_key_value_heads !== num_attention_heads?

fmmoret avatar Mar 30 '24 01:03 fmmoret