Byeongjoo Kim

Results 1 comments of Byeongjoo Kim

Different hyper-parameter between the paper and the code? (lora_alpha and a global batch size)

I have some exact same questions just like @t-hyun mentioned. It would be really appreciate to respond his questions especially in terms of lora_alpha! I cannot clearly understand the effect...