CAR icon indicating copy to clipboard operation
CAR copied to clipboard
verified publisher icon sunwj

question about clipping value and soft round function

Open brighteast opened this issue 2 years ago • 0 comments

Hi, first really thank you for your work!

Now I'm reproducing your work. I have two question about clipping value and soft round function.

  1. When I set learning rate to 10e-4, graident values are diverged. So I use gradient clipping and set the value to 0.01. I wonder if it is reasonable value.

  2. What value did you set to tuning parameter alpha?

thank you in advance!

brighteast avatar May 23 '23 03:05 brighteast