hheavenknowss

Results 3 comments of hheavenknowss

> @hheavenknowss Please try to clip the gradients. I have reduce the learning rate and it works, thanks reply

> @hheavenknowss Can you tell me your revised learning rate? I have the same problem. I'm looking forward to your reply. Sorry about that, it has been a while and...

Hi there, have you tried to train a medium/large models yet? I wonder how many A100 cards did you use to train a large model.