Li Xiaohong
Li Xiaohong
Thanks kwonmha, Follow up on the punctuation removal question: If I don't remove punctuation in the corpus file, I will see vocab built for cases like words followed by punct...
Hihi Thanks a lot @HamidShojanazeri for your prompt reply! Sorry may I understand more how do I do device assignment with partitioned GPUs, when all partitioned GPUs assigned with same...
hihi @HamidShojanazeri , any updates? Thank you!
hi @HamidShojanazeri , I have tried your suggestion, however, the device string format of GPU_UUID/GPU_instance_ID/0 is not valid device string. I have tried some other formats for device string, all...
hihi @HamidShojanazeri, thanks for the references. Btw, I have tried various formats of device string, including with 'MIG-' prefix, still failing for the same reason.
+1 same problem. For my data/setup, training completed only for 2 steps, hangs at 3rd step backward.
@minhthuc2502 , is it possible to include the logits too? or return logits instead of log prob? because it is easier to calculate log prob from logits, but not the...
similar issue reported at: https://github.com/openai/triton/issues/1975