Qintong Li

Results 5 comments of Qintong Li

Are there any kind people to help me out? Thanks in advance!

I also encounter this issue. I run inference_test.py to load OPT-IML-30B downloaded from Huggingface.

I could successfully run the script. I first saved the sharded checkpoints to a custom directory and then load the sharded ones for inference (This [2379](https://github.com/microsoft/DeepSpeed/issues/2379) helps me a lot!...

I also have the same problem. Could you please share the delexilization code? Thank you so much!