Qintong Li
Qintong Li
Are there any kind people to help me out? Thanks in advance!
I also encounter this issue. I run inference_test.py to load OPT-IML-30B downloaded from Huggingface.
I could successfully run the script. I first saved the sharded checkpoints to a custom directory and then load the sharded ones for inference (This [2379](https://github.com/microsoft/DeepSpeed/issues/2379) helps me a lot!...
I could find the function in the package:
I also have the same problem. Could you please share the delexilization code? Thank you so much!