Rohan Sood comments

Repositories
Issues
Comments

Results 2 comments of


                                            Rohan Sood

[BUG]transformer_inference.so: cannot open shared object file: No such file or directory

Can you try ``` git clone https://github.com/microsoft/DeepSpeed cd DeepSpeed DS_BUILD_OPS=1 DS_BUILD_AIO=0 DS_BUILD_SPARSE_ATTN=0 pip install -e . --global-option="build_ext" --global-option="-g" --global-option="-j8" --no-cache -v --disable-pip-version-check ```

The step2 scoring looks correct but the step3 model is talking gibberish

This issue still persists. RLHF produces gibberish when using the step 1 and 2 checkpoints. Are there any updates from your investigation @yaozhewei ?