Lei Wang

DeepSpeed support with CUDA 11.2？

1

Torch version ``` pytorch==1.11 cudatoolkit==11.3 ``` gcc version: 9.1.0 Install Deepspeed, i get the error: `DS_BUILD_AIO=0 DS_BUILD_OPS=1 pip install deepspeed --global-option="build_ext" --global-option="-j8"` ``` error: command '/usr/local/cuda-11.2/bin/nvcc' failed with exit code...

Side chain Frame constrcution

1

For example: ``` # psi-frame to backbone mat = _make_rigid_transformation_4x4( ex=atom_positions['C'] - atom_positions['CA'], ey=atom_positions['CA'] - atom_positions['N'], translation=atom_positions['C']) restype_rigid_group_default_frame[restype, 3, :, :] = mat ``` From paper: `For the side chain...

Apply evolocity to other language models?

2

ESM-1b is currently the most widely used protein language model. I want to use evolocity to test other language models. Do you have any suggestions？

mixed precision with Deepspeed

6

### Bug description When using mixed precision with Deepspeed, the model resulted in the error: `RuntimeError: expected scalar type Float but found Half`. ### How to reproduce the bug ```python...

ESM C load ESM 3 tokenizer？

3

 This mean before you install ESM C， must install ESM 3