FastFold icon indicating copy to clipboard operation
FastFold copied to clipboard

Did fastfold support bfloat16 inference?

Open semal opened this issue 2 years ago • 5 comments

image fastfold/utils/geometry/vector.py seems got an unexpected data type.

semal avatar Mar 24 '23 07:03 semal

Thanks for your question, this feature is still under development.

Gy-Lu avatar Mar 25 '23 05:03 Gy-Lu

image

more information about the data type change.

semal avatar Mar 27 '23 05:03 semal

This error comes from xx = 1 - 2* (y ** 2 + z** 2), dtype of 1 should give a specific datatype. Another error comes from w *= inv_normwhich is a inplace operation, maybe should change to w = w * inv_norm

semal avatar Mar 27 '23 06:03 semal

hi! have you achieved inference with bf16? which part of the source code did you modified?

Ian-pku avatar Dec 10 '23 04:12 Ian-pku

Readme says: We can inference a sequence of length 10000 in bf16 with 61GB memory on a Nvidia A100(80GB).

How can I infer with bf16?

Lix1993 avatar Jul 11 '24 12:07 Lix1993