BMInf icon indicating copy to clipboard operation
BMInf copied to clipboard
verified publisher icon OpenBMB

[FEATURE] Question: why does CPM1.0 need 2 GPU cards while BMInf only need 1 GPU?

Open lucasjinreal opened this issue 3 years ago • 4 comments

where does it optimized?

lucasjinreal avatar Mar 10 '22 11:03 lucasjinreal

I have same question, looking forward the answer.

changleilei avatar Apr 12 '22 15:04 changleilei

Sorry for the late reply.

BMInf's Key Technologies:

  • model quantization
  • offloading

We have a technical report that will be made public recently.

a710128 avatar Apr 13 '22 01:04 a710128

Thank you ! Looking forward the report !

changleilei avatar Apr 13 '22 05:04 changleilei

report PDF

a710128 avatar Jun 27 '22 04:06 a710128