AlexHT Hung

Results 3 issues of AlexHT Hung

Hi, I'm wondering if I could use peft to finetune 176B BLOOMZ? I am experiencing poor GPU utilization efficiency with 64 V100s.

請問未來會支援RK3399Pro嗎?

Hi, I'm interested in running the example found in `biencoder/nli_msmarco/scripts/train_bloom7b1.slurm`. Is it possible to execute these using accelerate and deepspeed? I'm planning to experiment with larger models, hence the need...