prof-schacht

opt-175b model how to load model from disc.

2

I tried to load the opt-175b model by using the following command: python3 -m flexgen.flex_opt --model facebook/opt-175b --percent 0 0 100 0 100 0 --offload-dir ./tmp_offline The issue I have...