Parker Schless

icon company Cornell University icon location Ithaca, NY icon location ECE and CS student at Cornell University

Results 1 issues of Parker Schless

Cannot quantize to f16 with i2_s

1 comment

I am quite a newbie to LLM's, but was running into the following issue: Command: `python setup_env.py --hf-repo HF1BitLLM/Llama3-8B-1.58-100B-tokens -q i2_s --quant-embd` Output: `ERROR:root:Error occurred while running command: Command '['/home/pis7/miniconda3/envs/bitnet-cpp/bin/python',...