starcoder icon indicating copy to clipboard operation
starcoder copied to clipboard

Error during inference with starcoder

Open nashid opened this issue 2 years ago • 0 comments

While performing inference with starcoder, I encountered the following errors:

bin [ANONYMIZED_PATH]/miniconda3/envs/starcoder/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so
[ANONYMIZED_PATH]/miniconda3/envs/starcoder/lib/python3.10/site-packages/bitsandbytes/cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
  warn("The installed version of bitsandbytes was compiled without GPU support. "
[ANONYMIZED_PATH]/miniconda3/envs/starcoder/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cadam32bit_grad_fp32
... (abbreviated for brevity, continue with the anonymized log) ...
KeyError: 'LD_LIBRARY_PATH'

I installed the dependencies as specified in the repo. I'd appreciate any guidance on resolving this problem.

nashid avatar Aug 29 '23 11:08 nashid