starcoder
starcoder copied to clipboard
Error during inference with starcoder
While performing inference with starcoder, I encountered the following errors:
bin [ANONYMIZED_PATH]/miniconda3/envs/starcoder/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so
[ANONYMIZED_PATH]/miniconda3/envs/starcoder/lib/python3.10/site-packages/bitsandbytes/cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
warn("The installed version of bitsandbytes was compiled without GPU support. "
[ANONYMIZED_PATH]/miniconda3/envs/starcoder/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cadam32bit_grad_fp32
... (abbreviated for brevity, continue with the anonymized log) ...
KeyError: 'LD_LIBRARY_PATH'
I installed the dependencies as specified in the repo. I'd appreciate any guidance on resolving this problem.