devpramod

ImportError: /lib64/libc.so.6: version `GLIBC_2.32' not found

4

Following instructions from [https://github.com/intel-analytics/BigDL/tree/main/python/llm/example/GPU/LLM-Finetuning/QLoRA/simple-example](https://github.com/intel-analytics/BigDL/tree/main/python/llm/example/GPU/LLM-Finetuning/QLoRA/simple-example) to set up exaple Facing the following error: `import linear_q4_0 ImportError: /lib64/libc.so.6: version `GLIBC_2.32' not found`

Error in comps/llms/text-generation/vllm/launch_vllm_service.sh

2

Error Message: When launching vllm service in comps/llms/text-generation/vllm the following error message appears: `api_server.py: error: unrecognized arguments: /bin/bash -c cd / && export VLLM_CPU_KVCACHE_SPACE=40 && python3 -m vllm.entrypoints.openai.api_server --model --host...

host_ip causes an error in ChatQnA AIPC deployment with Ollama

6

### Priority P2-High ### OS type Ubuntu ### Hardware type AI-PC ### Installation method - [ ] Pull docker images from hub.docker.com - [ ] Build docker images from source...