dakai

Error when `serve run`

1

I build the image and run the container. ``` docker run -d -it --gpus all --shm-size 1g -p 8000:8000 -e HF_HOME=~/data -v $cache_dir:/home/ray/data anyscale/ray-llm:latest ``` But in the container, when...

[Bug] Error when evaluate using LightLLM api

1

### 先决条件 - [X] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。 - [X] 错误在 [最新版本](https://github.com/open-compass/opencompass) 中尚未被修复。 ### 问题类型 我正在使用官方支持的任务/模型/数据集进行评估。 ### 环境 ``` {'CUDA available': True, 'CUDA_HOME': '/usr/local/cuda-12.3', 'GCC': 'gcc (Debian 12.2.0-14) 12.2.0',...

minikube cannot detect the GPUs

15

I used your image to create a container. In the container, I installed minikube. When I run `minikube start`, the node `minikube` didn't detect any GPU. I am wondering how...

I have run the code successfully in this repository, but when I run the code below: ```py import torch from utils.custom_device_mode import foo_module, enable_foo_device a = torch.randn(4, device='privateuseone') ``` I...