Genesis icon indicating copy to clipboard operation
Genesis copied to clipboard

Why is it running so slow, so stuck?

Open Logic-TARS opened this issue 1 year ago • 14 comments

I tested it twice, and almost every time I had to wait nearly 15 minutes to get a normal frame rate. It's the same whether I use gs.cuda or gs.cpu. Is anyone else experiencing this? this is hello_genesis example. 12 23 34

Logic-TARS avatar Dec 21 '24 12:12 Logic-TARS

This seems pretty weird. What platform and hardware are you on?

zhouxian avatar Dec 21 '24 12:12 zhouxian

Also, if you are using a light terminal background, you can change the theme to 'light' in gs.init()

zhouxian avatar Dec 21 '24 12:12 zhouxian

This seems pretty weird. What platform and hardware are you on?

H800 and Ubuntu 22.04

Logic-TARS avatar Dec 21 '24 12:12 Logic-TARS

This seems pretty weird. What platform and hardware are you on?

Does this have anything to do with my use of a remote server? I use VNC for remote desktop connections,the server itself does not have a display

Logic-TARS avatar Dec 21 '24 12:12 Logic-TARS

Also, if you are using a light terminal background, you can change the theme to 'light' in gs.init()另外,如果您使用浅色终端背景,您可以在 gs.init() 中将主题更改为“浅色”

image You can see that the GPU is basically unresponsive.

Logic-TARS avatar Dec 21 '24 12:12 Logic-TARS

This is indeed a bit weird and I don't have a clue yet... it's probably caused by the way you transfer the rendered image back

zhouxian avatar Dec 21 '24 16:12 zhouxian

I was trying Hello_Genesis on Google Colab. The building visualizer step takes about 20 minutes regardless of whether I use CPU or GPU.

sudhir2016 avatar Dec 21 '24 16:12 sudhir2016

I got the exactly same issue, FPS is pretty low. I'm also in a remote 4090 server docker, with ubuntu 22.04, python 3.9, cuda 12.4

ziqiyang107 avatar Dec 23 '24 08:12 ziqiyang107

same issue too

renyu2016 avatar Dec 24 '24 14:12 renyu2016

same

ofirbartal100 avatar Dec 25 '24 08:12 ofirbartal100

I have the same issue but I think what @zhouxian mentioned is valid. This only happens when I enabled camera.render. It seems like it forces the rendered image to back on cpu so it slows the simulation dramatically. I have no figured out how to avoid this.

yic03685 avatar Dec 26 '24 01:12 yic03685

I have the same issue but I think what @zhouxian mentioned is valid. This only happens when I enabled camera.render. It seems like it forces the rendered image to back on cpu so it slows the simulation dramatically. I have no figured out how to avoid this. same error,when run cam.render() ,I noticed that the CPU utilization is 100% but the GPU utilization is 0,and very slowly

soooocold avatar Dec 26 '24 06:12 soooocold

I sloved this issue by upgrade the CUDA version to 12.6 NVIDIA-SMI 560.35.05 Driver Version: 560.35.05 CUDA Version: 12.6

soooocold avatar Dec 26 '24 08:12 soooocold

I encountered the same issue on Google Colab, but I was able to resolve it by adding the following code before importing genesis:

import os
NVIDIA_ICD_CONFIG_PATH = '/usr/share/glvnd/egl_vendor.d/10_nvidia.json'
ICD_CONFIG_CONTENT = """{
    "file_format_version" : "1.0.0",
    "ICD" : {
        "library_path" : "libEGL_nvidia.so.0"
    }
}
"""
with open(NVIDIA_ICD_CONFIG_PATH, 'w') as f:
    f.write(ICD_CONFIG_CONTENT)

You can find the complete code here: Gist link

Taka-Hashimoto avatar Dec 28 '24 23:12 Taka-Hashimoto

I encountered the same issue on Google Colab, but I was able to resolve it by adding the following code before importing genesis:我在 Google Colab 上遇到了同样的问题,但我能够通过在导入 genesis 之前添加以下代码来解决它:

import os
NVIDIA_ICD_CONFIG_PATH = '/usr/share/glvnd/egl_vendor.d/10_nvidia.json'
ICD_CONFIG_CONTENT = """{
    "file_format_version" : "1.0.0",
    "ICD" : {
        "library_path" : "libEGL_nvidia.so.0"
    }
}
"""
with open(NVIDIA_ICD_CONFIG_PATH, 'w') as f:
    f.write(ICD_CONFIG_CONTENT)

You can find the complete code here: Gist link您可以在此处找到完整的代码: Gist 链接

I tried your method on my cloud server, but it doesn't seem to work.

ZimengYuan avatar Jan 09 '25 08:01 ZimengYuan