gaianet-node icon indicating copy to clipboard operation
gaianet-node copied to clipboard

feat: Monitor and export hardware info

Open DarumaDocker opened this issue 1 year ago • 0 comments

Summary

I need a way to determine the hardware my LLM model is running on to dynamically analyze its performance. Could you provide an API for retrieving the machine's hardware information?

Details

The structure can be something like:

{
  "cpu": {
    "manufacturer": "Intel",
    "model": "Core i7-12700K",
    "cores": 12
  },
  "gpu": [
    {
      "manufacturer": "NVIDIA",
      "model": "RTX 3080",
      "memory": 10
    },
    {
      "manufacturer": "NVIDIA",
      "model": "RTX 3080",
      "memory": 10
    }
  ],
  "ram": {
    "total": 32
  },
  "os": {
    "name": "Ubuntu",
    "version": "22.04",
    "architecture": "x86_64"
  }
}

Ref: https://github.com/WasmEdge/WasmEdge/issues/3914

DarumaDocker avatar Dec 19 '24 02:12 DarumaDocker