gaianet-node
gaianet-node copied to clipboard
feat: Monitor and export hardware info
Summary
I need a way to determine the hardware my LLM model is running on to dynamically analyze its performance. Could you provide an API for retrieving the machine's hardware information?
Details
The structure can be something like:
{
"cpu": {
"manufacturer": "Intel",
"model": "Core i7-12700K",
"cores": 12
},
"gpu": [
{
"manufacturer": "NVIDIA",
"model": "RTX 3080",
"memory": 10
},
{
"manufacturer": "NVIDIA",
"model": "RTX 3080",
"memory": 10
}
],
"ram": {
"total": 32
},
"os": {
"name": "Ubuntu",
"version": "22.04",
"architecture": "x86_64"
}
}
Ref: https://github.com/WasmEdge/WasmEdge/issues/3914