geraldstanje1
geraldstanje1
hi, i get this error on osx: ``` pip3 install docker-compose-diagram Collecting docker-compose-diagram Using cached docker_compose_diagram-0.6.0-py3-none-any.whl.metadata (686 bytes) Collecting PyYAML==6.0.1 (from docker-compose-diagram) Using cached PyYAML-6.0.1-cp313-cp313-macosx_14_0_arm64.whl Collecting click=8.0.3 (from docker-compose-diagram) Using...
hi, is there a grafana dashboard i can use for node exporter so i dont need to create all the charts myself? edit: i found this: https://github.com/prometheus/node_exporter/blob/master/docs/node-mixin/dashboards/use.libsonnet - can i...
hi, is the following a known issue? please advise how to fix it? ``` [controller-runtime] log.SetLogger(...) was never called; logs will not be displayed. Detected at: > goroutine 216 [running]:...
hi, i see the format is different as expected ```"text_input", [1, 1],```: https://github.com/npuichigo/openai_trtllm/blob/main/src/routes/completions.rs#L201 but inflight batcher expects: ``` name: "text_input" data_type: TYPE_STRING dims: [ 1 ] ``` https://github.com/NVIDIA/TensorRT-LLM/blob/main/triton_backend/all_models/inflight_batcher_llm/ensemble/config.pbtxt#L34 is that...
hi, how to make this work with triton inference server with python backend? my python backend uses: ``` name: "gemma_chat" backend: "python" max_batch_size: 0 input [ { name: "text_input" data_type:...
hi @dmitry-tokarev-nv @mc-nv @achartier @chzblych can someone tell me why i see the following error? it should build triton inference server with tensorrt llm backend? also why is it using...
hi, i use a nvidia a10 on aws ec2 and run docker compose for dcgm_exporter and the following error. also how can i enable DCGM_FI_PROF_PIPE_FP64_ACTIVE and DCGM_FI_PROF_SM_ACTIVE? do i need...