roborluo

Results 5 comments of roborluo

Question about building locally with open repo

Some supplementary, I was trying to build latest ONNXoptimizer with latest released version of ONNX(1.14.1), and failed to pass 11 unit tests in ONNXoptimizer.

Server stuck after `Starting Python backend stub`

I resolved by running `PMIX_MCA_gds=hash` by referring to this page https://github.com/open-mpi/ompi/issues/6981. Please tell me if my solution makes sense. after I added this solution. Server gets stuck after https://github.com/triton-inference-server/python_backend/blob/main/src/stub_launcher.cc#L253-L256. Please...

Server stuck after `Starting Python backend stub`

Hi Slyne, Nice to hear from you. I like your profile BTW. > How many H100 GPUs are there? So as we are using p5 so, the only answer is...

gRPC Segfaults in Triton 24.06 due to Low Request Cancellation Timeout

+1 same issue.

batch inference is different with single

+1 here