Alex Ng

icon company alibaba cloud icon location Beijing icon location Working at Alibaba Cloud, responsible for model inference optimization on the AI infrastructure of the ECS platform.

Results 3 comments of Alex Ng

error with mpirun

I encounter the similar problem, how do you fix it? RuntimeError: Default process group has not been initialized, please make sure to call init_process_group.

The output is wrong when using serve.py.

GPU:4xA100-80G torch 2.4.0+cu121

The output is wrong when using serve.py.

> Thanks for your question. Nanoflow works on 8*A100 only for the current version. When less than 8 cards are presented, Nanoflow assumes empty result for the missing GPUs, causing...