NVGaryJi
Results
1
comments of
NVGaryJi
@linchpinlin @hjunjie0324 Can you verify with latest TRT-LLM (without setting --use_custom_all_reduce option) and see if it works? As byshiue explained, whether to use custom_all_reduce is now determined automatically.