REST icon indicating copy to clipboard operation
REST copied to clipboard
verified publisher icon FasterDecoding

Tensor parallelism

Open lethean1 opened this issue 1 year ago • 0 comments

I want to use tensor parallel with REST, but I do not find the config to start the tensor parallel, can you give me an example?

lethean1 avatar Oct 11 '24 14:10 lethean1