tiny-llm icon indicating copy to clipboard operation
tiny-llm copied to clipboard
Published 3 months ago • verified publisher icon skyzh

feat: Distributed inference (TP/PP)

Open gaocegege opened this issue 6 months ago • 0 comments

It would be great to add support for single-node, multi-process inference to Tiny LLM.

gaocegege avatar Aug 04 '25 11:08 gaocegege