chr1ce

icon company Beijing University of Post and Telecommunication icon location Beijing icon location Hi,im chr1ce. A undergraduate student from BUPT, majoring computer science and teconology.If you like my respositories, please star it, thank you!

Results 2 comments of chr1ce

Releasing Training Codes

looking forward~

Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method

i modified the sglang's code, and it worked for me add this in sglang>srt>server.py line 143 ```Python try: mp.set_start_method('spawn', force=True) print("spawned") except RuntimeError: pass ```