GUIJIN SON

icon indicating a website link https://scholar.google.com/citations?user=Zf_eLDsAAAAJ&hl=en&oi=ao icon indicating an email [email protected]

icon location Seoul, Korea icon location Yonsei University UIC Economics Major

Results 3 comments of GUIJIN SON

Help on MultiGPU setup

I am experiencing the same error, and ` --device cuda ` does not seem to work!

Help on MultiGPU setup

I was using qwen-72b

Help on MultiGPU setup

@haileyschoelkopf Thank you for the clarification running with `--model_args parallelize=True` works for me. It was this description at the readme that made me confused. > If your model is is...