Ravi Ghadia

icon indicating a website link https://ghadiaravi13.github.io/

icon company NVIDIA icon location Bengaluru icon location Trying to do better :)

Results 5 comments of Ravi Ghadia

RuntimeError: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method

Hi @muellerzr I am able to reproduce the same error for a dummy case, where I make no others imports other than the accelerate library. Cell:0 `from accelerate import Accelerator`...

RuntimeError: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method

Works for me too, thanks a lot @muellerzr for the prompt response!

Off-policy RL algorithms support

Hi, Probably somewhat related to this, having a forced_decoder_ids argument in the policy.generate() function might help with the offline RL setting, so is there a specific reason to not have...

Off-policy RL algorithms support

Got it, thanks!

Offloaded KV Cache

this cache is very helpful (for low-memory long-context inference) thanks for adding it!