Tobia Poppi

icon indicating a website link tobiapoppi.github.io icon indicating an email [email protected]

icon company @aimagelab | University of Modena and Reggio Emilia icon location Modena, Italy icon location PhD student in Artificial Intelligence at Unimore and Unipi.

Results 3 comments of Tobia Poppi

'DQNStrategy' object has no attribute 'clock'

Hi @Ai360n, I'm having the same problem right now, but if you don't need the clock and you just need an alternative way to use the experience_counter, then just use...

[BUG] {'use_reentrant': True} results in "Gradients will be None"

Yes, I agree. Also, if training is gradient is distributed through deepspeed reentrant=False is no more an option.

dpo_ov7b.sh imports data_processing which is missing

+1 just remove the import line and add these two functions ``` def load_jsonl(filepath): """Load a JSONL file and return a list of parsed JSON objects.""" data = [] with...