rl icon indicating copy to clipboard operation
rl copied to clipboard
verified publisher icon pytorch

[Question] Item called in loss modules forces synchronization?

Open skandermoalla opened this issue 2 years ago • 1 comments

Aren't operations like this blocking? causing performance issues due to GPU synchronization? https://github.com/pytorch/rl/blob/5b3dd988ad7f0f91a2f61f77a8b3380eae3131fd/torchrl/objectives/ppo.py#L443

skandermoalla avatar Jan 10 '24 10:01 skandermoalla

Good point we should check that!

vmoens avatar Jan 10 '24 11:01 vmoens