Noah Farr comments

Results 5 comments of


                                            Noah Farr

Is this still an open issue? If so, I'd like to give it a shot.

No specific reason, take a look at this pull request https://github.com/vwxyzjn/cleanrl/pull/481

Here is the current state of my implementation: https://github.com/noahfarr/cleanrl/blob/master/cleanrl/crossq.py

Thanks for your quick response :)

Do I understand correctly that currently there is no way to access the true final obs of an episode? Why not just add it to the info dict as you...