Offline CQL performance on Hopper expert env

Open pcheng2 opened this issue 3 years ago • 3 comments

Hi, thank you for sharing the torch version code of CQL :) I found as training on Hopper-expert-v2 env, CQL-SAC performs poorly. Don't know why that happends.

Following are the relevant plots.

Feb 28 '22 06:02 pcheng2

Hey, thank you for using the implementation and testing with it! The results you get indeed look very bad. What hyperparameters did you use and did you try to change some?

Mar 02 '22 10:03 BY571

@BY571 Hi, I was runing by the default parameters. And yeah, I will try more parameters and hope it will work fine :p

Mar 04 '22 06:03 pcheng2

https://github.com/orgs/community/discussions/109171 Frauds happening everywhere

Feb 21 '24 06:02 sohanglal