PMIC
PMIC copied to clipboard
CLUB training
Hi, thanks for your nice work.
I have some questions about the training of the CLUB estimator. Is the iteration number too small to learn the estimator well? Does the estimator learn stably during training? (As I know, the CLUB is hard to be optimized to obtain good results.)
https://github.com/yeshenpy/PMIC/blob/ab3fee60b1c75d65c3c3f209397130c059eedb41/run_maxminMADDPG.py#L321
Thank you for your interest.
In the training curves, both CLUB and MINE show rapid convergence. You can take a look at the curves. If you are concerned about potential non-convergence issues, you can increase the training frequency, but this may introduce higher resource overhead.