UtilsRL
UtilsRL copied to clipboard
[Feature]: Full image input support
Prerequisites
- [X] I have tried updating UtilsRL to the newest version.
- [X] I have checked both open and closed issues but found nothing related to my request.
UtilsRL verison when proposing this request
0.3.13
What I am expecting
- add CNN backend for UtilsRL.
- refactor replay buffers to cope with high-dimensional visual observation.
- (possibly) refactor replay buffers to store discrete action. This may involve a significant change to the current buffer design, for we cannot set the dtype of action to
floatanymore. maybe relevant to #2.
Possible solutions
No response
Any additional messages which might help
No response
Urgency
Urgent, will bring significant improvement and should be considered in next main version.