Petros Christodoulou
Petros Christodoulou
I have 56GB of RAM and am trying to maintain a replay buffer of 1M atari observations (which are lazyframes pointing to numpy arrays of size 84x84x4). With 56GB I...
GPU doesn't work with A3C because A3C uses multiprocessing - try turning off the GPU to see if it works. For small games anyway it is faster to run it...
Have you also set: config.use_GPU = False ?
hi, yep this is still being worked on, thanks for pointing out this error. I've updated it now and it works again for me (although it is a bit more...
Hi, I’d have to check it but it sounds like I made a mistake and you are correct it shouldn’t be there
Hi! I don't really know about the available tools, are there any you'd recommend?
hi, sorry i am not sure when i will have time to implement that one. There might be a paper that has done this before that you could use to...
Hi! I see, the NaN rewards might be because the environment is returning super large rewards which i think can happen in this environment if the agent starts choosing really...
Hi, Ah yes, at the moment if you choose the multiple runs option it will do multiple runs with the same random seed that you set. So that might be...
hi, does it work if you only use a CPU and not a GPU? For small games like this it should also be much faster to use a CPU