captify-alapite

Can't test CartPole-v0 model trained with TRPO

3

I've tried to use TRPO to create a model for `CartPole-v0` by following the instructions on your [OpenAI Gym page](https://gym.openai.com/evaluations/eval_4QXCRAATTDqakJV0YZlJ4g#reproducibility), changing the command to the following to reflect the api...

Code hardwired to Atari and emulator environments

1

In many places in the code, there's a hardwired expectation that the environment will either be from ALE, or else it will be from some other type of video game....