coltra-rl
coltra-rl copied to clipboard
Make a proper connection between Observation/Action, and gym spaces
Right now, there is a vague connection between (Box(...) and Action(continuous=...)), and between (Discrete(...) and Action(discrete=...))
In principle, all of these can support Dict action/observation spaces, but I don't want to lose static typing of obs.vector, action.continuous etc.