ml-agents icon indicating copy to clipboard operation
ml-agents copied to clipboard

Defining an empty observation for Buffer Sensor

Open CubeMD opened this issue 4 years ago • 1 comments

Is your feature request related to a problem? Please describe. If Buffer Sensor is not completely filled with observables the rest of observations are zeros. This might become an issue in case that an observation full of zeros is a valid entity observation.

Describe the solution you'd like It might help to define a custom empty observation per buffer sensor and just before writing sensor values using it to fill in the remaining observables. I came up with a solution which looks like this in the Editor image

Describe alternatives you've considered Ignoring it and hoping that the agent will learn regardless

CubeMD avatar Jan 18 '22 17:01 CubeMD

Hi, Thanks for bringing up this request. Currently we consider a nearly zero entity as an empty observation and it's a fair point that it might be a valid observation. I logged this internally as MLA-2360 and will prioritize accordingly.

maryamhonari avatar Jan 25 '22 16:01 maryamhonari