Reinforcement Learning Auto Scaling Demo

[Andcircle]

Link to the notebook Add the link to the notebook. https://github.com/aws/amazon-sagemaker-examples/blob/main/reinforcement_learning/rl_predictive_autoscaling_coach_customEnv/rl_predictive_autoscaling_coach_customEnv.ipynb

What aspects of the notebook can be improved? It only plot rewards, but not actual scaling results, e.g. load vs capacity plot. And actually the ppo preset performs very bad, is it possible to give a better tuned preset as starting point?

blue is load, red is capacity

What are your suggestions?