ml-agents icon indicating copy to clipboard operation
ml-agents copied to clipboard

Recording imitation learning session at runtime

Open Fax3D opened this issue 5 years ago • 4 comments

I would like to know if it's possibile, now or in the future, to record a session of imitation learning and use that record to train an agent during the "gameplay".

Image this scenario: Users play a game recording a session to train an agent, the agent learn with imitation learning (in a separate, even long, background process) and then it can play. All this stuff is done during gameplay, because every user must be auto-capable of traing its agent AI.

Is this scenario possible? Or it will be in the future?

Thanks

Fax3D avatar Feb 24 '20 11:02 Fax3D

Any news?

Fax3D avatar Aug 14 '20 14:08 Fax3D

I logged this request as MLA-1942.

vincentpierre avatar Apr 15 '21 21:04 vincentpierre

Is this current possible or still in developing stage?

Ro-tico avatar Aug 19 '21 11:08 Ro-tico

We will investigate at some point recoding demonstrations from built executables rather than the editor for imitation learning in Python. Regarding training at runtime, we currently rely on Python to perform training and do not have plans to support training within a built executable in C#. I do not know what this "separate, even long, background process" could look like. Maybe this would work if the user was willing to launch a Python learning process but I doubt it. Learning from real time data might be excruciatingly slow for a user to manage, I believe a difficulty adjustment setting would provide the same results for a fraction of the complexity.

vincentpierre avatar Aug 19 '21 17:08 vincentpierre

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

github-actions[bot] avatar Nov 04 '22 20:11 github-actions[bot]