ART icon indicating copy to clipboard operation
ART copied to clipboard

About asynchronous generation and training like AReal

Open llv22 opened this issue 5 months ago • 2 comments

One question about ART framework, will we plan to support asynchronous generation/rollout and training, like https://github.com/inclusionAI/AReaL?tab=readme-ov-file (paper: https://arxiv.org/pdf/2505.24298)?

Essentially, it is a non-blocking rollout mechanism so that the ready-to-use rollout group can be sent to training queue, instead of waiting (If I understand correctly)

Best Regards Orlando

llv22 avatar Aug 14 '25 02:08 llv22