HouseLi

Results 5 comments of HouseLi

[Feature]: Simple Data Parallelism in vLLM

Any progress on it? I think it would be quite useful for efficient inference on Qwen3-4B with a single node and 8 GPUs.

Cannot run geo3k multiturn example

any progress? I met the same issue.

Cannot run geo3k multiturn example

> https://github.com/volcengine/verl/blob/main/verl/utils/dataset/rl_dataset.py#L317 If verl is receiving data from `rl_dataset` and the rollout is done using `AsyncRolloutRequest`, then would it be enough to just modify the `rl_dataset` part to solve this...

Cannot run geo3k multiturn example

it seems like `AsyncRolloutRequest` will update the position_ids and discard prompts['position_ids']

improve prompt messages

would you like to provide my details about your needs, such as prompts for what? Thank you.