HillDing comments

Repositories
Issues
Comments

Results 2 comments of


                                            HillDing

Fail to save megatron distributed checkpoints when using megatron as a back-end, and distributed checkpoint as actor model

> You can use mbrige to save transformers' type checkpoint. You can refer to this script:https://github.com/volcengine/verl/blob/main/examples/grpo_trainer/run_qwen3-235b_megatron_96gb.sh#L96. Thanks for your recommendation, I tried to use mbrige to save transformers' type, the...

Fail to save megatron distributed checkpoints when using megatron as a back-end, and distributed checkpoint as actor model

> [@HillDing](https://github.com/HillDing) Which version of verl and megatron you use? We recently fix the logic to use mbridge to save checkpoints, could you try to use new `megatron_checkpoint_manager`? Actually, after...