[tests] fix deepspeed zero3 config for `test_stage3_nvme_offload`
What does this PR do?
Since we manually modified the original zero3 config value here, we will end up with a ValueError in accelerate (code).
For Zero3 Checkpointing, we need to turn this value to True.
@amyeroberts and @ydshieh
OK for me.
Hi @ydshieh , could you take a look at this PR? Thx!
Hi @faaany Works for me, but the link
we will end up with a ValueError in accelerate (code).
doesn't seem pointing to the desired line/block?
Hi @faaany Works for me, but the link
we will end up with a ValueError in accelerate (code).
doesn't seem pointing to the desired line/block?
Oh, that's a mis-click. This is the correct line: https://github.com/huggingface/accelerate/blob/main/src/accelerate/accelerator.py#L3278
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.