jmcmanus15
jmcmanus15
This may be related to Issue #1216 I'm not sure this is just a matter of documentation. I've spent two days trying to get the fuzzy dedup workflow to succeed,...
I'm attempting to use these checkpoints as Composer training checkpoints, but Composer hangs when loading them. My yaml file has: load_path: /workspace/checkpoints/modernbert_large_context_extension/ep0-ba49552-rank0.pt I downloaded that checkpoint from the link above...
I figured out my issue. The checkpoints cited above are not suitable for the composer Trainer, even if one sets `load_weights_only` to `True`. There are two distinct code paths for...