jeff3071
jeff3071
You can refer to my code at https://github.com/open-evals/evals .
Thank you for asking. I utilize [Open-evals](https://github.com/open-evals/evals) to convert the data into chat format. The format includes a question to be solved based on a given context, followed by a...
Hi @anandkaranubc , is there any update? I’m interested in contributing and would be happy to help with this feature. Please let me know if it's okay for me to...
@liam60 Sorry for late response. I am working on it now. Will update PR soon.
Same issue with 4xA100 ``` + nvidia-smi topo -m GPU0 GPU1 GPU2 GPU3 CPU Affinity NUMA Affinity GPU NUMA ID GPU0 X NV12 SYS SYS 0-23 0 N/A GPU1 NV12...
> Could you try setting `sync_module_states=False` when initializing FSDP? This resolved the issue on my end but I'm not sure if it doesn't impact other parts of the code. I...