liyu199809
liyu199809
> I'm also reproducing this paper now, can you conveniently share my config file for the training?
现在这个evluate代码提供了吗？
Will megatron context parallelism be supported in the future?
> > 未来会支持 megatron 上下文并行吗？ > > 是的。我们将默认使用支持cp的mcore。 It seems that the context parallelism in the model part has not been implemented yet. Is this function currently available?