Ethan

icon location Patience is everything.

Results 4 comments of Ethan

[REQUEST] Examples for tensor parallelism and pipeline parallelism

Great question. It would be even better if it could be combined with DDP.

Does Megatron has plan to support Gemma？

also looking for example of gemma in megatron-lm

stderr: AssertionError: Main process was not first

the same issue

Usage instructions

looking forward to it, sir :）