Megatron-LM icon indicating copy to clipboard operation
Megatron-LM copied to clipboard
Published 5 months ago • verified publisher icon NVIDIA

Changes to support latent MoEs

Open deepakn94 opened this issue 5 months ago • 1 comments

deepakn94 avatar Nov 19 '25 02:11 deepakn94

Thanks for the work. Could you also add UT and integration tests covering this feature combined with EP/TP?

yanring avatar Nov 24 '25 05:11 yanring

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

copy-pr-bot[bot] avatar Dec 05 '25 18:12 copy-pr-bot[bot]

/ok to test dd645a8e848c92fc93037e6e6bfc729fa72d3f11

deepakn94 avatar Dec 05 '25 21:12 deepakn94

/ok to test 80f1d5f

deepakn94 avatar Dec 06 '25 23:12 deepakn94

/ok to test 4257d6a

deepakn94 avatar Dec 06 '25 23:12 deepakn94

/ok to test 44b708d

deepakn94 avatar Dec 07 '25 00:12 deepakn94

/ok to test ec588117fd113a98030d84765240a6780027add6

ericharper avatar Dec 08 '25 03:12 ericharper

/ok to test ec588117fd113a98030d84765240a6780027add6

deepakn94 avatar Dec 08 '25 07:12 deepakn94