Alisson Azzolini issues

Results 3 issues of


                                            Alisson Azzolini

Traceable dtensor

Fixes #ISSUE_NUMBER cc @gujinghui @PenghuiCheng @XiaobingSuper @jianyuh @jgong5 @mingfeima @sanchitintel @ashokei @jingxu10 @min-jean-cho @yanbing-j @Guobing-Chen @Xia-Weiwen @mlazos @soumith @voznesenskym @yanboliang @penguinwu @anijain2305 @EikanWang @chunyuan-w @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @peterbell10 @desertfire

module: mkldnn

release notes: distributed (c10d)

module: inductor

ciflow/inductor

Hard to debug issue when passing a DTensor to spmd.distribute_tensor() (cuda/nccl only)

Passing a DTensor into spmd.distribute_tensor , or more specifically, into DeviceMesh, will cause issues - in device_mesh.broadcast, it will cause an assert to fail deep into torch code - in...

dtensor_tests generate tests with numel == 0 , causing redistribute (all_gather) to abort

This depends on issue https://github.com/pytorch/pytorch/issues/85234 It's hard to debug since the abort doesn't generate stack trace or any exceptions that can be caught.