Raghu Ganti comments

Results 14 comments of


                                            Raghu Ganti

Add support for scoring metrics to Runtime.cross_validate()

created by @yuanchi2807

Data splitter

The basic utility has been added, putting it as an actual node needs more work.

Support better integration between Ray and Spark in passing ObjectRef without actually moving data

@klwuibm Suggest that you fill in the rest of the issue template? :)

Support better integration between Ray and Spark in passing ObjectRef without actually moving data

Thanks @klwuibm !

how to exclude json serialization?

@RuedigerMoeller Why use such an old version of Jackson?

Support for AMD GPUs in the Llama Recipes notebook quickstart

We have tried this script on AMD GPUs and it works for LoRa and full fine tuning. We have not tried bits-n-bytes.

Adjust MFU to account for FP8

yes, this needs to be updated. The MFU computations for `fp8` are too good to be true :) CC: @lchu-ibm

Plan to support FSDP2?

Barebones example of fsdpv2 is available in https://github.com/pytorch/torchtitan.

[PP + EP][Master Thread] Enable Pipeline Parallelism (PP) and Expert Parallelism (EP)

@lchu6 would it make sense to start with MoE only, since MoE is the main thing that complicates parallelism strategy. We can add Mamba2 later.

[PP + EP][Master Thread] Enable Pipeline Parallelism (PP) and Expert Parallelism (EP)

@AdnanHoque has been working on benchmarking the kernels that he developed with Less, so it may be worth checking how the comms and compute look at the choices we make...