seansong

FLOPs counter seems doesn't work

8

### 🚀 The feature, motivation and pitch I am able to run the training with the FSDP. But then add the "--flop_counter" flag. It gives the following issue. Could someone...

New metrics for benchmark

2

### 🚀 The feature, motivation and pitch Very nice work, Llama team. Llama is the most popular open-source LLM project and has been adopted for different platforms. It will be...

Inference with "FULL_STATE_DICT" checkpoint from FSDP fine tuning

2

### 🚀 The feature, motivation and pitch I can get a single checkpoint after using FSDP fine tune the model.  My question is how can I use this single...

Though there are some related tickets, it would be great to see the steps to use the raw checkpoints for inference. https://github.com/pytorch/torchtitan/blob/main/docs/checkpoint.md This helps to verify the training works well.