training icon indicating copy to clipboard operation
training copied to clipboard
verified publisher icon mlcommons

Llama2 - LoRA Reference Implementation

Open rgandikota opened this issue 1 year ago • 2 comments

  1. The Readme points to using a eval.py, which is missing from the llama2 scripts folder.
  2. Instructions to run this reference implementation on multiple nodes would be helpful for anyone looking to use it as-is.
  3. Would be helpful to new submitters if the training time for the reference run is documented.

rgandikota avatar Apr 08 '24 16:04 rgandikota

  1. I'll delete it - it is just confusing
  2. @michal2409 can you open a PR to update the README with multi-node
  3. I can add one log but we don't usually do that - @nv-rborkar what do you think

itayhubara avatar Apr 11 '24 15:04 itayhubara

@itayhubara Could you please let us know if we can use this dataset from hugging face instead of the parquet files from the Google Drive? From the ReadMe instructions, looks like this is the dataset the parquet files https://huggingface.co/datasets/tau/scrolls/blob/main/gov_report.zip

rgandikota avatar May 02 '24 19:05 rgandikota

@rgandikota can we close this issue?

hiwotadese avatar Jul 10 '24 23:07 hiwotadese