FlexNeuART icon indicating copy to clipboard operation
FlexNeuART copied to clipboard

Adding data conversion and training script to support HF Accelerate

Open nkatyal opened this issue 9 months ago • 0 comments

The following changes introduces a newer version of the training script that uses HF accelerate. The functionality remains the same while making it easier for the user to set up the training environment. The changes has been tested in the following environments

🔍 Model Training Comparison (Old vs. New Setup)

Model GPUs Training Time (Old / New) MRR (Old / New)
BERT Short 1 × NVIDIA L4 (24GB) 3h 30m / 3h 22m 0.3319 / 0.3401
ElectraBERT MAXP 4 × NVIDIA T4 (16GB each) 6h 15m / 6h 30m 0.3364 / 0.3428

nkatyal avatar Apr 15 '25 19:04 nkatyal