Transformers4Rec
Transformers4Rec copied to clipboard
[FEA] Update Transformers4Rec to use latest release of HF transformers
🚀 Feature request
Update Transformers4Rec to use the latest version of HF transformers.
Motivation
The current API supports a pinned old version (4.12.) while the latest HF (4.25.). The motivation for this feature request is to update T4Rec to make use of the recent functionalities upgraded in the HF transformers library.
Hi @oliverholworthy , I observed that since transformers 4.35.0, they removed the use_cuda_amp, and the amp was entirely migrated to Accelerate: https://github.com/huggingface/transformers/issues/27760 Do you think we can remove it from t4rec as well?