Rogue Knight

How to specify the gpu in the training?

1

Hello, I want to use gpu speed up the training process. However the default gpu which id is "0" has been occupied. So I want to specify the gpu to...

Questions about replicating NLU experiments

1

Dear Author, Hello, I encountered the following issues while reproducing the NLU-deberta-v2-xxlarge experiment in the example folder: 1. After running deberta_v2_xxlarge_mnli.sh file, I find it does not generate lora file...

Env Problem

1

Thank you for your wonderful work. When I install the environment with 'pip install -e .', I fail to build flash_attention and get the error below. How can I fix...

Dear Author, First of all, I would like to express my gratitude for your excellent work and for open-sourcing such a valuable resource. After carefully reading your paper and going...