Ritabrata Maiti issues

Repositories
Issues
Comments

Results 2 issues of


                                            Ritabrata Maiti

Confused about the entire dimension thing...

What should the input and output dimensions be for the test dataset. For example, I have a test dataset of dimensions (94,1,1). What should the output dimensions be? I am...

Whenever I use QLoRA to train LLama/LLama 2 on an instruction-tuning dataset like Dolly or Alpaca I get a periodically oscillating training loss

![image](https://github.com/artidoro/qlora/assets/20902368/2215ab48-fa9d-4b25-a05e-7f5dd4d36b68) Is this behavior normal/acceptable? Why does it happen?