z7r7y7

Train using custom dataset

9

Thank you for providing this excellent project! I would like to train on my custom dataset. In the _backbone.py_ file, I noticed that setting `self[0].train_backbone` to `True` results in a...

Long inference time

2

Hello, thank you for providing this excellent work. However, I have encountered an issue while using the model for inference. I have utilized fifteen images and generated a .pth file...

Hello，Thank you very much for your project and algorithm contributions! I have some questions regarding the process of fine-tuning and quantizing the llama model using the Qalora algorithm: 1.**Do I...

Hello, thank you for sharing such an amazing code repository. I am currently researching on the Llama model, generating a dataset based on my own constructed code for LoRA fine-tuning,...