KongXiaoyu

icon company University of Science and Technology of China icon location Hefei, China icon location I'm Kong Xiaoyu, a student in University of Science and Technology of China.

Results 2 issues of KongXiaoyu

More Input: If I use PyTorch Lightning for large model fine-tuning (LoRA) tasks, and I want to pass an additional parameter p outside the input-output pair (input, label), to be used in the Linear layer of LoRA for some special tasks during forward pass, how should I proceed?

2 comment

How can I make it? If I use PyTorch Lightning for large model fine-tuning (LoRA) tasks, and I want to pass an additional parameter p outside the input-output pair (input,...

传入更多参数：进行大模型微调(LoRA)任务，我在输入输出对(input,label)外还想要传入一个额外的参数p,用于在LoRA的Linear层中，在forward时进行一些特殊的任务，我应如何做？

如题，我如何传入更多的参数给Linear层的forward函数？