Guang Yang

icon indicating a website link ntdxyg.github.io

icon company Nanjing University of Aeronautics and Astronautics icon location Software Engineering Researcher & PhD Student

Results 2 issues of Guang Yang

I want to discuss the impact of hyperparameters in PEFT/LoRA on CodeT5+

5 comment

I tried to fine tune the code generation tasks on specific domains using lora for the 220M, 770M, 2B, 6B models. When I kept the hyperparameters consistent (target_modules I set...

[Feature] Can support THUDM/GLM-Z1-9B-0414, thanks

3 comment

**What features would you like to see? Is it related to a problem or a new feature you'd like to see? Please describe.** Now, both transformers and VLLM support the...

feature request