Megatron-DeepSpeed icon indicating copy to clipboard operation
Megatron-DeepSpeed copied to clipboard
verified publisher icon bigscience-workshop

how to frozen some layers of GPT, only fintune last k layers?

Open joan126 opened this issue 2 years ago • 0 comments

Hello, I want to finetune only last k layer of GPT model. how can I solve this?

joan126 avatar Apr 04 '23 07:04 joan126