luxuriance19
luxuriance19
> I run the Test.py with your model and met a problem tensorflow.python.framework.errors_impl.invalidargumenterror : cannot assign a design for operation 'shared model/conv_20_b', I use the python3.5 and tensorflow 1.4.1 ，I...
+ wx: muzi_luxuriance
> > 模型更新了 > > > > > > 按照chatglm-6b的方式ptuning微调 报错了 ChatGLMModel' object has no attribute 'prefix_encoder' > > > > > > > > > > > > >...
> > preprocess_function_train > > 改preprocess_function_train就行 ` """ 为了适配ChatGLM1 context_length = input_ids.index(tokenizer.bos_token_id) mask_position = context_length - 1 labels = [-100] * context_length + input_ids[mask_position+1:] """ > > 为了适配ChatGLM2，讲上面的代码改为下面的： context_length =...
I tried peft==0.2.0, bitsandbytes ==0.37.2. But it still run out of memory when validate at second times. 7B model on 24G VRAM
anybody solved this problem？