newtonysls
newtonysls
> 请问 显卡吞吐量如何 大概多少tokens/GPU/s
the same issue occur in my program. And I also find the reason of stuck is the tensor can not be moved to GPU. the same error will happen when...
> @theblackcat102, @macabdul9 is this issue now resolved? > > @newtonysls, it sounds like a different problem can you please open a new ticket? > > Thanks problem solve. My...
> transformers已经是4.30.2版本了,我通过修改chatglm的config.json解决了这个问题,但是出现在model_utils.py中出现了另一个问题:Traceback (most recent call last): File "/home/rlhf/DeepSpeedExamples/applications/DeepSpeed-Chat/training/step1_supervised_finetuning/main.py", line 356, in main() File "/home/rlhf/DeepSpeedExamples/applications/DeepSpeed-Chat/training/step1_supervised_finetuning/main.py", line 220, in main model = create_hf_model(AutoModelForCausalLM, File "/home/rlhf/DeepSpeedExamples/applications/DeepSpeed-Chat/training/utils/model/model_utils.py", line 49, in create_hf_model model.resize_token_embeddings(int( File "/home/anaconda3/envs/rl/lib/python3.9/site-packages/transformers/modeling_utils.py",...