huacilang

where is the Knowledge Distillation in the code

1

hello ，distillation of knowledge is mentioned In the paper , but i didn't see in the code

多卡训练，现存需要多少

1

你好，用V100多卡训练aishell数据集，从2张到4张到8张，都报torch.cuda.OutOfMemoryError: CUDA out of memory，是哪里需要调整吗

Hello, the directory after fine-tuning only have few files ：adapter_config.json adapter_model.safetensors optimizer.pt preprocessor_config.json README.md rng_state.pth scheduler.pt trainer_state.json training_args.bin。 Missing a few files, such as pytorch_model.bin and config.json. What transformations have...