Aniruddha-JU

File "/home/aniruddha/anaconda3/envs/rupak_qg/lib/python3.6/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl return forward_call(*input, **kwargs) File "/home/aniruddha/Rupak_QG/meta_learning/pytorch_pretrained_bert/modeling.py", line 1525, in forward return self.beam_search(input_ids, token_type_ids, position_ids, attention_mask, task_idx=task_idx, mask_qkv=mask_qkv) File "/home/aniruddha/Rupak_QG/meta_learning/pytorch_pretrained_bert/modeling.py", line 1732, in beam_search prev_embedding, back_ptrs)...

return _sentencepiece.SentencePieceProcessor_LoadFromFile(self, arg) RuntimeError: Internal: /sentencepiece/python/bundled/sentencepiece/src/sentencepiece_processor.cc(848) [model_proto->ParseFromArray(serialized.data(), serialized.size())]

Hi, Thanks for your reply : I am getting the error when I am using this command python pretrain_nmt.py -n 1 -nr 0 -g 1 --use_official_pretrained --pretrained_model ai4bharat/IndicBART --tokenizer_name_or_path ai4bharat/IndicBART...

But when I am putting: model_path a blank folder then the code is running python pretrain_nmt.py -n 1 -nr 0 -g 1 --use_official_pretrained --pretrained_model ai4bharat/IndicBART --tokenizer_name_or_path ai4bharat/IndicBART --langs hi --mono_src...

Hi, I realized and changed earlier. I have one query also..the model path argument in the above query does not use for any initialize model if we are using --use_official_pretrained...

So,We should not give any exiting model path right. Rather, I am giving anew path where the new pre-trained model will save.. AM I rIGHT? please confirm it once .....

as we are using args.use_official_pretrained so we don't need to give any exiting model path.. Because in your code, model_path is used to store the model, config, and tokenizer, AM...

Hi Thank you for your reply. Yes, model_path should be local path, actually I created it as the of ai4bhart/IndicBART like huggingface model name, and I have verified that the...

hi, i am getting one point..That your code is only working when I am putting .hi extension. Otherwise its getting error. Like when I am passing train.kn it is getting...

IndicBART size is 2.4 GB and pure_model size is 932.