FengPeanut

icon location Hubei Wuhan icon location Do as a little vegetable-dog

Results 3 issues of FengPeanut

strange score

1 comment

Everyone has encountered that every time a reference is added, the bleu score will increase and the sari will decrease. Then when I add all the refs, the bleu score...

No implement of generate() when using models from hugging face.

What an amazing work, however, when I tried to inference kosmos model from hugging face, there was an error: NotImplementedError: A model class needs to define a `prepare_inputs_for_generation` method in...

When I try to do the tensor_parallel on NLLB from meta, there is an error

Here is my code: from transformers import AutoModelForSeq2SeqLM, AutoTokenizer import tensor_parallel as tp tokenizer = AutoTokenizer.from_pretrained("/workspace/projects/nllb/nllb3.3b", use_auth_token=True, src_lang="deu_Latn") model = AutoModelForSeq2SeqLM.from_pretrained("/workspace/projects/nllb/nllb3.3b", use_auth_token=True) model = tp.tensor_parallel(model, ["cuda:0", "cuda:1"]) # parallelize(model, num_gpus=2,...