teanon

Results 3 comments of teanon

transformer_base never registered with registry hparams

I have the same problem. Have you solved it

[Help] <size mismatch for embedding.weight>copying a param with shape torch.Size([8, 229376]) from checkpoint, the shape in current model is torch.Size([8, 4096]).

我的理解是推理时的有些参数（如source_prefix 和prefix_projection）需要和训练时保持一致 config = AutoConfig.from_pretrained(path, trust_remote_code=True, pre_seq_len=128, source_prefix='如果你有prefix 就把它加上吧', prefix_projection=True)

Hello, I used Chinese data for training and found that all the results I got have the first character as "的", such as "的 里 有 一 的 男 士" and "的 山 小 上 一 的 女 人 和 一 手 子 的 人". I would like to ask if there is anything else I need to modify besides the data when training Chinese language.

请问中文的话下载哪个模型呀？