BitNet
BitNet copied to clipboard
a demo sample problem
This model is currently English only, so any other languages like Chinese and so on are not expected to work well.
128k的词表,跟llama3一样大的,中文分词应该没啥问题。但是这个模型没怎么在中文语料上训练过,需要自己微调对齐一下。