MOSS
MOSS copied to clipboard
An open-source tool-augmented conversational language model from Fudan University
没有显卡的话,是否有人研究过纯CPU的模式?
According to this [thread](https://github.com/openai/triton/issues/1465#issuecomment-1493772250), triton is now only available on Linux. Is there any work around for Windows and MacOS?
量化模型需要triton库,但是triton库只有Linux版本,后续是否会改进其他方式兼容Windows呢?
excuse me, i want run this in colab pro. but don't know how to do it. just copy paste not work. could you please give me some tips?
The word 'multiple' is misspelled as 'mutiple'. Please fix this issue.
无法多卡训练
 系统有两张3090,但是每次训练的时候只能调用一张卡,然后每次都会显示OOM
│ /home/ubuntu/.cache/huggingface/modules/transformers_modules/fnlp/moss-moon- │ │ 003-sft/dc39155402a323c3ad85ac9c4cb02556c61594f1/modeling_moss.py:53 in │ │ apply_rotary_pos_emb │ │ │ │ 50 │ │ 51 # Copied from transformers.models.gptj.modeling_gptj.apply_rotary_pos_ │ │ 52 def apply_rotary_pos_emb(tensor: torch.Tensor, sin: torch.Tensor, cos:...
报错咋解决呀
raise ValueError( ValueError: At least one of the model submodule will be offloaded to disk, please pass along an `offload_folder`.