MOSS icon indicating copy to clipboard operation
MOSS copied to clipboard

这个是因为显存不够还是什么?

Open af-74413592 opened this issue 2 years ago • 4 comments

│ /home/ubuntu/.cache/huggingface/modules/transformers_modules/fnlp/moss-moon- │ │ 003-sft/dc39155402a323c3ad85ac9c4cb02556c61594f1/modeling_moss.py:53 in │ │ apply_rotary_pos_emb │ │ │ │ 50 │ │ 51 # Copied from transformers.models.gptj.modeling_gptj.apply_rotary_pos_ │ │ 52 def apply_rotary_pos_emb(tensor: torch.Tensor, sin: torch.Tensor, cos: │ │ ❱ 53 │ sin = torch.repeat_interleave(sin[:, :, None, :], 2, 3) │ │ 54 │ cos = torch.repeat_interleave(cos[:, :, None, :], 2, 3) │ │ 55 │ return (tensor * cos) + (rotate_every_two(tensor) * sin) │ │ 56 │ ╰──────────────────────────────────────────────────────────────────────────────╯ RuntimeError: CUDA error: device-side assert triggered CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

af-74413592 avatar Apr 23 '23 06:04 af-74413592

版本不对。安装新版本就行 pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117

WanJuWuGo avatar Apr 23 '23 06:04 WanJuWuGo

请问您解决了吗,

piglaker avatar Apr 23 '23 12:04 piglaker

请问您解决了吗,

我按照这个 解决了 pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117

img_v2_5155b4df-cc15-4a4d-a03d-9eb6a6e5510g s0TApeHjWb

wktdwktd avatar Apr 23 '23 12:04 wktdwktd

请问您解决了吗,

我按照这个 解决了 pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117

img_v2_5155b4df-cc15-4a4d-a03d-9eb6a6e5510g s0TApeHjWb

请问我就是图中这个版本,在A100上尝试,几次问答后,依然报同样的错误。请问怎么解决

baigang666 avatar Apr 24 '23 06:04 baigang666