Luning Wang

icon indicating a website link https://wln20.github.io/ icon indicating an email [email protected]

icon company University of Michigan icon location Ann Arbor, US icon location M.S. @ UMich | B.Eng. @ THU | Seeking full-time jobs on LLMs & AI Infra

Results 2 issues of Luning Wang

ImportError: /home/miniconda3/envs/BMCook/lib/python3.10/site-packages/bmtrain/nccl/_C.cpython-310-x86_64-linux-gnu.so: undefined symbol: ncclBroadcast ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 17198) of binary: /home/miniconda3/envs/BMCook/bin/python

3 comment

Hi, I encountered the error described in the title of this issue, while trying to run the gpt-2 example. Here is my command: ``` export CUDA_VISIBLE_DEVICES=7 torchrun --nnodes=1 --nproc_per_node=1 --rdzv_id=1...

TypeError: bad operand type for unary -: 'NoneType'

An error occurred when I tried to run Mistral-7b-instruct-v0.2 model: ``` ... File "~/anaconda/envs/streamingllm/lib/python3.9/site-packages/transformers/models/mistral/modeling_mistral.py", line 88, in _make_sliding_window_causal_mask mask = torch.triu(mask, diagonal=-sliding_window) TypeError: bad operand type for unary -: 'NoneType'...