nobita
nobita
I had same issue. `/usr/bin/ld : cannot find -lsycl` mean that `ld` cannot find **libsycl.so**. You can find it by use command: `locate libsycl.so` and link it to `usr/lib` using...
k is the beam width of the beam search.
This error raised because you ran this project on GPU but some tensor ran on CPU.
``` def create_masks(src, trg, opt): src_mask = (src != opt.src_pad).unsqueeze(-2).to(opt.device) if trg is not None: trg_mask = (trg != opt.trg_pad).unsqueeze(-2).to(opt.device) size = trg.size(1) # get seq_len for matrix np_mask =...
I use T4 on Google Colab.
> When merging tokenizers with `tokenizer_source: union` the output will always be a fast tokenizer, which gets saved as `tokenizer.json` instead of `tokenizer.model`. Is this file not present as well?...
I tried with the newest code on Github and it fixed this bug. Thanks!
> I had the same problem because CUBLABS is deprecated, you can build 0.2.79 using CUBLABS but for versions >=0.2.8, you should use `CMAKE_ARGS="-DGGML_CUDA=on" pip install llama-cpp-python --upgrade --force-reinstall` >...