Conan

NameError: name 'awq_ext' is not defined

3

### Reminder - [X] I have read the README and searched the existing issues. ### Reproduction Exception in thread Thread-6 (run_exp): Traceback (most recent call last): File "/root/miniconda3/envs/llama-factory/lib/python3.10/threading.py", line 1016,...

Import a model:latest aborted (core dumped)

6

### What is the issue? I carefully read the documentation content of the README to try root@autodl-container-36e51198ae-c4ed76b0:~/autodl-tmp/model# ollama create example -f Modelfile transferring model data using existing layer sha256:8c7d76a23837d1b07ca3c3aa497d90ffafdfc2fd417b93e4e06caeeabf4f1526 using...

error loading model: error loading model vocabulary: unknown pre-tokenizer type: 'qwen2'

6

### What is the issue? I carefully read the contents of the readme's documentation to try and found that something went wrong time=2024-05-20T10:06:02.688+08:00 level=INFO source=server.go:320 msg="starting llama server" cmd="/tmp/ollama2132883000/runners/cuda_v11/ollama_llama_server --model...

### Reminder - [X] I have read the README and searched the existing issues. ### Reproduction 05/22/2024 11:46:06 - INFO - transformers.configuration_utils - Model config LlamaConfig { "_name_or_path": "/root/autodl-tmp/Meta-Llama-3-8B", "architectures":...

eval_mixtral怎么来的

3

── playground │ └── eval_mixtral.py 没搞懂这个eval_mixtral.py怎么来的

(mixtral) root@autodl-container-582647ab6b-a5b6a91c:~/autodl-tmp/mixtral-8x7b-32kseqlen# magnet:?xt=urn:btih:5546272da9065eddeb6fcd7ffddeef5b75be79a7&dn=mixtral-8x7b-32kseqlen&tr=udp%3A%2F%http://2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=http%3A%2F%http://2Ftracker.openbittorrent.com%3A80%2Fannounce [1] 11681 [2] 11682 [3] 11683 -bash: magnet:?xt=urn:btih:5546272da9065eddeb6fcd7ffddeef5b75be79a7: command not found 他一直报错

None of the inputs have requires_grad=True. Gradients will be None

1

**Describe the bug** What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程，最好有截图) 在训练yi-vl模型和Phi-3-vision-128k-instruct模型在webui页面训练的时候报错    下面的这段是报错信息Detected kernel version 5.4.0, which is below the recommended minimum of 5.5.0;...

long memory question

3

Boss, where did you implement the long memory memory stream in your AI town? Did you refer to the interface or library, or did you perform compression, deletion, transfer, and...