goodbai

无法使用，/options.html页面打开全部空白

1

chrome 版本 39.0.2171.95 m options.html页面打开全部空白 不知道如何使用，没有任何配置的地方。 谢谢！

RuntimeError: CUDA out of memory

5

安装完成第一次运行时报错，ubuntu2204/nvidia T4卡x2 。是要切换量化等级吗？ $python moss_cli_demo.py Fetching 17 files: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 17/17 [00:00> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

使用fnlp/moss-moon-003-sft-int4和fnlp/moss-moon-003-sft-int8模型报错

5

因为GPU显存32G，所以修改了文件moss_gui_demo.py 中的模型引用，改为fnlp/moss-moon-003-sft-int4和fnlp/moss-moon-003-sft-int8后都报错。 ~/MOSS$ python moss_gui_demo.py Downloading pytorch_model.bin: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████| 10.8G/10.8G [04:29

经过几番捣腾，后台报语法错误：TypeError: '<' not supported between instances of 'tuple' and 'float'`

8

经过几番捣腾，载入int4的模型OK了，浏览器提交prompt，后台报语法错误如下。 ubuntu：2204 NVIDIA-SMI 530.41.03 nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2019 NVIDIA Corporation Built on Sun_Jul_28_19:07:16_PDT_2019 Cuda compilation tools, release 10.1, V10.1.243 `~/MOSS$ python moss_gui_demo.py Waiting for all...

The server console prints an error message when I submit a request from the browser

2

**1 start log++++++++++++++++++** $ bash alpaca-serve.sh ``` ===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues ================================================================================ CUDA SETUP: CUDA runtime path found: /usr/lib/x86_64-linux-gnu/libcudart.so...

默认模板表现比较差，在做LLAMA原版模型+LORA模型合并时报错。

2

下载了[Linly-Chinese-LLaMA-7b-hf]这个模型文件，使用merge.sh运行报下面错误。是模型文件有误还是其他呢？谢谢了！ bash scripts/merge.sh ===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please run python -m bitsandbytes and submit this information together with your error trace to: https://github.com/TimDettmers/bitsandbytes/issues ================================================================================ bin /home/good/anaconda3/envs/lawgpt/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cuda115.so...

ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 2)

8

### System Info ``` python -x examples/Aquila/Aquila-chat/aquila_chat.py [2023-06-10 13:32:17,187] [INFO] [logger.py:85:log_dist] [Rank -1] Unsupported bmtrain args list is ['--IGNORE_INDEX', '-100', '--adam_beta1', '0.9', '--adam_beta2', '0.999', '--already_fp16', 'False', '--batch_size', '1', '--bmt_async_load', 'False',...

[Question] RuntimeError: Internal: src/sentencepiece_processor.cc(1101) 官方demo报错

1

### Required prerequisites - [X] I have read the documentation . - [X] I have searched the [Issue Tracker](https://github.com/baichuan-inc/baichuan-7B/issues) and [Discussions](https://github.com/baichuan-inc/baichuan-7B/discussions) that this hasn't already been reported. (+1 or comment...