linuxdevops

./caddyplug install http.ipfilter fetching missing dependencies: caddy, dnsproviders, hook.pluginloader go: github.com/caddyserver/caddy upgrade => v1.0.5 exit status 128 Caddy version v1.0.3

An error is reported when running python setup_cuda.py install

2

(textgen) quanlian@quanlian-System-Product-Name:~/aigc/text-generation-webui/repositories/GPTQ-for-LLaMa$ python setup_cuda.py install running install /home/quanlian/mambaforge/envs/textgen/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer, pypa/build or other standards-based tools. See...

运行量化llama2报错 AttributeError: 'LlamaForCausalLM' object has no attribute 'quantize'

5

[['cuda', 'fp16i8']] Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00