quartets
quartets
Hi, WeileiZeng! can you tell me where do I put these parameters? Into which file? Thanks
I have the same error, stuck here for a whole day now. I have checked nvidia driver, cuda, cudnn, torch, torchvisioin, all checked out fine. I am using the Windows...
My problem solved. It was the non-proper installation of bitsandbytes package. I did an uninstall and then: pip install https://github.com/acpopescu/bitsandbytes/releases/download/v0.37.2-win.1/bitsandbytes-0.37.2-py3-none-any.whl Then the MiniGPT-4 can start without any futher error message....
在~/.sat_models/visualglm-6b中。
你把配置里的这句删掉就能用了： "fingerprint": "chrome"
我的v100+32g Vram，在默认参数下跑13b对话很慢。我按指南里这句话进行了修改： 对于更强大的GPU，您可以在配置文件[minigpt4_eval.yaml](https://github.com/RiseInRose/MiniGPT-4-ZH/blob/main/eval_configs/minigpt4_eval.yaml)中将low_resource设置为False并使用更大的搜索宽度以16位运行模型。 改完参数后，对话基本上在3·5秒就回复我了。gpu和显存占用率提高了20%，还绰绰有余。
你的配置看起来是服务器配置，不是客户端配置。