ChuangLee

Results 5 issues of ChuangLee

### Is your feature request related to a problem? Please describe. many users have multi-gpu matchine, such as 3090, 2080ti, the individual Vram of these GPUs is insufficient to deploy...

### Is your feature request related to a problem? Please describe. https://github.com/ChuangLee/ChatGLM-6B-multiGPU 自动平均分配显存。 之前单卡要13GB,很多GPU刚好用不了,很尴尬。 ### Solutions https://github.com/ChuangLee/ChatGLM-6B-multiGPU 已解决。 ### Additional context _No response_

### What happened? The user-configured System Prompt does not seem to be effective. Upon inspecting the code, I observed that the system prompt is consistently read from `default-completion-system-prompt.txt.` The method...

bug