limoncc
limoncc
At today ,the InternLM release a tool that you can covert the model to llama architecture. https://github.com/InternLM/InternLM/tree/main/tools I successfully converted the model, but the llama.cpp don't support rope scaling type...
[Slider](https://mui.com/material-ui/react-slider/) is very important
maybe you need implement the api yourself，i check this app ,find this [docs](https://wudao.aminer.cn/open/document/code_ref/codegeex_generation)
libcuda.so.1: cannot open shared object file: No such file or directory==>Most likely you didn't turn on your gpu: **--gpus all**, Of course, you need to install nvidia-container-toolkit on the host...