XHPlus
XHPlus
Oh, I just find the early similar issues. But it would be better if there was a makefile sulotion!
Thanks , i have read the issue #2. In fact, i run the program step by step as listed in scripi-simple.sh rather than directly run the script-simple.sh. When I did...
As for the model file format, we have not tested GGML/GGUF up to now. What is the motivation to use these formats?
Thanks for your great PR! We are refactoring part of our code and will merge your PR as soon as the refactored version is ready. Besides, hope to add a...
Also welcome a contribution from the community, thanks!
If you deploy LightLLM with K8S, you can directly utilize the native load balance ability of K8S infra, such as starting multiple pods in K8S.
minicpmv2.5在端侧多模态模型中确实表现出众，我们尽快添加一下～
8G的单卡4060甚至也可以
https://huggingface.co/lightx2v/Wan2.2-Lightning/tree/main
可以发一下： 运行环境 GPU型号 启动脚本