Jim Straub comments

Repositories
Issues
Comments

Results 3 comments of


                                            Jim Straub

Make detecting CUDA libraries more general

@dhiltgen It looks like everyone has honed in on the 'libnvidia-ml' loading problem. **This should fix it and close out a bunch of issues.** It should also work for AMD...

issue: Embedding and Reranker models do not work after reinstalling OpenWebUI and importing a JSON file

I'm trying to do the exact same thing with the same models. All I get (after waiting) is "no sources found". There is NO feedback about what is happening! I...

issue: Embedding and Reranker models do not work after reinstalling OpenWebUI and importing a JSON file

**Update** ### How to use llama-server as a reranker To use llama-server with reranking: - add the --reranking argument - You may need to increase -ubatch-size XXXX (if you get...