Hansen523 comments

Repositories
Issues
Comments

Results 2 comments of


                                            Hansen523

Report "Not a valid PEM pre boundary" error when I add a model

@dosu I use dify in private net，it don't have domain, so I doesn't use ssl, use http not https

按照文档运行 bge 模型不正常

> 代码 > > ``` > import ray > from byzerllm.utils.client import ByzerLLM,LLMRequest,InferBackend > ray.init(address="auto",namespace="default",ignore_reinit_error=True) > llm = ByzerLLM() > > llm.setup_gpus_per_worker(0.4).setup_num_workers(2).setup_infer_backend(InferBackend.Transformers) > llm.deploy( > model_path="/home/dev/model/assets/embeddings/BAAI/bge-base-zh-v1.5/", > pretrained_model_type="custom/bge", > udf_name="emb",...