qinantong
qinantong
测速结果 初始化配置 启动服务(2024/05/27 12:21:07)... D:\v2rayN\v2rayN-With-Core\guiConfigs\configSpeedtest.json Xray 1.8.10 (Xray, Penetrates Everything.) 07ed094 (go1.22.1 windows/amd64) A unified platform for anti-censorship. 2024/05/27 12:21:07 [Info] infra/conf/serial: Reading config: configSpeedtest.json 2024/05/27 12:21:07 [Warning] core: Xray...
The documentation mentions that the underlying system uses the OpenAI SDK. For local deployment, you can use tools like vLLM or other compatible methods to deploy in an OpenAI-compatible manner....
Ollama won't work; it must be a tool support deploy model in Openai-Compatible way, such as vLLM. As you mentioned, LM Studio seems to support.
Perhaps I could help with this. May I ask if you have already started working on it? If not, would it be possible for me to take it on?