xi liu

How to reduce latency

21

1.there have 3 seconds delay when play local rtmp stream in vlc the local rtmp stream url like this:rtmp://127.0.0.1/live/123.flv. nging.conf is like this: application live { live on; play /usr/nginx/html/flv_file;...

[BUG]0.3.1版本使用one-api在线大语音模型，提示词模版不起作用

2

chat_box.ai_say("正在思考...") text = "" started = False client = openai.Client(base_url=f"{api_address()}/chat", api_key="NONE") extra_body = dict( temperature=temperature, prompt_name=prompt_name, ) stream = True params = dict( messages=messages, model=llm_model, stream=stream, # TODO：xinference qwen-vl-chat 流式输出会出错，后续看更新...