zutuanwang

> If you call `http.debug(true)` before running the request, you will see the formatted request in your log file. First confirm that this looks correct (i.e. the method appears correct)....

in addition, same script, if i disable keepalive, there will be no such issue, as below ``` local qrbody = { method = ngx.var.request_method, query = ngx.req.get_uri_args(), body = nil,...

> Ok, interesting, but again - a working config file with steps to reproduce the error are needed here. The behaviour of the library is very dependent on the actual...

遇到了同样的问题，即glm-4-9b-chat模型q4_0/q8_0量化后，返回的tool_calls字段为空，大佬们能帮忙看看怎么解决吗 启动OpenAI API cd examples MODEL=../models/glm4-9b-ggml-q80.bin uvicorn chatglm_cpp.openai_api:app --host 127.0.0.1 --port 8000 使用openai_client请求 python3 examples/openai_client.py --base_url http://127.0.0.1:8000/v1 --tool_call --prompt 上海天气怎么样 返回tool_calls为空 ``` ChatCompletion(id='chatcmpl', choices=[Choice(finish_reason='stop', index=0, logprobs=None, message=ChatCompletionMessage(content='get_current_weather\n{"location": "Shanghai, China", "unit":...

Same issue happen in mac mini M2