MaxKB icon indicating copy to clipboard operation
MaxKB copied to clipboard

[Feature] Access to QwQ-32B

Open AbnerSC opened this issue 10 months ago • 2 comments

MaxKB Version

1.10.2

Please describe your needs or suggestions for improvements

  1. 申请接入QwQ-32B模型
  2. 包括通过ollama部署的离线接口以及阿里云百炼提供的在线接口

Please describe the solution you suggest

No response

Additional Information

No response

AbnerSC avatar Mar 13 '25 02:03 AbnerSC

感谢反馈,应该是该模型不支持非流式输出,添加模型时我们会进行一次对话来校验,该校验使用了非流式对话,所以校验失败了,后续版本考虑一下,添加模型时支持不验证。

baixin513 avatar Mar 15 '25 02:03 baixin513

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Thanks for the feedback, it should be that this model does not support non-streaming output. When adding the model, we will conduct a conversation to verify. This verification uses non-streaming conversation, so the verification failed. Consider it later versions. It supports no verification when adding the model.

shaohuzhang1 avatar Mar 15 '25 02:03 shaohuzhang1

该问题已在V1.10.4版本解决,请升级后试用

baixin513 avatar Apr 22 '25 02:04 baixin513

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


This problem has been resolved in V1.10.4. Please try it after upgrading.

shaohuzhang1 avatar Apr 22 '25 02:04 shaohuzhang1