Yue Ying
Yue Ying
@hvpeteet Function OnActionReceived uses ActionBuffers. I think Acutor is needed.
> @elokus I made the suggested changes in [my fork](https://github.com/hwchase17/langchain/compare/master...vai0:langchain:master) but am still running into the same error. were there any additional changes that needed to be made? thanks! >...
vllm是支持minicpm推理的。理论上来说如果vllm支持输出logits的话应该能适配吧
基于langchain做的qa，prompt就是根据给的三个步骤完成问题的回答。 其实不让他分三步答题，直接答题的话他反而能答对。他会说卡的申请条件是境外人士，提问者不满足条件
> OK 感谢反馈。猜测还是微调有对langchain格式适配提升效果的空间 拿72b int4试了下，水平略有进步，但还是有bad case 
I think this grafana [example](https://github.com/sgl-project/sglang/blob/main/examples/monitoring/grafana.json) need update