18600709862

[Feature] ollama发布的模型如何评估支持

2

### 描述该功能 ollama直接发布本地模型非常方便，如何对这种api进行评估，是否可以给一个例子。 ### 是否希望自己实现该功能？ - [ ] 我希望自己来实现这一功能，并向 OpenCompass 贡献代码！

can use Qwen1.5-7B-Chat ?

11

exec readme bash Pairwise Knowledge Fusion FuseLLM/FuseChat/train/trainer.py", line 121, in compute_loss if self.args.distill_loss_type == "ce": loss_lm = cross_entropy(input=outputs["logits"].view(-1, vocab_size), target=target_dist.view(-1, vocab_size), reduction="none").view(batch_size, -1) # (bs, seq_len) RuntimeError: shape '[-1, 151936]'...

Stopped by user.

5

### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing...

[Bug]: vllm 启动，openai的swarm 函数调用不正常

3

### Model Series Qwen2.5 ### What are the models used? Qwen2.5-72B-Instruct-AWQ ### What is the scenario where the problem happened? vllm启动 ### Is this a known issue? - [X] I...

qwen setting,InternalError.Algo.InvalidParameter: Tool names are not allowed to be search?

1

### What happened? 非常棒的开源，感谢！虽然现在还没有跑起来。 .env setting USE_CUSTOM_LLM=true CUSTOM_LLM_PROVIDER="openai" # LLM provider CUSTOM_LLM_API_KEY="xxxxxxxxxxx" # Your LLM provider API key CUSTOM_LLM_ENDPOINT="https://dashscope.aliyuncs.com/compatible-mode/v1" # API endpoint CUSTOM_LLM_MODEL_NAME="qwen3-235b-a22b" # Model name # Optional parameters CUSTOM_LLM_TEMPERATURE=0.7...