NUIST-EC

icon location Some projects of evolutionary computation, swarm intelligence, large language models, agents

Results 5 comments of NUIST-EC

Can not use tool and function-call?

官方api本身可以进行function calling， 但是似乎自己本地的模型在function calling时总是匹配不到

AttributeError: 'GenerationConfig' object has no attribute '_eos_token_tensor'

同样的错误

[Bug] triton.runtime.autotuner.OutOfResources: out of resource: shared memory, Required: 108672, Hardware limit: 101376. Reducing block sizes or `num_stages` may help.

我在vllm上能正常部署

[Bug] triton.runtime.autotuner.OutOfResources: out of resource: shared memory, Required: 108672, Hardware limit: 101376. Reducing block sizes or `num_stages` may help.

我尝试进行了修改，但很遗憾， 这不奏效

Simulator showing a static image without animation

同样 的问题，prompt上面有输出，但是画面没有显示