Kino

Results 6 comments of Kino

Failed to build pycuda ERROR: Could not build wheels for pycuda, which is required to install pyproject.toml-based projects

same

How to deploy qwen-vl using tensorrtllm_backend?

Same here. help!

How to use prompt_table?

> You can see how QwenVL accelerates, and then you may understand Thank you for your response. Yes, I’ve looked into how Qwen-VL implements the prompt_table, but I’m not sure...

How to use prompt_table?

> I have the same feeling as you. #2104 Could we have a short discussion? my email address is [email protected] Thank you！

can i add images embedding to llm input? How can i do it？

Same problem

`tensorrt_llm.bindings.Request` class is not usable for non-text inputs

Is there any progress? Same problem