Wei-Chen Wang

Results 8 comments of Wei-Chen Wang

Hi @waquey, thanks for your interest in our work! For questions 1 and 2, I believe the errors came out due to the lack of ArduCam. To support your request...

Hi @Rkyzzy, thank you for your interest in our work. The issue you noticed arose due to our previous implementation. But the good news is, we've addressed it. TinyChatEngine should...

Hi @songkq and @atomicrajat, thank you for your interest in our work. You guys are correct - for Nvidia GPU, our CUDA backend may not support Nvidia GPUs with compute...

Hi @songkq, @atomicrajat and @tuobulatuo, thanks for your patience in waiting. We just released the new version of our CUDA implementation. We've tested it on various GPUs and verified that...

Hi @tuobulatuo, thanks for your interest in our work. Sorry that I can't replicate your issue firsthand as I don't have an A100 GPU on hand. That being said, we've...

Hi @lucasjinreal, thank you for your interest in our work. We will compare TinyChatEngine's performance with other frameworks and put the results into our repo asap. Please stay tuned!

Hi @tuobulatuo, thanks for your valuable suggestion. We've made a quick fix to support a configurable number of threads for matrix multiplication on CPU platforms, as shown in [README](https://github.com/mit-han-lab/TinyChatEngine#download-and-deploy-models-from-our-model-zoo). You...

Hi @omjee, thanks for the PR! Would you mind updating the necessary files like Makefile and README directly? Once you've made all the changes, I'll be glad to help review...