Klaus Chen comments

Repositories
Issues
Comments

Results 4 comments of


                                            Klaus Chen

when will add the stream feature in api？

Joining the request. Need stream in API.

No module named 'torch_int'

> install torch-int https://github.com/Guangxuan-Xiao/torch-int Thanks for pointing this out, but it only works in Cuda 11.3 environment? Failed to run bash build_cutlass.sh when I was using cuda12.1

No module named 'torch_int'

> @amazingkmy I found that I can't install the "torch_int" code library. Do you have a solution? If you do, I would be extremely grateful. × python setup.py egg_info did...

SmoothQuant for llama

Same here, when can you support LLAMA?