ChanWoong Kwak

icon indicating a website link https://velog.io/@kcw4875 icon indicating an email [email protected]

icon company Hyundai Motor Company icon location Seoul icon location ML Serving Performance Optimization / on-device AI / ...

Results 1 comments of ChanWoong Kwak

Questions about local-llm awq support

Thank you for quick response. As far as I know, TensorRT-LLM is not yet supported. Can I know roughly when this will be possible?