TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard

Does tensorrt-llm support blip2 with fp8 quantization??

Open SVT-Yang opened this issue 1 year ago • 1 comments

I wonder if tensorrt-llm supports blip2 with fp8 quantization? Thanks!

SVT-Yang avatar Jul 15 '24 11:07 SVT-Yang

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 15 days."

github-actions[bot] avatar Aug 15 '24 01:08 github-actions[bot]

This issue was closed because it has been stalled for 15 days with no activity.

github-actions[bot] avatar Aug 30 '24 01:08 github-actions[bot]