Rolando Martins

icon indicating an email [email protected]

icon location Assistant Professor at the Computer Science Department of the Faculty of Science of the University of Porto (FCUP). and Researcher at C3P.

Results 1 comments of Rolando Martins

Support for Nvidia TensorRT

Great work! Was curious and tried to deploy this, managed to get it running but now I having this error: NotImplementedError: Nvidia TensorRT-LLM does not currently support streaming completion. Is...