Orion Papadakis

icon indicating an email [email protected]

icon company The University of Manchester icon location Manchester icon location Electronics & Computer Engineer, Postdoctoral Research Associate at The University of Manchester

Results 1 comments of Orion Papadakis

Need persistent HTTP server mode for deployments (like Ollama)

Hi @pfrydids and @petenorth, Indeed #49 adds support for deploying GPULlama3.java via a RESTful API, but it’s currently a work in progress. In the meantime, you can use the integration...