David Robinson

Results 2 comments of David Robinson

[REQUEST] Model serving via deepspeed's inference module

Any update on this? Is there another recommended way to do this - for instance, if we wanted to run with uvicorn and thus couldn't use the deepspeed launcher?

t5 notebook broken with transformer-deploy 0.5.0

Anyone have a workaround here?