Support for AWS inferentia

Open jinmingteo opened this issue 3 years ago • 2 comments

Hi team, thanks for sharing the great work here.

will there be an integration to AWS inferentia?

thanks!

Oct 14 '22 06:10 jinmingteo

Hi. We do not have an exact timeline on this. But we will add some documentation in the next commit, to make it easier for you to implement yourself. Thanks.

Nov 04 '22 16:11 tayoola

Hi. We still do not have a timeline on this. Here is the documentation on how to use a PyTorch model with AWS inferentia https://docs.aws.amazon.com/dlami/latest/devguide/tutorial-inferentia-pytorch-neuron.html, in case you wanted to implement it yourself. Thanks.

Nov 23 '22 18:11 tayoola