[REQUEST] Is there any demo or tutorial for Deepspeed pipeline inference?

[Noblezhong]

Hi! I am a graduate student who have read the paper about the Deepspeed framework.https://arxiv.org/pdf/2207.00032 I gain great interests on the hybrid pipline inference strategy descrided in Section Ⅳ, but when learn how to implement it in offical tutorial website, I found there are only some parts teaching how to us PP for training instead of inferencing. So I wonder if there are someone who know where the pipeline inference turorial is or have the experience for hybrid pipeline inference strategy?

Sry I am not an English native speaker, my writing is poor. :(