texar-pytorch icon indicating copy to clipboard operation
texar-pytorch copied to clipboard
verified publisher icon asyml

SentencePieceTokenizer vocab

Open ZhitingHu opened this issue 6 years ago • 0 comments

SentencePieceTokenizer should also be able to directly take a vocab. Now it looks only take a vocab file as here

ZhitingHu avatar Oct 04 '19 19:10 ZhitingHu