Aria Haghighi

Results 1 issues of Aria Haghighi

Was testing out the `SentencePieceModel` tokenizer on longer text (web articles of about a few thousand characters) and noticed that tokenization was taking a long time. Taking a look at...