freecraver

Question: Why NLTK TweetTokenizer?

2

Thanks for your work on this nice project. I intend to create a library for text simplification, and potentially would like to integrate your package. The selection of a tokenizer...

See https://github.com/cdimascio/py-readability-metrics/issues/26#issuecomment-1046301510 Introduces a non-breaking change which allows to override custom word-level tokenization. The new `f_tokenize_words` argument accepts a function which maps a text to its words. **_example:_** ```python from...