Filbe

Ast visitor function for using declarations.

5

Recursive ast visitor function for using declarations.

Request for pre-tokenizer that creates words based length alone.

2

Hello! I would like to request a fast pre-tokenizer to be implemented, which only splits the input to continuous pre-defined length segments. I know that this is not a common...