NLPiper icon indicating copy to clipboard operation
NLPiper copied to clipboard

Custom Tokenizer

Open tomassosorio opened this issue 4 years ago • 0 comments

🚀 Feature

Allow the user to add a custom Tokenizer with minor implementation.

Motivation

It is impossible to integrate every tool, but that does not mean that it shouldn't exist a CustomTokenizer that allows the user to use its own implementation.

Needs: callable function or object Warnings: If Compose.create_from_steps should throw an error since it cannot load its implementation

tomassosorio avatar Feb 21 '22 17:02 tomassosorio