fast-bert icon indicating copy to clipboard operation
fast-bert copied to clipboard
verified publisher icon utterworks

enhancement: creating tokenised features in batches

Open jkhalsa-arabesque opened this issue 5 years ago • 0 comments

it seems that creating tokenised features is a very memory intensive task, perhaps by doing this in batches it can alleviate the RAM usage a little.

jkhalsa-arabesque avatar Mar 30 '20 08:03 jkhalsa-arabesque