neuspell icon indicating copy to clipboard operation
neuspell copied to clipboard

Unpickle error , invalid load key ,'<'

Open call-me-suman opened this issue 11 months ago • 1 comments

i have tried to download the .pkl and pytorch_model.bin file for subwordbert using the given python code . but it didnt work . Then i saw a google drive link containing these two files i have downloaded it and used with it . still the same error occurs whenever the "checker = BertChecker() checker.from_pretrained()" is running.

call-me-suman avatar Mar 22 '25 09:03 call-me-suman

unfortunately the latest version available version downloads data google drive but as it has a "not possible to scan for virus warning" the downloaded file is basically just an html page. It requires few tweaks to get it working. I did it in a separate fork as it does not seem that there is any active development in this branch

https://github.com/fsan/neuspell

DISCLAIMER

  • I do not intend to be the unofficial maintainer or anything but i might consider merging PRs to fix bugs. so consider the risks for that.
  • the weights made available by the neuspell team were saved long time ago in an older version of Torch. To be able to load those weights I had to include the allow it loading all content from the files which might pose some SECURITY RISKS. The correct thing would be to download all models, save only containing the weights them and upload them to somewhere. For anyone reading this.

fsan avatar Jul 16 '25 11:07 fsan