SudachiPy icon indicating copy to clipboard operation
SudachiPy copied to clipboard

Python version of Sudachi, a Japanese tokenizer.

Results 18 SudachiPy issues
Sort by recently updated
recently updated
newest added

Hi, thank you for providing this repo. I tried to install SudachiDict-core 20200722 from https://pypi.org/project/SudachiDict-core/20200722/, but the pip tells me that ``` (gd) wu@irgpu01:~/repo/gesture-diffusion$ python -m pip install SudachiDict-core==20200722 Collecting...

Since development has moved to the Rust version, if this version is not going to be maintained (which seems likely) it might be best to archive it to make it...

Can we please loosen the `sortedcontainers` requirement. I have the PR here https://github.com/WorksApplications/SudachiPy/pull/170

すみません。 [from sudachipy import tokenizer]の時、失敗した。 そして、sudachipy中の「.pyd」全部importできないことが発見した。 system:win10 python:3.7.6 SudachiPy :0.4.9

Hi, After building the latest codes from git (branch "develop"), I have the following issue: ``` $ python setup.py build_ext --inplace running build_ext skipping 'sudachipy/latticenode.c' Cython extension (up-to-date) cythoning sudachipy/lattice.pyx...

If I understand correctly, Sudachi is a lattice-based tokenizer and uses the occurrence probabilities and left-right probabilities (costs) for finding the best token sequence. We would like to know whether...

I am making use of sudachipy via ginza, and am trying to annotate the following sentences. ``` プロ野球の中日で選手、監督を務め、1月4日に70歳で死去した星野仙一氏をしのび、3日、名古屋市東区のナゴヤドームで行われた中日―楽天のオープン戦は追悼試合として開催された。 明治大の後輩、島内宏明外野手は「改めてすごい人だったんだなと思った」と話した。 ``` And in my dictionary I have the following lines, which...

We are facing below error in docker container however sudachidict_core library already installed. please help me to fix issue ===================================================================== ModuleNotFoundError: No module named 'sudachidict' During handling of the above...

https://github.com/WorksApplications/SudachiPy/issues/129#issuecomment-645726195