polyglot icon indicating copy to clipboard operation
polyglot copied to clipboard

WARNING:polyglot.detect.base:Detector is not able to detect the language reliably.

Open sandman13 opened this issue 5 years ago • 5 comments

Hi, thanks for reading my comments. When I run python in script, how to ignore this alarm message, I added "warnings.filterwarnings ('ignore')", but it didn't work.

sandman13 avatar May 26 '20 09:05 sandman13

Did you find a way to get rid of the warning? If yes, would you mind sharing? Thanks.

yucongo avatar Jun 25 '20 06:06 yucongo

I am having the same issue here.

ScottIsWorking avatar Jul 15 '20 17:07 ScottIsWorking

Guys... Just a quick look at the code in the repo and you are set...

from polyglot.detect.base import logger as polyglot_logger
polyglot_logger.setLevel("ERROR")

marrrcin avatar Jul 27 '20 10:07 marrrcin

But does this warning carries any meaning that we should attend to? I got it while testing a 2 tokens Hebrew text though the confidence level (93) seems on par with other languages that I tested (for example 94 for a French Test). For a 4 tokens text I got 97 confidence for Hebrew without the warning. I'm just wandering if I should pay attention in the future, thanks

ronyarmon avatar Jun 14 '23 08:06 ronyarmon

@marrrcin that should be documented

seyfer avatar Oct 09 '23 09:10 seyfer