refinery icon indicating copy to clipboard operation
refinery copied to clipboard

[BUG] - spacy Doc sentiment is always 0.0

Open DerEchteFeuerpfeil opened this issue 3 years ago • 1 comments

Describe the bug The spacy Doc sentiment is always 0.0 for the attributes of my records.

To Reproduce Steps to reproduce the behavior:

  1. Go to a project of yours
  2. Make a labeling function printing the sentiment of one of your attributes, e.g. "print(record["headline"].sentiment)" in AG_News
  3. Observe the sentiment output, which is always 0.0

Expected behavior The sentiment should reflect the true sentiment of the attribute, which is NOT always 0.0

Screenshots image

Desktop (please complete the following information):

  • OS: Windows
  • Browser: chrome
  • Version: 1.2.0

Additional context

DerEchteFeuerpfeil avatar Sep 21 '22 10:09 DerEchteFeuerpfeil

I need to look up the source for this, but if I remember correctly, the md (medium) tokenizers don't contain a sentiment pipeline. We can offer to also integrate lg models, which have both a higher precision in their entity recognition and sentiment.

Again, this is off the top of my head, I need to research this again to be 100% sure

jhoetter avatar Sep 21 '22 11:09 jhoetter

Sentiment isn't a field that is automatically filled by spacy

JWittmeyer avatar May 04 '23 13:05 JWittmeyer