pycocoevalcap
pycocoevalcap copied to clipboard
salaniz
Python 3 support for the MS COCO caption evaluation tools
I'm currently using the pycocoevalcap package to evaluate the performance of my image captioning model. I've noticed that the CIDEr score is consistently 0 for all of my model's generated...
No, this is not an issue. It's an example for whoever trying to use this package with their own data. ```python from pycocoevalcap.tokenizer.ptbtokenizer import PTBTokenizer from pycocoevalcap.bleu.bleu import Bleu from...
When i import the package and calculate spice: I have these 90 word long sentence to calculate SPICE. Maybe it is too long, but it showw error could not cache...
I found that the result obtain from NLTK.translate.meteor is different from this repo (i.e., the meteor scorer). So I'm wondering what are the default configurations of the parameters for this...
In the regard of CIDEr's logic, both candidates and references need to be mapped to their stem or root form. However, I couldn't see such operation in the code. I...
Let's say I have multiple pair of of sentences, other than calculating the mean of bleu, metoer... could i also get the variance?
Hi, @salaniz. I compute meteor and rouge scores but I find it is rather slow to wait for the computation result of Meteor scores. Could you please tell me why?...
Hi! when running the example script, I get the following error: ``` (venv2) *******% python coco_eval_example.py loading annotations into memory... Done (t=0.22s) creating index... index created! Loading and preparing results......
I was wondering how much of the ratio of the modified n gram in BLEU-2 ,3 ,and 4. And if possible how to change the proportion? Or does the calculation...
I fixed 2 bugs in `_score()` function of Meteor class. 1. add `.encode()` and `.decode()` to `stdiin` and `stdout` functions, respectively. 2. remove overlapped line for the 2nd bug fix,...
