Confidence scores for image captions?

[key88sf]

Hello - is there any way for the model to also return a [0,1] confidence score when generating an image caption?

[LiJunnan1992]

Hi, you can pass in the generated caption to our ITM model to get a similarity matching score. You may want to refer to examples in our LAVIS library: https://github.com/salesforce/LAVIS/blob/main/examples/blip_image_text_matching.ipynb

[kosarkazemi]

Hello, What about the visual question answering? How can we get the probabilities? Thanks