colpali icon indicating copy to clipboard operation
colpali copied to clipboard

Restore, refactor, and improve the interpretability module

Open tonywu71 opened this issue 1 year ago • 1 comments

Description

Added

  • Restore, refactor, and improve the interpretability module for generating similarity maps

Tests

The following figures were obtained using the code from https://github.com/tonywu71/colpali-cookbooks/pull/5.

ColPali

ColPali

ColQwen2

ColQwen2

tonywu71 avatar Oct 10 '24 21:10 tonywu71

@ManuelFay I managed to make the interpretability work with both ColPali and ColQwen while keeping the API as simple as possible. Wdyt?

tonywu71 avatar Oct 13 '24 11:10 tonywu71

@tonywu71 any reason this is not merged ?

ManuelFay avatar Oct 16 '24 15:10 ManuelFay

@tonywu71 any reason this is not merged ?

Yup, was running a few extra tests yesterday. Gonna merge it tonight or tomorrow morning!

tonywu71 avatar Oct 16 '24 16:10 tonywu71