colpali
colpali copied to clipboard
Restore, refactor, and improve the interpretability module
Description
Added
- Restore, refactor, and improve the
interpretabilitymodule for generating similarity maps
Tests
The following figures were obtained using the code from https://github.com/tonywu71/colpali-cookbooks/pull/5.
ColPali
ColQwen2
@ManuelFay I managed to make the interpretability work with both ColPali and ColQwen while keeping the API as simple as possible. Wdyt?
@tonywu71 any reason this is not merged ?
@tonywu71 any reason this is not merged ?
Yup, was running a few extra tests yesterday. Gonna merge it tonight or tomorrow morning!