Pierre Colombo

Obtain unprocessed annotator labels on MOSI

1

Hello, Thanks for your great work. I would like to know if it would be possible to obtain the unprocessed labels. If I open the unprocessed version of the provided...

Improvement of TIM

1

Hi ! Thanks a lot for your great work. Is it possible to add the improvement of TIM https://proceedings.neurips.cc/paper/2021/file/4d7a968bb636e25818ff2a3941db08c1-Paper.pdf ? Kindest regards, Pierre

Adding 3 metrics

5

Hello ! I hope you are doing great ! Could you add these 3 metrics: - BaryScore (oral EMNL 2021) - DepthScore - InfoLM (best student paper award AAAI 2022)...

Hello, Thanks a lot for your work. To make the code more user friendly you might want to use the argparse librairy to have less hardcoded strings: - config is...

PR to add new metric results

1

Dear Author, With @GuillaumeStaermanML we would like to add new metrics results specifically: BaryScore https://arxiv.org/abs/2108.12463 And DepthScore https://arxiv.org/abs/2103.12711 And InfoLM (currently unpublished). Is it something you could be interested in...

Inconsistency with OT with Non Uniforme Weights ? What are we doing wrong ?

1

Hello, Thanks a lot for your great librairy ! We are trying to compute the transportation cost with Geomloss and we obtain inconsitent results when compared with ot. We want...

Error while logging

8

### My actions before raising this issue - [v ] Read/searched [the docs](https://github.com/cvat-ai/cvat/tree/master#documentation) - [v ] Searched [past issues](/issues) Hi ! I am trying to follow the developping guide to...

Adding NLLB-200 - MoE - 54.5B for no language left behind

5

### System Info Hello @LysandreJik, Thanks a lot for your work on no language left behind. Is there any plan to add the 54.4B Model? Kindest regards ### Who can...

Hello, To compare different models, you should stop relying on the mean aggregation. We have develloped new tools in our NeurIPS 2022 paper: https://openreview.net/pdf?id=kvtVrzQPvgb The code is available https://github.com/pierrecolombo/rankingnlpsystems Best,

Bug in the batch size vs accumulation step

6

### Please check that this issue hasn't been reported before. - [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior Hi ! Thanks for your...