Márton Kardos
Márton Kardos
Sorry for the delay. It should work now with version 1.1.1. Can you please test and confirm?
Yeah that looks like a quite the pickle (pun intended). I would recommend that you override the `topic_names` property of the TopicData object manually to the ones extracted by GPT....
I'm also currently working on getting generative AI topic labels in turftopic, I can ping you when that is a thing :)
Hmm strange, but why do they show up in the old leaderboard then? Shouldn't we strive for 100% feature parity?
We can overwrite Jasper's and Voyage's revision in the metadata to `external`, then that would get highest precedence when loading results. I think this would be the most painless, though...
Or another one would be to delete the result files **without** the dev split from the results repo.
How about we just remove the newer results on the problematic tasks from the results folder? Then we can rerun in the future if need be, and if people run...
I've managed to find another pretty burning issue that we need to fix before launching the leaderboard: #1886 A lot of tasks in the `MTEB(eng, classic)` benchmark are missing a...
I think main @imenelydiaker ! So that we can release the leaderboard
@isaac-chung @Samoed I might be able to fix the issue with the results in code, I will update you about it.