Maik Fröbe
Maik Fröbe
Hi @seanmacavaney, I was talking with @daria87 and we would like to integrate the INEX 2004 and 2005 datasets on academic search into ir_datasets. What would be the best way...
I would like to implement this ticket.
cc @samarthbhargav
Dear all, I now had the time to implement this in this branch: https://github.com/mam10eks/ir_datasets/tree/trec-tip-of-the-tongue Basically, everything is resolved, but I forgot how to do these two steps: - "Documentation generated...
I have started to work on this and have a first prototype locally that uses TrecDocs and TsvQueries, so it should be not much code that is needed here.
Yes, makes perfect sense, I can implement this ticket? (I already have a prototype, it is not much code as LongEval comes in formats already supported in ir_datasets)
Dear Romain, Thanks for reaching out. Yes, this is feasible. The ir-datasets integration would expect that the user manually downloads the data (I already have a prototype implementation that assumes...
This is indeed a very cool concept, it would maybe also be cool if we could load artifact-results such as runs from TIRA? Could maybe be also prefixed similar to...
yes, I think this style of magic (we likely should introduce a verbose flag :)) would be quite cool, automatically detecting that an ouptut is a run file should be...
Yes, sounds very good. I think a cool way could also be when one could directly pass a dataset id from ir_datasets, i.e., that the mapping from dataset-id to tira...