Xinyan (Velocity) Yu comments

Repositories
Issues
Comments

Results 3 comments of


                                            Xinyan (Velocity) Yu

Build inverted indexes on the fly

> Agreed. This would be a nice feature. In the meantime, the janky solution is to write collection to disk and then invoke indexer via shell, see: https://github.com/castorini/pyserini/blob/master/scripts/msmarco-doc/rerank_with_bm25_passages.py Hi! I...

Code pointer for converting the original tf checkpoint to pytorch

> Hi, > > Thanks for interested in this repository! > > Currently there is no simple conversion script that can convert pretrained TF checkpoints like `cc_news_pretrained` into compact `RealmEmbedder`...

MATH dataset unavailable

https://huggingface.co/datasets/huggingface-legal/takedown-notices/blob/main/2025/2025-01-02-AoPS.md Probably because of this...