Implement a interface for external datasets.

Open rajarshd opened this issue 6 years ago • 2 comments

Currently, it is hard to run experiments with new datasets, as the interface to create multi_corpus object is missing. This makes starting up with the code very difficult.

Originally reported by @manzilzaheer.

Sep 25 '19 00:09 rajarshd

Use protocol buffers. Suggested and told to comment by Manzil Zaheer (http://www.manzil.ml/)

Sep 28 '19 19:09 shehzaadzd

How can you get the correct_paras.json? Do you deal with the whole Wikipedia dataset? Can you provide the preprocessing of data?

Dec 13 '19 02:12 yeliu918