MASKER icon indicating copy to clipboard operation
MASKER copied to clipboard

Other language usage

Open phc4valid opened this issue 4 years ago • 1 comments

Hi , I really like and appreciate what you guys are doing. Is it possible to implement the method on other languages ? etc :Chinese General-usage of language model was being used in the method , I was curious about the difference between domain-specific finetuned language model and models with MASKER mentioned in the paper and how they affect OOD and performance on downstream tasks. Have you given a try ,yet? Really looking forward to your response. Thanks.

phc4valid avatar Apr 05 '21 17:04 phc4valid

Hi, I'm not an expert of other languages, but I think MASKER would be applied for other languages if pre-trained language models are available (e.g., Chinese version of BERT), as the implementation of masked keyword regularization would be straightforward upon those models.

sangwoomo avatar Apr 06 '21 02:04 sangwoomo