massive

massive copied to clipboard

Will the rule "dev splits of the MASSIVE dataset may not be used for model training" makes the competition unfair for individual contestants

1

Though dev splits of the MASSIVE dataset may not be used for model training, but it can be used for hyperparamer tuning. Tuning hyperparamters with effective hyperparamer searching algorithms is...

yichaopku

Error while creating predictions on heldout dataset

4

Steps to reproduce: 1. Create new dataset using create_hf_dataset.py script 2. In the config, point to your finetuned model and new dataset. **We are using XLMR model.** Running torchrun --nproc_per_node=1...

iamsimha

About the official evaluation script

2

Is there an evaluation script that can directly compare a prediction file against the gold prediction file, i.e., the official evaluation script?

bozheng-hit

infer a statement

3

I used mt5-base pre-trained model to train my massive slot and intend model and I saved checkpoints in a directory. I want to infer one simple statement without creating test...

ebarkhordar