dialoglue

dialoglue copied to clipboard

Bumps [numpy](https://github.com/numpy/numpy) from 1.18.1 to 1.22.0. Release notes Sourced from numpy's releases. v1.22.0 NumPy 1.22.0 Release Notes NumPy 1.22.0 is a big release featuring the work of 153 contributors spread...

dependabot[bot]

*Issue #, if available:* *Description of changes:* Correcting the value of unmasked indices in the target tensor in mask_tokens(). Currently, line 348 is: labels[~masked_indices] = -1 But, the value of...

maxlchen

About Observers in the paper

3

Hi Mehri, Thanks for your awesome work 'Example-Driven Intent Prediction with Observers', and your open sourcing codebase. How did you add observers to bert model in your codebase? I can't...

shunyuzh

For example, there are two categories A and B, a total of 100 samples, 99 of which are category A and one is category B. the output of the final...

YXWisaboy

HWU64 odd number of samples

2

The HWU64 dataset contains 25k samples according to the [original paper](https://arxiv.org/pdf/1903.05566.pdf). The DialoGLUE paper stats the same number of samples. However, the [Readme](https://github.com/alexa/dialoglue) states 11k samples. If I count the...

jnehring

Acc of CLINC150 and HWU64 on leaderboard are reversed.

1


lindabigwheel

Reproducing few-shot experiments on Multiwoz2.1

1

Hi, I am working on few-shot experiments on MultiWOZ2.1. However, I faced the same problem as in #7 . *BERT + pre + multi* trained on few-shot dataset achieved ~0.49...

jimpei8989

hyper parameters for MultiWOZ

5

Hi ! For all datasets in dialoGLUE benchmark, I can reproduce similar results except for the MultiWOZ. For ConverBERT-DG, your joint goal is around 58, but I can only get...

YinpeiDai

reproducibility for slot filling task

7

in https://github.com/alexa/dialoglue/blob/42737dac04d8c922c524a51fd451ea4c0b932bf2/data_utils/process_slot.py#L47-L49 Slot BIO labels are stored in a python `set`, then saved into a python `list` using a for loop. But `set` is unordered. In my experiment, `vocab.txt` is...

libing125

Bumps [scipy](https://github.com/scipy/scipy) from 1.4.1 to 1.10.0. Release notes Sourced from scipy's releases. SciPy 1.10.0 Release Notes SciPy 1.10.0 is the culmination of 6 months of hard work. It contains many...

dependabot[bot]