Martin Smolík

Question answering example throws an exception even if sanity check is skipped

10

## 🐛 Bug Running the squad example `python train.py task=nlp/question_answering dataset=nlp/question_answering/squad trainer.gpus=[1] training.batch_size=8 trainer.num_sanity_val_steps=0` throws an exception while finalizing training. This is not a replication of #218 ### To Reproduce...

Attention head implementation is different from the paper

3

I have gone through the code for the attention head, and it seem to me that it is wildly different from what is described in the paper. It starts with...